2026-01-13T10:36:21,899 Created temporary directory: /tmp/pip-ephem-wheel-cache-ra65w20_ 2026-01-13T10:36:21,901 Created temporary directory: /tmp/pip-build-tracker-d082n51i 2026-01-13T10:36:21,902 Initialized build tracking at /tmp/pip-build-tracker-d082n51i 2026-01-13T10:36:21,902 Created build tracker: /tmp/pip-build-tracker-d082n51i 2026-01-13T10:36:21,903 Entered build tracker: /tmp/pip-build-tracker-d082n51i 2026-01-13T10:36:21,903 Created temporary directory: /tmp/pip-wheel-50gpeme1 2026-01-13T10:36:21,906 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-01-13T10:36:21,909 Created temporary directory: /tmp/pip-ephem-wheel-cache-dsy5wdfp 2026-01-13T10:36:21,930 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-01-13T10:36:21,934 2 location(s) to search for versions of unitxt: 2026-01-13T10:36:21,934 * https://pypi.org/simple/unitxt/ 2026-01-13T10:36:21,934 * https://www.piwheels.org/simple/unitxt/ 2026-01-13T10:36:21,935 Fetching project page and analyzing links: https://pypi.org/simple/unitxt/ 2026-01-13T10:36:21,936 Getting page https://pypi.org/simple/unitxt/ 2026-01-13T10:36:21,937 Found index url https://pypi.org/simple 2026-01-13T10:36:22,166 Fetched page https://pypi.org/simple/unitxt/ as application/vnd.pypi.simple.v1+json 2026-01-13T10:36:22,206 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/60/14353836d07d1f605e224223440d78bdf0845cafcf6cf7ab18f3240f467f/unitxt-0.0.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) 2026-01-13T10:36:22,207 Found link https://files.pythonhosted.org/packages/58/3a/c92912f61ff66cbcc9341759a2135bae9f5006f7b0e43a12839f6bfd6558/unitxt-0.0.1.tar.gz (from https://pypi.org/simple/unitxt/), version: 0.0.1 2026-01-13T10:36:22,207 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/a1/bff27d252e99f95ccffc0ed3fd42bb3d5adca047f6be92150f1c12aec0d3/unitxt-1.0.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,208 Found link https://files.pythonhosted.org/packages/80/e9/b54fdcc623c84d7298dc1bd073e5c84bfbbaf62aa2ac92bd4db2c98d7389/unitxt-1.0.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.0 2026-01-13T10:36:22,209 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/94/185e566601e713c8e35d15be46b80c4723acc01b70c36144d97129b8df4a/unitxt-1.0.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,210 Found link https://files.pythonhosted.org/packages/3c/cc/f7fdd45973958bfdfaf685714a5d1b64b40aefa2c43fce9614af53c9aabc/unitxt-1.0.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.2 2026-01-13T10:36:22,211 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0e/ec/47b4c890389c9146714ccbf60c6c1895402885047cc56a09efee064d88cd/unitxt-1.0.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,212 Found link https://files.pythonhosted.org/packages/4f/ff/c37d78e0e45fb81dd94704314c9523413bdd6b65e9ed2f2ac77d869ea9ec/unitxt-1.0.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.3 2026-01-13T10:36:22,213 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c4/e9/8a362c68a5ee3fc5ca8a4d8555154aedef518bfc658ba58f5dbd57ce4118/unitxt-1.0.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,214 Found link https://files.pythonhosted.org/packages/11/d1/d3b62f8baf803050688a5209b7a249f450e3b915906be3b8636049f44de2/unitxt-1.0.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.7 2026-01-13T10:36:22,214 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/54/31/e55bb57ce60745be009f8562e320edc214555002f6ad801355acfa04befb/unitxt-1.0.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,216 Found link https://files.pythonhosted.org/packages/0e/ad/4d0c5d55831a7fd66fbaca1667f8f31321026e46d5f9444cb997646d2fe7/unitxt-1.0.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.9 2026-01-13T10:36:22,216 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/46/9b/479b42629f534961d580476c9e0584b9d7f3847b874edffaeacd177f9751/unitxt-1.0.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,217 Found link https://files.pythonhosted.org/packages/ce/c3/d13d529a093821f4f9aac0aacfbda93a31a3c0fb5e4e764434826ded2674/unitxt-1.0.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.10 2026-01-13T10:36:22,218 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b5/ad/7d55a38344db877cd52f6fe417f3b1245297083ce61536f3f864d53f1fd1/unitxt-1.0.11-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,219 Found link https://files.pythonhosted.org/packages/02/50/85cf98c6c362866a7226f69eff6fbfab7827314b2b7151756f27537c8c5f/unitxt-1.0.11.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.11 2026-01-13T10:36:22,219 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/93/39/d0b0e6376073122dd4eb91f68979b954fd1286f0e5e8561619cc4a57f3ca/unitxt-1.0.12-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,220 Found link https://files.pythonhosted.org/packages/be/1d/a00bb5629d15c115a5d71104e1bf9d051123f26eb698bf87337b36215270/unitxt-1.0.12.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.12 2026-01-13T10:36:22,221 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b8/ac/5b7fc2277dd86b4468bca84dd52586084c857b5cacb78924f2c9764c4f95/unitxt-1.0.13-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,222 Found link https://files.pythonhosted.org/packages/dc/a2/6f56a775b858fac1b24abb26b289609df00ce2c23401f9e457d239707032/unitxt-1.0.13.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.13 2026-01-13T10:36:22,222 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/86/55/a190f86d68179b80a837e85fea21a2f0fb29f42efab6f800b18fe9386292/unitxt-1.0.14-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,223 Found link https://files.pythonhosted.org/packages/46/67/d0446e57188ad1d91e6bfa95052fe5106212978fcba1049d9ab36ebe46a9/unitxt-1.0.14.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.14 2026-01-13T10:36:22,224 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/69/866ccefee1433cc9376c9288bc207222fd81277b2ea305e749144b840b0d/unitxt-1.0.15-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,225 Found link https://files.pythonhosted.org/packages/90/6c/e54f7ce50e4fc8981f7e4989de137e0100acdfe9f03b6582aeefe7d52709/unitxt-1.0.15.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.15 2026-01-13T10:36:22,226 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/d9/f56c6ed3470dc8b74dd02b7466ae594ba283fd460f5f7c8fe70383971270/unitxt-1.0.16-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,227 Found link https://files.pythonhosted.org/packages/58/f5/c3f7db40d92686e6b7e6e111c080f8a4ef9184adb95b2c2accaf9d7bdddd/unitxt-1.0.16.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.16 2026-01-13T10:36:22,228 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/a1/e9e5020dd816fe50263594e47f4cbb806e2ad7b6bd8dd8c63bcdc6bf947d/unitxt-1.0.17-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,229 Found link https://files.pythonhosted.org/packages/2b/d1/e1ec41ce037e829604b1ac777dd3156546b08cf98c9745a26637406db4f5/unitxt-1.0.17.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.17 2026-01-13T10:36:22,230 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/f5/c71d8308182f8ac306a93f26b457de8b45ceacd5a65cda26687bbfdc6dab/unitxt-1.0.18-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,231 Found link https://files.pythonhosted.org/packages/8c/6b/fcb61b4b108d949b8754ccafd1cc4d604383e4cbbcc35086a353130adc7c/unitxt-1.0.18.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.18 2026-01-13T10:36:22,231 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/56/b4/da7cec834fce00d5ad095e51738429d5cb07194c1a7bf4bf31a47ae49528/unitxt-1.0.19-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,232 Found link https://files.pythonhosted.org/packages/11/e0/13e4f60aff6d6bf5aa67eea1b341a826d6bec316a3c02bfa713b2e2fc818/unitxt-1.0.19.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.19 2026-01-13T10:36:22,233 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fc/a3/11450554e4ff01ac93a6eb342d4e57c6795051e1450c96eebf19e4b590ab/unitxt-1.0.20-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,233 Found link https://files.pythonhosted.org/packages/50/a3/a7bb75377e16d1f94c7dcabfb9b31744a05a52b12aada20576e76ab85e5e/unitxt-1.0.20.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.20 2026-01-13T10:36:22,234 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/01/49/cc9f2c575f95fa5be4b14a2d361fffad4acfa80ff3d67cd27fac37236f33/unitxt-1.0.31-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,235 Found link https://files.pythonhosted.org/packages/f3/42/772959850a2c96ae29dd9c910d7fb58a66183b445350cfe6d5ea0c29a328/unitxt-1.0.31.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.31 2026-01-13T10:36:22,236 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bf/5e/203dd2dd6c3288a8fd53519380a526730510bcc1d6c4aa1889265866b379/unitxt-1.0.34-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,237 Found link https://files.pythonhosted.org/packages/dc/22/4a766be66b6ef9c208ab2458587b8a870b4ad87fa1817319b25b6c8b4517/unitxt-1.0.34.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.34 2026-01-13T10:36:22,238 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/91/36ffd960eedbd4e9f5eeb2cdba190f76964fb08f030f0d2bdace209db64f/unitxt-1.0.35-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,239 Found link https://files.pythonhosted.org/packages/8f/bf/522102de1b48ac6a2db4830c21771a131add76b01ccc974046f5070c6b7e/unitxt-1.0.35.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.35 2026-01-13T10:36:22,239 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b9/ad/e1fcdc69839eddf8e616a528ff6c60231c5b0d615f67bdb78a49e372df38/unitxt-1.0.38-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,240 Found link https://files.pythonhosted.org/packages/84/66/0077b202a4de4e41b550914a7eb35c436be1c8a3e3fa9e1ba3b6df23df26/unitxt-1.0.38.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.38 2026-01-13T10:36:22,241 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/0f/59863844b834fec261bf6532057da64f88ac2a04c7c4759f67dabdd4069b/unitxt-1.0.42-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,242 Found link https://files.pythonhosted.org/packages/03/3b/c4aed7e4b23a65097439256a03eb0a756fca50de458082a4b9e8a0945189/unitxt-1.0.42.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.42 2026-01-13T10:36:22,243 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/cb/d5/321ba31c9b7fa9da776051a5b5b1fb8373ab0323fbafcc534a3d52933cb5/unitxt-1.0.43-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,243 Found link https://files.pythonhosted.org/packages/cb/3c/4b43d8ffb77f6b87cdd3accb0c24cd27c73394100ceede652de3efd4e0e7/unitxt-1.0.43.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.43 2026-01-13T10:36:22,244 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/9a/03d23b55637ee7f2a12fe0773f9d63c297b954ba08bd1d61a678bde7c698/unitxt-1.0.45-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,245 Found link https://files.pythonhosted.org/packages/19/b1/3fc705d8ebf98b8067f9e86b83f9a36792faeb87499ca17348fe73fb85ca/unitxt-1.0.45.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.45 2026-01-13T10:36:22,246 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/89/49/a27337aeac942ee84c446172dc06f034a5eda441038c37c9843dab1f0712/unitxt-1.0.47-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,246 Found link https://files.pythonhosted.org/packages/a8/d9/9cf334e39b78b62817263483602ca67544b470cd58db04aefdfd3c2e3f5f/unitxt-1.0.47.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.47 2026-01-13T10:36:22,247 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/32/31bb58c1b7aff52305232cfcc87c6f7495035ada82c39b27402873807eff/unitxt-1.1.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,248 Found link https://files.pythonhosted.org/packages/93/d5/54d6fe9b9a249ee722e5c504d88d802658eee941975b1c06b234a69b6569/unitxt-1.1.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.1 2026-01-13T10:36:22,249 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/90/1c/73066e4afcf84c60e783b5bd113c4990368af34e9a19a8c11a848f7d038a/unitxt-1.1.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,250 Found link https://files.pythonhosted.org/packages/69/33/9c606d674b66aad293649180045deb0522c4f0a35fb4b80b722d2eb43c13/unitxt-1.1.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.3 2026-01-13T10:36:22,250 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6f/0d/d23cc17a47ebb2f9469d5db65bf6ee39d742c50302fd7bad40747f4f76ba/unitxt-1.1.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,251 Found link https://files.pythonhosted.org/packages/91/d7/5c1dc940d3555c20c052ad6fc05f4d7851639db8f57aa27e05403701310f/unitxt-1.1.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.4 2026-01-13T10:36:22,252 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/74/1f/f302733369b7becec09481ee735fe516634a56065f29da0d52b6bb398fcf/unitxt-1.2.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,253 Found link https://files.pythonhosted.org/packages/09/cd/3803e5f96e21e54924cf1b13e0743902c3969f5be622c25b4c9343cfb037/unitxt-1.2.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.2.0 2026-01-13T10:36:22,254 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ad/d4/6c3082daa56aafffb35420df69ffd4a94105ffe44be30a61d34f8897e0a7/unitxt-1.3.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,255 Found link https://files.pythonhosted.org/packages/73/65/62cbb295c17a2f6d1dbaab82687cd8c74094e40aa9a9576a7050d26e9755/unitxt-1.3.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.0 2026-01-13T10:36:22,255 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/4c/f7709ad6c10c3644b8edcbf00f3e9cc74a8f49b80bf303dd3e2b349f3e7c/unitxt-1.3.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,256 Found link https://files.pythonhosted.org/packages/32/53/645acf4c60882182d6df8de987bf00fa5e5a76ce60c253d6e87681d47751/unitxt-1.3.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.1 2026-01-13T10:36:22,257 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/39/16447931efc16cdd889a0ef9ef842e4cbcb87cecb1cffa62a0d6ab9b8908/unitxt-1.3.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,258 Found link https://files.pythonhosted.org/packages/cb/76/d8c5fb8205f44581208752c91c553c2992bac7bfd817f44d48b107b9ef6a/unitxt-1.3.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.2 2026-01-13T10:36:22,258 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/98/4b/d28bec99cab3081a7c93db04ab16db69fb3e19ff1dbced22fd944313f3d4/unitxt-1.4.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,259 Found link https://files.pythonhosted.org/packages/64/1a/9f84ced25db7db742586c1c84767a1b8c8ea8121a3329d2e7111fe5841fc/unitxt-1.4.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.0 2026-01-13T10:36:22,260 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f6/ab/a0ab8ad956c9935d2f6fdd01cf85268bf1e3112fef1d937c6596bb687c43/unitxt-1.4.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,260 Found link https://files.pythonhosted.org/packages/37/5a/c8a4e5aa2f19fe163817b4aa2dea50c025dc51963f7d1acb384eebd6ab63/unitxt-1.4.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.1 2026-01-13T10:36:22,261 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/2a/0c/3d5833c1b0f22bf42fcb0d19942602602568f9b3ae2d3e71ddea929b4dde/unitxt-1.4.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,262 Found link https://files.pythonhosted.org/packages/9b/18/ae9a17a4e7be0d7dbd8fcc84f494b67ccad88118f518faf3c040cf692127/unitxt-1.4.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.2 2026-01-13T10:36:22,263 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bd/e3/c232012723f1fbaed61dc0968e80887d6a8344d7914ea415e0bed567fe93/unitxt-1.4.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,264 Found link https://files.pythonhosted.org/packages/56/86/226dd18b4d8ce1f2d32361d0e62d325c689faf3b29767ee5f94ca1b901ab/unitxt-1.4.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.3 2026-01-13T10:36:22,264 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3d/e8/c8ddc4127f002b8c5eb3f17ab0d2950a8a8bcb1f2f0d63259d8717dcac16/unitxt-1.4.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,265 Found link https://files.pythonhosted.org/packages/86/c3/b1b31fdb53b11adbe576820edf7ade73f75cf6297c5175989d6003be83bc/unitxt-1.4.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.4 2026-01-13T10:36:22,266 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/52/45/afed7aabb6e0a642a7311c4a4fc0aa9096946da528e88d8dbc006aa8d452/unitxt-1.4.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,267 Found link https://files.pythonhosted.org/packages/a4/54/d3fc1e45b47c941b0adf4fd7740cd3a92007e3860f7ba8bcace66c813369/unitxt-1.4.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.5 2026-01-13T10:36:22,268 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/5f/6b1d8130c1f0d56187fc918cdabd697417ef95c4285799f11dfb7cbfe8aa/unitxt-1.4.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,269 Found link https://files.pythonhosted.org/packages/a5/0f/0295e4722eb7a3098cc1b9f62f2b39bf3972dfd6544a447980213b061cad/unitxt-1.4.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.6 2026-01-13T10:36:22,269 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/57/59/c81dc1337ac379c70b92bc3e69f82eecee8883b4b6d474703047ead2b8bf/unitxt-1.5.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,270 Found link https://files.pythonhosted.org/packages/c2/fc/75d869a8b0fa48c0f30309a8abb4bf36b2e5f924bfa4afab92d17da201e7/unitxt-1.5.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.0 2026-01-13T10:36:22,271 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/f6/719d57e6078cc25b2af211c3387d01c7fe4357f86c832e4474385dca1bf0/unitxt-1.5.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,272 Found link https://files.pythonhosted.org/packages/70/bf/c817e0d0ebd5ebc9150fc760d1959d981a9062cc5929a3fee2da82c78bc2/unitxt-1.5.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.1 2026-01-13T10:36:22,272 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/9e/01/58cbc78cd7cb05e39809983d2cb9ad5ae60850c1e032c9909ea090b60c72/unitxt-1.5.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,273 Found link https://files.pythonhosted.org/packages/20/a4/d279ec7c566ffe56ad2773f4baf4e1ee7156c1127616131d30b5b840eb5c/unitxt-1.5.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.2 2026-01-13T10:36:22,274 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0d/ae/c094bd4e161d89d21c5b8dcbe1178307a56eee3754f882ac78b9ea7d6eb0/unitxt-1.5.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,275 Found link https://files.pythonhosted.org/packages/5f/54/209ba8eae604f8d96ff4f4cf5b59eb462b942fd891bf37c0a5170a3efda5/unitxt-1.5.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.3 2026-01-13T10:36:22,276 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/c4/4d9be75082fb4ac0a20f208f16f606c81af9e2d3a8ca2e10d00a01907a5e/unitxt-1.6.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,276 Found link https://files.pythonhosted.org/packages/9b/0b/4112e4a959d3ba21750a69de68130b4b7bf8875e7497320ea2d8972dbbcf/unitxt-1.6.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.0 2026-01-13T10:36:22,277 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e4/85/35d17f95e0c03d334fd146352f7a9848c46a2b705075eb99518617a6ac87/unitxt-1.6.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,278 Found link https://files.pythonhosted.org/packages/2f/09/1b17e594bcbcdefa162a51fe2b6a6e9ddc01bf95968d3bc8013252f76c47/unitxt-1.6.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.1 2026-01-13T10:36:22,279 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5c/4e/a7a9c682050216382c3b59daf758c368ac5990db827bd71fd0f40867b72b/unitxt-1.6.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,280 Found link https://files.pythonhosted.org/packages/77/ca/76ad0c2aec3195f05513c5e524e44684dfdb6b50509217fc92cc63654b89/unitxt-1.6.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.2 2026-01-13T10:36:22,280 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fb/df/1d62d1d50ac198ceb4029919403afffc2e8447924fa8a7dccacae2fbe254/unitxt-1.6.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,281 Found link https://files.pythonhosted.org/packages/0a/ff/fb18ad9a68114ebec6d83c4692bf76e798be8cb704601927b83c43e77468/unitxt-1.6.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.3 2026-01-13T10:36:22,282 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/3c/00f9689dc044aefeb12cf6d1711be8b356c1b4a9e9064afbbf8ad3a0386a/unitxt-1.6.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,283 Found link https://files.pythonhosted.org/packages/d9/ce/e0a235cc4c3c4206dace6e136c2185c619e96cffaa8a89ce5c6b29d4d1d2/unitxt-1.6.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.4 2026-01-13T10:36:22,283 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c9/6f/1e3cf56c018e921e962833129e9b2e3fdb217d13446069d14947226aa6ff/unitxt-1.6.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,284 Found link https://files.pythonhosted.org/packages/53/89/6402b06a2ee9c183e233fcb3ddf5e94acae69f3469db0dd4b9c832e1de06/unitxt-1.6.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.5 2026-01-13T10:36:22,285 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/3a/38a54ad28c6001f2ed1cf9b473397d2e50b84562fbb6fc7ef8b12e2f8816/unitxt-1.6.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,286 Found link https://files.pythonhosted.org/packages/2b/68/686ca788728a7b0d9aed1e4554890249bf3b8913157f0af726dd001b6171/unitxt-1.6.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.6 2026-01-13T10:36:22,287 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7c/b3/74575ea394250bbdc8cbec7bdee89e1dd256b98bd33c921fa3fb1c6da0de/unitxt-1.7.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,288 Found link https://files.pythonhosted.org/packages/7d/61/def0db05f178011014f52a1c6262782608f445d401aa9038cf7558df5501/unitxt-1.7.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.0 2026-01-13T10:36:22,289 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/3f/74f7b113d7374bae178602cd509611f4e22b71c4c2108b0a0cdb612478bb/unitxt-1.7.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,289 Found link https://files.pythonhosted.org/packages/03/4a/771ffed7a13ed4a5125a2f9b1a3f9bd8ca92bba1efce70816dfad2a3c847/unitxt-1.7.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.1 2026-01-13T10:36:22,290 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/77/4b/958241779f9e39e2a725e0c5a3b42a30093be8ed979bf3450a33d895eef0/unitxt-1.7.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,291 Found link https://files.pythonhosted.org/packages/71/e8/377300138eea7ddf4e8aca9e5fe027f726d79daea68ff3e5d507d839dc4d/unitxt-1.7.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.2 2026-01-13T10:36:22,292 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6b/b5/144bcad686fd0856d5e55afa832af65c5a0ab1cd68e3f5810f99ecad6bbd/unitxt-1.7.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,293 Found link https://files.pythonhosted.org/packages/18/2d/285793d136c1b46181c23c8d5151f19c7f7bbd19df3aaca87c2feea32264/unitxt-1.7.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.3 2026-01-13T10:36:22,293 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/eb/08cbd79d2647219bc56b29fda798ac8f396447abe04ef3918bf209921fa5/unitxt-1.7.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,294 Found link https://files.pythonhosted.org/packages/8c/4e/07f3da23342b34a21bba87a3823a5b07fd9bb57ff000b9f4ca8a25a304a9/unitxt-1.7.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.4 2026-01-13T10:36:22,295 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5f/1b/d91ad58df97b9d4abffe3fdb1ecc06f605100d4fc68aa0c648879dc17220/unitxt-1.7.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,296 Found link https://files.pythonhosted.org/packages/8e/cc/ca7a3f531f42997e7b57f60f863813242b20f75fedcf3680098b0564f7f0/unitxt-1.7.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.6 2026-01-13T10:36:22,296 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c0/50/130797cf6027e03e31ced6dba58431c112dca7cb0d77aff444d152d5a9ee/unitxt-1.7.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,297 Found link https://files.pythonhosted.org/packages/11/90/50793b6f9dcde0a23dcf8de3e1d051835f23c76b66918248e21964456570/unitxt-1.7.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.7 2026-01-13T10:36:22,298 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/db/69/b40831baf977a856f684c3b17ba3b93cd7286a0711780f1669e44ef1cf87/unitxt-1.7.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,299 Found link https://files.pythonhosted.org/packages/2a/65/c423c9142c37ca5e6c04b07856aa4403cc8e7cd1ac082986c349bbba8d11/unitxt-1.7.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.8 2026-01-13T10:36:22,299 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/65/a4/082a98d142a50b232009deb8870060ed1159bef7c7700fc945a5e1b1c576/unitxt-1.7.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,300 Found link https://files.pythonhosted.org/packages/2c/74/aeb29b7ea4c2c5164d7ad2db78380dc0dafff3fb110e55f40990b7dfeb5f/unitxt-1.7.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.9 2026-01-13T10:36:22,301 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/40/22/f66ec5af55ff05232ceed6000fbdf9c0f9dd75440315c7d7db379484400a/unitxt-1.8.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,302 Found link https://files.pythonhosted.org/packages/f1/70/1567cb0df5f1ecb0b57b7af412afa3d4c6f4d55b13174287215027f78ee0/unitxt-1.8.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.0 2026-01-13T10:36:22,303 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/45/4f/35ddea885fbf44ed77f59878a8aeeb42bee610ef5c7816cd5686fe11c9e7/unitxt-1.8.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,304 Found link https://files.pythonhosted.org/packages/cf/47/2c4684544ff10770059aa0841f7c1c9f3749c5b0af58854b4199cf75c724/unitxt-1.8.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.1 2026-01-13T10:36:22,305 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/e2/99691f526c7e639ed85a90b7528e26d5ad78813f6f135ec3ae09243e074f/unitxt-1.9.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,305 Found link https://files.pythonhosted.org/packages/e2/98/69dd3bc53ec1d69f15725badf2b4d09e4f59c880d31d391b77e87271e189/unitxt-1.9.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.9.0 2026-01-13T10:36:22,306 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b2/93/cf4654da1a4287252ef58b4ecc282652a22ae0e9e699489a59d8eb6c4770/unitxt-1.10.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,307 Found link https://files.pythonhosted.org/packages/e2/05/b391af435d7374e32801695929e2fff7b2b38c37269fa6f24ad88c5c1e1d/unitxt-1.10.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.0 2026-01-13T10:36:22,307 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5b/78/1fd132e1b142d1d5b9fa0f45c1abee0f6f11845ec0383da05270641c714a/unitxt-1.10.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,308 Found link https://files.pythonhosted.org/packages/aa/2c/ff867c9050c46fe0ef969c854e8283395bcea3a9422699783daab29a65ce/unitxt-1.10.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.1 2026-01-13T10:36:22,309 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c6/6b/15a29c9c043b70f10bcfe734e69738868cc02ba854d27d5dc3c38148d638/unitxt-1.10.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,310 Found link https://files.pythonhosted.org/packages/ca/bb/36c17130bed6f135a9c8134171f24ce088116ec7e181fb20cdc010d236e1/unitxt-1.10.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.2 2026-01-13T10:36:22,311 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ec/59/9f689da2b9d027dc6154a1584e73bcfd395d2ea21f87b89a331920de39f2/unitxt-1.10.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,312 Found link https://files.pythonhosted.org/packages/a5/c2/3502bc5d54fce05e84631015febc3009accf02fe17ebcfe21f8957b41038/unitxt-1.10.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.3 2026-01-13T10:36:22,312 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/72/38562d593bfbad59884388397d349c02a43f506522a6c38f5f880e33a5c0/unitxt-1.11.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,313 Found link https://files.pythonhosted.org/packages/15/c1/f5691d721631c0dfda9081520048d9f5040006c94bf58a71589448b70ce7/unitxt-1.11.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.0 2026-01-13T10:36:22,314 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/26/22/9a3ee0912f98885f654beebb03f90294c0fd957c8114ca69bf29e12ad1f6/unitxt-1.11.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,315 Found link https://files.pythonhosted.org/packages/8b/a3/98734125bc1418eff9a00cd296ae17fa485778e8d652a3c245d7a1f73fef/unitxt-1.11.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.1 2026-01-13T10:36:22,316 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e1/6e/302b606ffd159dab1261e61aa1f0fe64a7ed6158318ac867b5c832b51e97/unitxt-1.12.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,317 Found link https://files.pythonhosted.org/packages/0c/4a/c0fbee3975ec2fd18df6953120dc221a6191d4d29d89bc52ce4ec3c4718a/unitxt-1.12.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.0 2026-01-13T10:36:22,317 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/53/aa/fcc64d0486e683ee91b098729a57cdee00b551feae7c3c906c04aa8c082c/unitxt-1.12.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,318 Found link https://files.pythonhosted.org/packages/61/c2/6788469e9954b4d1dc725ea03b8a8d849c3484943bc4f56f33a7b5590311/unitxt-1.12.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.2 2026-01-13T10:36:22,319 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/ca/f36cf428780f82b96cfddf15e66ab362a0f5e67689758cbf16109b49f23d/unitxt-1.12.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,320 Found link https://files.pythonhosted.org/packages/2e/a0/129850543fe0585c455d5d473e7d65a6c510ff9d562e2601ba2945052382/unitxt-1.12.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.3 2026-01-13T10:36:22,321 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a4/0e/5ce073bfde80fb99cd1b6ef3725627ebc03221170fc6d7b669d464466e9d/unitxt-1.12.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,321 Found link https://files.pythonhosted.org/packages/e8/0b/f1be5a140bf9b321b27446182f0a0d1d36815ba2d4ca01ab7c5e7a186bba/unitxt-1.12.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.4 2026-01-13T10:36:22,322 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ce/22/9eb17d4ffd417aaee5bc2d92b1846237b96198bba297f98ff87d07e1a345/unitxt-1.13.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,323 Found link https://files.pythonhosted.org/packages/f6/85/10188d25411e97b47f42a6e1d58dc7ca68537a6cf26acfc3089e8608a98c/unitxt-1.13.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.0 2026-01-13T10:36:22,324 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/da/61/1e51d544f85194f8c2d614ddb8f33a0d6b9cce39e3419b7d0cd6a02a17dc/unitxt-1.13.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,325 Found link https://files.pythonhosted.org/packages/cc/b1/fab39a111d07c512f66ecca4e34f887539b1c1cf3251c6e4bd3c3c1535b2/unitxt-1.13.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.1 2026-01-13T10:36:22,326 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/07/bc/91c014790d9cfb9742766c0c76928dac7313c183fac30e40a158bcbe5fc7/unitxt-1.14.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,326 Found link https://files.pythonhosted.org/packages/70/24/78cc6337efc8e99c168dac278e70eccfa344669e06e89403bc77e526bec9/unitxt-1.14.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.0 2026-01-13T10:36:22,327 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f7/de/756bf8d48d4b998e3a16c3c754231d6655be5ba2784f50014e138975279f/unitxt-1.14.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,328 Found link https://files.pythonhosted.org/packages/4a/68/dfc467083e42ee09998e108b4347c740121c9c22940dbef280f52d55facf/unitxt-1.14.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.1 2026-01-13T10:36:22,329 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c7/77/4f5ddf5e206df145db14fb61687457f082c9797da4e96ca54b7685245718/unitxt-1.15.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,330 Found link https://files.pythonhosted.org/packages/b9/f0/de2fba113f54a3da5bba12b570d95591dca28b05fb98209a54a1c0f7a4bd/unitxt-1.15.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.6 2026-01-13T10:36:22,331 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/3f/dee7f199ed4b28c0cad74bce821b3a94f45470535f496b4578c267144ec7/unitxt-1.15.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,332 Found link https://files.pythonhosted.org/packages/0b/6d/f1a559b32a7c43e7804936b1e51cafd0b04fcf31a72b28cd1989e7a0680c/unitxt-1.15.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.7 2026-01-13T10:36:22,332 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c5/20/0f408a271a4b7496cc9351196dfaf0d4eb21ed443a4c0bdf6a8f224bcb15/unitxt-1.15.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,333 Found link https://files.pythonhosted.org/packages/a1/7e/aee80d7b5565d02a012070d7fd37631a47b70da99976d58fd2c7980d8d9a/unitxt-1.15.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.8 2026-01-13T10:36:22,334 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/39/e7/4c4ae5000ffaafcaec7644dcaad1afee8ef4baf035a1c0ed52f0df988c6b/unitxt-1.15.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,334 Found link https://files.pythonhosted.org/packages/ba/e2/45cd1839c84b9c0651451e9abd364f058aed4b0a4a725573ad2e6d3b87aa/unitxt-1.15.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.9 2026-01-13T10:36:22,335 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/ef/9cffc953f5ea4eb17698c1163819afa181a9d8892672114131ccffcb9699/unitxt-1.15.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,336 Found link https://files.pythonhosted.org/packages/7a/8a/eb348a8a441071e738673e838766135dbe85971aab5bf5647b648bd8f9b1/unitxt-1.15.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.10 2026-01-13T10:36:22,337 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/a1/5101918d00f623986322f755d775ababff05c0d9efd469a6d8b289e4af28/unitxt-1.16.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,338 Found link https://files.pythonhosted.org/packages/af/52/fa432517d161487482a062fe1bce3dfebf532e5d5a9a3571af65ef2642ea/unitxt-1.16.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.0 2026-01-13T10:36:22,339 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/68/39/ec4043f2009ac9ca7ab6920384e9b7eed0dc83f6629cce3c157528838cc8/unitxt-1.16.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,340 Found link https://files.pythonhosted.org/packages/05/7a/795a963d77756283170bb036ffbabcd4558637addc387164fd05b5307ec8/unitxt-1.16.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.1 2026-01-13T10:36:22,340 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/eb/82/36c6929e0098c2a8dbbf0c87e4d0dc3c57e82e88446a42a2195e3bf714c6/unitxt-1.16.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,341 Found link https://files.pythonhosted.org/packages/39/6e/b9d2ec30ad363fee9f5b9af3a9cbeaa1ff17552617acf55a37825663ebcc/unitxt-1.16.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.2 2026-01-13T10:36:22,342 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d5/7a/10608d7223e148fd77fbe44a8c50e9069dcdce3331c0f561bf7ddcae791d/unitxt-1.16.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,343 Found link https://files.pythonhosted.org/packages/70/99/c9af119e0ee12a03e4eb1aba238de3cbdcedee4428389f6729631f0accba/unitxt-1.16.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.3 2026-01-13T10:36:22,344 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/12/4b/f32a0b0faaff9f9313b7c545ff694c388c049bf94b065440d4c385c92ef5/unitxt-1.16.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,345 Found link https://files.pythonhosted.org/packages/95/81/aa5f10427622f38453ac1886ac01e15cbcc2f1c9ff18d94c347ae2a8095a/unitxt-1.16.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.4 2026-01-13T10:36:22,345 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/7f/1326785089371de1104510f16bdca0ae45b8f15323d0eddf73d8d8a8a4ac/unitxt-1.17.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,346 Found link https://files.pythonhosted.org/packages/4e/58/186b6b1966401921b2f1f28a3fec113271eb9fb07e404b034aa11314950a/unitxt-1.17.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.0 2026-01-13T10:36:22,346 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/4f/e3/a56211d050bab7c9f47d66a3ae79341504068c57afdafdc198ac9d3e8423/unitxt-1.17.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,347 Found link https://files.pythonhosted.org/packages/0a/fe/3840438766376433e26ee3bcfae015aa54bb90b81d1f908e3f43efe1aec3/unitxt-1.17.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.1 2026-01-13T10:36:22,348 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/f7/331ef88d7a201fa6fab7aa3c4da5e362dbc42ee7cb438f4598289ef4173c/unitxt-1.17.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,349 Found link https://files.pythonhosted.org/packages/96/cb/bf79447be5333489a539cb339caa4755990a03ea1f0a72b06d4fd5cad91a/unitxt-1.17.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.2 2026-01-13T10:36:22,350 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7f/54/c07931fdfde9216bfdbfc0f750c6ac4b4dac699b45f2743750097f3c3282/unitxt-1.18.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,351 Found link https://files.pythonhosted.org/packages/7f/b9/40673c1639ea52b808066a58c2a6d7728760c720a7a67189a05126c62eec/unitxt-1.18.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.18.0 2026-01-13T10:36:22,352 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/8f/be/5b04f2a962f443fb1232385056a66030703a1ea5eb0668717a50f4624950/unitxt-1.19.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,352 Found link https://files.pythonhosted.org/packages/84/0c/7bbf65409b22d468f9263d527a51530a489f3fccb8faba33ab6b151b0c09/unitxt-1.19.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.19.0 2026-01-13T10:36:22,353 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a7/65/6d51e684ab355851a671f1277aec67c3f202bef15657b6e2e03d9fc035c6/unitxt-1.20.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,354 Found link https://files.pythonhosted.org/packages/95/ea/67cb2f1c98950176d24cf36aaa708e8574df868c62f9c244839c1757d3bc/unitxt-1.20.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.20.0 2026-01-13T10:36:22,355 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/22/104bc58e591adf8c1ab5aa7394dac2f4b8c9d6d049864c06ff5f0761d0bd/unitxt-1.21.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,356 Found link https://files.pythonhosted.org/packages/07/11/212b1d9b9a0125adf6df3fc61f764f7779a5722fc3a7800346669e591300/unitxt-1.21.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.21.0 2026-01-13T10:36:22,356 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/35/b0/31d6a49431770663f238eca5d76c0bafe7d094c0cb6c8a0fe7142b7c3f14/unitxt-1.22.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,357 Found link https://files.pythonhosted.org/packages/65/dc/648810f78839db26139e88b7388f9f3481578e0005c406adb7727227e0b1/unitxt-1.22.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.0 2026-01-13T10:36:22,358 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/47/c7fc9adca33de9c0183d4be4a6a0f4ef204cbe08395aed0f34910738b0f1/unitxt-1.22.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,358 Found link https://files.pythonhosted.org/packages/9a/bb/31f76a0c74d78150a845cd4e46c5a385d41cd25aa189e2665c249b81c775/unitxt-1.22.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.1 2026-01-13T10:36:22,359 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/71/25/7381055a00d191f137f01c85ba18ab1c78317a68fbe1d2695862134211bf/unitxt-1.22.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,360 Found link https://files.pythonhosted.org/packages/50/b8/3605637a5a8632e761261c15f586f45055871dea28db9196bc813d98acbd/unitxt-1.22.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.2 2026-01-13T10:36:22,361 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6e/9e/53c5da526410e603534303eb0a8d317c00a448f0ce284dee30c8e1e81a0c/unitxt-1.22.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,362 Found link https://files.pythonhosted.org/packages/a9/a1/c0863aee6a05bde3d3cc2bd4334483cd5198f1a8dff3c662d0744800af78/unitxt-1.22.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.3 2026-01-13T10:36:22,362 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0f/87/03ed3b5edfd7b5d34d4deb6a12ef02e7834b1db0c873acbe69096b1fa8ba/unitxt-1.22.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,363 Found link https://files.pythonhosted.org/packages/db/bf/7b3fba584153936ba717c3865374633bc451e3ba420f71e617b71b478f18/unitxt-1.22.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.4 2026-01-13T10:36:22,364 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/36/47/65d15e6072dff8f6df1a263d047d7c07c75f364cb4baf286aa369409c9a0/unitxt-1.23.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,365 Found link https://files.pythonhosted.org/packages/28/06/90d21fd59a884150b97d2439e879c1ab1655d49ab125b696b66d371a56d1/unitxt-1.23.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.0 2026-01-13T10:36:22,366 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/62/de/a84986a8c771bd8c2de4d82b9ec9654eec0701db30b5269a1c98b0b40e72/unitxt-1.23.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,367 Found link https://files.pythonhosted.org/packages/c2/09/8d2aed1843a291ebc1ee82ce32bf8815a9eb65fcd6bacc70d38f23cc2e44/unitxt-1.23.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.1 2026-01-13T10:36:22,368 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d7/61/73e8fcb9a33dfaed609eb52301656bccc21a4e372a970d98706c948e2ce9/unitxt-1.24.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,368 Found link https://files.pythonhosted.org/packages/3d/2e/abf220721625586c937585370a93bb0e6e9bd6462cf8313565c5c7107a64/unitxt-1.24.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.24.0 2026-01-13T10:36:22,369 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/27/f5/0b39aa090e8e3f431ca9cdb56da92af77982a0497f7853cb1aa60f1c1943/unitxt-1.25.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,370 Found link https://files.pythonhosted.org/packages/d1/35/4f3bb7d13a262470c6cde689b3ded940988220a2140f4781c747fac6654c/unitxt-1.25.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.25.0 2026-01-13T10:36:22,370 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/df/cd7c2bb8bafe0fc13e825f9b2d93c205804642a7460637c3d4b595d976c9/unitxt-1.26.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,371 Found link https://files.pythonhosted.org/packages/8e/88/434ccf056e5899cdb0664793110f8865bfa76af5ad0b801edbfdb756e937/unitxt-1.26.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.0 2026-01-13T10:36:22,372 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/93/2d917b7d44136fcecbe432242b3f862e282afb06a3cebdf3b7a80c2fd97d/unitxt-1.26.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,373 Found link https://files.pythonhosted.org/packages/9b/df/e79513c8324b6e06982e5f951a5ce10d529261f6c4018d83148f1d0aae34/unitxt-1.26.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.1 2026-01-13T10:36:22,373 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b4/18/b5e41a3e4c3f932cf3b85aa07f9946c58002ac0197a388e764cedf270521/unitxt-1.26.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,374 Found link https://files.pythonhosted.org/packages/c4/3e/327710b0d0b2d3486c91dc6fd19c788373f48ec5819ae4a8c4d8df2af22b/unitxt-1.26.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.2 2026-01-13T10:36:22,375 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c3/8a/2b2328bb2ca0a7521de1c77b168081738ed27a43b0b24c35c438f73e33d3/unitxt-1.26.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,376 Found link https://files.pythonhosted.org/packages/8d/71/0026f05fa1b0bfc72d541f4225301b174ff498a9f31ce4c43f4aeb30991a/unitxt-1.26.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.3 2026-01-13T10:36:22,377 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/21/8e/6b80f38968d2028d29cfd73a4e35f88deb7b9b25d6560ec0321dfefba17a/unitxt-1.26.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,378 Found link https://files.pythonhosted.org/packages/8b/63/25be472438554113d73bd0ba6376796896a681d39eefbf6c84f360c4513d/unitxt-1.26.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.4 2026-01-13T10:36:22,379 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a6/c0/f71a77e934bdbf92d27e4aaa43f5fb2a7344cb9a3b5da54ba4c307803f21/unitxt-1.26.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,380 Found link https://files.pythonhosted.org/packages/b7/a6/f340d3caad1c471163ff69e4887e9fe268531e3e2923fab16c1d72708d5f/unitxt-1.26.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.5 2026-01-13T10:36:22,381 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/b8/94feb68e8c5b41218d6628669f5810d6b355dfa06d1db9ced22025b1b28c/unitxt-1.26.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,381 Found link https://files.pythonhosted.org/packages/d8/7e/db3a123bd5e8220299d10e9b7d6f7d3072b8f878708a13113bd5dc61e52a/unitxt-1.26.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.6 2026-01-13T10:36:22,382 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/0a/36d6c355c916eb5082323c8458f3185018d826956e673a6c09cd033e801a/unitxt-1.26.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,383 Found link https://files.pythonhosted.org/packages/aa/b1/e123a7cabdda6c77cce021925e68b3c6b420a8017884736181f147f1ca33/unitxt-1.26.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.7 2026-01-13T10:36:22,383 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/85/094363f7f5da524949ed6c4ab16024f36c3d3a2ec60e25291f7a32d2f5c6/unitxt-1.26.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,384 Found link https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.8 2026-01-13T10:36:22,385 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fe/2d/1c720fbb87b82ba7d13334c95e02ebaf8c476bde3753ada39d2acd65093e/unitxt-1.26.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,386 Found link https://files.pythonhosted.org/packages/7a/0c/01cd186889d2b44f8ddc51c5992b5d9e37fcd2d93e92ba7c6739a9c3fa52/unitxt-1.26.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.9 2026-01-13T10:36:22,387 Fetching project page and analyzing links: https://www.piwheels.org/simple/unitxt/ 2026-01-13T10:36:22,387 Getting page https://www.piwheels.org/simple/unitxt/ 2026-01-13T10:36:22,389 Found index url https://www.piwheels.org/simple 2026-01-13T10:36:22,549 Fetched page https://www.piwheels.org/simple/unitxt/ as text/html 2026-01-13T10:36:22,560 Skipping link: No binaries permitted for unitxt: https://www.piwheels.org/simple/unitxt/unitxt-1.26.8-py3-none-any.whl#sha256=abc967e670a81c20b6c1fe69a6a23a6861304793df40d094d5fa4ba4a5112a80 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,561 Skipping link: No binaries permitted for unitxt: https://www.piwheels.org/simple/unitxt/unitxt-1.26.7-py3-none-any.whl#sha256=1bf931de32df61cc6593135d9767737307d7fde8765e0b15dcacd20bd488e53e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,561 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.6-py3-none-any.whl#sha256=5cdb7b8221f1a7997250d9aaf8b089439479a9c547e674573b4b22a7003ba664 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,562 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.5-py3-none-any.whl#sha256=50928ba0f2db3e11d754b5d360806bcaed7889def23311e08bb674682bf82dad (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,562 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.4-py3-none-any.whl#sha256=ba799ee72a97c6a21a9fe89d07ca84bb12e95396e4580f01022d6ebc8f22b052 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,563 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.3-py3-none-any.whl#sha256=41b3345e5e9aa9442e972ec1061914f96fca699935837596049f55fdbff8a352 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,564 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.2-py3-none-any.whl#sha256=8938710761272f29708076f5ff3eb69284a2bdd3efccb7c71f3d58266d696d0a (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,564 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.1-py3-none-any.whl#sha256=249aef3d72d6087909fcfe44da337c0d4329a8d850752bf782a8a48963f9e315 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,565 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.0-py3-none-any.whl#sha256=d975f99895a416a4b8592ad4981ce05a0b2ebfce1468171716ccaebc27144fe9 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,565 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.25.0-py3-none-any.whl#sha256=7f29296002a9df0ee50f136d9c64fa48921c3e6b91a182b9c47494bbb39fba36 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,565 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.24.0-py3-none-any.whl#sha256=5faab657fe934ff3e9ef545f8570b89629cd01f269b0d87ecd29dff92474cb51 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,566 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.1-py3-none-any.whl#sha256=202aad8b827cecf0fd794c2f70e17200f1f59ef2d7bdeb5e85889aac1cf7f19f (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,566 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.0-py3-none-any.whl#sha256=6ca125bcf7a402049bfe28fecc5175862e0e94d0ae119e711c65a5788a2bda98 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,567 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.4-py3-none-any.whl#sha256=d7b3fb369e39eea3f7a9020d0de002c2159da1d7e0e59f05188e353627488e42 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,567 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.3-py3-none-any.whl#sha256=6191b273b617bd2ece88767dd8b16f8318517ba0810377d27d16dc7b9e590dcb (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,568 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.2-py3-none-any.whl#sha256=79a2fafd79be53d90c8a302f6b9b3fc6caa47004bae9e29dc945b75d7f1f5ac7 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,569 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.1-py3-none-any.whl#sha256=d04567b442c00815adab0efd3d9079b6401e960507f80c070fa30dec72bc3286 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,569 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.0-py3-none-any.whl#sha256=8fe219da3d2fba763d78b017bb9e0afb4ed7d3b66a942496ac11f903a9f6c3a4 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,570 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.21.0-py3-none-any.whl#sha256=a3cc0d8765d375b7811431310b10f25538c06d930c20533ea5b33e3a6e7e9d6e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,570 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.20.0-py3-none-any.whl#sha256=4f2d951df83d84af78a712031e5a7b50267ed7414506901c1027b838340f1b1e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,571 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.19.0-py3-none-any.whl#sha256=9a50ce6821619c85e41b78b2f7ad1a27f95ea27e62c988ef658d47a88077ad2b (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,572 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.18.0-py3-none-any.whl#sha256=bd53260ec29c82abef68c7b2a955d8c397ba0b64f5b92e0bdcfc7a9b887c053d (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,572 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.2-py3-none-any.whl#sha256=37ba61972e9bdc1014f633b3df104fd56e0b77989263a033aac14fbf57a1f534 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,572 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.1-py3-none-any.whl#sha256=a3fdf135f154ad6dff3e6d9deba685dbf94bf9968382f93fdbc43a64fea27d45 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,573 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.0-py3-none-any.whl#sha256=d029e01585bc1ee13c3ad96dbdcb8921036d0f2752716e1477bf757d84b6c6cc (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,573 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.4-py3-none-any.whl#sha256=70026ae1118327261b6a997a655dd60f50db2f637dcbbdeb423b214739e60712 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,574 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.3-py3-none-any.whl#sha256=cc4627f40b27ccf86d3e148d37bf12b3a58cf72bcf4b4dd3a8e95a6484856643 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,574 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.2-py3-none-any.whl#sha256=4f6b72a4c34b5bd05a87007f84b86ce3d4bc645639deb85aebceab2b360eb806 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,575 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.1-py3-none-any.whl#sha256=70aaf53f2794be1a7d22cd8c65957b9afdf8dda58efc09a723320274ac5ecb30 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,576 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.0-py3-none-any.whl#sha256=498d60de1829c4369a67ffc748a7149accca692ce10b969d968510a6d5e6b9f2 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,576 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.10-py3-none-any.whl#sha256=e8330cccf455567c9a9a2e7e8442bd29c13fa52d4347ed40d1863d5d8251b106 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,577 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.9-py3-none-any.whl#sha256=e3f95b0317a6814314667a949ef664c63f77c3205c50469a073bda29ffa237ee (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,577 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.8-py3-none-any.whl#sha256=e60b21e2a67ecbd56e8f2d62b53bfe224d64fa8ff94f01eea74d9e54712d0b2c (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,578 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.7-py3-none-any.whl#sha256=c1324bdeeda9f2e18f5d84e0d7b4bf4edf46ca79b959180993472ecaa0fba2a0 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,579 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.6-py3-none-any.whl#sha256=614a1b437c499d5c5525bbf96dab1a1ad9e1c9c102ee14199dfbced6ed5ef464 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-13T10:36:22,579 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-0.0.1-py3-none-any.whl#sha256=d5db4950544d2741808be98b6a40f37b95b9eef3012027ea5ed4093d8d4fe688 (from https://www.piwheels.org/simple/unitxt/) 2026-01-13T10:36:22,580 Skipping link: not a file: https://www.piwheels.org/simple/unitxt/ 2026-01-13T10:36:22,580 Skipping link: not a file: https://pypi.org/simple/unitxt/ 2026-01-13T10:36:22,612 Given no hashes to check 1 links for project 'unitxt': discarding no candidates 2026-01-13T10:36:22,631 Collecting unitxt==1.26.9 2026-01-13T10:36:22,633 Created temporary directory: /tmp/pip-unpack-8wh2pmnj 2026-01-13T10:36:22,846 Downloading unitxt-1.26.9.tar.gz (28.8 MB) 2026-01-13T10:36:35,770 Added unitxt==1.26.9 from https://files.pythonhosted.org/packages/7a/0c/01cd186889d2b44f8ddc51c5992b5d9e37fcd2d93e92ba7c6739a9c3fa52/unitxt-1.26.9.tar.gz to build tracker '/tmp/pip-build-tracker-d082n51i' 2026-01-13T10:36:35,780 Created temporary directory: /tmp/pip-build-env-2482n_e8 2026-01-13T10:36:35,785 Installing build dependencies: started 2026-01-13T10:36:35,786 Running command pip subprocess to install build dependencies 2026-01-13T10:36:37,035 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-01-13T10:36:37,706 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-01-13T10:36:37,731 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-01-13T10:36:39,464 Collecting setuptools 2026-01-13T10:36:39,564 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2026-01-13T10:36:39,842 Collecting wheel 2026-01-13T10:36:39,860 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2026-01-13T10:36:42,874 Installing collected packages: wheel, setuptools 2026-01-13T10:36:43,123 Creating /tmp/pip-build-env-2482n_e8/overlay/local/bin 2026-01-13T10:36:43,126 changing mode of /tmp/pip-build-env-2482n_e8/overlay/local/bin/wheel to 755 2026-01-13T10:36:46,898 Successfully installed setuptools-80.9.0 wheel-0.45.1 2026-01-13T10:36:47,173 Installing build dependencies: finished with status 'done' 2026-01-13T10:36:47,179 Getting requirements to build wheel: started 2026-01-13T10:36:47,181 Running command Getting requirements to build wheel 2026-01-13T10:36:48,119 /tmp/pip-build-env-2482n_e8/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-13T10:36:48,119 !! 2026-01-13T10:36:48,121 ******************************************************************************** 2026-01-13T10:36:48,122 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-13T10:36:48,123 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-13T10:36:48,123 or your builds will no longer be supported. 2026-01-13T10:36:48,124 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-13T10:36:48,125 ******************************************************************************** 2026-01-13T10:36:48,125 !! 2026-01-13T10:36:48,126 corresp(dist, value, root_dir) 2026-01-13T10:36:48,229 running egg_info 2026-01-13T10:36:48,236 writing src/unitxt.egg-info/PKG-INFO 2026-01-13T10:36:48,271 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-01-13T10:36:48,273 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-01-13T10:36:48,291 writing requirements to src/unitxt.egg-info/requires.txt 2026-01-13T10:36:48,293 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-01-13T10:36:49,614 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:49,877 adding license file 'LICENSE' 2026-01-13T10:36:50,135 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:50,244 Getting requirements to build wheel: finished with status 'done' 2026-01-13T10:36:50,247 Created temporary directory: /tmp/pip-modern-metadata-7rnmpudj 2026-01-13T10:36:50,249 Preparing metadata (pyproject.toml): started 2026-01-13T10:36:50,250 Running command Preparing metadata (pyproject.toml) 2026-01-13T10:36:50,978 /tmp/pip-build-env-2482n_e8/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-13T10:36:50,979 !! 2026-01-13T10:36:50,980 ******************************************************************************** 2026-01-13T10:36:50,980 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-13T10:36:50,982 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-13T10:36:50,982 or your builds will no longer be supported. 2026-01-13T10:36:50,983 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-13T10:36:50,984 ******************************************************************************** 2026-01-13T10:36:50,985 !! 2026-01-13T10:36:50,986 corresp(dist, value, root_dir) 2026-01-13T10:36:51,086 running dist_info 2026-01-13T10:36:51,098 creating /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info 2026-01-13T10:36:51,099 writing /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/PKG-INFO 2026-01-13T10:36:51,135 writing dependency_links to /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/dependency_links.txt 2026-01-13T10:36:51,137 writing entry points to /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/entry_points.txt 2026-01-13T10:36:51,155 writing requirements to /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/requires.txt 2026-01-13T10:36:51,157 writing top-level names to /tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/top_level.txt 2026-01-13T10:36:51,159 writing manifest file '/tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:52,374 reading manifest file '/tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:52,376 adding license file 'LICENSE' 2026-01-13T10:36:52,549 writing manifest file '/tmp/pip-modern-metadata-7rnmpudj/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:52,558 creating '/tmp/pip-modern-metadata-7rnmpudj/unitxt-1.26.9.dist-info' 2026-01-13T10:36:52,695 Preparing metadata (pyproject.toml): finished with status 'done' 2026-01-13T10:36:52,704 Source in /tmp/pip-wheel-50gpeme1/unitxt_7c3e71886a7748cca79fa1201eaf61cc has version 1.26.9, which satisfies requirement unitxt==1.26.9 from https://files.pythonhosted.org/packages/7a/0c/01cd186889d2b44f8ddc51c5992b5d9e37fcd2d93e92ba7c6739a9c3fa52/unitxt-1.26.9.tar.gz 2026-01-13T10:36:52,705 Removed unitxt==1.26.9 from https://files.pythonhosted.org/packages/7a/0c/01cd186889d2b44f8ddc51c5992b5d9e37fcd2d93e92ba7c6739a9c3fa52/unitxt-1.26.9.tar.gz from build tracker '/tmp/pip-build-tracker-d082n51i' 2026-01-13T10:36:52,718 Created temporary directory: /tmp/pip-unpack-z0e726b4 2026-01-13T10:36:52,719 Building wheels for collected packages: unitxt 2026-01-13T10:36:52,723 Created temporary directory: /tmp/pip-wheel-aeq5i_54 2026-01-13T10:36:52,723 Destination directory: /tmp/pip-wheel-aeq5i_54 2026-01-13T10:36:52,726 Building wheel for unitxt (pyproject.toml): started 2026-01-13T10:36:52,727 Running command Building wheel for unitxt (pyproject.toml) 2026-01-13T10:36:53,465 /tmp/pip-build-env-2482n_e8/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-13T10:36:53,465 !! 2026-01-13T10:36:53,466 ******************************************************************************** 2026-01-13T10:36:53,467 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-13T10:36:53,468 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-13T10:36:53,468 or your builds will no longer be supported. 2026-01-13T10:36:53,469 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-13T10:36:53,470 ******************************************************************************** 2026-01-13T10:36:53,471 !! 2026-01-13T10:36:53,471 corresp(dist, value, root_dir) 2026-01-13T10:36:53,565 running bdist_wheel 2026-01-13T10:36:53,586 running build 2026-01-13T10:36:53,587 running build_py 2026-01-13T10:36:53,595 creating build/lib/unitxt 2026-01-13T10:36:53,597 copying src/unitxt/formats.py -> build/lib/unitxt 2026-01-13T10:36:53,600 copying src/unitxt/operators.py -> build/lib/unitxt 2026-01-13T10:36:53,605 copying src/unitxt/generator_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,607 copying src/unitxt/settings_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,609 copying src/unitxt/logging_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,611 copying src/unitxt/type_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,614 copying src/unitxt/deprecation_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,617 copying src/unitxt/random_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,618 copying src/unitxt/llm_as_judge_chat_templates.py -> build/lib/unitxt 2026-01-13T10:36:53,620 copying src/unitxt/dataset_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,622 copying src/unitxt/types.py -> build/lib/unitxt 2026-01-13T10:36:53,624 copying src/unitxt/standard.py -> build/lib/unitxt 2026-01-13T10:36:53,627 copying src/unitxt/benchmark.py -> build/lib/unitxt 2026-01-13T10:36:53,629 copying src/unitxt/augmentors.py -> build/lib/unitxt 2026-01-13T10:36:53,631 copying src/unitxt/error_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,634 copying src/unitxt/dict_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,637 copying src/unitxt/__init__.py -> build/lib/unitxt 2026-01-13T10:36:53,639 copying src/unitxt/llm_as_judge.py -> build/lib/unitxt 2026-01-13T10:36:53,642 copying src/unitxt/serializers.py -> build/lib/unitxt 2026-01-13T10:36:53,645 copying src/unitxt/catalog.py -> build/lib/unitxt 2026-01-13T10:36:53,648 copying src/unitxt/dataclass.py -> build/lib/unitxt 2026-01-13T10:36:53,651 copying src/unitxt/split_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,653 copying src/unitxt/dialog_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,656 copying src/unitxt/metrics.py -> build/lib/unitxt 2026-01-13T10:36:53,662 copying src/unitxt/text_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,666 copying src/unitxt/collections.py -> build/lib/unitxt 2026-01-13T10:36:53,668 copying src/unitxt/span_lableing_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,671 copying src/unitxt/validate.py -> build/lib/unitxt 2026-01-13T10:36:53,673 copying src/unitxt/parsing_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,676 copying src/unitxt/metric_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,678 copying src/unitxt/normalizers.py -> build/lib/unitxt 2026-01-13T10:36:53,680 copying src/unitxt/base_metric.py -> build/lib/unitxt 2026-01-13T10:36:53,682 copying src/unitxt/card.py -> build/lib/unitxt 2026-01-13T10:36:53,684 copying src/unitxt/llm_as_judge_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,686 copying src/unitxt/register.py -> build/lib/unitxt 2026-01-13T10:36:53,688 copying src/unitxt/api.py -> build/lib/unitxt 2026-01-13T10:36:53,690 copying src/unitxt/utils.py -> build/lib/unitxt 2026-01-13T10:36:53,693 copying src/unitxt/version.py -> build/lib/unitxt 2026-01-13T10:36:53,695 copying src/unitxt/struct_data_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,698 copying src/unitxt/processors.py -> build/lib/unitxt 2026-01-13T10:36:53,700 copying src/unitxt/llm_as_judge_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,702 copying src/unitxt/instructions.py -> build/lib/unitxt 2026-01-13T10:36:53,704 copying src/unitxt/recipe.py -> build/lib/unitxt 2026-01-13T10:36:53,705 copying src/unitxt/image_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,708 copying src/unitxt/system_prompts.py -> build/lib/unitxt 2026-01-13T10:36:53,709 copying src/unitxt/file_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,711 copying src/unitxt/task.py -> build/lib/unitxt 2026-01-13T10:36:53,714 copying src/unitxt/inference.py -> build/lib/unitxt 2026-01-13T10:36:53,720 copying src/unitxt/metric.py -> build/lib/unitxt 2026-01-13T10:36:53,722 copying src/unitxt/templates.py -> build/lib/unitxt 2026-01-13T10:36:53,727 copying src/unitxt/text2sql_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,731 copying src/unitxt/blocks.py -> build/lib/unitxt 2026-01-13T10:36:53,733 copying src/unitxt/operator.py -> build/lib/unitxt 2026-01-13T10:36:53,735 copying src/unitxt/splitters.py -> build/lib/unitxt 2026-01-13T10:36:53,738 copying src/unitxt/fusion.py -> build/lib/unitxt 2026-01-13T10:36:53,740 copying src/unitxt/artifact.py -> build/lib/unitxt 2026-01-13T10:36:53,744 copying src/unitxt/stream.py -> build/lib/unitxt 2026-01-13T10:36:53,746 copying src/unitxt/llm_as_judge_constants.py -> build/lib/unitxt 2026-01-13T10:36:53,751 copying src/unitxt/dataset.py -> build/lib/unitxt 2026-01-13T10:36:53,753 copying src/unitxt/hf_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,755 copying src/unitxt/llm_as_judge_from_template.py -> build/lib/unitxt 2026-01-13T10:36:53,759 copying src/unitxt/string_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,761 copying src/unitxt/collections_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,763 copying src/unitxt/loaders.py -> build/lib/unitxt 2026-01-13T10:36:53,766 copying src/unitxt/evaluate_cli.py -> build/lib/unitxt 2026-01-13T10:36:53,770 copying src/unitxt/stream_operators.py -> build/lib/unitxt 2026-01-13T10:36:53,772 copying src/unitxt/eval_utils.py -> build/lib/unitxt 2026-01-13T10:36:53,774 copying src/unitxt/schema.py -> build/lib/unitxt 2026-01-13T10:36:53,778 creating build/lib/unitxt/assistant 2026-01-13T10:36:53,779 copying src/unitxt/assistant/__init__.py -> build/lib/unitxt/assistant 2026-01-13T10:36:53,781 copying src/unitxt/assistant/app.py -> build/lib/unitxt/assistant 2026-01-13T10:36:53,784 copying src/unitxt/assistant/index.py -> build/lib/unitxt/assistant 2026-01-13T10:36:53,787 creating build/lib/unitxt/test_utils 2026-01-13T10:36:53,789 copying src/unitxt/test_utils/operators.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,792 copying src/unitxt/test_utils/__init__.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,793 copying src/unitxt/test_utils/storage.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,796 copying src/unitxt/test_utils/catalog.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,798 copying src/unitxt/test_utils/metrics.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,800 copying src/unitxt/test_utils/card.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,803 copying src/unitxt/test_utils/artifact.py -> build/lib/unitxt/test_utils 2026-01-13T10:36:53,805 creating build/lib/unitxt/service 2026-01-13T10:36:53,806 copying src/unitxt/service/__init__.py -> build/lib/unitxt/service 2026-01-13T10:36:53,808 creating build/lib/unitxt/ui 2026-01-13T10:36:53,809 copying src/unitxt/ui/settings.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,811 copying src/unitxt/ui/ui_utils.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,813 copying src/unitxt/ui/__init__.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,815 copying src/unitxt/ui/ui_tester.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,818 copying src/unitxt/ui/load_catalog_data.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,822 copying src/unitxt/ui/run.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,824 copying src/unitxt/ui/gradio_utils.py -> build/lib/unitxt/ui 2026-01-13T10:36:53,827 creating build/lib/unitxt/assistant/assessment 2026-01-13T10:36:53,828 copying src/unitxt/assistant/assessment/assistant_inference_engine.py -> build/lib/unitxt/assistant/assessment 2026-01-13T10:36:53,830 copying src/unitxt/assistant/assessment/__init__.py -> build/lib/unitxt/assistant/assessment 2026-01-13T10:36:53,832 copying src/unitxt/assistant/assessment/my_pretty_table.py -> build/lib/unitxt/assistant/assessment 2026-01-13T10:36:54,064 creating build/lib/unitxt/service/metrics 2026-01-13T10:36:54,066 copying src/unitxt/service/metrics/main.py -> build/lib/unitxt/service/metrics 2026-01-13T10:36:54,069 copying src/unitxt/service/metrics/__init__.py -> build/lib/unitxt/service/metrics 2026-01-13T10:36:54,071 copying src/unitxt/service/metrics/tokens.py -> build/lib/unitxt/service/metrics 2026-01-13T10:36:54,090 running egg_info 2026-01-13T10:36:54,102 writing src/unitxt.egg-info/PKG-INFO 2026-01-13T10:36:54,137 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-01-13T10:36:54,140 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-01-13T10:36:54,158 writing requirements to src/unitxt.egg-info/requires.txt 2026-01-13T10:36:54,160 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-01-13T10:36:56,161 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:56,426 adding license file 'LICENSE' 2026-01-13T10:36:56,676 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-13T10:36:57,787 creating build/lib/unitxt/catalog/serializers/text2sql 2026-01-13T10:36:57,790 copying src/unitxt/catalog/serializers/text2sql/schema.json -> build/lib/unitxt/catalog/serializers/text2sql 2026-01-13T10:36:57,792 creating build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,793 copying src/unitxt/catalog/serializers/table/concat.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,795 copying src/unitxt/catalog/serializers/table/json.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,797 copying src/unitxt/catalog/serializers/table/indexed_row_major.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,799 copying src/unitxt/catalog/serializers/table/df.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,801 copying src/unitxt/catalog/serializers/table/html.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,804 copying src/unitxt/catalog/serializers/table/markdown.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,806 copying src/unitxt/catalog/serializers/table/image.json -> build/lib/unitxt/catalog/serializers/table 2026-01-13T10:36:57,808 creating build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,809 copying src/unitxt/catalog/tasks/generation.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,812 copying src/unitxt/catalog/tasks/grammatical_error_correction.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,814 copying src/unitxt/catalog/tasks/text2sql.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,816 copying src/unitxt/catalog/tasks/schema_linking.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,818 copying src/unitxt/catalog/tasks/text2sql_logic.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,820 copying src/unitxt/catalog/tasks/language_identification.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,822 copying src/unitxt/catalog/tasks/key_value_extraction.json -> build/lib/unitxt/catalog/tasks 2026-01-13T10:36:57,823 creating build/lib/unitxt/catalog/tasks/rag 2026-01-13T10:36:57,824 copying src/unitxt/catalog/tasks/rag/end_to_end.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-13T10:36:57,827 copying src/unitxt/catalog/tasks/rag/corpora.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-13T10:36:57,829 copying src/unitxt/catalog/tasks/rag/response_generation.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-13T10:36:57,831 creating build/lib/unitxt/catalog/tasks/tool_calling 2026-01-13T10:36:57,832 copying src/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-01-13T10:36:57,834 copying src/unitxt/catalog/tasks/tool_calling/supervised.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-01-13T10:36:57,836 creating build/lib/unitxt/catalog/tasks/ner 2026-01-13T10:36:57,837 copying src/unitxt/catalog/tasks/ner/all_entity_types.json -> build/lib/unitxt/catalog/tasks/ner 2026-01-13T10:36:57,839 copying src/unitxt/catalog/tasks/ner/single_entity_type.json -> build/lib/unitxt/catalog/tasks/ner 2026-01-13T10:36:57,841 creating build/lib/unitxt/catalog/tasks/qa 2026-01-13T10:36:57,842 copying src/unitxt/catalog/tasks/qa/open.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-13T10:36:57,844 copying src/unitxt/catalog/tasks/qa/with_context.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-13T10:36:57,846 copying src/unitxt/catalog/tasks/qa/extractive.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-13T10:36:57,848 creating build/lib/unitxt/catalog/tasks/qa/extractive 2026-01-13T10:36:57,849 copying src/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/lib/unitxt/catalog/tasks/qa/extractive 2026-01-13T10:36:57,851 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:36:57,852 copying src/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:36:57,854 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:36:57,856 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:36:57,858 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-13T10:36:57,859 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-13T10:36:57,862 creating build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:36:57,862 copying src/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:36:57,865 copying src/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:36:57,867 copying src/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:36:57,869 copying src/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:36:57,872 creating build/lib/unitxt/catalog/tasks/evaluation 2026-01-13T10:36:57,873 copying src/unitxt/catalog/tasks/evaluation/preference.json -> build/lib/unitxt/catalog/tasks/evaluation 2026-01-13T10:36:57,875 creating build/lib/unitxt/catalog/tasks/rewriting 2026-01-13T10:36:57,877 copying src/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-01-13T10:36:57,879 copying src/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-01-13T10:36:57,881 creating build/lib/unitxt/catalog/tasks/generation 2026-01-13T10:36:57,882 copying src/unitxt/catalog/tasks/generation/from_pair.json -> build/lib/unitxt/catalog/tasks/generation 2026-01-13T10:36:57,884 creating build/lib/unitxt/catalog/tasks/summarization 2026-01-13T10:36:57,885 copying src/unitxt/catalog/tasks/summarization/abstractive.json -> build/lib/unitxt/catalog/tasks/summarization 2026-01-13T10:36:57,887 creating build/lib/unitxt/catalog/tasks/regression 2026-01-13T10:36:57,888 copying src/unitxt/catalog/tasks/regression/two_texts.json -> build/lib/unitxt/catalog/tasks/regression 2026-01-13T10:36:57,890 copying src/unitxt/catalog/tasks/regression/single_text.json -> build/lib/unitxt/catalog/tasks/regression 2026-01-13T10:36:57,892 creating build/lib/unitxt/catalog/tasks/regression/two_texts 2026-01-13T10:36:57,893 copying src/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/lib/unitxt/catalog/tasks/regression/two_texts 2026-01-13T10:36:57,895 creating build/lib/unitxt/catalog/tasks/translation 2026-01-13T10:36:57,896 copying src/unitxt/catalog/tasks/translation/directed.json -> build/lib/unitxt/catalog/tasks/translation 2026-01-13T10:36:57,898 creating build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:36:57,899 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:36:57,901 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:36:57,903 creating build/lib/unitxt/catalog/tasks/span_labeling 2026-01-13T10:36:57,904 copying src/unitxt/catalog/tasks/span_labeling/extraction.json -> build/lib/unitxt/catalog/tasks/span_labeling 2026-01-13T10:36:57,906 creating build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:36:57,908 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:36:57,910 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:36:57,912 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:36:57,913 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:36:57,915 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:36:57,917 creating build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:36:57,918 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:36:57,921 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:36:57,923 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:36:57,924 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:36:57,926 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:36:57,928 creating build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:36:57,929 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:36:57,931 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:36:57,933 creating build/lib/unitxt/catalog/tasks/classification 2026-01-13T10:36:57,934 copying src/unitxt/catalog/tasks/classification/binary.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-13T10:36:57,936 copying src/unitxt/catalog/tasks/classification/multi_label.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-13T10:36:57,939 copying src/unitxt/catalog/tasks/classification/multi_class.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-13T10:36:57,941 creating build/lib/unitxt/catalog/tasks/classification/binary 2026-01-13T10:36:57,941 copying src/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/lib/unitxt/catalog/tasks/classification/binary 2026-01-13T10:36:57,943 creating build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:36:57,944 copying src/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:36:57,946 copying src/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:36:57,948 copying src/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:36:57,951 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:36:57,952 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:36:57,954 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:36:57,956 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:36:57,958 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:36:57,960 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:57,961 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:57,963 creating build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:36:57,964 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:36:57,967 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:36:57,969 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:36:57,971 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:36:57,973 creating build/lib/unitxt/catalog/tasks/selection 2026-01-13T10:36:57,974 copying src/unitxt/catalog/tasks/selection/by_attribute.json -> build/lib/unitxt/catalog/tasks/selection 2026-01-13T10:36:57,976 creating build/lib/unitxt/catalog/tasks/completion 2026-01-13T10:36:57,977 copying src/unitxt/catalog/tasks/completion/extractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-13T10:36:57,979 copying src/unitxt/catalog/tasks/completion/multiple_choice.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-13T10:36:57,981 copying src/unitxt/catalog/tasks/completion/abstractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-13T10:36:57,983 creating build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,984 copying src/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,986 copying src/unitxt/catalog/processors/safe_unsafe.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,988 copying src/unitxt/catalog/processors/load_json.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,990 copying src/unitxt/catalog/processors/remove_articles.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,992 copying src/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,994 copying src/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,996 copying src/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:57,998 copying src/unitxt/catalog/processors/extract_verbal_judgement.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,000 copying src/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,002 copying src/unitxt/catalog/processors/load_json_from_predictions.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,003 copying src/unitxt/catalog/processors/remove_none_from_list.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,005 copying src/unitxt/catalog/processors/stance_to_pro_con.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,007 copying src/unitxt/catalog/processors/lower_case.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,009 copying src/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,011 copying src/unitxt/catalog/processors/fix_whitespace.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,013 copying src/unitxt/catalog/processors/take_last_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,015 copying src/unitxt/catalog/processors/literal_eval.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,017 copying src/unitxt/catalog/processors/yes_no_to_int.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,019 copying src/unitxt/catalog/processors/get_string_after_colon.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,021 copying src/unitxt/catalog/processors/substring.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,023 copying src/unitxt/catalog/processors/remove_punctuations.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,025 copying src/unitxt/catalog/processors/capitalize.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,027 copying src/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,029 copying src/unitxt/catalog/processors/to_string_stripped.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,031 copying src/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,033 copying src/unitxt/catalog/processors/multi_tool_call.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,035 copying src/unitxt/catalog/processors/first_character.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,038 copying src/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,040 copying src/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,042 copying src/unitxt/catalog/processors/to_span_label_pairs.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,044 copying src/unitxt/catalog/processors/extract_from_double_brackets.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,046 copying src/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,048 copying src/unitxt/catalog/processors/take_first_word.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,050 copying src/unitxt/catalog/processors/upper_case.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,052 copying src/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,053 copying src/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,055 copying src/unitxt/catalog/processors/to_list_by_comma.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,057 copying src/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,059 copying src/unitxt/catalog/processors/match_closest_option.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,061 copying src/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,063 copying src/unitxt/catalog/processors/str_to_float_format.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,065 copying src/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,067 copying src/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,069 copying src/unitxt/catalog/processors/load_json_predictions.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,071 copying src/unitxt/catalog/processors/lower_case_till_punc.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,073 copying src/unitxt/catalog/processors/to_string.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,075 copying src/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,077 copying src/unitxt/catalog/processors/to_list_by_comma_space.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,079 copying src/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,081 copying src/unitxt/catalog/processors/to_yes_or_none.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,083 copying src/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,085 copying src/unitxt/catalog/processors/take_first_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,088 copying src/unitxt/catalog/processors/convert_to_boolean.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,090 copying src/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,092 copying src/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/lib/unitxt/catalog/processors 2026-01-13T10:36:58,094 creating build/lib/unitxt/catalog/processors/text2sql 2026-01-13T10:36:58,095 copying src/unitxt/catalog/processors/text2sql/get_sql.json -> build/lib/unitxt/catalog/processors/text2sql 2026-01-13T10:36:58,097 creating build/lib/unitxt/catalog/templates 2026-01-13T10:36:58,098 copying src/unitxt/catalog/templates/key_val.json -> build/lib/unitxt/catalog/templates 2026-01-13T10:36:58,100 copying src/unitxt/catalog/templates/empty.json -> build/lib/unitxt/catalog/templates 2026-01-13T10:36:58,102 copying src/unitxt/catalog/templates/key_val_with_new_lines.json -> build/lib/unitxt/catalog/templates 2026-01-13T10:36:58,104 creating build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,106 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,108 copying src/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,110 copying src/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,112 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,114 copying src/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:36:58,116 creating build/lib/unitxt/catalog/templates/rag/end_to_end 2026-01-13T10:36:58,117 copying src/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/lib/unitxt/catalog/templates/rag/end_to_end 2026-01-13T10:36:58,119 creating build/lib/unitxt/catalog/templates/tool_calling 2026-01-13T10:36:58,120 copying src/unitxt/catalog/templates/tool_calling/base.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-01-13T10:36:58,123 copying src/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-01-13T10:36:58,124 creating build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,125 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,128 copying src/unitxt/catalog/templates/text2sql/empty.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,130 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,132 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,134 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,136 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,138 copying src/unitxt/catalog/templates/text2sql/all.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,140 copying src/unitxt/catalog/templates/text2sql/you_are_given.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,142 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,144 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-13T10:36:58,146 creating build/lib/unitxt/catalog/templates/key_value_extraction 2026-01-13T10:36:58,147 copying src/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/lib/unitxt/catalog/templates/key_value_extraction 2026-01-13T10:36:58,149 creating build/lib/unitxt/catalog/templates/qa 2026-01-13T10:36:58,150 copying src/unitxt/catalog/templates/qa/open.json -> build/lib/unitxt/catalog/templates/qa 2026-01-13T10:36:58,152 copying src/unitxt/catalog/templates/qa/with_context.json -> build/lib/unitxt/catalog/templates/qa 2026-01-13T10:36:58,155 copying src/unitxt/catalog/templates/qa/extractive.json -> build/lib/unitxt/catalog/templates/qa 2026-01-13T10:36:58,158 creating build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,159 copying src/unitxt/catalog/templates/qa/open/empty.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,161 copying src/unitxt/catalog/templates/qa/open/simple2.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,164 copying src/unitxt/catalog/templates/qa/open/title.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,166 copying src/unitxt/catalog/templates/qa/open/all.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,169 copying src/unitxt/catalog/templates/qa/open/simple.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-13T10:36:58,172 creating build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-13T10:36:58,174 copying src/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-13T10:36:58,177 creating build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:36:58,178 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:36:58,181 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:36:58,184 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:36:58,186 creating build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-13T10:36:58,188 copying src/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-13T10:36:58,190 creating build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:36:58,191 copying src/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:36:58,193 copying src/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:36:58,195 copying src/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:36:58,197 copying src/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:36:58,199 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,200 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,202 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,204 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,206 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,209 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,211 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,213 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,215 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:36:58,217 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:36:58,218 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:36:58,221 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:36:58,223 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:36:58,225 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:36:58,227 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:36:58,228 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:36:58,230 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:36:58,232 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:36:58,234 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:36:58,236 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:36:58,237 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:36:58,239 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:36:58,241 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:36:58,243 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:36:58,245 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:36:58,246 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:36:58,248 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:36:58,250 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:36:58,253 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:36:58,255 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:36:58,256 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:36:58,258 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:36:58,260 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:36:58,262 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:36:58,264 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,265 copying src/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,268 copying src/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,270 copying src/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,272 copying src/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,274 copying src/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:36:58,276 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:36:58,277 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:36:58,279 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:36:58,281 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:36:58,283 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:36:58,285 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:36:58,286 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:36:58,288 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:36:58,290 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:36:58,292 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:36:58,294 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:36:58,295 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:36:58,298 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:36:58,300 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:36:58,302 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:36:58,304 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:36:58,305 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:36:58,307 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:36:58,309 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:36:58,311 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:36:58,313 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:36:58,314 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:36:58,316 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:36:58,318 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:36:58,321 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:36:58,323 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,323 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,326 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,328 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,330 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,333 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,335 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,338 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,341 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:36:58,343 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,344 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,346 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,348 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,351 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,353 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,355 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,357 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:36:58,359 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:36:58,360 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:36:58,362 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:36:58,364 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:36:58,366 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:36:58,369 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:36:58,370 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:36:58,372 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:36:58,374 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:36:58,376 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:36:58,378 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:36:58,379 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:36:58,381 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:36:58,384 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:36:58,386 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:36:58,388 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:36:58,389 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:36:58,391 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:36:58,393 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:36:58,395 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:36:58,397 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:36:58,398 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:36:58,400 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:36:58,402 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:36:58,405 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:36:58,407 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:36:58,408 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:36:58,410 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:36:58,413 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:36:58,415 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:36:58,416 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:36:58,417 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:36:58,419 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:36:58,422 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:36:58,423 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:36:58,425 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:36:58,426 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:36:58,429 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:36:58,431 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:36:58,433 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:36:58,435 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:36:58,436 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:36:58,438 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:36:58,440 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:36:58,442 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:36:58,444 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:36:58,445 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:36:58,448 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:36:58,450 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:36:58,452 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:36:58,455 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:36:58,455 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:36:58,458 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:36:58,460 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:36:58,462 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:36:58,464 creating build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,464 copying src/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,467 copying src/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,469 copying src/unitxt/catalog/templates/qa/with_context/simple2.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,471 copying src/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,473 copying src/unitxt/catalog/templates/qa/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,475 copying src/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,477 copying src/unitxt/catalog/templates/qa/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,479 copying src/unitxt/catalog/templates/qa/with_context/with_type.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,482 copying src/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,484 copying src/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,487 copying src/unitxt/catalog/templates/qa/with_context/websrc.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,489 copying src/unitxt/catalog/templates/qa/with_context/question_first.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,491 copying src/unitxt/catalog/templates/qa/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-13T10:36:58,493 creating build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-13T10:36:58,494 copying src/unitxt/catalog/templates/evaluation/preference/default.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-13T10:36:58,497 copying src/unitxt/catalog/templates/evaluation/preference/all.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-13T10:36:58,499 creating build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:36:58,500 copying src/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:36:58,502 copying src/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:36:58,504 creating build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:36:58,505 copying src/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:36:58,508 copying src/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:36:58,510 creating build/lib/unitxt/catalog/templates/generation 2026-01-13T10:36:58,511 copying src/unitxt/catalog/templates/generation/empty.json -> build/lib/unitxt/catalog/templates/generation 2026-01-13T10:36:58,513 copying src/unitxt/catalog/templates/generation/default.json -> build/lib/unitxt/catalog/templates/generation 2026-01-13T10:36:58,515 copying src/unitxt/catalog/templates/generation/all.json -> build/lib/unitxt/catalog/templates/generation 2026-01-13T10:36:58,516 creating build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-13T10:36:58,517 copying src/unitxt/catalog/templates/generation/from_pair/default.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-13T10:36:58,520 copying src/unitxt/catalog/templates/generation/from_pair/all.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-13T10:36:58,521 creating build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,523 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,525 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,527 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,529 copying src/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,531 copying src/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,533 copying src/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,535 copying src/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,538 copying src/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,540 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,543 copying src/unitxt/catalog/templates/summarization/abstractive/title.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,545 copying src/unitxt/catalog/templates/summarization/abstractive/full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,547 copying src/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,549 copying src/unitxt/catalog/templates/summarization/abstractive/all.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,551 copying src/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,553 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,555 copying src/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,557 copying src/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:36:58,559 creating build/lib/unitxt/catalog/templates/regression/single_text 2026-01-13T10:36:58,561 copying src/unitxt/catalog/templates/regression/single_text/title.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-13T10:36:58,563 copying src/unitxt/catalog/templates/regression/single_text/all.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-13T10:36:58,565 copying src/unitxt/catalog/templates/regression/single_text/simple.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-13T10:36:58,567 creating build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-13T10:36:58,568 copying src/unitxt/catalog/templates/regression/two_texts/title.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-13T10:36:58,570 copying src/unitxt/catalog/templates/regression/two_texts/all.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-13T10:36:58,572 copying src/unitxt/catalog/templates/regression/two_texts/simple.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-13T10:36:58,574 creating build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-13T10:36:58,575 copying src/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-13T10:36:58,577 creating build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:36:58,578 copying src/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:36:58,580 copying src/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:36:58,582 creating build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,584 copying src/unitxt/catalog/templates/translation/directed/casual.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,586 copying src/unitxt/catalog/templates/translation/directed/bluebench.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,589 copying src/unitxt/catalog/templates/translation/directed/title.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,591 copying src/unitxt/catalog/templates/translation/directed/all.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,592 copying src/unitxt/catalog/templates/translation/directed/formal.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,594 copying src/unitxt/catalog/templates/translation/directed/playful.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,597 copying src/unitxt/catalog/templates/translation/directed/instructional.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,599 copying src/unitxt/catalog/templates/translation/directed/simple.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-13T10:36:58,601 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,601 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,604 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,606 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,608 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,610 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,612 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:36:58,614 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:36:58,615 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:36:58,617 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:36:58,619 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:36:58,621 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:36:58,622 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:36:58,624 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:36:58,626 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:36:58,628 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:36:58,630 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:36:58,631 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:36:58,633 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:36:58,636 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:36:58,638 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:36:58,640 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:36:58,641 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:36:58,644 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:36:58,646 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:36:58,648 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:36:58,650 creating build/lib/unitxt/catalog/templates/schema_linking 2026-01-13T10:36:58,651 copying src/unitxt/catalog/templates/schema_linking/default.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-13T10:36:58,653 copying src/unitxt/catalog/templates/schema_linking/with_hint.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-13T10:36:58,656 copying src/unitxt/catalog/templates/schema_linking/all.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-13T10:36:58,658 creating build/lib/unitxt/catalog/templates/safety 2026-01-13T10:36:58,659 copying src/unitxt/catalog/templates/safety/llamaguard.json -> build/lib/unitxt/catalog/templates/safety 2026-01-13T10:36:58,661 copying src/unitxt/catalog/templates/safety/harm_rating.json -> build/lib/unitxt/catalog/templates/safety 2026-01-13T10:36:58,663 creating build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,664 copying src/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,667 copying src/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,669 copying src/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,670 copying src/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,672 copying src/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,674 copying src/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,676 copying src/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,678 copying src/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:36:58,680 creating build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,681 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,684 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,686 copying src/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,688 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,691 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,693 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,695 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,697 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,699 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,701 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,703 copying src/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,705 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,707 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,709 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,711 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,714 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,716 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,720 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:36:58,723 creating build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,725 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,728 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,731 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,734 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,737 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,740 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:36:58,742 creating build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,743 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,745 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,747 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,749 copying src/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,751 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,753 copying src/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,755 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,757 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,759 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:36:58,762 creating build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,763 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,765 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,768 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,770 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,773 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,775 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,777 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,779 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,782 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,784 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,786 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,789 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,791 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,793 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,796 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:36:58,799 creating build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,801 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,805 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,809 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,812 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,815 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,817 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,819 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:36:58,821 creating build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:36:58,822 copying src/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:36:58,824 copying src/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:36:58,826 creating build/lib/unitxt/catalog/templates/language_identification 2026-01-13T10:36:58,826 copying src/unitxt/catalog/templates/language_identification/all.json -> build/lib/unitxt/catalog/templates/language_identification 2026-01-13T10:36:58,828 copying src/unitxt/catalog/templates/language_identification/simple.json -> build/lib/unitxt/catalog/templates/language_identification 2026-01-13T10:36:58,830 creating build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,832 copying src/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,834 copying src/unitxt/catalog/templates/classification/multi_label/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,836 copying src/unitxt/catalog/templates/classification/multi_label/default.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,838 copying src/unitxt/catalog/templates/classification/multi_label/title.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,840 copying src/unitxt/catalog/templates/classification/multi_label/all.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:36:58,842 creating build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,843 copying src/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,846 copying src/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,848 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,850 copying src/unitxt/catalog/templates/classification/multi_class/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,852 copying src/unitxt/catalog/templates/classification/multi_class/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,855 copying src/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,857 copying src/unitxt/catalog/templates/classification/multi_class/title.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,859 copying src/unitxt/catalog/templates/classification/multi_class/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,861 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:36:58,863 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:36:58,865 copying src/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:36:58,868 copying src/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:36:58,871 copying src/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:36:58,874 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,876 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,880 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,883 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,887 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,890 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,895 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,899 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,903 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:36:58,908 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,911 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,916 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,922 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,927 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,931 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,933 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,936 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,938 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:36:58,940 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:58,941 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:58,944 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:58,946 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:58,949 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:36:58,951 creating build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,952 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,955 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,958 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,961 copying src/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,964 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,966 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,969 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:36:58,971 creating build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:36:58,973 copying src/unitxt/catalog/templates/selection/by_attribute/default.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:36:58,976 copying src/unitxt/catalog/templates/selection/by_attribute/all.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:36:58,979 creating build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,982 copying src/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,985 copying src/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,988 copying src/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,991 copying src/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,994 copying src/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:58,998 copying src/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:36:59,002 creating build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-13T10:36:59,004 copying src/unitxt/catalog/templates/completion/abstractive/empty.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-13T10:36:59,009 copying src/unitxt/catalog/templates/completion/abstractive/standard.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-13T10:36:59,014 copying src/unitxt/catalog/templates/completion/abstractive/all.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-13T10:36:59,017 creating build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,018 copying src/unitxt/catalog/metrics/anls.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,020 copying src/unitxt/catalog/metrics/spearman.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,022 copying src/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,024 copying src/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,027 copying src/unitxt/catalog/metrics/kendalltau_b.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,030 copying src/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,032 copying src/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,034 copying src/unitxt/catalog/metrics/kpa.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,037 copying src/unitxt/catalog/metrics/tool_calling.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,040 copying src/unitxt/catalog/metrics/max_accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,043 copying src/unitxt/catalog/metrics/squad.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,046 copying src/unitxt/catalog/metrics/regard_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,050 copying src/unitxt/catalog/metrics/rouge.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,054 copying src/unitxt/catalog/metrics/f1_micro.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,058 copying src/unitxt/catalog/metrics/recall_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,062 copying src/unitxt/catalog/metrics/root_mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,066 copying src/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,071 copying src/unitxt/catalog/metrics/f1_macro.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,077 copying src/unitxt/catalog/metrics/max_f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,082 copying src/unitxt/catalog/metrics/matthews_correlation.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,084 copying src/unitxt/catalog/metrics/is_code_mixed.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,086 copying src/unitxt/catalog/metrics/bleu.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,088 copying src/unitxt/catalog/metrics/ndcg.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,091 copying src/unitxt/catalog/metrics/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,093 copying src/unitxt/catalog/metrics/meteor_hf.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,095 copying src/unitxt/catalog/metrics/rerank_recall.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,097 copying src/unitxt/catalog/metrics/relaxed_correctness.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,100 copying src/unitxt/catalog/metrics/pearson.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,102 copying src/unitxt/catalog/metrics/accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,105 copying src/unitxt/catalog/metrics/websrc_squad_f1.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,108 copying src/unitxt/catalog/metrics/map.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,112 copying src/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,116 copying src/unitxt/catalog/metrics/roc_auc.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,119 copying src/unitxt/catalog/metrics/token_overlap_with_context.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,121 copying src/unitxt/catalog/metrics/jaccard_index_words.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,124 copying src/unitxt/catalog/metrics/fuzzyner.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,127 copying src/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,129 copying src/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,133 copying src/unitxt/catalog/metrics/mrr.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,134 copying src/unitxt/catalog/metrics/safety_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,137 copying src/unitxt/catalog/metrics/meteor.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,139 copying src/unitxt/catalog/metrics/f1_weighted.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,141 copying src/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,143 copying src/unitxt/catalog/metrics/precision_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,145 copying src/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,147 copying src/unitxt/catalog/metrics/char_edit_distance.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,150 copying src/unitxt/catalog/metrics/ner.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,152 copying src/unitxt/catalog/metrics/string_containment_ratio.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,154 copying src/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,157 copying src/unitxt/catalog/metrics/string_containment.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,159 copying src/unitxt/catalog/metrics/mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,163 copying src/unitxt/catalog/metrics/sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,166 copying src/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,169 copying src/unitxt/catalog/metrics/exact_match_mm.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,173 copying src/unitxt/catalog/metrics/metric_based_ner.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,177 copying src/unitxt/catalog/metrics/accuracy.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,179 copying src/unitxt/catalog/metrics/f1_strings.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,181 copying src/unitxt/catalog/metrics/jaccard_index.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,183 copying src/unitxt/catalog/metrics/prediction_length.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,186 copying src/unitxt/catalog/metrics/wer.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,190 copying src/unitxt/catalog/metrics/token_overlap.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,193 copying src/unitxt/catalog/metrics/f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,197 copying src/unitxt/catalog/metrics/fin_qa_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-13T10:36:59,200 creating build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-13T10:36:59,202 copying src/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-13T10:36:59,208 copying src/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-13T10:36:59,212 copying src/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-13T10:36:59,215 creating build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,216 copying src/unitxt/catalog/metrics/rag/answer_inference.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,218 copying src/unitxt/catalog/metrics/rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,220 copying src/unitxt/catalog/metrics/rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,222 copying src/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,226 copying src/unitxt/catalog/metrics/rag/context_perplexity.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,229 copying src/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,231 copying src/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,234 copying src/unitxt/catalog/metrics/rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,237 copying src/unitxt/catalog/metrics/rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,239 copying src/unitxt/catalog/metrics/rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-13T10:36:59,241 creating build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,242 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,244 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,246 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,249 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,253 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,256 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,259 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,261 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,264 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,268 copying src/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,271 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,274 copying src/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,276 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,280 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,283 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,286 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,289 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,291 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:36:59,293 creating build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:36:59,294 copying src/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:36:59,296 copying src/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:36:59,299 copying src/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:36:59,301 creating build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,302 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,305 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,307 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,310 copying src/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,313 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,315 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:36:59,317 creating build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,319 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,322 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,324 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,327 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,329 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,332 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,335 copying src/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,338 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,342 copying src/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:36:59,346 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,349 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,354 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,359 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,365 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,370 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,376 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,382 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,388 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,394 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,401 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,409 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,417 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,424 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,431 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,437 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,443 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,449 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:36:59,455 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-13T10:36:59,458 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-13T10:36:59,460 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-13T10:36:59,461 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-13T10:36:59,464 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-13T10:36:59,465 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-13T10:36:59,467 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-13T10:36:59,468 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-13T10:36:59,470 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-13T10:36:59,471 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-13T10:36:59,473 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,474 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,476 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,479 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,481 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,483 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,485 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,487 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,489 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,491 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,494 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,496 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,499 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,503 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:36:59,507 creating build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-13T10:36:59,508 copying src/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-13T10:36:59,514 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,516 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,520 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,522 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,525 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,528 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,530 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,534 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,537 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,541 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,543 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,547 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,550 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,552 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,555 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,558 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,561 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:36:59,564 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-13T10:36:59,565 copying src/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-13T10:36:59,568 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-13T10:36:59,570 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-13T10:36:59,573 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:36:59,575 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:36:59,579 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:36:59,581 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-13T10:36:59,582 copying src/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-13T10:36:59,585 creating build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,587 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,590 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,592 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,595 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,598 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:36:59,601 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,602 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,605 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,608 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,611 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,614 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,617 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,620 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,622 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,625 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,628 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,631 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,633 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,635 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,637 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,639 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,641 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,643 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:36:59,645 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:36:59,646 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:36:59,649 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:36:59,651 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:36:59,653 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-13T10:36:59,654 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-13T10:36:59,656 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-13T10:36:59,657 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-13T10:36:59,659 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-13T10:36:59,660 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-13T10:36:59,662 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-13T10:36:59,663 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-13T10:36:59,666 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-13T10:36:59,667 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-13T10:36:59,669 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,670 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,672 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,674 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,676 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,678 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,681 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,683 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,685 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,687 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,689 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,691 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,693 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,695 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:36:59,697 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,698 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,701 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,703 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,705 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,710 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,712 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,714 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,717 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,719 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,721 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,724 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,726 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,729 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,731 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,733 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:36:59,735 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,736 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,738 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,740 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,742 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,744 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,746 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,748 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,751 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,753 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,755 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,757 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,759 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,761 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,763 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,765 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,767 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:36:59,769 creating build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,771 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,773 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,775 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,777 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,779 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,781 copying src/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,783 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,785 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,787 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,789 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:36:59,791 creating build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,792 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,794 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,796 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,799 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,801 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:36:59,803 creating build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,804 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,807 copying src/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,810 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,813 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,815 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:36:59,818 creating build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,819 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,821 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,824 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,826 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,828 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,830 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,832 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,834 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,836 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,839 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,841 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,843 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,845 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,847 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,849 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,852 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,854 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:36:59,856 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:36:59,857 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:36:59,859 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:36:59,861 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:36:59,863 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-13T10:36:59,865 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-13T10:36:59,867 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-13T10:36:59,868 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-13T10:36:59,870 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-13T10:36:59,871 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-13T10:36:59,874 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-13T10:36:59,875 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-13T10:36:59,877 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-13T10:36:59,878 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-13T10:36:59,880 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,881 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,883 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,885 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,890 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,892 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,894 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,897 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,899 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,901 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,903 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,905 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,907 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,910 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:36:59,912 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,913 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,915 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,917 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,919 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,922 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,924 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,926 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,928 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,930 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,932 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,934 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,936 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,938 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,940 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,943 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:36:59,944 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,945 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,948 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,950 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,953 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,955 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,957 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,959 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,962 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,965 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,967 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,969 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,972 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,974 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,976 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,978 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,980 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:36:59,983 creating build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-13T10:36:59,984 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-13T10:36:59,987 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-13T10:36:59,989 creating build/lib/unitxt/catalog/metrics/reward 2026-01-13T10:36:59,990 copying src/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/lib/unitxt/catalog/metrics/reward 2026-01-13T10:36:59,992 creating build/lib/unitxt/catalog/metrics/perplexity_q 2026-01-13T10:36:59,993 copying src/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_q 2026-01-13T10:36:59,995 creating build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:36:59,996 copying src/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:36:59,999 copying src/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:00,001 copying src/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:00,003 copying src/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:00,005 copying src/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:00,008 copying src/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:00,010 creating build/lib/unitxt/catalog/metrics/perplexity_nli 2026-01-13T10:37:00,011 copying src/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/lib/unitxt/catalog/metrics/perplexity_nli 2026-01-13T10:37:00,013 creating build/lib/unitxt/catalog/metrics/tool_calling 2026-01-13T10:37:00,014 copying src/unitxt/catalog/metrics/tool_calling/reflection.json -> build/lib/unitxt/catalog/metrics/tool_calling 2026-01-13T10:37:00,017 creating build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-01-13T10:37:00,018 copying src/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-01-13T10:37:00,020 creating build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:00,021 copying src/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:00,024 copying src/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:00,026 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-13T10:37:00,027 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-13T10:37:00,029 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-13T10:37:00,030 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-13T10:37:00,033 creating build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-01-13T10:37:00,034 copying src/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-01-13T10:37:00,036 creating build/lib/unitxt/catalog/metrics/text2sql 2026-01-13T10:37:00,037 copying src/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-13T10:37:00,039 copying src/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-13T10:37:00,041 copying src/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-13T10:37:00,043 creating build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:00,045 copying src/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:00,047 copying src/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:00,049 creating build/lib/unitxt/catalog/metrics/qa/open 2026-01-13T10:37:00,051 copying src/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-13T10:37:00,053 copying src/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-13T10:37:00,055 copying src/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-13T10:37:00,058 creating build/lib/unitxt/catalog/metrics/perplexity_a 2026-01-13T10:37:00,058 copying src/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_a 2026-01-13T10:37:00,061 creating build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,061 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,064 copying src/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,066 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,068 copying src/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,070 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,073 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,075 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,078 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,080 copying src/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,082 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,085 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,087 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,089 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,092 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,094 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,096 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,099 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,102 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,104 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-13T10:37:00,106 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:00,108 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:00,111 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:00,113 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:00,115 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,116 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,118 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,122 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,125 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,129 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,133 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:00,137 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,139 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,141 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,144 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,146 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,148 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,150 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,152 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,154 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,156 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:00,158 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,158 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,161 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,163 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,165 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,167 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:00,169 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,170 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,173 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,175 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,177 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,179 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,181 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,185 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,187 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,190 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,192 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,194 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,197 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:00,199 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,201 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,204 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,207 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,209 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,211 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,214 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,217 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:00,219 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,220 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,222 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,224 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,226 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,229 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,231 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:00,233 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:00,234 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:00,237 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:00,239 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,240 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,242 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,245 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,247 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,249 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,251 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,253 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:00,255 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,256 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,259 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,261 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,263 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,265 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,267 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,269 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,271 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,273 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:00,275 creating build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,276 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,278 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,280 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,283 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,286 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,288 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,290 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,292 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,294 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,296 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,298 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,300 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,302 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,304 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,306 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,308 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,311 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,313 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:00,315 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,315 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,318 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,320 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,322 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,324 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,326 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:00,328 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-13T10:37:00,329 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-13T10:37:00,332 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-13T10:37:00,333 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-13T10:37:00,335 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-13T10:37:00,336 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-13T10:37:00,338 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:00,340 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:00,342 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:00,344 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:00,346 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,347 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,350 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,352 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,354 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,356 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,358 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:00,360 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,361 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,363 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,365 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,368 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,370 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,372 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,374 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,376 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,378 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:00,380 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,381 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,383 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,386 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,388 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,390 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:00,392 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,393 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,395 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,397 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,399 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,402 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,405 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,407 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,410 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,412 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,414 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,417 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,419 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:00,422 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,423 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,426 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,429 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,433 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,436 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,441 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,445 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,447 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,449 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,451 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,453 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,455 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,457 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,459 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,461 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,463 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,465 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,468 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,470 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,472 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,474 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,476 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,478 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,480 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,482 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,485 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,487 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,489 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,491 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,493 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,495 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,497 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,499 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,501 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,503 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,505 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,507 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,509 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,511 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,514 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,516 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,518 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,520 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,522 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,524 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,526 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,528 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,530 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,532 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,535 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,537 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,539 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,542 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,544 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,546 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,548 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,550 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,552 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,554 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,556 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,558 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,560 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,563 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,565 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,567 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,569 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:00,572 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,573 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,575 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,577 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,580 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,582 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,584 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:00,586 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:00,587 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:00,589 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:00,591 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,592 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,594 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,596 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,598 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,600 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,603 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,605 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:00,606 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,607 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,610 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,611 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,614 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,616 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,618 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,621 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,623 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,625 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:00,627 creating build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:00,628 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:00,630 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:00,632 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:00,633 copying src/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:00,635 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:00,637 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:00,639 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-13T10:37:00,640 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-13T10:37:00,642 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:00,643 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:00,645 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:00,647 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:00,649 creating build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,651 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,653 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,655 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,657 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,659 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,661 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:00,663 creating build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-13T10:37:00,664 copying src/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-13T10:37:00,666 creating build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,667 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,669 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,671 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,673 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,675 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:00,677 creating build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:00,678 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:00,681 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:00,683 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:00,685 creating build/lib/unitxt/catalog/metrics/perplexity_chat 2026-01-13T10:37:00,686 copying src/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_chat 2026-01-13T10:37:00,688 creating build/lib/unitxt/catalog/metrics/perplexity 2026-01-13T10:37:00,689 copying src/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity 2026-01-13T10:37:00,691 creating build/lib/unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:00,692 copying src/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:00,694 copying src/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:00,696 creating build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,697 copying src/unitxt/catalog/benchmarks/tool_calling.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,700 copying src/unitxt/catalog/benchmarks/bluebench.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,702 copying src/unitxt/catalog/benchmarks/vision_default.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,704 copying src/unitxt/catalog/benchmarks/vision_full.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,706 copying src/unitxt/catalog/benchmarks/torr.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,710 copying src/unitxt/catalog/benchmarks/llama_vision.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,712 copying src/unitxt/catalog/benchmarks/glue.json -> build/lib/unitxt/catalog/benchmarks 2026-01-13T10:37:00,714 creating build/lib/unitxt/catalog/augmentors 2026-01-13T10:37:00,715 copying src/unitxt/catalog/augmentors/no_augmentation.json -> build/lib/unitxt/catalog/augmentors 2026-01-13T10:37:00,717 copying src/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-01-13T10:37:00,719 copying src/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-01-13T10:37:00,722 creating build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,723 copying src/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,725 copying src/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,728 copying src/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,730 copying src/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,733 copying src/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,735 copying src/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,738 copying src/unitxt/catalog/augmentors/table/truncate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,740 copying src/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,743 copying src/unitxt/catalog/augmentors/table/transpose.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-13T10:37:00,746 creating build/lib/unitxt/catalog/augmentors/text 2026-01-13T10:37:00,748 copying src/unitxt/catalog/augmentors/text/white_space.json -> build/lib/unitxt/catalog/augmentors/text 2026-01-13T10:37:00,751 copying src/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/lib/unitxt/catalog/augmentors/text 2026-01-13T10:37:00,754 creating build/lib/unitxt/catalog/augmentors/image 2026-01-13T10:37:00,755 copying src/unitxt/catalog/augmentors/image/grey_scale.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-13T10:37:00,757 copying src/unitxt/catalog/augmentors/image/oldify.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-13T10:37:00,759 copying src/unitxt/catalog/augmentors/image/grid_lines.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-13T10:37:00,761 copying src/unitxt/catalog/augmentors/image/white_noise.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-13T10:37:00,762 creating build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,763 copying src/unitxt/catalog/cards/20_newsgroups_short.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,765 copying src/unitxt/catalog/cards/simple_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,767 copying src/unitxt/catalog/cards/unfair_tos.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,770 copying src/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,773 copying src/unitxt/catalog/cards/race_middle.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,775 copying src/unitxt/catalog/cards/news_category_classification_headline.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,778 copying src/unitxt/catalog/cards/law_stack_exchange.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,780 copying src/unitxt/catalog/cards/mbpp.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,782 copying src/unitxt/catalog/cards/medical_abstracts.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,784 copying src/unitxt/catalog/cards/bold.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,786 copying src/unitxt/catalog/cards/argument_topic.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,789 copying src/unitxt/catalog/cards/tldr.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,791 copying src/unitxt/catalog/cards/attaq_500.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,800 copying src/unitxt/catalog/cards/ethos_binary.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,807 copying src/unitxt/catalog/cards/squad.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,813 copying src/unitxt/catalog/cards/social_iqa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,819 copying src/unitxt/catalog/cards/human_eval.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,824 copying src/unitxt/catalog/cards/claim_stance_topic.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,830 copying src/unitxt/catalog/cards/financial_tweets.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,834 copying src/unitxt/catalog/cards/qnli.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,836 copying src/unitxt/catalog/cards/openbook_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,839 copying src/unitxt/catalog/cards/numeric_nlg.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,841 copying src/unitxt/catalog/cards/20_newsgroups.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,843 copying src/unitxt/catalog/cards/scigen.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,845 copying src/unitxt/catalog/cards/cola.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,847 copying src/unitxt/catalog/cards/coedit_gec.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,850 copying src/unitxt/catalog/cards/tablerow_classify.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,853 copying src/unitxt/catalog/cards/toxigen.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,856 copying src/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,860 copying src/unitxt/catalog/cards/trec.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,863 copying src/unitxt/catalog/cards/rte.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,866 copying src/unitxt/catalog/cards/billsum.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,868 copying src/unitxt/catalog/cards/tablebench.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,870 copying src/unitxt/catalog/cards/copa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,872 copying src/unitxt/catalog/cards/wiki_bio.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,874 copying src/unitxt/catalog/cards/tablebench_fact_checking.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,876 copying src/unitxt/catalog/cards/chart_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,878 copying src/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,881 copying src/unitxt/catalog/cards/atis.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,884 copying src/unitxt/catalog/cards/tab_fact.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,886 copying src/unitxt/catalog/cards/hellaswag.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,889 copying src/unitxt/catalog/cards/atta_q.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,890 copying src/unitxt/catalog/cards/frames.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,893 copying src/unitxt/catalog/cards/wnli.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,895 copying src/unitxt/catalog/cards/mnli.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,897 copying src/unitxt/catalog/cards/dbpedia_14.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,899 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,902 copying src/unitxt/catalog/cards/info_vqa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,905 copying src/unitxt/catalog/cards/qqp.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,908 copying src/unitxt/catalog/cards/race_all.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,911 copying src/unitxt/catalog/cards/cnn_dailymail.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,913 copying src/unitxt/catalog/cards/long_bench_v2.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,915 copying src/unitxt/catalog/cards/stsb.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,918 copying src/unitxt/catalog/cards/attaq.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,920 copying src/unitxt/catalog/cards/tablebench_data_analysis.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,922 copying src/unitxt/catalog/cards/ledgar.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,926 copying src/unitxt/catalog/cards/quality.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,928 copying src/unitxt/catalog/cards/turl_col_type.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,933 copying src/unitxt/catalog/cards/yahoo_answers_topics.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,937 copying src/unitxt/catalog/cards/pop_qa_robust.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,940 copying src/unitxt/catalog/cards/pop_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,943 copying src/unitxt/catalog/cards/banking77.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,945 copying src/unitxt/catalog/cards/coedit_error_detection.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,948 copying src/unitxt/catalog/cards/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,950 copying src/unitxt/catalog/cards/sciq.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,953 copying src/unitxt/catalog/cards/hh_rlhf.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,955 copying src/unitxt/catalog/cards/dart.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,958 copying src/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,960 copying src/unitxt/catalog/cards/almost_evil.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,962 copying src/unitxt/catalog/cards/fin_qa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,965 copying src/unitxt/catalog/cards/ai2d.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,967 copying src/unitxt/catalog/cards/seed_bench.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,969 copying src/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,971 copying src/unitxt/catalog/cards/ag_news.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,973 copying src/unitxt/catalog/cards/wsc.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,975 copying src/unitxt/catalog/cards/qtsumm.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,977 copying src/unitxt/catalog/cards/race_high.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,979 copying src/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,981 copying src/unitxt/catalog/cards/websrc.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,983 copying src/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,986 copying src/unitxt/catalog/cards/piqa.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,988 copying src/unitxt/catalog/cards/wikitq.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,991 copying src/unitxt/catalog/cards/language_identification.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,994 copying src/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,996 copying src/unitxt/catalog/cards/xsum.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:00,998 copying src/unitxt/catalog/cards/sst2.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:01,000 copying src/unitxt/catalog/cards/mrpc.json -> build/lib/unitxt/catalog/cards 2026-01-13T10:37:01,003 creating build/lib/unitxt/catalog/cards/rag 2026-01-13T10:37:01,004 copying src/unitxt/catalog/cards/rag/mtrag.json -> build/lib/unitxt/catalog/cards/rag 2026-01-13T10:37:01,007 creating build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-01-13T10:37:01,009 copying src/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-01-13T10:37:01,013 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-13T10:37:01,015 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-13T10:37:01,017 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-13T10:37:01,018 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-13T10:37:01,020 creating build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-13T10:37:01,021 copying src/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-13T10:37:01,023 creating build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-13T10:37:01,024 copying src/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-13T10:37:01,027 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-13T10:37:01,028 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-13T10:37:01,030 creating build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-13T10:37:01,031 copying src/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-13T10:37:01,035 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-13T10:37:01,036 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-13T10:37:01,039 creating build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-13T10:37:01,040 copying src/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-13T10:37:01,042 creating build/lib/unitxt/catalog/cards/rag/response_generation 2026-01-13T10:37:01,043 copying src/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation 2026-01-13T10:37:01,045 creating build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:01,046 copying src/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:01,048 copying src/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:01,050 creating build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,051 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,053 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,055 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,057 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,059 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,062 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,064 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,066 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,068 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,071 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,075 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,079 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:01,084 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,087 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,090 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,092 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,095 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,097 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:01,099 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,101 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,103 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,105 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,107 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,110 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:01,112 creating build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:01,114 copying src/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:01,116 copying src/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:01,118 copying src/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:01,120 copying src/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:01,122 creating build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-13T10:37:01,124 copying src/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-13T10:37:01,126 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-13T10:37:01,127 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-13T10:37:01,129 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-13T10:37:01,131 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-13T10:37:01,133 creating build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-13T10:37:01,134 copying src/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-13T10:37:01,136 creating build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-13T10:37:01,137 copying src/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-13T10:37:01,139 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-13T10:37:01,140 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-13T10:37:01,143 creating build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-13T10:37:01,144 copying src/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-13T10:37:01,146 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-13T10:37:01,147 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-13T10:37:01,149 creating build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-13T10:37:01,150 copying src/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-13T10:37:01,153 creating build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,155 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,158 copying src/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,161 copying src/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,165 copying src/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,169 copying src/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,387 copying src/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,390 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,392 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,395 copying src/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,397 copying src/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,400 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,402 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,404 copying src/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,407 copying src/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,409 copying src/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,412 copying src/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,414 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,417 copying src/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,419 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,421 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,424 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,427 copying src/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,431 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,434 copying src/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,437 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,440 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,442 copying src/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,445 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,447 copying src/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,449 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,451 copying src/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,453 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,455 copying src/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,457 copying src/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,460 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,462 copying src/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,464 copying src/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,466 copying src/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,468 copying src/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,471 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,473 copying src/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,475 copying src/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,478 copying src/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,480 copying src/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,482 copying src/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,485 copying src/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,488 copying src/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,491 copying src/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,493 copying src/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,496 copying src/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,498 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,501 copying src/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,504 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,507 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,511 copying src/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,514 copying src/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,517 copying src/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:01,521 creating build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,522 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,525 copying src/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,527 copying src/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,529 copying src/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,531 copying src/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,533 copying src/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,535 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,538 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,540 copying src/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,542 copying src/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,544 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,546 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,548 copying src/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,550 copying src/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,553 copying src/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,555 copying src/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,557 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,559 copying src/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,561 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,563 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,565 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,568 copying src/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,571 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,573 copying src/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,575 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,578 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,580 copying src/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,582 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,585 copying src/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,589 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,593 copying src/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,598 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,602 copying src/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,605 copying src/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,607 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,609 copying src/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,611 copying src/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,613 copying src/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,616 copying src/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,618 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,620 copying src/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,622 copying src/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,625 copying src/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,627 copying src/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,629 copying src/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,631 copying src/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,633 copying src/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,636 copying src/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,638 copying src/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,640 copying src/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,642 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,645 copying src/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,648 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,650 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,652 copying src/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,654 copying src/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,656 copying src/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:01,658 creating build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,659 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,662 copying src/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,665 copying src/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,669 copying src/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,673 copying src/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,677 copying src/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,682 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,686 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,691 copying src/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,695 copying src/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,699 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,703 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,707 copying src/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,709 copying src/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,712 copying src/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,714 copying src/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,716 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,718 copying src/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,721 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,723 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,725 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,727 copying src/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,729 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,732 copying src/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,735 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,738 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,740 copying src/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,742 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,748 copying src/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,754 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,758 copying src/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,761 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,765 copying src/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,768 copying src/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,772 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,774 copying src/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,778 copying src/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,782 copying src/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,785 copying src/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,788 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,791 copying src/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,794 copying src/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,797 copying src/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,800 copying src/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,802 copying src/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,805 copying src/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,808 copying src/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,811 copying src/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,813 copying src/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,816 copying src/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,819 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,821 copying src/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,824 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,827 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,830 copying src/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,832 copying src/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,835 copying src/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:01,837 creating build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,839 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,842 copying src/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,844 copying src/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,847 copying src/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,849 copying src/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,851 copying src/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,854 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,856 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,858 copying src/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,860 copying src/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,863 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,865 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,867 copying src/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,869 copying src/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,871 copying src/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,874 copying src/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,876 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,878 copying src/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,881 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,883 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,885 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,887 copying src/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,889 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,891 copying src/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,893 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,895 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,898 copying src/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,900 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,902 copying src/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,904 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,906 copying src/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,908 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,910 copying src/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,912 copying src/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,915 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,917 copying src/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,919 copying src/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,921 copying src/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,923 copying src/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,925 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,928 copying src/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,930 copying src/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,933 copying src/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,935 copying src/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,937 copying src/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,939 copying src/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,942 copying src/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,944 copying src/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,946 copying src/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,948 copying src/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,950 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,952 copying src/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,954 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,957 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,959 copying src/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,961 copying src/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,963 copying src/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:01,965 creating build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,966 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,968 copying src/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,970 copying src/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,973 copying src/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,975 copying src/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,978 copying src/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,980 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,983 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,985 copying src/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,988 copying src/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,990 copying src/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,993 copying src/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,995 copying src/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:01,998 copying src/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,000 copying src/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,003 copying src/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,006 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,008 copying src/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,011 copying src/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,013 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,016 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,018 copying src/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,020 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,023 copying src/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,025 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,028 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,030 copying src/unitxt/catalog/cards/global_mmlu/de/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,033 copying src/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,035 copying src/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,038 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,040 copying src/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,043 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,046 copying src/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,048 copying src/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,051 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,053 copying src/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,056 copying src/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,058 copying src/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,061 copying src/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,063 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,066 copying src/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,068 copying src/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,071 copying src/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,073 copying src/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,076 copying src/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,079 copying src/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,081 copying src/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,083 copying src/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,086 copying src/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,089 copying src/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,091 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,093 copying src/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,096 copying src/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,098 copying src/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,101 copying src/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,103 copying src/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,106 copying src/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:02,109 creating build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,110 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,113 copying src/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,115 copying src/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,118 copying src/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,121 copying src/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,124 copying src/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,127 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,129 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,132 copying src/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,134 copying src/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,137 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,139 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,142 copying src/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,144 copying src/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,146 copying src/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,149 copying src/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,151 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,154 copying src/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,156 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,158 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,160 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,162 copying src/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,165 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,167 copying src/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,169 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,172 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,174 copying src/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,176 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,179 copying src/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,181 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,183 copying src/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,186 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,188 copying src/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,191 copying src/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,193 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,195 copying src/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,197 copying src/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,200 copying src/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,202 copying src/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,204 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,206 copying src/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,209 copying src/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,211 copying src/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,214 copying src/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,216 copying src/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,218 copying src/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,221 copying src/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,224 copying src/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,226 copying src/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,228 copying src/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,230 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,234 copying src/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,237 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,239 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,241 copying src/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,245 copying src/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,248 copying src/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:02,250 creating build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,252 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,254 copying src/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,256 copying src/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,259 copying src/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,261 copying src/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,263 copying src/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,265 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,268 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,270 copying src/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,272 copying src/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,274 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,276 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,279 copying src/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,281 copying src/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,283 copying src/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,285 copying src/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,287 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,289 copying src/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,292 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,294 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,298 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,300 copying src/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,302 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,304 copying src/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,306 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,309 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,311 copying src/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,313 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,315 copying src/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,317 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,320 copying src/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,322 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,324 copying src/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,326 copying src/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,328 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,330 copying src/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,333 copying src/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,335 copying src/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,337 copying src/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,339 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,341 copying src/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,344 copying src/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,346 copying src/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,348 copying src/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,350 copying src/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,352 copying src/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,354 copying src/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,356 copying src/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,359 copying src/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,361 copying src/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,363 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,365 copying src/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,367 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,369 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,371 copying src/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,373 copying src/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,375 copying src/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:02,377 creating build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,378 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,381 copying src/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,383 copying src/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,386 copying src/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,388 copying src/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,390 copying src/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,393 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,395 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,397 copying src/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,399 copying src/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,401 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,404 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,406 copying src/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,408 copying src/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,410 copying src/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,412 copying src/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,414 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,416 copying src/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,418 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,420 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,423 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,425 copying src/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,427 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,429 copying src/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,431 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,434 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,436 copying src/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,438 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,440 copying src/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,443 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,445 copying src/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,447 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,449 copying src/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,452 copying src/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,454 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,456 copying src/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,458 copying src/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,460 copying src/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,463 copying src/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,465 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,467 copying src/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,469 copying src/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,471 copying src/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,473 copying src/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,475 copying src/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,477 copying src/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,479 copying src/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,482 copying src/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,484 copying src/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,486 copying src/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,489 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,491 copying src/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,493 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,495 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,497 copying src/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,499 copying src/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,502 copying src/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:02,504 creating build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,505 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,508 copying src/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,510 copying src/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,512 copying src/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,514 copying src/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,516 copying src/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,519 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,521 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,523 copying src/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,525 copying src/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,528 copying src/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,530 copying src/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,532 copying src/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,535 copying src/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,537 copying src/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,540 copying src/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,542 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,544 copying src/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,547 copying src/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,551 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,554 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,557 copying src/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,559 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,562 copying src/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,565 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,567 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,570 copying src/unitxt/catalog/cards/global_mmlu/el/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,573 copying src/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,575 copying src/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,578 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,581 copying src/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,584 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,587 copying src/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,589 copying src/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,592 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,595 copying src/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,598 copying src/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,601 copying src/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,603 copying src/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,606 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,609 copying src/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,612 copying src/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,615 copying src/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,618 copying src/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,620 copying src/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,623 copying src/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,626 copying src/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,629 copying src/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,632 copying src/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,635 copying src/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,638 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,641 copying src/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,644 copying src/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,647 copying src/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,649 copying src/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,652 copying src/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,654 copying src/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:02,656 creating build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,657 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,660 copying src/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,662 copying src/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,664 copying src/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,666 copying src/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,668 copying src/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,671 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,673 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,675 copying src/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,677 copying src/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,679 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,682 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,684 copying src/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,686 copying src/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,689 copying src/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,692 copying src/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,695 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,698 copying src/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,701 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,705 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,708 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,710 copying src/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,712 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,715 copying src/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,717 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,720 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,722 copying src/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,724 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,727 copying src/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,729 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,731 copying src/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,733 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,736 copying src/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,738 copying src/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,740 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,742 copying src/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,745 copying src/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,747 copying src/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,749 copying src/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,751 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,754 copying src/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,757 copying src/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,760 copying src/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,762 copying src/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,765 copying src/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,768 copying src/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,771 copying src/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,775 copying src/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,780 copying src/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,785 copying src/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,790 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,794 copying src/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,796 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,799 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,801 copying src/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,803 copying src/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,806 copying src/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:02,808 creating build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,809 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,811 copying src/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,814 copying src/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,816 copying src/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,819 copying src/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,821 copying src/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,823 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,825 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,827 copying src/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,830 copying src/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,832 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,834 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,836 copying src/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,838 copying src/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,841 copying src/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,843 copying src/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,845 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,848 copying src/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,850 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,852 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,854 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,856 copying src/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,859 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,861 copying src/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,864 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,866 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,868 copying src/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,871 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,874 copying src/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,876 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,878 copying src/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,881 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,883 copying src/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,885 copying src/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,888 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,891 copying src/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,893 copying src/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,895 copying src/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,897 copying src/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,899 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,902 copying src/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,904 copying src/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,906 copying src/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,908 copying src/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,910 copying src/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,912 copying src/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,915 copying src/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,917 copying src/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,920 copying src/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,922 copying src/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,925 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,928 copying src/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,932 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,935 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,938 copying src/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,941 copying src/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,943 copying src/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:02,945 creating build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,946 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,949 copying src/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,951 copying src/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,953 copying src/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,956 copying src/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,958 copying src/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,960 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,963 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,965 copying src/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,967 copying src/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,970 copying src/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,972 copying src/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,974 copying src/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,976 copying src/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,978 copying src/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,980 copying src/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,982 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,984 copying src/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,987 copying src/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,989 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,991 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,994 copying src/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,996 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:02,998 copying src/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,000 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,002 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,005 copying src/unitxt/catalog/cards/global_mmlu/te/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,007 copying src/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,010 copying src/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,013 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,017 copying src/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,019 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,022 copying src/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,024 copying src/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,027 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,030 copying src/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,033 copying src/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,035 copying src/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,038 copying src/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,040 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,042 copying src/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,044 copying src/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,046 copying src/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,049 copying src/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,051 copying src/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,053 copying src/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,055 copying src/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,058 copying src/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,060 copying src/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,062 copying src/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,064 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,066 copying src/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,069 copying src/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,071 copying src/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,073 copying src/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,075 copying src/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,078 copying src/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:03,080 creating build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,081 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,083 copying src/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,086 copying src/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,088 copying src/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,090 copying src/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,093 copying src/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,095 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,097 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,099 copying src/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,101 copying src/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,103 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,106 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,108 copying src/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,110 copying src/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,112 copying src/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,114 copying src/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,116 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,119 copying src/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,121 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,124 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,126 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,128 copying src/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,130 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,133 copying src/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,136 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,139 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,141 copying src/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,143 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,146 copying src/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,148 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,150 copying src/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,152 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,155 copying src/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,157 copying src/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,159 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,161 copying src/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,163 copying src/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,165 copying src/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,168 copying src/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,170 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,172 copying src/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,174 copying src/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,177 copying src/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,179 copying src/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,182 copying src/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,184 copying src/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,186 copying src/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,189 copying src/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,191 copying src/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,193 copying src/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,195 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,198 copying src/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,200 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,203 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,205 copying src/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,207 copying src/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,210 copying src/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:03,212 creating build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,213 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,216 copying src/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,218 copying src/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,220 copying src/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,223 copying src/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,225 copying src/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,227 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,229 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,231 copying src/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,233 copying src/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,236 copying src/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,238 copying src/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,240 copying src/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,243 copying src/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,245 copying src/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,248 copying src/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,251 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,253 copying src/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,255 copying src/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,257 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,259 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,262 copying src/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,264 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,266 copying src/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,268 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,270 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,273 copying src/unitxt/catalog/cards/global_mmlu/so/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,275 copying src/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,277 copying src/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,280 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,282 copying src/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,284 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,286 copying src/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,288 copying src/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,291 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,293 copying src/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,295 copying src/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,298 copying src/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,300 copying src/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,302 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,304 copying src/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,306 copying src/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,309 copying src/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,311 copying src/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,313 copying src/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,315 copying src/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,318 copying src/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,321 copying src/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,323 copying src/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,326 copying src/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,328 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,331 copying src/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,333 copying src/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,336 copying src/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,338 copying src/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,340 copying src/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,343 copying src/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:03,345 creating build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,346 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,349 copying src/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,351 copying src/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,353 copying src/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,355 copying src/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,358 copying src/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,360 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,362 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,364 copying src/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,367 copying src/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,369 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,371 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,373 copying src/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,376 copying src/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,378 copying src/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,381 copying src/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,383 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,385 copying src/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,388 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,391 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,395 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,398 copying src/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,401 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,403 copying src/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,406 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,409 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,412 copying src/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,414 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,417 copying src/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,420 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,423 copying src/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,426 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,429 copying src/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,431 copying src/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,434 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,437 copying src/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,439 copying src/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,442 copying src/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,444 copying src/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,446 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,449 copying src/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,451 copying src/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,453 copying src/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,455 copying src/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,458 copying src/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,460 copying src/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,462 copying src/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,465 copying src/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,468 copying src/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,470 copying src/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,473 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,476 copying src/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,479 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,482 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,485 copying src/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,488 copying src/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,491 copying src/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:03,494 creating build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,495 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,499 copying src/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,502 copying src/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,508 copying src/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,511 copying src/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,514 copying src/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,517 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,520 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,523 copying src/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,526 copying src/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,529 copying src/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,531 copying src/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,534 copying src/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,536 copying src/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,540 copying src/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,542 copying src/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,545 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,548 copying src/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,552 copying src/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,556 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,560 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,562 copying src/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,567 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,570 copying src/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,574 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,578 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,584 copying src/unitxt/catalog/cards/global_mmlu/am/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,591 copying src/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,594 copying src/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,598 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,601 copying src/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,605 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,609 copying src/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,613 copying src/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,837 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,841 copying src/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,843 copying src/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,846 copying src/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,848 copying src/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,851 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,854 copying src/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,857 copying src/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,860 copying src/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,863 copying src/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,867 copying src/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,873 copying src/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:03,879 copying src/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,321 copying src/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,325 copying src/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,329 copying src/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,334 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,338 copying src/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,342 copying src/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,346 copying src/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,350 copying src/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,354 copying src/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,358 copying src/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:04,362 creating build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,364 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,368 copying src/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,371 copying src/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,375 copying src/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,379 copying src/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,383 copying src/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,387 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,391 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,395 copying src/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,399 copying src/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,404 copying src/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,408 copying src/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,413 copying src/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,417 copying src/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,421 copying src/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,426 copying src/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,430 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,434 copying src/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,438 copying src/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,441 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,444 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,447 copying src/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,450 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,453 copying src/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,456 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,459 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,461 copying src/unitxt/catalog/cards/global_mmlu/id/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,464 copying src/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,467 copying src/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,470 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,472 copying src/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,475 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,478 copying src/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,481 copying src/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,483 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,486 copying src/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,489 copying src/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,492 copying src/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,495 copying src/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,498 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,501 copying src/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,503 copying src/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,506 copying src/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,509 copying src/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,512 copying src/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,515 copying src/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,518 copying src/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,521 copying src/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,523 copying src/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,526 copying src/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,529 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,532 copying src/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,535 copying src/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,537 copying src/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,540 copying src/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,543 copying src/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,545 copying src/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:04,548 creating build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,549 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,551 copying src/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,554 copying src/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,556 copying src/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,559 copying src/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,562 copying src/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,564 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,567 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,569 copying src/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,572 copying src/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,574 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,577 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,580 copying src/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,582 copying src/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,585 copying src/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,588 copying src/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,591 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,593 copying src/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,596 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,598 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,601 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,604 copying src/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,606 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,609 copying src/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,611 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,614 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,616 copying src/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,619 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,621 copying src/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,624 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,626 copying src/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,629 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,632 copying src/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,634 copying src/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,637 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,639 copying src/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,642 copying src/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,644 copying src/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,646 copying src/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,648 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,650 copying src/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,653 copying src/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,655 copying src/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,657 copying src/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,659 copying src/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,661 copying src/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,664 copying src/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,666 copying src/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,668 copying src/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,671 copying src/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,673 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,675 copying src/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,678 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,680 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,682 copying src/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,684 copying src/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,686 copying src/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:04,688 creating build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,689 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,692 copying src/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,694 copying src/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,696 copying src/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,698 copying src/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,700 copying src/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,703 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,705 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,707 copying src/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,709 copying src/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,712 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,714 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,716 copying src/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,719 copying src/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,721 copying src/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,723 copying src/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,725 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,728 copying src/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,730 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,732 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,734 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,737 copying src/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,739 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,742 copying src/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,744 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,746 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,748 copying src/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,750 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,752 copying src/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,755 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,757 copying src/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,759 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,762 copying src/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,764 copying src/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,766 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,768 copying src/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,771 copying src/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,773 copying src/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,775 copying src/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,778 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,780 copying src/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,782 copying src/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,784 copying src/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,787 copying src/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,789 copying src/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,791 copying src/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,793 copying src/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,796 copying src/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,798 copying src/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,800 copying src/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,803 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,805 copying src/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,808 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,810 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,812 copying src/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,815 copying src/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,817 copying src/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:04,819 creating build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,820 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,822 copying src/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,825 copying src/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,827 copying src/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,829 copying src/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,831 copying src/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,834 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,836 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,838 copying src/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,840 copying src/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,843 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,845 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,847 copying src/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,849 copying src/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,852 copying src/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,854 copying src/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,856 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,859 copying src/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,861 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,863 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,865 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,868 copying src/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,870 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,872 copying src/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,874 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,876 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,878 copying src/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,880 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,883 copying src/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,885 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,887 copying src/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,889 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,891 copying src/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,894 copying src/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,896 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,898 copying src/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,900 copying src/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,903 copying src/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,905 copying src/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,907 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,909 copying src/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,912 copying src/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,914 copying src/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,916 copying src/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,919 copying src/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,921 copying src/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,923 copying src/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,925 copying src/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,928 copying src/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,930 copying src/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,933 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,935 copying src/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,937 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,939 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,941 copying src/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,944 copying src/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,946 copying src/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:04,948 creating build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,949 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,951 copying src/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,954 copying src/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,956 copying src/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,958 copying src/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,960 copying src/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,963 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,965 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,967 copying src/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,969 copying src/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,971 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,974 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,976 copying src/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,978 copying src/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,981 copying src/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,983 copying src/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,985 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,988 copying src/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,990 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,993 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,995 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,997 copying src/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:04,999 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,002 copying src/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,004 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,006 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,008 copying src/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,010 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,012 copying src/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,015 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,017 copying src/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,019 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,021 copying src/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,024 copying src/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,026 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,028 copying src/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,030 copying src/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,032 copying src/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,035 copying src/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,037 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,039 copying src/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,041 copying src/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,044 copying src/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,046 copying src/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,049 copying src/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,051 copying src/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,054 copying src/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,057 copying src/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,059 copying src/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,062 copying src/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,064 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,067 copying src/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,069 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,072 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,074 copying src/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,076 copying src/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,079 copying src/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:05,082 creating build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,083 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,086 copying src/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,089 copying src/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,092 copying src/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,096 copying src/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,099 copying src/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,102 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,105 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,107 copying src/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,109 copying src/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,112 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,115 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,117 copying src/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,120 copying src/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,124 copying src/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,127 copying src/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,131 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,135 copying src/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,138 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,140 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,143 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,146 copying src/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,150 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,154 copying src/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,157 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,161 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,164 copying src/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,167 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,170 copying src/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,173 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,176 copying src/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,179 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,181 copying src/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,184 copying src/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,187 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,190 copying src/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,192 copying src/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,195 copying src/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,198 copying src/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,201 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,204 copying src/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,207 copying src/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,210 copying src/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,212 copying src/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,215 copying src/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,218 copying src/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,221 copying src/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,224 copying src/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,227 copying src/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,230 copying src/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,232 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,235 copying src/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,239 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,242 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,244 copying src/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,246 copying src/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,248 copying src/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:05,250 creating build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,251 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,254 copying src/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,256 copying src/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,259 copying src/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,261 copying src/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,263 copying src/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,266 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,268 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,270 copying src/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,272 copying src/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,275 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,277 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,279 copying src/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,281 copying src/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,284 copying src/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,286 copying src/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,289 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,291 copying src/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,293 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,295 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,297 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,299 copying src/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,301 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,304 copying src/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,306 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,308 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,310 copying src/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,312 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,314 copying src/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,316 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,319 copying src/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,321 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,323 copying src/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,325 copying src/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,328 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,330 copying src/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,332 copying src/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,335 copying src/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,338 copying src/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,340 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,343 copying src/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,346 copying src/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,348 copying src/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,351 copying src/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,353 copying src/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,356 copying src/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,358 copying src/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,360 copying src/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,362 copying src/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,365 copying src/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,367 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,369 copying src/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,371 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,373 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,376 copying src/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,378 copying src/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,380 copying src/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:05,382 creating build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,383 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,385 copying src/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,388 copying src/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,390 copying src/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,392 copying src/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,395 copying src/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,397 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,399 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,401 copying src/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,403 copying src/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,405 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,408 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,410 copying src/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,413 copying src/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,415 copying src/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,418 copying src/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,420 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,422 copying src/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,424 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,426 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,428 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,430 copying src/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,432 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,435 copying src/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,437 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,439 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,441 copying src/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,443 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,445 copying src/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,448 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,450 copying src/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,452 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,454 copying src/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,456 copying src/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,459 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,461 copying src/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,464 copying src/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,466 copying src/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,468 copying src/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,470 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,473 copying src/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,475 copying src/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,477 copying src/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,480 copying src/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,482 copying src/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,484 copying src/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,486 copying src/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,489 copying src/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,491 copying src/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,493 copying src/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,495 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,497 copying src/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,500 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,502 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,504 copying src/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,506 copying src/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,509 copying src/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:05,511 creating build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,512 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,514 copying src/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,516 copying src/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,518 copying src/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,521 copying src/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,523 copying src/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,525 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,527 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,530 copying src/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,532 copying src/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,534 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,536 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,539 copying src/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,541 copying src/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,543 copying src/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,546 copying src/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,548 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,550 copying src/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,552 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,554 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,557 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,559 copying src/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,561 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,564 copying src/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,566 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,568 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,571 copying src/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,573 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,575 copying src/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,577 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,579 copying src/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,581 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,584 copying src/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,586 copying src/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,588 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,590 copying src/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,593 copying src/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,595 copying src/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,597 copying src/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,599 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,602 copying src/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,604 copying src/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,606 copying src/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,608 copying src/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,610 copying src/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,612 copying src/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,615 copying src/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,617 copying src/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,619 copying src/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,621 copying src/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,623 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,625 copying src/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,628 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,630 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,632 copying src/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,635 copying src/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,637 copying src/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:05,639 creating build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,640 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,643 copying src/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,645 copying src/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,647 copying src/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,650 copying src/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,652 copying src/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,654 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,656 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,658 copying src/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,660 copying src/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,662 copying src/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,665 copying src/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,667 copying src/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,669 copying src/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,671 copying src/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,673 copying src/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,675 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,677 copying src/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,680 copying src/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,682 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,685 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,687 copying src/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,689 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,691 copying src/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,693 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,696 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,698 copying src/unitxt/catalog/cards/global_mmlu/it/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,700 copying src/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,702 copying src/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,704 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,707 copying src/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,709 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,711 copying src/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,713 copying src/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,715 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,718 copying src/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,720 copying src/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,722 copying src/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,725 copying src/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,728 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,731 copying src/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,733 copying src/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,735 copying src/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,737 copying src/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,739 copying src/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,742 copying src/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,744 copying src/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,746 copying src/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,748 copying src/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,750 copying src/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,752 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,754 copying src/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,756 copying src/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,758 copying src/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,760 copying src/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,763 copying src/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,765 copying src/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:05,767 creating build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,768 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,770 copying src/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,773 copying src/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,775 copying src/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,778 copying src/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,780 copying src/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,782 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,785 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,787 copying src/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,790 copying src/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,793 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,796 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,798 copying src/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,800 copying src/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,803 copying src/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,806 copying src/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,809 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,811 copying src/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,814 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,817 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,819 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,822 copying src/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,824 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,826 copying src/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,829 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,831 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,833 copying src/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,835 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,838 copying src/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,841 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,843 copying src/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,846 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,848 copying src/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,851 copying src/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,853 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,855 copying src/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,857 copying src/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,860 copying src/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,862 copying src/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,865 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,868 copying src/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,870 copying src/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,872 copying src/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,875 copying src/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,877 copying src/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,880 copying src/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,883 copying src/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,885 copying src/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,888 copying src/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,891 copying src/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,894 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,897 copying src/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,899 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,902 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,904 copying src/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,906 copying src/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,908 copying src/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:05,910 creating build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,911 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,914 copying src/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,916 copying src/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,918 copying src/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,921 copying src/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,923 copying src/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,925 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,927 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,930 copying src/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,932 copying src/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,934 copying src/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,936 copying src/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,938 copying src/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,940 copying src/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,943 copying src/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,945 copying src/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,948 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,950 copying src/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,952 copying src/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,954 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,957 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,960 copying src/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,963 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,966 copying src/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,968 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,971 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,974 copying src/unitxt/catalog/cards/global_mmlu/en/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,976 copying src/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,979 copying src/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,982 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,984 copying src/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,986 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,989 copying src/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,991 copying src/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,993 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,995 copying src/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:05,997 copying src/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,000 copying src/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,002 copying src/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,004 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,006 copying src/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,008 copying src/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,010 copying src/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,012 copying src/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,014 copying src/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,017 copying src/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,019 copying src/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,021 copying src/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,024 copying src/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,026 copying src/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,028 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,030 copying src/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,032 copying src/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,035 copying src/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,038 copying src/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,041 copying src/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,044 copying src/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:06,047 creating build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,048 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,051 copying src/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,053 copying src/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,056 copying src/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,059 copying src/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,062 copying src/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,065 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,067 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,070 copying src/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,072 copying src/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,074 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,076 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,079 copying src/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,081 copying src/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,083 copying src/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,085 copying src/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,087 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,089 copying src/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,091 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,094 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,096 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,098 copying src/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,100 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,102 copying src/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,105 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,107 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,109 copying src/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,112 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,115 copying src/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,117 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,120 copying src/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,123 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,125 copying src/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,128 copying src/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,131 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,133 copying src/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,136 copying src/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,138 copying src/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,141 copying src/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,144 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,147 copying src/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,149 copying src/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,152 copying src/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,155 copying src/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,157 copying src/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,160 copying src/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,163 copying src/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,165 copying src/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,167 copying src/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,169 copying src/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,172 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,175 copying src/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,178 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,180 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,182 copying src/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,184 copying src/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,187 copying src/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:06,189 creating build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,190 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,192 copying src/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,194 copying src/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,196 copying src/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,199 copying src/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,201 copying src/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,204 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,206 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,208 copying src/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,211 copying src/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,213 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,216 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,218 copying src/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,221 copying src/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,224 copying src/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,226 copying src/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,229 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,232 copying src/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,235 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,237 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,240 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,243 copying src/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,245 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,248 copying src/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,250 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,253 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,256 copying src/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,259 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,261 copying src/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,263 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,267 copying src/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,269 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,271 copying src/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,274 copying src/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,276 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,278 copying src/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,280 copying src/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,282 copying src/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,285 copying src/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,288 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,290 copying src/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,292 copying src/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,294 copying src/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,297 copying src/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,299 copying src/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,301 copying src/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,304 copying src/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,306 copying src/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,308 copying src/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,311 copying src/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,313 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,315 copying src/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,317 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,320 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,322 copying src/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,325 copying src/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,327 copying src/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:06,330 creating build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,331 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,343 copying src/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,345 copying src/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,348 copying src/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,350 copying src/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,352 copying src/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,354 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,356 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,358 copying src/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,361 copying src/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,363 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,365 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,367 copying src/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,370 copying src/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,372 copying src/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,374 copying src/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,376 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,379 copying src/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,381 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,383 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,385 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,388 copying src/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,390 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,392 copying src/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,394 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,397 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,399 copying src/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,401 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,403 copying src/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,406 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,408 copying src/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,411 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,413 copying src/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,416 copying src/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,418 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,420 copying src/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,422 copying src/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,425 copying src/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,427 copying src/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,429 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,431 copying src/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,433 copying src/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,435 copying src/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,437 copying src/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,439 copying src/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,441 copying src/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,444 copying src/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,446 copying src/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,448 copying src/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,450 copying src/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,452 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,455 copying src/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,457 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,459 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,461 copying src/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,463 copying src/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,466 copying src/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:06,468 creating build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,469 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,471 copying src/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,473 copying src/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,476 copying src/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,478 copying src/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,480 copying src/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,482 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,484 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,486 copying src/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,488 copying src/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,490 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,493 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,495 copying src/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,497 copying src/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,500 copying src/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,503 copying src/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,509 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,511 copying src/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,514 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,516 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,518 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,520 copying src/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,522 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,525 copying src/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,527 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,529 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,531 copying src/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,534 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,536 copying src/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,538 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,541 copying src/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,543 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,545 copying src/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,547 copying src/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,549 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,551 copying src/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,553 copying src/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,556 copying src/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,558 copying src/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,560 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,562 copying src/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,564 copying src/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,567 copying src/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,570 copying src/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,573 copying src/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,576 copying src/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,579 copying src/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,582 copying src/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,585 copying src/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,587 copying src/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,590 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,593 copying src/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,595 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,598 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,600 copying src/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,603 copying src/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,606 copying src/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:06,610 creating build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,611 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,613 copying src/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,615 copying src/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,618 copying src/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,620 copying src/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,622 copying src/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,624 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,626 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,629 copying src/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,631 copying src/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,634 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,636 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,639 copying src/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,641 copying src/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,643 copying src/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,645 copying src/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,647 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,649 copying src/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,652 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,654 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,657 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,660 copying src/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,663 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,665 copying src/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,669 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,672 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,675 copying src/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,678 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,681 copying src/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,684 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,687 copying src/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,689 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,692 copying src/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,694 copying src/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,697 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,700 copying src/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,703 copying src/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,705 copying src/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,708 copying src/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,710 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,713 copying src/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,716 copying src/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,719 copying src/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,722 copying src/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,725 copying src/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,728 copying src/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,730 copying src/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,733 copying src/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,736 copying src/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,739 copying src/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,741 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,744 copying src/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,747 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,749 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,752 copying src/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,754 copying src/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,756 copying src/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:06,759 creating build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,760 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,762 copying src/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,764 copying src/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,766 copying src/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,769 copying src/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,771 copying src/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,773 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,775 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,777 copying src/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,779 copying src/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,782 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,784 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,786 copying src/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,788 copying src/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,791 copying src/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,793 copying src/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,795 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,797 copying src/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,800 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,802 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,804 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,806 copying src/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,809 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,811 copying src/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,814 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,816 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,818 copying src/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,821 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,823 copying src/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,825 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,827 copying src/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,829 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,831 copying src/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,833 copying src/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,835 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,837 copying src/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,839 copying src/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,841 copying src/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,844 copying src/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,846 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,848 copying src/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,850 copying src/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,853 copying src/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,855 copying src/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,857 copying src/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,859 copying src/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,862 copying src/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,864 copying src/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,866 copying src/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,869 copying src/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,871 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,873 copying src/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,875 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,878 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,881 copying src/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,883 copying src/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,885 copying src/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:06,887 creating build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,888 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,891 copying src/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,893 copying src/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,895 copying src/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,897 copying src/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,899 copying src/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,901 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,904 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,906 copying src/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,908 copying src/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,910 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,912 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,915 copying src/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,917 copying src/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,919 copying src/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,922 copying src/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,924 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,926 copying src/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,928 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,931 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,933 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,935 copying src/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,938 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,940 copying src/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,942 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,945 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,947 copying src/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,949 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,951 copying src/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,953 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,955 copying src/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,957 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,960 copying src/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,962 copying src/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,964 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,966 copying src/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,969 copying src/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,971 copying src/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,973 copying src/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,976 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,978 copying src/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,981 copying src/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,983 copying src/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,985 copying src/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,988 copying src/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,990 copying src/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,992 copying src/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,995 copying src/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,997 copying src/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:06,999 copying src/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,002 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,004 copying src/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,007 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,009 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,012 copying src/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,014 copying src/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,016 copying src/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:07,018 creating build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,019 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,021 copying src/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,023 copying src/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,025 copying src/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,027 copying src/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,029 copying src/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,031 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,034 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,036 copying src/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,038 copying src/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,040 copying src/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,043 copying src/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,045 copying src/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,047 copying src/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,049 copying src/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,052 copying src/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,054 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,056 copying src/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,059 copying src/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,061 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,063 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,065 copying src/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,068 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,070 copying src/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,072 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,074 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,076 copying src/unitxt/catalog/cards/global_mmlu/si/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,079 copying src/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,081 copying src/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,083 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,085 copying src/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,087 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,089 copying src/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,092 copying src/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,094 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,096 copying src/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,098 copying src/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,101 copying src/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,103 copying src/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,105 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,108 copying src/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,110 copying src/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,112 copying src/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,114 copying src/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,116 copying src/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,119 copying src/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,121 copying src/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,123 copying src/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,125 copying src/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,127 copying src/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,130 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,132 copying src/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,134 copying src/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,136 copying src/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,139 copying src/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,141 copying src/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,143 copying src/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:07,145 creating build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,146 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,148 copying src/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,150 copying src/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,153 copying src/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,155 copying src/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,157 copying src/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,159 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,161 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,163 copying src/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,166 copying src/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,168 copying src/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,170 copying src/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,172 copying src/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,174 copying src/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,177 copying src/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,179 copying src/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,181 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,183 copying src/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,186 copying src/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,188 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,190 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,193 copying src/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,195 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,197 copying src/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,199 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,202 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,204 copying src/unitxt/catalog/cards/global_mmlu/he/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,206 copying src/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,208 copying src/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,210 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,212 copying src/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,214 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,216 copying src/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,218 copying src/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,221 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,223 copying src/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,225 copying src/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,227 copying src/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,229 copying src/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,232 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,234 copying src/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,236 copying src/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,238 copying src/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,240 copying src/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,243 copying src/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,245 copying src/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,247 copying src/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,249 copying src/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,252 copying src/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,254 copying src/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,256 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,258 copying src/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,260 copying src/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,263 copying src/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,265 copying src/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,267 copying src/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,269 copying src/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:07,271 creating build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,272 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,274 copying src/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,276 copying src/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,278 copying src/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,280 copying src/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,282 copying src/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,285 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,287 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,289 copying src/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,291 copying src/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,293 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,295 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,298 copying src/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,300 copying src/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,302 copying src/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,304 copying src/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,307 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,309 copying src/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,311 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,313 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,316 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,318 copying src/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,320 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,322 copying src/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,324 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,326 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,329 copying src/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,331 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,333 copying src/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,335 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,338 copying src/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,340 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,342 copying src/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,344 copying src/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,346 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,349 copying src/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,351 copying src/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,353 copying src/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,355 copying src/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,358 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,360 copying src/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,363 copying src/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,365 copying src/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,367 copying src/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,369 copying src/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,372 copying src/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,374 copying src/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,376 copying src/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,379 copying src/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,381 copying src/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,383 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,385 copying src/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,388 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,390 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,392 copying src/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,395 copying src/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,397 copying src/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:07,399 creating build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,400 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,402 copying src/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,404 copying src/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,406 copying src/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,409 copying src/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,411 copying src/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,413 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,415 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,418 copying src/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,420 copying src/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,422 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,424 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,426 copying src/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,429 copying src/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,431 copying src/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,434 copying src/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,436 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,438 copying src/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,441 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,443 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,445 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,447 copying src/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,449 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,452 copying src/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,454 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,456 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,458 copying src/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,460 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,462 copying src/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,465 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,468 copying src/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,470 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,472 copying src/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,475 copying src/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,477 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,479 copying src/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,481 copying src/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,484 copying src/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,486 copying src/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,488 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,491 copying src/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,493 copying src/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,495 copying src/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,497 copying src/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,500 copying src/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,502 copying src/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,505 copying src/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,507 copying src/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,509 copying src/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,511 copying src/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,514 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,516 copying src/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,518 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,520 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,522 copying src/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,524 copying src/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,527 copying src/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:07,529 creating build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,530 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,532 copying src/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,534 copying src/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,537 copying src/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,539 copying src/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,542 copying src/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,544 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,547 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,551 copying src/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,554 copying src/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,557 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,560 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,563 copying src/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,565 copying src/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,568 copying src/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,571 copying src/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,574 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,577 copying src/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,580 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,583 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,585 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,588 copying src/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,590 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,592 copying src/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,594 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,597 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,599 copying src/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,601 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,604 copying src/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,607 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,609 copying src/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,612 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,614 copying src/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,616 copying src/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,618 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,621 copying src/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,623 copying src/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,626 copying src/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,628 copying src/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,631 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,633 copying src/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,636 copying src/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,638 copying src/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,641 copying src/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,644 copying src/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,646 copying src/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,649 copying src/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,652 copying src/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,654 copying src/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,656 copying src/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,659 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,661 copying src/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,664 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,667 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,669 copying src/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,671 copying src/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,674 copying src/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:07,676 creating build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,677 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,680 copying src/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,682 copying src/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,685 copying src/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,687 copying src/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,690 copying src/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,692 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,694 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,697 copying src/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,699 copying src/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,701 copying src/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,704 copying src/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,706 copying src/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,709 copying src/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,711 copying src/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,714 copying src/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,716 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,718 copying src/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,721 copying src/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,723 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,725 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,727 copying src/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,729 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,732 copying src/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,735 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,737 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,739 copying src/unitxt/catalog/cards/global_mmlu/es/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,742 copying src/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,744 copying src/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,746 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,748 copying src/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,751 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,753 copying src/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,755 copying src/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,758 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,760 copying src/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,762 copying src/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,765 copying src/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,767 copying src/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,769 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,772 copying src/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,775 copying src/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,777 copying src/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,779 copying src/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,782 copying src/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,784 copying src/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,786 copying src/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,789 copying src/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,791 copying src/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,793 copying src/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,795 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,798 copying src/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,800 copying src/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,802 copying src/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,804 copying src/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,806 copying src/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,809 copying src/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:07,811 creating build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,812 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,815 copying src/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,817 copying src/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,819 copying src/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,822 copying src/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,824 copying src/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,826 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,829 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,831 copying src/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,833 copying src/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,836 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,838 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,840 copying src/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,843 copying src/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,845 copying src/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,847 copying src/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,850 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,852 copying src/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,854 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,856 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,859 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,861 copying src/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,864 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,866 copying src/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,868 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,870 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,876 copying src/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,879 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,881 copying src/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,884 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,886 copying src/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,888 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,890 copying src/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,893 copying src/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,895 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,897 copying src/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,900 copying src/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,903 copying src/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,907 copying src/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,909 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,912 copying src/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,914 copying src/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,917 copying src/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,919 copying src/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,922 copying src/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,924 copying src/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,927 copying src/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,929 copying src/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,932 copying src/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,934 copying src/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,936 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,939 copying src/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,942 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,944 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,947 copying src/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,950 copying src/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,989 copying src/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:07,991 creating build/lib/unitxt/catalog/cards/universal_ner/ru 2026-01-13T10:37:07,992 copying src/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/ru 2026-01-13T10:37:07,994 creating build/lib/unitxt/catalog/cards/universal_ner/de 2026-01-13T10:37:07,995 copying src/unitxt/catalog/cards/universal_ner/de/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/de 2026-01-13T10:37:07,998 creating build/lib/unitxt/catalog/cards/universal_ner/sk 2026-01-13T10:37:07,999 copying src/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/lib/unitxt/catalog/cards/universal_ner/sk 2026-01-13T10:37:08,001 creating build/lib/unitxt/catalog/cards/universal_ner/sr 2026-01-13T10:37:08,002 copying src/unitxt/catalog/cards/universal_ner/sr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/sr 2026-01-13T10:37:08,004 creating build/lib/unitxt/catalog/cards/universal_ner/hr 2026-01-13T10:37:08,006 copying src/unitxt/catalog/cards/universal_ner/hr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/hr 2026-01-13T10:37:08,008 creating build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:08,009 copying src/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:08,012 copying src/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:08,014 copying src/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:08,016 creating build/lib/unitxt/catalog/cards/universal_ner/da 2026-01-13T10:37:08,017 copying src/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/lib/unitxt/catalog/cards/universal_ner/da 2026-01-13T10:37:08,020 creating build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:08,021 copying src/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:08,023 copying src/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:08,027 creating build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-01-13T10:37:08,028 copying src/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-01-13T10:37:08,030 creating build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:08,031 copying src/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:08,034 copying src/unitxt/catalog/cards/universal_ner/en/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:08,248 creating build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:08,250 copying src/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:08,253 copying src/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:08,256 creating build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:08,257 copying src/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:08,260 copying src/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:08,262 creating build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,264 copying src/unitxt/catalog/cards/xlsum/russian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,267 copying src/unitxt/catalog/cards/xlsum/spanish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,269 copying src/unitxt/catalog/cards/xlsum/tigrinya.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,272 copying src/unitxt/catalog/cards/xlsum/persian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,275 copying src/unitxt/catalog/cards/xlsum/sinhala.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,279 copying src/unitxt/catalog/cards/xlsum/vietnamese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,283 copying src/unitxt/catalog/cards/xlsum/bengali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,286 copying src/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,290 copying src/unitxt/catalog/cards/xlsum/telugu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,293 copying src/unitxt/catalog/cards/xlsum/french.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,297 copying src/unitxt/catalog/cards/xlsum/uzbek.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,300 copying src/unitxt/catalog/cards/xlsum/english.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,304 copying src/unitxt/catalog/cards/xlsum/ukrainian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,308 copying src/unitxt/catalog/cards/xlsum/thai.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,311 copying src/unitxt/catalog/cards/xlsum/korean.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,314 copying src/unitxt/catalog/cards/xlsum/pashto.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,317 copying src/unitxt/catalog/cards/xlsum/nepali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,320 copying src/unitxt/catalog/cards/xlsum/kirundi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,324 copying src/unitxt/catalog/cards/xlsum/marathi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,327 copying src/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,331 copying src/unitxt/catalog/cards/xlsum/punjabi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,335 copying src/unitxt/catalog/cards/xlsum/japanese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,338 copying src/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,342 copying src/unitxt/catalog/cards/xlsum/welsh.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,345 copying src/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,348 copying src/unitxt/catalog/cards/xlsum/tamil.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,351 copying src/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,354 copying src/unitxt/catalog/cards/xlsum/yoruba.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,357 copying src/unitxt/catalog/cards/xlsum/turkish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,360 copying src/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,363 copying src/unitxt/catalog/cards/xlsum/indonesian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,366 copying src/unitxt/catalog/cards/xlsum/swahili.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,369 copying src/unitxt/catalog/cards/xlsum/portuguese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,372 copying src/unitxt/catalog/cards/xlsum/igbo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,376 copying src/unitxt/catalog/cards/xlsum/burmese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,379 copying src/unitxt/catalog/cards/xlsum/urdu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,383 copying src/unitxt/catalog/cards/xlsum/arabic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,386 copying src/unitxt/catalog/cards/xlsum/hindi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,389 copying src/unitxt/catalog/cards/xlsum/amharic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,393 copying src/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,397 copying src/unitxt/catalog/cards/xlsum/gujarati.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,400 copying src/unitxt/catalog/cards/xlsum/oromo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,403 copying src/unitxt/catalog/cards/xlsum/hausa.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,405 copying src/unitxt/catalog/cards/xlsum/somali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,408 copying src/unitxt/catalog/cards/xlsum/pidgin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-13T10:37:08,411 creating build/lib/unitxt/catalog/cards/coqa 2026-01-13T10:37:08,412 copying src/unitxt/catalog/cards/coqa/multi_turn.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-13T10:37:08,415 copying src/unitxt/catalog/cards/coqa/completion.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-13T10:37:08,417 copying src/unitxt/catalog/cards/coqa/qa.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-13T10:37:08,419 creating build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,420 copying src/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,423 copying src/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,426 copying src/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,429 copying src/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,431 copying src/unitxt/catalog/cards/amazon_mass/en_US.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,434 copying src/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,436 copying src/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,439 copying src/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,442 copying src/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,444 copying src/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,447 copying src/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,450 copying src/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,453 copying src/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,458 copying src/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,464 copying src/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,470 copying src/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,473 copying src/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,475 copying src/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,478 copying src/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,481 copying src/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,483 copying src/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,486 copying src/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,489 copying src/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,491 copying src/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,494 copying src/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,497 copying src/unitxt/catalog/cards/amazon_mass/all.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,499 copying src/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,502 copying src/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,504 copying src/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,507 copying src/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,510 copying src/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,513 copying src/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,515 copying src/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,518 copying src/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,521 copying src/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,523 copying src/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,526 copying src/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,529 copying src/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,531 copying src/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,534 copying src/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,537 copying src/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,540 copying src/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,543 copying src/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,546 copying src/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,550 copying src/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,553 copying src/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,556 copying src/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,559 copying src/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,561 copying src/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,564 copying src/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,567 copying src/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,569 copying src/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,572 copying src/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:08,575 creating build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-01-13T10:37:08,576 copying src/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-01-13T10:37:08,579 creating build/lib/unitxt/catalog/cards/arena_hard/generation 2026-01-13T10:37:08,581 copying src/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/cards/arena_hard/generation 2026-01-13T10:37:08,584 creating build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:08,585 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:08,588 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:08,590 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:08,592 creating build/lib/unitxt/catalog/cards/coedit 2026-01-13T10:37:08,593 copying src/unitxt/catalog/cards/coedit/paraphrase.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-13T10:37:08,595 copying src/unitxt/catalog/cards/coedit/rewriting.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-13T10:37:08,598 copying src/unitxt/catalog/cards/coedit/selection.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-13T10:37:08,600 copying src/unitxt/catalog/cards/coedit/preference.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-13T10:37:08,602 creating build/lib/unitxt/catalog/cards/text2sql 2026-01-13T10:37:08,603 copying src/unitxt/catalog/cards/text2sql/bird.json -> build/lib/unitxt/catalog/cards/text2sql 2026-01-13T10:37:08,605 creating build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,607 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,610 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,612 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,614 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,617 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,619 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,621 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:08,623 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,624 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,627 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,629 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,632 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,634 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,636 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:08,639 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:08,640 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:08,642 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:08,644 creating build/lib/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:08,646 copying src/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:08,648 copying src/unitxt/catalog/cards/reward_bench/safety.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:08,650 copying src/unitxt/catalog/cards/reward_bench/reasoning.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:08,652 copying src/unitxt/catalog/cards/reward_bench/chat.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:08,654 creating build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:08,655 copying src/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:08,658 copying src/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:08,660 copying src/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:08,662 copying src/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:08,664 creating build/lib/unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:08,666 copying src/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:08,668 copying src/unitxt/catalog/cards/doc_vqa/en.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:08,670 copying src/unitxt/catalog/cards/doc_vqa/fr.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:08,672 creating build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,674 copying src/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,677 copying src/unitxt/catalog/cards/mmlu/security_studies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,679 copying src/unitxt/catalog/cards/mmlu/international_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,682 copying src/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,684 copying src/unitxt/catalog/cards/mmlu/college_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,686 copying src/unitxt/catalog/cards/mmlu/nutrition.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,688 copying src/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,691 copying src/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,693 copying src/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,696 copying src/unitxt/catalog/cards/mmlu/formal_logic.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,699 copying src/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,702 copying src/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,706 copying src/unitxt/catalog/cards/mmlu/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,709 copying src/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,712 copying src/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,714 copying src/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,716 copying src/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,719 copying src/unitxt/catalog/cards/mmlu/public_relations.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,721 copying src/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,724 copying src/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,727 copying src/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,729 copying src/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,731 copying src/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,734 copying src/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,736 copying src/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,738 copying src/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,741 copying src/unitxt/catalog/cards/mmlu/management.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,743 copying src/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,745 copying src/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,748 copying src/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,751 copying src/unitxt/catalog/cards/mmlu/human_aging.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,753 copying src/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,756 copying src/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,758 copying src/unitxt/catalog/cards/mmlu/world_religions.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,760 copying src/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,762 copying src/unitxt/catalog/cards/mmlu/prehistory.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,764 copying src/unitxt/catalog/cards/mmlu/astronomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,767 copying src/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,769 copying src/unitxt/catalog/cards/mmlu/college_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,771 copying src/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,773 copying src/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,776 copying src/unitxt/catalog/cards/mmlu/econometrics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,779 copying src/unitxt/catalog/cards/mmlu/business_ethics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,781 copying src/unitxt/catalog/cards/mmlu/virology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,783 copying src/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,786 copying src/unitxt/catalog/cards/mmlu/college_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,789 copying src/unitxt/catalog/cards/mmlu/marketing.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,791 copying src/unitxt/catalog/cards/mmlu/machine_learning.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,794 copying src/unitxt/catalog/cards/mmlu/sociology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,796 copying src/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,798 copying src/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,801 copying src/unitxt/catalog/cards/mmlu/anatomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,803 copying src/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,805 copying src/unitxt/catalog/cards/mmlu/professional_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,808 copying src/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,810 copying src/unitxt/catalog/cards/mmlu/computer_security.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,812 copying src/unitxt/catalog/cards/mmlu/global_facts.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-13T10:37:08,814 creating build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-01-13T10:37:08,816 copying src/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-01-13T10:37:08,818 creating build/lib/unitxt/catalog/cards/wmt 2026-01-13T10:37:08,819 copying src/unitxt/catalog/cards/wmt/en_fr.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-13T10:37:08,822 copying src/unitxt/catalog/cards/wmt/en_de.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-13T10:37:08,824 copying src/unitxt/catalog/cards/wmt/en_ro.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-13T10:37:08,826 creating build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,827 copying src/unitxt/catalog/cards/head_qa/en.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,829 copying src/unitxt/catalog/cards/head_qa/gl.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,831 copying src/unitxt/catalog/cards/head_qa/ru.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,834 copying src/unitxt/catalog/cards/head_qa/es.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,836 copying src/unitxt/catalog/cards/head_qa/it.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-13T10:37:08,838 creating build/lib/unitxt/catalog/cards/boolq 2026-01-13T10:37:08,839 copying src/unitxt/catalog/cards/boolq/classification.json -> build/lib/unitxt/catalog/cards/boolq 2026-01-13T10:37:08,842 copying src/unitxt/catalog/cards/boolq/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq 2026-01-13T10:37:08,844 creating build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:08,845 copying src/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:08,848 copying src/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:08,850 copying src/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:08,852 copying src/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:08,854 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:08,856 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:08,859 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:08,862 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:08,866 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:08,870 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:08,872 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:08,877 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:08,881 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:08,884 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:08,886 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:08,887 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:08,889 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:08,892 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:08,894 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:08,897 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,898 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,901 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,903 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,905 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,908 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,910 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,912 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,914 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,917 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:08,919 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,920 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,922 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,925 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,927 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,930 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,932 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,935 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,937 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,940 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:08,942 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,944 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,948 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,952 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,956 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,960 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,965 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,970 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,974 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,978 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:08,981 creating build/lib/unitxt/catalog/cards/judge_bench/cola 2026-01-13T10:37:08,982 copying src/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/lib/unitxt/catalog/cards/judge_bench/cola 2026-01-13T10:37:08,985 creating build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:08,986 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:08,988 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:08,990 creating build/lib/unitxt/catalog/cards/judge_bench/dices 2026-01-13T10:37:08,991 copying src/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/lib/unitxt/catalog/cards/judge_bench/dices 2026-01-13T10:37:08,994 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-13T10:37:08,995 copying src/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-13T10:37:08,997 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-13T10:37:08,998 copying src/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-13T10:37:09,001 creating build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-13T10:37:09,002 copying src/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-13T10:37:09,004 creating build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-01-13T10:37:09,005 copying src/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-01-13T10:37:09,008 creating build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,009 copying src/unitxt/catalog/cards/xnli/zh.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,012 copying src/unitxt/catalog/cards/xnli/sw.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,015 copying src/unitxt/catalog/cards/xnli/en.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,017 copying src/unitxt/catalog/cards/xnli/el.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,020 copying src/unitxt/catalog/cards/xnli/th.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,022 copying src/unitxt/catalog/cards/xnli/ur.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,025 copying src/unitxt/catalog/cards/xnli/ru.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,028 copying src/unitxt/catalog/cards/xnli/bg.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,032 copying src/unitxt/catalog/cards/xnli/vi.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,034 copying src/unitxt/catalog/cards/xnli/ar.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,038 copying src/unitxt/catalog/cards/xnli/hi.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,041 copying src/unitxt/catalog/cards/xnli/fr.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,043 copying src/unitxt/catalog/cards/xnli/es.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,046 copying src/unitxt/catalog/cards/xnli/de.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,048 copying src/unitxt/catalog/cards/xnli/tr.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-13T10:37:09,050 creating build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,051 copying src/unitxt/catalog/cards/mmmu/math.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,054 copying src/unitxt/catalog/cards/mmmu/art.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,056 copying src/unitxt/catalog/cards/mmmu/economics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,058 copying src/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,060 copying src/unitxt/catalog/cards/mmmu/art_theory.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,062 copying src/unitxt/catalog/cards/mmmu/literature.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,065 copying src/unitxt/catalog/cards/mmmu/computer_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,067 copying src/unitxt/catalog/cards/mmmu/history.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,070 copying src/unitxt/catalog/cards/mmmu/accounting.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,072 copying src/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,074 copying src/unitxt/catalog/cards/mmmu/pharmacy.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,076 copying src/unitxt/catalog/cards/mmmu/music.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,079 copying src/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,081 copying src/unitxt/catalog/cards/mmmu/finance.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,083 copying src/unitxt/catalog/cards/mmmu/design.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,086 copying src/unitxt/catalog/cards/mmmu/electronics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,089 copying src/unitxt/catalog/cards/mmmu/biology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,092 copying src/unitxt/catalog/cards/mmmu/physics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,095 copying src/unitxt/catalog/cards/mmmu/manage.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,098 copying src/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,101 copying src/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,105 copying src/unitxt/catalog/cards/mmmu/psychology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,108 copying src/unitxt/catalog/cards/mmmu/materials.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,113 copying src/unitxt/catalog/cards/mmmu/marketing.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,116 copying src/unitxt/catalog/cards/mmmu/geography.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,119 copying src/unitxt/catalog/cards/mmmu/sociology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,122 copying src/unitxt/catalog/cards/mmmu/chemistry.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,126 copying src/unitxt/catalog/cards/mmmu/public_health.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,130 copying src/unitxt/catalog/cards/mmmu/agriculture.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,133 copying src/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-13T10:37:09,136 creating build/lib/unitxt/catalog/cards/gpqa 2026-01-13T10:37:09,138 copying src/unitxt/catalog/cards/gpqa/main.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-13T10:37:09,141 copying src/unitxt/catalog/cards/gpqa/diamond.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-13T10:37:09,144 copying src/unitxt/catalog/cards/gpqa/extended.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-13T10:37:09,147 creating build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,149 copying src/unitxt/catalog/cards/almost_evil/en.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,152 copying src/unitxt/catalog/cards/almost_evil/ru.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,156 copying src/unitxt/catalog/cards/almost_evil/pt.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,159 copying src/unitxt/catalog/cards/almost_evil/nl.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,162 copying src/unitxt/catalog/cards/almost_evil/fr.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,166 copying src/unitxt/catalog/cards/almost_evil/es.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,169 copying src/unitxt/catalog/cards/almost_evil/de.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,172 copying src/unitxt/catalog/cards/almost_evil/it.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:09,175 creating build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:09,178 copying src/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:09,181 copying src/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:09,185 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:09,187 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:09,190 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:09,193 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:09,196 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:09,199 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:09,200 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:09,203 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:09,206 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:09,209 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:09,211 creating build/lib/unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:09,213 copying src/unitxt/catalog/cards/clinc_oos/plus.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:09,216 copying src/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:09,219 copying src/unitxt/catalog/cards/clinc_oos/small.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:09,222 creating build/lib/unitxt/catalog/cards/reuters21578 2026-01-13T10:37:09,223 copying src/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-13T10:37:09,226 copying src/unitxt/catalog/cards/reuters21578/ModApte.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-13T10:37:09,228 copying src/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-13T10:37:09,231 creating build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:09,232 copying src/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:09,235 copying src/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:09,237 creating build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:09,238 copying src/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:09,240 copying src/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:09,242 creating build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:09,243 copying src/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:09,246 copying src/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:09,248 creating build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:09,249 copying src/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:09,252 copying src/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:09,254 creating build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:09,255 copying src/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:09,257 copying src/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:09,259 creating build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:09,260 copying src/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:09,263 copying src/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:09,265 creating build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:09,266 copying src/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:09,268 copying src/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:09,270 creating build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:09,271 copying src/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:09,274 copying src/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:09,276 creating build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:09,277 copying src/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:09,280 copying src/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:09,282 creating build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:09,283 copying src/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:09,286 copying src/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:09,288 creating build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,289 copying src/unitxt/catalog/cards/mlsum/ru.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,291 copying src/unitxt/catalog/cards/mlsum/tu.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,293 copying src/unitxt/catalog/cards/mlsum/fr.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,296 copying src/unitxt/catalog/cards/mlsum/es.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,298 copying src/unitxt/catalog/cards/mlsum/de.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-13T10:37:09,300 creating build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,302 copying src/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,304 copying src/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,307 copying src/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,309 copying src/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,311 copying src/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,313 copying src/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,315 copying src/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,318 copying src/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,320 copying src/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,322 copying src/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,325 copying src/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,327 copying src/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,329 copying src/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,332 copying src/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,334 copying src/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,336 copying src/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:09,338 creating build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,340 copying src/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,342 copying src/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,345 copying src/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,347 copying src/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,349 copying src/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,352 copying src/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,354 copying src/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,356 copying src/unitxt/catalog/cards/milu/Telugu/Science.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:09,359 creating build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,360 copying src/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,362 copying src/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,364 copying src/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,367 copying src/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,369 copying src/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,371 copying src/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,373 copying src/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,376 copying src/unitxt/catalog/cards/milu/English/Science.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-13T10:37:09,378 creating build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,379 copying src/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,382 copying src/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,384 copying src/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,386 copying src/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,389 copying src/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,391 copying src/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,393 copying src/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,396 copying src/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:09,398 creating build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,399 copying src/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,401 copying src/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,404 copying src/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,407 copying src/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,409 copying src/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,411 copying src/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,414 copying src/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,416 copying src/unitxt/catalog/cards/milu/Bengali/Science.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:09,419 creating build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,420 copying src/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,422 copying src/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,424 copying src/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,427 copying src/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,429 copying src/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,431 copying src/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,434 copying src/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,436 copying src/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:09,439 creating build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,440 copying src/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,442 copying src/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,445 copying src/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,447 copying src/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,450 copying src/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,452 copying src/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,454 copying src/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,457 copying src/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:09,459 creating build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,460 copying src/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,463 copying src/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,466 copying src/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,468 copying src/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,471 copying src/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,473 copying src/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,476 copying src/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,478 copying src/unitxt/catalog/cards/milu/Kannada/Science.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:09,480 creating build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,482 copying src/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,485 copying src/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,487 copying src/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,490 copying src/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,492 copying src/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,494 copying src/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,496 copying src/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,499 copying src/unitxt/catalog/cards/milu/Hindi/Science.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:09,501 creating build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,502 copying src/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,505 copying src/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,508 copying src/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,511 copying src/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,513 copying src/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,515 copying src/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,518 copying src/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,520 copying src/unitxt/catalog/cards/milu/Odia/Science.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:09,522 creating build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,523 copying src/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,526 copying src/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,529 copying src/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,532 copying src/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,535 copying src/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,538 copying src/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,540 copying src/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,542 copying src/unitxt/catalog/cards/milu/Tamil/Science.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:09,545 creating build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,546 copying src/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,548 copying src/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,550 copying src/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,553 copying src/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,555 copying src/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,558 copying src/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,561 copying src/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,563 copying src/unitxt/catalog/cards/milu/Marathi/Science.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:09,565 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,566 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,569 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,572 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,575 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,579 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,582 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,586 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,589 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,593 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,595 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,598 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,601 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,604 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,607 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:09,610 creating build/lib/unitxt/catalog/cards/wnli 2026-01-13T10:37:09,611 copying src/unitxt/catalog/cards/wnli/truthfulness.json -> build/lib/unitxt/catalog/cards/wnli 2026-01-13T10:37:09,614 creating build/lib/unitxt/catalog/cards/go_emotions 2026-01-13T10:37:09,615 copying src/unitxt/catalog/cards/go_emotions/simplified.json -> build/lib/unitxt/catalog/cards/go_emotions 2026-01-13T10:37:09,618 creating build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:09,619 copying src/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:09,623 copying src/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:09,626 creating build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,628 copying src/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,630 copying src/unitxt/catalog/cards/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,633 copying src/unitxt/catalog/cards/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,635 copying src/unitxt/catalog/cards/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,638 copying src/unitxt/catalog/cards/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,640 copying src/unitxt/catalog/cards/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,642 copying src/unitxt/catalog/cards/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,645 copying src/unitxt/catalog/cards/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,647 copying src/unitxt/catalog/cards/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,650 copying src/unitxt/catalog/cards/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,652 copying src/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,655 copying src/unitxt/catalog/cards/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-13T10:37:09,657 creating build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,658 copying src/unitxt/catalog/cards/safety/truthful_qa.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,661 copying src/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,663 copying src/unitxt/catalog/cards/safety/provoq.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,666 copying src/unitxt/catalog/cards/safety/xstest.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,668 copying src/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,670 copying src/unitxt/catalog/cards/safety/airbench2024.json -> build/lib/unitxt/catalog/cards/safety 2026-01-13T10:37:09,672 creating build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:09,673 copying src/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:09,676 copying src/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:09,678 creating build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,679 copying src/unitxt/catalog/cards/safety/bbq/SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,682 copying src/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,684 copying src/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,686 copying src/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,689 copying src/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,691 copying src/unitxt/catalog/cards/safety/bbq/Age.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,694 copying src/unitxt/catalog/cards/safety/bbq/Religion.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,696 copying src/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,699 copying src/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,701 copying src/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,703 copying src/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:09,705 creating build/lib/unitxt/catalog/cards/bfcl 2026-01-13T10:37:09,707 copying src/unitxt/catalog/cards/bfcl/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl 2026-01-13T10:37:09,709 creating build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,711 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,715 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,718 copying src/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,720 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,723 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,725 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,728 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,731 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,734 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,737 copying src/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,739 copying src/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,742 copying src/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:09,744 creating build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,745 copying src/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,747 copying src/unitxt/catalog/cards/legalbench/proa.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,749 copying src/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,752 copying src/unitxt/catalog/cards/legalbench/abercrombie.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,754 copying src/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-13T10:37:09,756 creating build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,757 copying src/unitxt/catalog/cards/belebele/wol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,761 copying src/unitxt/catalog/cards/belebele/hye_armn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,764 copying src/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,767 copying src/unitxt/catalog/cards/belebele/tur_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,769 copying src/unitxt/catalog/cards/belebele/slv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,772 copying src/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,776 copying src/unitxt/catalog/cards/belebele/kat_geor.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,779 copying src/unitxt/catalog/cards/belebele/spa_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,782 copying src/unitxt/catalog/cards/belebele/sin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,785 copying src/unitxt/catalog/cards/belebele/pol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,788 copying src/unitxt/catalog/cards/belebele/eus_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,791 copying src/unitxt/catalog/cards/belebele/tgl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,793 copying src/unitxt/catalog/cards/belebele/cat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,796 copying src/unitxt/catalog/cards/belebele/npi_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,799 copying src/unitxt/catalog/cards/belebele/pbt_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,802 copying src/unitxt/catalog/cards/belebele/jav_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,804 copying src/unitxt/catalog/cards/belebele/uzn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,807 copying src/unitxt/catalog/cards/belebele/afr_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,810 copying src/unitxt/catalog/cards/belebele/vie_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,812 copying src/unitxt/catalog/cards/belebele/pan_guru.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,815 copying src/unitxt/catalog/cards/belebele/ron_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,817 copying src/unitxt/catalog/cards/belebele/kac_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,819 copying src/unitxt/catalog/cards/belebele/deu_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,822 copying src/unitxt/catalog/cards/belebele/kor_hang.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,824 copying src/unitxt/catalog/cards/belebele/heb_hebr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,826 copying src/unitxt/catalog/cards/belebele/zul_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,829 copying src/unitxt/catalog/cards/belebele/hau_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,831 copying src/unitxt/catalog/cards/belebele/nld_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,834 copying src/unitxt/catalog/cards/belebele/tel_telu.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,836 copying src/unitxt/catalog/cards/belebele/hin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,840 copying src/unitxt/catalog/cards/belebele/mlt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,844 copying src/unitxt/catalog/cards/belebele/tha_thai.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,848 copying src/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,851 copying src/unitxt/catalog/cards/belebele/tso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,854 copying src/unitxt/catalog/cards/belebele/ben_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,856 copying src/unitxt/catalog/cards/belebele/ben_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,860 copying src/unitxt/catalog/cards/belebele/ceb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,864 copying src/unitxt/catalog/cards/belebele/por_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,868 copying src/unitxt/catalog/cards/belebele/urd_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,874 copying src/unitxt/catalog/cards/belebele/fuv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,877 copying src/unitxt/catalog/cards/belebele/mar_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,879 copying src/unitxt/catalog/cards/belebele/luo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,882 copying src/unitxt/catalog/cards/belebele/dan_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,884 copying src/unitxt/catalog/cards/belebele/ary_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,888 copying src/unitxt/catalog/cards/belebele/nob_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,892 copying src/unitxt/catalog/cards/belebele/lvs_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,895 copying src/unitxt/catalog/cards/belebele/zho_hant.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,898 copying src/unitxt/catalog/cards/belebele/zsm_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,903 copying src/unitxt/catalog/cards/belebele/hun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,908 copying src/unitxt/catalog/cards/belebele/ssw_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,912 copying src/unitxt/catalog/cards/belebele/snd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,915 copying src/unitxt/catalog/cards/belebele/lug_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,919 copying src/unitxt/catalog/cards/belebele/ell_grek.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,923 copying src/unitxt/catalog/cards/belebele/hat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,928 copying src/unitxt/catalog/cards/belebele/lit_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,934 copying src/unitxt/catalog/cards/belebele/zho_hans.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,941 copying src/unitxt/catalog/cards/belebele/grn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,947 copying src/unitxt/catalog/cards/belebele/mri_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,954 copying src/unitxt/catalog/cards/belebele/tam_taml.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,961 copying src/unitxt/catalog/cards/belebele/urd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,967 copying src/unitxt/catalog/cards/belebele/hin_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,974 copying src/unitxt/catalog/cards/belebele/ckb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,980 copying src/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,984 copying src/unitxt/catalog/cards/belebele/kan_knda.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,988 copying src/unitxt/catalog/cards/belebele/hrv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,992 copying src/unitxt/catalog/cards/belebele/ibo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:09,996 copying src/unitxt/catalog/cards/belebele/azj_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,003 copying src/unitxt/catalog/cards/belebele/ars_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,009 copying src/unitxt/catalog/cards/belebele/apc_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,018 copying src/unitxt/catalog/cards/belebele/ita_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,027 copying src/unitxt/catalog/cards/belebele/guj_gujr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,036 copying src/unitxt/catalog/cards/belebele/ind_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,041 copying src/unitxt/catalog/cards/belebele/asm_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,046 copying src/unitxt/catalog/cards/belebele/nya_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,050 copying src/unitxt/catalog/cards/belebele/fin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,054 copying src/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,059 copying src/unitxt/catalog/cards/belebele/tsn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,064 copying src/unitxt/catalog/cards/belebele/ory_orya.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,069 copying src/unitxt/catalog/cards/belebele/khm_khmr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,073 copying src/unitxt/catalog/cards/belebele/sin_sinh.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,077 copying src/unitxt/catalog/cards/belebele/kea_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,082 copying src/unitxt/catalog/cards/belebele/sot_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,088 copying src/unitxt/catalog/cards/belebele/arz_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,094 copying src/unitxt/catalog/cards/belebele/isl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,101 copying src/unitxt/catalog/cards/belebele/npi_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,108 copying src/unitxt/catalog/cards/belebele/est_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,115 copying src/unitxt/catalog/cards/belebele/mya_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,123 copying src/unitxt/catalog/cards/belebele/kin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,127 copying src/unitxt/catalog/cards/belebele/shn_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,132 copying src/unitxt/catalog/cards/belebele/amh_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,137 copying src/unitxt/catalog/cards/belebele/acm_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,141 copying src/unitxt/catalog/cards/belebele/ces_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,145 copying src/unitxt/catalog/cards/belebele/bam_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,149 copying src/unitxt/catalog/cards/belebele/sna_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,154 copying src/unitxt/catalog/cards/belebele/lao_laoo.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,160 copying src/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,167 copying src/unitxt/catalog/cards/belebele/fra_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,174 copying src/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,181 copying src/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,185 copying src/unitxt/catalog/cards/belebele/slk_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,190 copying src/unitxt/catalog/cards/belebele/som_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,194 copying src/unitxt/catalog/cards/belebele/swh_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,200 copying src/unitxt/catalog/cards/belebele/mal_mlym.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,207 copying src/unitxt/catalog/cards/belebele/arb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,213 copying src/unitxt/catalog/cards/belebele/bod_tibt.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,219 copying src/unitxt/catalog/cards/belebele/gaz_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,227 copying src/unitxt/catalog/cards/belebele/tir_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,234 copying src/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,243 copying src/unitxt/catalog/cards/belebele/pes_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,253 copying src/unitxt/catalog/cards/belebele/swe_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,257 copying src/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,261 copying src/unitxt/catalog/cards/belebele/yor_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,266 copying src/unitxt/catalog/cards/belebele/plt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,272 copying src/unitxt/catalog/cards/belebele/als_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,279 copying src/unitxt/catalog/cards/belebele/eng_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,288 copying src/unitxt/catalog/cards/belebele/xho_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,296 copying src/unitxt/catalog/cards/belebele/arb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,305 copying src/unitxt/catalog/cards/belebele/sun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,314 copying src/unitxt/catalog/cards/belebele/lin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,325 copying src/unitxt/catalog/cards/belebele/ilo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,332 copying src/unitxt/catalog/cards/belebele/war_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,336 copying src/unitxt/catalog/cards/belebele/nso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-13T10:37:10,339 creating build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,344 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,349 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,353 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,357 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,360 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,364 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,368 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,372 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,376 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,381 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,386 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,390 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:10,394 creating build/lib/unitxt/catalog/cards/biggen_bench/results 2026-01-13T10:37:10,397 copying src/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/lib/unitxt/catalog/cards/biggen_bench/results 2026-01-13T10:37:10,401 creating build/lib/unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:10,403 copying src/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:10,408 copying src/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:10,411 creating build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-13T10:37:10,413 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-13T10:37:10,417 creating build/lib/unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:10,420 copying src/unitxt/catalog/cards/CFPB/product/2023.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:10,424 copying src/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:10,429 creating build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,431 copying src/unitxt/catalog/cards/mmlu_pro/math.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,439 copying src/unitxt/catalog/cards/mmlu_pro/economics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,446 copying src/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,454 copying src/unitxt/catalog/cards/mmlu_pro/health.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,462 copying src/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,470 copying src/unitxt/catalog/cards/mmlu_pro/law.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,477 copying src/unitxt/catalog/cards/mmlu_pro/history.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,483 copying src/unitxt/catalog/cards/mmlu_pro/biology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,488 copying src/unitxt/catalog/cards/mmlu_pro/physics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,493 copying src/unitxt/catalog/cards/mmlu_pro/business.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,498 copying src/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,503 copying src/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,506 copying src/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,510 copying src/unitxt/catalog/cards/mmlu_pro/other.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:10,514 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,516 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,522 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,529 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,535 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,542 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,549 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,557 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,566 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,574 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,581 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,588 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,592 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,596 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,600 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:10,603 creating build/lib/unitxt/catalog/cards/tot 2026-01-13T10:37:10,605 copying src/unitxt/catalog/cards/tot/arithmetic.json -> build/lib/unitxt/catalog/cards/tot 2026-01-13T10:37:10,608 copying src/unitxt/catalog/cards/tot/semantic.json -> build/lib/unitxt/catalog/cards/tot 2026-01-13T10:37:10,610 creating build/lib/unitxt/catalog/cards/babi 2026-01-13T10:37:10,612 copying src/unitxt/catalog/cards/babi/qa.json -> build/lib/unitxt/catalog/cards/babi 2026-01-13T10:37:10,614 creating build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,616 copying src/unitxt/catalog/cards/xwinogrande/zh.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,619 copying src/unitxt/catalog/cards/xwinogrande/en.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,622 copying src/unitxt/catalog/cards/xwinogrande/ru.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,625 copying src/unitxt/catalog/cards/xwinogrande/pt.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,629 copying src/unitxt/catalog/cards/xwinogrande/jp.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:10,632 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-13T10:37:10,635 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-13T10:37:10,639 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:10,641 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:10,644 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:10,648 creating build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,649 copying src/unitxt/catalog/cards/winogrande/debiased.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,654 copying src/unitxt/catalog/cards/winogrande/m.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,658 copying src/unitxt/catalog/cards/winogrande/xl.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,661 copying src/unitxt/catalog/cards/winogrande/s.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,665 copying src/unitxt/catalog/cards/winogrande/l.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,669 copying src/unitxt/catalog/cards/winogrande/xs.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-13T10:37:10,673 creating build/lib/unitxt/catalog/cards/20_newsgroups 2026-01-13T10:37:10,675 copying src/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/lib/unitxt/catalog/cards/20_newsgroups 2026-01-13T10:37:10,679 creating build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,681 copying src/unitxt/catalog/splitters/large_no_test.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,685 copying src/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,688 copying src/unitxt/catalog/splitters/small_no_test.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,691 copying src/unitxt/catalog/splitters/small_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,693 copying src/unitxt/catalog/splitters/large_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,696 copying src/unitxt/catalog/splitters/test_only.json -> build/lib/unitxt/catalog/splitters 2026-01-13T10:37:10,699 creating build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,700 copying src/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,703 copying src/unitxt/catalog/formats/user_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,705 copying src/unitxt/catalog/formats/empty.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,708 copying src/unitxt/catalog/formats/llama2.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,710 copying src/unitxt/catalog/formats/deepseek_coder.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,712 copying src/unitxt/catalog/formats/textual_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,714 copying src/unitxt/catalog/formats/llamaguard2.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,717 copying src/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,720 copying src/unitxt/catalog/formats/user_agent.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,723 copying src/unitxt/catalog/formats/chat_api.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,725 copying src/unitxt/catalog/formats/human_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,727 copying src/unitxt/catalog/formats/llama.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,730 copying src/unitxt/catalog/formats/llama3_instruct.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,732 copying src/unitxt/catalog/formats/empty_input_output_separator.json -> build/lib/unitxt/catalog/formats 2026-01-13T10:37:10,734 creating build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,735 copying src/unitxt/catalog/formats/models/alpaca_instruct.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,738 copying src/unitxt/catalog/formats/models/llava.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,740 copying src/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,742 copying src/unitxt/catalog/formats/models/phi_3.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,744 copying src/unitxt/catalog/formats/models/starling.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,747 copying src/unitxt/catalog/formats/models/llava_interleave.json -> build/lib/unitxt/catalog/formats/models 2026-01-13T10:37:10,749 creating build/lib/unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:10,750 copying src/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:10,752 copying src/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:10,754 creating build/lib/unitxt/catalog/formats/models/mistral 2026-01-13T10:37:10,755 copying src/unitxt/catalog/formats/models/mistral/instruction.json -> build/lib/unitxt/catalog/formats/models/mistral 2026-01-13T10:37:10,758 creating build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-01-13T10:37:10,759 copying src/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-01-13T10:37:10,761 creating build/lib/unitxt/catalog/formats/models/flan 2026-01-13T10:37:10,762 copying src/unitxt/catalog/formats/models/flan/exq_exa.json -> build/lib/unitxt/catalog/formats/models/flan 2026-01-13T10:37:10,765 copying src/unitxt/catalog/formats/models/flan/few_shot.json -> build/lib/unitxt/catalog/formats/models/flan 2026-01-13T10:37:10,767 creating build/lib/unitxt/catalog/engines/model 2026-01-13T10:37:10,768 copying src/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/model 2026-01-13T10:37:10,771 creating build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-01-13T10:37:10,772 copying src/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-01-13T10:37:10,775 creating build/lib/unitxt/catalog/engines/ollama 2026-01-13T10:37:10,776 copying src/unitxt/catalog/engines/ollama/llama2.json -> build/lib/unitxt/catalog/engines/ollama 2026-01-13T10:37:10,778 creating build/lib/unitxt/catalog/engines/rits 2026-01-13T10:37:10,779 copying src/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/lib/unitxt/catalog/engines/rits 2026-01-13T10:37:10,782 copying src/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/lib/unitxt/catalog/engines/rits 2026-01-13T10:37:10,783 creating build/lib/unitxt/catalog/engines/rits/llama_3 2026-01-13T10:37:10,785 copying src/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/lib/unitxt/catalog/engines/rits/llama_3 2026-01-13T10:37:10,787 creating build/lib/unitxt/catalog/engines/ibm_wml 2026-01-13T10:37:10,788 copying src/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/ibm_wml 2026-01-13T10:37:10,790 creating build/lib/unitxt/catalog/engines/openai 2026-01-13T10:37:10,791 copying src/unitxt/catalog/engines/openai/gpt_4o.json -> build/lib/unitxt/catalog/engines/openai 2026-01-13T10:37:10,793 creating build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,794 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,796 copying src/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,799 copying src/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,801 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,803 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,805 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,808 copying src/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,810 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,812 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,815 copying src/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,817 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,819 copying src/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,821 copying src/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,824 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,826 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,829 copying src/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,831 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,834 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,836 copying src/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,838 copying src/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,841 copying src/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,843 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-13T10:37:10,845 creating build/lib/unitxt/catalog/engines/cross_provider 2026-01-13T10:37:10,846 copying src/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-01-13T10:37:10,848 copying src/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-01-13T10:37:10,850 creating build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,851 copying src/unitxt/catalog/operators/remove_articles.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,853 copying src/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,855 copying src/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,858 copying src/unitxt/catalog/operators/extract_verbal_judgement.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,860 copying src/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,862 copying src/unitxt/catalog/operators/remove_none_from_list.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,864 copying src/unitxt/catalog/operators/stance_to_pro_con.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,866 copying src/unitxt/catalog/operators/lower_case.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,869 copying src/unitxt/catalog/operators/fix_whitespace.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,871 copying src/unitxt/catalog/operators/take_last_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,873 copying src/unitxt/catalog/operators/literal_eval.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,875 copying src/unitxt/catalog/operators/yes_no_to_int.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,877 copying src/unitxt/catalog/operators/get_string_after_colon.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,879 copying src/unitxt/catalog/operators/substring.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,882 copying src/unitxt/catalog/operators/fix_json_schema.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,884 copying src/unitxt/catalog/operators/remove_punctuations.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,886 copying src/unitxt/catalog/operators/capitalize.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,888 copying src/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,891 copying src/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,893 copying src/unitxt/catalog/operators/first_character.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,895 copying src/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,897 copying src/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,900 copying src/unitxt/catalog/operators/extract_from_double_brackets.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,902 copying src/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,904 copying src/unitxt/catalog/operators/take_first_word.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,907 copying src/unitxt/catalog/operators/upper_case.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,909 copying src/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,911 copying src/unitxt/catalog/operators/match_closest_option.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,915 copying src/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,918 copying src/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,920 copying src/unitxt/catalog/operators/str_to_float_format.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,922 copying src/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,925 copying src/unitxt/catalog/operators/lower_case_till_punc.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,927 copying src/unitxt/catalog/operators/regex_parser.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,929 copying src/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,931 copying src/unitxt/catalog/operators/to_yes_or_none.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,934 copying src/unitxt/catalog/operators/take_first_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,936 copying src/unitxt/catalog/operators/convert_to_boolean.json -> build/lib/unitxt/catalog/operators 2026-01-13T10:37:10,938 creating build/lib/unitxt/catalog/operators/mt_bench 2026-01-13T10:37:10,939 copying src/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-01-13T10:37:10,942 copying src/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-01-13T10:37:10,944 creating build/lib/unitxt/catalog/operators/balancers/multi_label 2026-01-13T10:37:10,946 copying src/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/lib/unitxt/catalog/operators/balancers/multi_label 2026-01-13T10:37:10,948 creating build/lib/unitxt/catalog/operators/balancers/ner 2026-01-13T10:37:10,950 copying src/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/lib/unitxt/catalog/operators/balancers/ner 2026-01-13T10:37:10,952 creating build/lib/unitxt/catalog/operators/balancers/qa 2026-01-13T10:37:10,953 copying src/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/lib/unitxt/catalog/operators/balancers/qa 2026-01-13T10:37:10,955 creating build/lib/unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:10,957 copying src/unitxt/catalog/operators/balancers/classification/by_label.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:10,959 copying src/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:10,961 creating build/lib/unitxt/catalog/system_prompts 2026-01-13T10:37:10,963 copying src/unitxt/catalog/system_prompts/boolqa.json -> build/lib/unitxt/catalog/system_prompts 2026-01-13T10:37:10,965 copying src/unitxt/catalog/system_prompts/empty.json -> build/lib/unitxt/catalog/system_prompts 2026-01-13T10:37:10,967 creating build/lib/unitxt/catalog/system_prompts/model 2026-01-13T10:37:10,969 copying src/unitxt/catalog/system_prompts/model/granite.json -> build/lib/unitxt/catalog/system_prompts/model 2026-01-13T10:37:10,971 creating build/lib/unitxt/catalog/system_prompts/general 2026-01-13T10:37:10,972 copying src/unitxt/catalog/system_prompts/general/be_concise.json -> build/lib/unitxt/catalog/system_prompts/general 2026-01-13T10:37:10,974 creating build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,976 copying src/unitxt/catalog/system_prompts/models/labradorite.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,978 copying src/unitxt/catalog/system_prompts/models/llama2.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,980 copying src/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,983 copying src/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,985 copying src/unitxt/catalog/system_prompts/models/alpaca.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,987 copying src/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,989 copying src/unitxt/catalog/system_prompts/models/llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-13T10:37:10,991 creating build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:10,993 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:10,996 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:10,998 creating build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:10,999 copying src/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:11,002 copying src/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:11,004 creating build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,005 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,007 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,010 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,012 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,014 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,017 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,019 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,022 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,024 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,026 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,029 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:11,031 creating build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:11,032 copying src/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:11,034 copying src/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:11,037 creating build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-13T10:37:11,038 copying src/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-13T10:37:11,040 creating build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,041 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,044 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,046 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,048 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,050 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,052 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,054 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,057 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,059 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,061 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,063 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,066 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,068 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,070 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,073 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:11,075 creating build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-01-13T10:37:11,076 copying src/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-01-13T10:37:11,079 creating build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-13T10:37:11,080 copying src/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-13T10:37:11,083 creating build/lib/unitxt/catalog/recipes/bluebench/safety 2026-01-13T10:37:11,085 copying src/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/lib/unitxt/catalog/recipes/bluebench/safety 2026-01-13T10:37:11,087 creating build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-13T10:37:11,088 copying src/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-13T10:37:11,091 creating build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,092 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,095 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,097 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,099 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,101 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,103 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,105 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,108 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,110 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,112 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,114 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,116 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,119 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,121 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:11,123 creating build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,124 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,127 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,129 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,132 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,134 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:11,137 creating build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-01-13T10:37:11,138 copying src/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-01-13T10:37:11,140 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,143 copying src/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,145 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,148 copying src/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,151 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,153 copying src/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:11,155 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,156 copying src/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,159 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,161 copying src/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,164 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,166 copying src/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:11,168 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,169 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,171 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,174 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,176 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,179 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:11,181 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,182 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,185 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,187 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,189 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,192 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:11,194 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,195 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,197 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,200 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,202 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,204 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:11,206 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,208 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,210 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,212 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,215 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,217 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:11,219 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,220 copying src/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,223 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,226 copying src/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,229 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,231 copying src/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:11,234 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,236 copying src/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,239 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,242 copying src/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,245 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,247 copying src/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:11,250 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,251 copying src/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,255 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,258 copying src/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,260 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,263 copying src/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:11,265 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,267 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,269 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,271 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,274 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,276 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:11,278 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,279 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,281 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,283 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,285 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,287 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:11,290 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,291 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,293 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,295 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,297 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,300 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:11,303 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,304 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,307 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,310 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,312 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,314 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:11,316 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,318 copying src/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,320 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,323 copying src/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,325 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,328 copying src/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:11,330 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,331 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,334 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,336 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,338 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,340 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:11,342 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,344 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,347 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,349 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,351 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,354 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:11,356 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,357 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,359 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,362 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,364 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,366 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:11,368 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,369 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,372 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,374 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,376 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,378 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:11,381 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,382 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,384 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,386 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,388 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,391 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:11,393 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,394 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,396 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,399 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,401 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,403 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:11,405 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,407 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,409 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,411 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,414 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,416 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:11,418 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,420 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,422 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,425 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,428 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,430 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:11,433 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,434 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,437 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,439 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,442 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,444 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:11,447 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,448 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,451 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,453 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,456 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,459 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:11,461 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,462 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,465 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,468 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,471 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,473 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:11,475 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,477 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,479 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,482 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,484 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,487 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:11,489 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,490 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,493 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,495 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,498 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,500 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:11,503 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,504 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,507 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,510 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,512 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,516 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:11,518 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,520 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,523 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,525 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,528 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,530 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:11,532 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,534 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,536 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,539 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,541 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,544 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:11,546 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,548 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,550 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,553 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,555 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,558 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:11,560 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,562 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,565 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,567 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,570 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,572 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:11,575 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,576 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,579 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,582 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,585 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,588 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:11,590 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,592 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,594 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,597 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,599 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,602 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:11,604 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,606 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,609 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,612 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,615 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,618 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:11,622 creating build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,625 copying src/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,628 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,630 copying src/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,633 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,635 copying src/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:11,638 creating build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,639 copying src/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,642 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,644 copying src/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,646 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,649 copying src/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:11,651 creating build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,653 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,656 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,659 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,661 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,664 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:11,667 creating build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,668 copying src/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,671 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,674 copying src/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,676 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,678 copying src/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:11,681 creating build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,682 copying src/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,686 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,688 copying src/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,691 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,693 copying src/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:11,696 creating build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,698 copying src/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,700 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,703 copying src/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,705 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,708 copying src/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:11,710 creating build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,711 copying src/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,714 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,717 copying src/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,719 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,722 copying src/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:11,724 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,726 copying src/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,729 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,731 copying src/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,734 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,737 copying src/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:11,739 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,741 copying src/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,743 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,746 copying src/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,749 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,752 copying src/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:11,755 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,756 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,760 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,763 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,766 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,768 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:11,771 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,772 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,775 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,777 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,780 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,782 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:11,784 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,786 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,789 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,791 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,794 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,796 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:11,798 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,800 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,803 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,805 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,808 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,811 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:11,813 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,815 copying src/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,818 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,821 copying src/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,824 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,827 copying src/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:11,829 creating build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,831 copying src/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,833 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,836 copying src/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,838 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,841 copying src/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:11,843 creating build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,844 copying src/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,847 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,850 copying src/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,852 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,855 copying src/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:11,857 creating build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,858 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,861 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,863 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,866 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,868 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:11,871 creating build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,872 copying src/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,874 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,877 copying src/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,879 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,882 copying src/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:11,884 creating build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,886 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,888 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,890 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,893 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,895 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:11,898 creating build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,899 copying src/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,902 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,904 copying src/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,907 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,909 copying src/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:11,911 creating build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,913 copying src/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,915 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,918 copying src/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,920 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,923 copying src/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:11,926 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,928 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,931 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,934 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,937 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,940 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:11,943 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,945 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,948 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,951 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,953 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,956 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:11,958 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,959 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,962 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,964 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,966 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,969 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:11,971 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,972 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,975 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,977 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,980 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,983 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:11,985 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,986 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,989 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,992 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,994 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,996 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:11,998 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,000 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,002 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,005 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,007 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,012 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:12,014 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,016 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,018 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,020 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,023 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,026 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:12,028 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,030 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,033 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,035 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,038 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,040 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:12,043 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,044 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,047 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,050 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,052 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,055 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:12,058 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,059 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,062 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,064 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,066 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,069 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:12,071 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,072 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,075 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,077 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,079 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,082 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:12,084 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,085 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,088 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,090 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,092 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,095 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:12,097 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,098 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,100 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,102 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,104 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,106 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:12,108 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,109 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,112 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,114 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,116 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,118 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:12,121 copying src/unitxt/ui/banner.png -> build/lib/unitxt/ui 2026-01-13T10:37:12,126 copying src/unitxt/assistant/embeddings.npz -> build/lib/unitxt/assistant 2026-01-13T10:37:12,530 copying src/unitxt/assistant/metadata.parquet -> build/lib/unitxt/assistant 2026-01-13T10:37:15,794 installing to build/bdist.linux-armv7l/wheel 2026-01-13T10:37:15,795 running install 2026-01-13T10:37:15,818 running install_lib 2026-01-13T10:37:15,824 creating build/bdist.linux-armv7l/wheel 2026-01-13T10:37:15,827 creating build/bdist.linux-armv7l/wheel/unitxt 2026-01-13T10:37:15,828 copying build/lib/unitxt/formats.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,831 copying build/lib/unitxt/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,836 copying build/lib/unitxt/generator_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,838 copying build/lib/unitxt/settings_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,840 copying build/lib/unitxt/logging_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,842 copying build/lib/unitxt/type_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,845 copying build/lib/unitxt/deprecation_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,847 copying build/lib/unitxt/random_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,849 copying build/lib/unitxt/llm_as_judge_chat_templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,851 copying build/lib/unitxt/dataset_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,853 copying build/lib/unitxt/types.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,855 copying build/lib/unitxt/standard.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,858 copying build/lib/unitxt/benchmark.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,860 copying build/lib/unitxt/augmentors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,862 copying build/lib/unitxt/error_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,864 copying build/lib/unitxt/dict_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,868 copying build/lib/unitxt/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,869 copying build/lib/unitxt/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,873 copying build/lib/unitxt/serializers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,875 copying build/lib/unitxt/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,878 copying build/lib/unitxt/dataclass.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,880 copying build/lib/unitxt/split_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,883 copying build/lib/unitxt/dialog_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,885 copying build/lib/unitxt/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:15,892 creating build/bdist.linux-armv7l/wheel/unitxt/assistant 2026-01-13T10:37:15,893 copying build/lib/unitxt/assistant/metadata.parquet -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-13T10:37:15,962 copying build/lib/unitxt/assistant/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-13T10:37:15,964 copying build/lib/unitxt/assistant/app.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-13T10:37:15,967 copying build/lib/unitxt/assistant/embeddings.npz -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-13T10:37:16,693 creating build/bdist.linux-armv7l/wheel/unitxt/assistant/assessment 2026-01-13T10:37:16,694 copying build/lib/unitxt/assistant/assessment/assistant_inference_engine.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-13T10:37:16,696 copying build/lib/unitxt/assistant/assessment/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-13T10:37:16,698 copying build/lib/unitxt/assistant/assessment/my_pretty_table.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-13T10:37:16,700 copying build/lib/unitxt/assistant/index.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-13T10:37:16,702 copying build/lib/unitxt/text_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,704 copying build/lib/unitxt/collections.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,706 copying build/lib/unitxt/span_lableing_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,708 copying build/lib/unitxt/validate.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,710 copying build/lib/unitxt/parsing_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,712 copying build/lib/unitxt/metric_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,715 copying build/lib/unitxt/normalizers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,716 copying build/lib/unitxt/base_metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,719 copying build/lib/unitxt/card.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,720 copying build/lib/unitxt/llm_as_judge_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,722 copying build/lib/unitxt/register.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,724 copying build/lib/unitxt/api.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,726 copying build/lib/unitxt/utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,729 copying build/lib/unitxt/version.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,730 copying build/lib/unitxt/struct_data_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,733 copying build/lib/unitxt/processors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,736 creating build/bdist.linux-armv7l/wheel/unitxt/test_utils 2026-01-13T10:37:16,737 copying build/lib/unitxt/test_utils/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,739 copying build/lib/unitxt/test_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,740 copying build/lib/unitxt/test_utils/storage.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,742 copying build/lib/unitxt/test_utils/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,743 copying build/lib/unitxt/test_utils/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,745 copying build/lib/unitxt/test_utils/card.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,748 copying build/lib/unitxt/test_utils/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-13T10:37:16,749 copying build/lib/unitxt/llm_as_judge_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,751 copying build/lib/unitxt/instructions.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,753 copying build/lib/unitxt/recipe.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,754 copying build/lib/unitxt/image_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,756 copying build/lib/unitxt/system_prompts.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,758 copying build/lib/unitxt/file_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,760 copying build/lib/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,762 copying build/lib/unitxt/inference.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,767 copying build/lib/unitxt/metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,769 copying build/lib/unitxt/templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,771 copying build/lib/unitxt/text2sql_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,774 copying build/lib/unitxt/blocks.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,776 copying build/lib/unitxt/operator.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,779 copying build/lib/unitxt/splitters.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:16,782 creating build/bdist.linux-armv7l/wheel/unitxt/catalog 2026-01-13T10:37:16,783 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers 2026-01-13T10:37:16,785 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/text2sql 2026-01-13T10:37:16,786 copying build/lib/unitxt/catalog/serializers/text2sql/schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/text2sql 2026-01-13T10:37:16,789 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/table 2026-01-13T10:37:16,790 copying build/lib/unitxt/catalog/serializers/table/concat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,791 copying build/lib/unitxt/catalog/serializers/table/json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,793 copying build/lib/unitxt/catalog/serializers/table/indexed_row_major.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,795 copying build/lib/unitxt/catalog/serializers/table/df.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,797 copying build/lib/unitxt/catalog/serializers/table/html.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,799 copying build/lib/unitxt/catalog/serializers/table/markdown.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,800 copying build/lib/unitxt/catalog/serializers/table/image.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-13T10:37:16,803 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks 2026-01-13T10:37:16,804 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag 2026-01-13T10:37:16,805 copying build/lib/unitxt/catalog/tasks/rag/end_to_end.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-13T10:37:16,807 copying build/lib/unitxt/catalog/tasks/rag/corpora.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-13T10:37:16,809 copying build/lib/unitxt/catalog/tasks/rag/response_generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-13T10:37:16,811 copying build/lib/unitxt/catalog/tasks/generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,813 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/tool_calling 2026-01-13T10:37:16,814 copying build/lib/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-01-13T10:37:16,816 copying build/lib/unitxt/catalog/tasks/tool_calling/supervised.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-01-13T10:37:16,818 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/ner 2026-01-13T10:37:16,819 copying build/lib/unitxt/catalog/tasks/ner/all_entity_types.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-01-13T10:37:16,821 copying build/lib/unitxt/catalog/tasks/ner/single_entity_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-01-13T10:37:16,823 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa 2026-01-13T10:37:16,824 copying build/lib/unitxt/catalog/tasks/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-13T10:37:16,826 copying build/lib/unitxt/catalog/tasks/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-13T10:37:16,828 copying build/lib/unitxt/catalog/tasks/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-13T10:37:16,830 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/extractive 2026-01-13T10:37:16,831 copying build/lib/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/extractive 2026-01-13T10:37:16,834 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:37:16,834 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:37:16,836 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:37:16,838 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-13T10:37:16,840 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-13T10:37:16,841 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-13T10:37:16,844 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/with_context 2026-01-13T10:37:16,845 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-13T10:37:16,846 copying build/lib/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-13T10:37:16,848 copying build/lib/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-13T10:37:16,850 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-13T10:37:16,852 copying build/lib/unitxt/catalog/tasks/grammatical_error_correction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,854 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/evaluation 2026-01-13T10:37:16,855 copying build/lib/unitxt/catalog/tasks/evaluation/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/evaluation 2026-01-13T10:37:16,857 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rewriting 2026-01-13T10:37:16,858 copying build/lib/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-01-13T10:37:16,860 copying build/lib/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-01-13T10:37:16,862 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/generation 2026-01-13T10:37:16,863 copying build/lib/unitxt/catalog/tasks/generation/from_pair.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/generation 2026-01-13T10:37:16,865 copying build/lib/unitxt/catalog/tasks/text2sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,867 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/summarization 2026-01-13T10:37:16,868 copying build/lib/unitxt/catalog/tasks/summarization/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/summarization 2026-01-13T10:37:16,870 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression 2026-01-13T10:37:16,871 copying build/lib/unitxt/catalog/tasks/regression/two_texts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-01-13T10:37:16,873 copying build/lib/unitxt/catalog/tasks/regression/single_text.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-01-13T10:37:16,875 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression/two_texts 2026-01-13T10:37:16,876 copying build/lib/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression/two_texts 2026-01-13T10:37:16,879 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/translation 2026-01-13T10:37:16,880 copying build/lib/unitxt/catalog/tasks/translation/directed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/translation 2026-01-13T10:37:16,881 copying build/lib/unitxt/catalog/tasks/schema_linking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,884 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:37:16,885 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:37:16,886 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-13T10:37:16,889 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/span_labeling 2026-01-13T10:37:16,890 copying build/lib/unitxt/catalog/tasks/span_labeling/extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/span_labeling 2026-01-13T10:37:16,892 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval 2026-01-13T10:37:16,893 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:37:16,895 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:37:16,896 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-13T10:37:16,899 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:37:16,900 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:37:16,902 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-13T10:37:16,904 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:37:16,905 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:37:16,907 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-13T10:37:16,909 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:37:16,910 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:37:16,912 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-13T10:37:16,914 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:37:16,915 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:37:16,916 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-13T10:37:16,919 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification 2026-01-13T10:37:16,920 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/binary 2026-01-13T10:37:16,921 copying build/lib/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/binary 2026-01-13T10:37:16,923 copying build/lib/unitxt/catalog/tasks/classification/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-13T10:37:16,925 copying build/lib/unitxt/catalog/tasks/classification/multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-13T10:37:16,927 copying build/lib/unitxt/catalog/tasks/classification/multi_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-13T10:37:16,929 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:37:16,930 copying build/lib/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:37:16,932 copying build/lib/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:37:16,934 copying build/lib/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-13T10:37:16,937 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment 2026-01-13T10:37:16,938 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:37:16,939 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:37:16,941 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:37:16,943 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:37:16,945 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-13T10:37:16,947 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:16,948 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:16,950 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:37:16,951 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:37:16,953 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:37:16,954 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:37:16,956 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-13T10:37:16,958 copying build/lib/unitxt/catalog/tasks/text2sql_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,960 copying build/lib/unitxt/catalog/tasks/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,961 copying build/lib/unitxt/catalog/tasks/key_value_extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-13T10:37:16,964 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/selection 2026-01-13T10:37:16,965 copying build/lib/unitxt/catalog/tasks/selection/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/selection 2026-01-13T10:37:16,967 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/completion 2026-01-13T10:37:16,968 copying build/lib/unitxt/catalog/tasks/completion/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-13T10:37:16,971 copying build/lib/unitxt/catalog/tasks/completion/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-13T10:37:16,972 copying build/lib/unitxt/catalog/tasks/completion/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-13T10:37:16,975 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors 2026-01-13T10:37:16,976 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,978 copying build/lib/unitxt/catalog/processors/safe_unsafe.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,980 copying build/lib/unitxt/catalog/processors/load_json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,982 copying build/lib/unitxt/catalog/processors/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,983 copying build/lib/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,985 copying build/lib/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,987 copying build/lib/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,989 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,990 copying build/lib/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,992 copying build/lib/unitxt/catalog/processors/load_json_from_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,994 copying build/lib/unitxt/catalog/processors/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,996 copying build/lib/unitxt/catalog/processors/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:16,998 copying build/lib/unitxt/catalog/processors/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,000 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors/text2sql 2026-01-13T10:37:17,001 copying build/lib/unitxt/catalog/processors/text2sql/get_sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors/text2sql 2026-01-13T10:37:17,003 copying build/lib/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,004 copying build/lib/unitxt/catalog/processors/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,006 copying build/lib/unitxt/catalog/processors/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,009 copying build/lib/unitxt/catalog/processors/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,010 copying build/lib/unitxt/catalog/processors/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,012 copying build/lib/unitxt/catalog/processors/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,014 copying build/lib/unitxt/catalog/processors/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,016 copying build/lib/unitxt/catalog/processors/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,018 copying build/lib/unitxt/catalog/processors/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,019 copying build/lib/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,021 copying build/lib/unitxt/catalog/processors/to_string_stripped.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,023 copying build/lib/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,025 copying build/lib/unitxt/catalog/processors/multi_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,026 copying build/lib/unitxt/catalog/processors/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,028 copying build/lib/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,030 copying build/lib/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,032 copying build/lib/unitxt/catalog/processors/to_span_label_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,034 copying build/lib/unitxt/catalog/processors/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,036 copying build/lib/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,037 copying build/lib/unitxt/catalog/processors/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,039 copying build/lib/unitxt/catalog/processors/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,040 copying build/lib/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,042 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,044 copying build/lib/unitxt/catalog/processors/to_list_by_comma.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,045 copying build/lib/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,047 copying build/lib/unitxt/catalog/processors/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,049 copying build/lib/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,051 copying build/lib/unitxt/catalog/processors/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,052 copying build/lib/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,054 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,056 copying build/lib/unitxt/catalog/processors/load_json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,058 copying build/lib/unitxt/catalog/processors/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,059 copying build/lib/unitxt/catalog/processors/to_string.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,061 copying build/lib/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,063 copying build/lib/unitxt/catalog/processors/to_list_by_comma_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,064 copying build/lib/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,066 copying build/lib/unitxt/catalog/processors/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,068 copying build/lib/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,070 copying build/lib/unitxt/catalog/processors/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,072 copying build/lib/unitxt/catalog/processors/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,073 copying build/lib/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,075 copying build/lib/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-13T10:37:17,078 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates 2026-01-13T10:37:17,080 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag 2026-01-13T10:37:17,082 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,083 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,085 copying build/lib/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,087 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,089 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,091 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-13T10:37:17,093 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/end_to_end 2026-01-13T10:37:17,095 copying build/lib/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/end_to_end 2026-01-13T10:37:17,097 copying build/lib/unitxt/catalog/templates/key_val.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-13T10:37:17,100 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/tool_calling 2026-01-13T10:37:17,101 copying build/lib/unitxt/catalog/templates/tool_calling/base.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-01-13T10:37:17,104 copying build/lib/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-01-13T10:37:17,106 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,108 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,110 copying build/lib/unitxt/catalog/templates/text2sql/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,111 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,113 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,115 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,117 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,119 copying build/lib/unitxt/catalog/templates/text2sql/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,121 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,123 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,124 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-13T10:37:17,127 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/key_value_extraction 2026-01-13T10:37:17,128 copying build/lib/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/key_value_extraction 2026-01-13T10:37:17,130 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa 2026-01-13T10:37:17,131 copying build/lib/unitxt/catalog/templates/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-13T10:37:17,133 copying build/lib/unitxt/catalog/templates/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-13T10:37:17,135 copying build/lib/unitxt/catalog/templates/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-13T10:37:17,137 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,138 copying build/lib/unitxt/catalog/templates/qa/open/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,140 copying build/lib/unitxt/catalog/templates/qa/open/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,141 copying build/lib/unitxt/catalog/templates/qa/open/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,143 copying build/lib/unitxt/catalog/templates/qa/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,145 copying build/lib/unitxt/catalog/templates/qa/open/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-13T10:37:17,147 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision 2026-01-13T10:37:17,148 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice 2026-01-13T10:37:17,150 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-13T10:37:17,151 copying build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-13T10:37:17,153 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:37:17,154 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:37:17,156 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:37:17,158 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-13T10:37:17,160 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn 2026-01-13T10:37:17,162 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-13T10:37:17,163 copying build/lib/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-13T10:37:17,166 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:37:17,167 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:37:17,169 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:37:17,171 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,173 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,175 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:37:17,176 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:37:17,178 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:37:17,179 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:37:17,181 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-13T10:37:17,183 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:37:17,184 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:37:17,186 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:37:17,188 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:37:17,190 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-13T10:37:17,192 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,194 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,195 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,197 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,199 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,201 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,203 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:37:17,204 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:37:17,206 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:37:17,208 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:37:17,209 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-13T10:37:17,212 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:37:17,213 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:37:17,214 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:37:17,216 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:37:17,218 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-13T10:37:17,220 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:37:17,221 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:37:17,223 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:37:17,225 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:37:17,227 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-13T10:37:17,229 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-13T10:37:17,230 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:37:17,233 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,234 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:37:17,235 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:37:17,237 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:37:17,239 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:37:17,241 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-13T10:37:17,243 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:37:17,244 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:37:17,246 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:37:17,248 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:37:17,250 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-13T10:37:17,252 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,253 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,255 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,257 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,259 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:37:17,261 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:37:17,262 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:37:17,264 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:37:17,266 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-13T10:37:17,268 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:37:17,269 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:37:17,271 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:37:17,273 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:37:17,275 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-13T10:37:17,277 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:37:17,278 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:37:17,280 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:37:17,282 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:37:17,284 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-13T10:37:17,286 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-13T10:37:17,288 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-13T10:37:17,290 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,291 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,293 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,295 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,297 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,299 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,301 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,302 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,305 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:37:17,306 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:37:17,308 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:37:17,309 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:37:17,311 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-13T10:37:17,313 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:37:17,314 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:37:17,316 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:37:17,318 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:37:17,320 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-13T10:37:17,322 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,323 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,325 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,327 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,328 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,330 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:37:17,331 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:37:17,333 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:37:17,335 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:37:17,337 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-13T10:37:17,339 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:37:17,340 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:37:17,342 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:37:17,344 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:37:17,346 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-13T10:37:17,348 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:37:17,349 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:37:17,351 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:37:17,353 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:37:17,355 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-13T10:37:17,357 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-13T10:37:17,359 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,361 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:37:17,363 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:37:17,364 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:37:17,366 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:37:17,368 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:37:17,370 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-13T10:37:17,372 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:37:17,373 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:37:17,375 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:37:17,377 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:37:17,379 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-13T10:37:17,381 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:37:17,382 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:37:17,384 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:37:17,387 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:37:17,388 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:37:17,390 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:37:17,392 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:37:17,394 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-13T10:37:17,396 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:37:17,397 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:37:17,399 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:37:17,401 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:37:17,403 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-13T10:37:17,405 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:37:17,406 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:37:17,408 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:37:17,410 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:37:17,411 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-13T10:37:17,413 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-13T10:37:17,415 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,417 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-13T10:37:17,420 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,420 copying build/lib/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,422 copying build/lib/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,424 copying build/lib/unitxt/catalog/templates/qa/with_context/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,426 copying build/lib/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,428 copying build/lib/unitxt/catalog/templates/qa/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,430 copying build/lib/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,432 copying build/lib/unitxt/catalog/templates/qa/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,434 copying build/lib/unitxt/catalog/templates/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,435 copying build/lib/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,437 copying build/lib/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,439 copying build/lib/unitxt/catalog/templates/qa/with_context/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,441 copying build/lib/unitxt/catalog/templates/qa/with_context/question_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,442 copying build/lib/unitxt/catalog/templates/qa/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-13T10:37:17,444 copying build/lib/unitxt/catalog/templates/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-13T10:37:17,446 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation 2026-01-13T10:37:17,448 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation/preference 2026-01-13T10:37:17,449 copying build/lib/unitxt/catalog/templates/evaluation/preference/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-01-13T10:37:17,451 copying build/lib/unitxt/catalog/templates/evaluation/preference/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-01-13T10:37:17,453 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting 2026-01-13T10:37:17,455 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:37:17,456 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:37:17,458 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-01-13T10:37:17,460 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:37:17,461 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:37:17,463 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-01-13T10:37:17,465 copying build/lib/unitxt/catalog/templates/key_val_with_new_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-13T10:37:17,467 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation 2026-01-13T10:37:17,469 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation/from_pair 2026-01-13T10:37:17,470 copying build/lib/unitxt/catalog/templates/generation/from_pair/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-01-13T10:37:17,472 copying build/lib/unitxt/catalog/templates/generation/from_pair/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-01-13T10:37:17,474 copying build/lib/unitxt/catalog/templates/generation/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-13T10:37:17,476 copying build/lib/unitxt/catalog/templates/generation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-13T10:37:17,478 copying build/lib/unitxt/catalog/templates/generation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-13T10:37:17,480 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization 2026-01-13T10:37:17,481 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,483 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,484 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,486 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,488 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,490 copying build/lib/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,491 copying build/lib/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,493 copying build/lib/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,495 copying build/lib/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,496 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,498 copying build/lib/unitxt/catalog/templates/summarization/abstractive/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,500 copying build/lib/unitxt/catalog/templates/summarization/abstractive/full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,502 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,504 copying build/lib/unitxt/catalog/templates/summarization/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,506 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,508 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,509 copying build/lib/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,511 copying build/lib/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-13T10:37:17,513 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression 2026-01-13T10:37:17,515 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/single_text 2026-01-13T10:37:17,516 copying build/lib/unitxt/catalog/templates/regression/single_text/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-13T10:37:17,518 copying build/lib/unitxt/catalog/templates/regression/single_text/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-13T10:37:17,520 copying build/lib/unitxt/catalog/templates/regression/single_text/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-13T10:37:17,522 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts 2026-01-13T10:37:17,523 copying build/lib/unitxt/catalog/templates/regression/two_texts/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-13T10:37:17,525 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-13T10:37:17,526 copying build/lib/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts/similarity 2026-01-13T10:37:17,528 copying build/lib/unitxt/catalog/templates/regression/two_texts/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-13T10:37:17,530 copying build/lib/unitxt/catalog/templates/regression/two_texts/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-13T10:37:17,533 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:37:17,534 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:37:17,536 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-01-13T10:37:17,538 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation 2026-01-13T10:37:17,540 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,541 copying build/lib/unitxt/catalog/templates/translation/directed/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,543 copying build/lib/unitxt/catalog/templates/translation/directed/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,545 copying build/lib/unitxt/catalog/templates/translation/directed/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,546 copying build/lib/unitxt/catalog/templates/translation/directed/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,548 copying build/lib/unitxt/catalog/templates/translation/directed/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,550 copying build/lib/unitxt/catalog/templates/translation/directed/playful.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,552 copying build/lib/unitxt/catalog/templates/translation/directed/instructional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,553 copying build/lib/unitxt/catalog/templates/translation/directed/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-13T10:37:17,556 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,558 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:37:17,559 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:37:17,561 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:37:17,562 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-13T10:37:17,564 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,566 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,568 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:37:17,569 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:37:17,571 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:37:17,573 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:37:17,574 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-13T10:37:17,576 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,578 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,580 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,582 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-13T10:37:17,584 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:37:17,585 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:37:17,587 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:37:17,589 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:37:17,591 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-13T10:37:17,593 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:37:17,594 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:37:17,596 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:37:17,598 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:37:17,600 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-13T10:37:17,602 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/schema_linking 2026-01-13T10:37:17,603 copying build/lib/unitxt/catalog/templates/schema_linking/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-13T10:37:17,605 copying build/lib/unitxt/catalog/templates/schema_linking/with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-13T10:37:17,607 copying build/lib/unitxt/catalog/templates/schema_linking/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-13T10:37:17,610 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/safety 2026-01-13T10:37:17,610 copying build/lib/unitxt/catalog/templates/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-01-13T10:37:17,612 copying build/lib/unitxt/catalog/templates/safety/harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-01-13T10:37:17,615 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling 2026-01-13T10:37:17,616 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,617 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,619 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,621 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,623 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,625 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,626 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,628 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,630 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-13T10:37:17,632 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval 2026-01-13T10:37:17,634 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,635 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,637 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,640 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,641 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,643 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,646 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,648 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,650 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,653 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,655 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,657 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,660 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,662 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,664 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,666 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,668 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,670 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,672 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-13T10:37:17,674 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,675 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,677 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,679 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,681 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,683 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,685 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-13T10:37:17,688 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,689 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,691 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,693 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,695 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,697 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,699 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,700 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,702 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,704 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-13T10:37:17,706 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,707 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,709 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,711 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,713 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,715 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,717 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,719 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,720 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,722 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,724 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,726 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,728 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,730 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,731 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,733 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-13T10:37:17,736 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,737 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,739 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,740 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,742 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,744 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,746 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,747 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-13T10:37:17,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:37:17,751 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:37:17,753 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-01-13T10:37:17,755 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/language_identification 2026-01-13T10:37:17,756 copying build/lib/unitxt/catalog/templates/language_identification/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-01-13T10:37:17,758 copying build/lib/unitxt/catalog/templates/language_identification/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-01-13T10:37:17,760 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification 2026-01-13T10:37:17,761 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,762 copying build/lib/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,764 copying build/lib/unitxt/catalog/templates/classification/multi_label/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,766 copying build/lib/unitxt/catalog/templates/classification/multi_label/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,768 copying build/lib/unitxt/catalog/templates/classification/multi_label/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,769 copying build/lib/unitxt/catalog/templates/classification/multi_label/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-13T10:37:17,772 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,773 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,775 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,777 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,778 copying build/lib/unitxt/catalog/templates/classification/multi_class/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,780 copying build/lib/unitxt/catalog/templates/classification/multi_class/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,782 copying build/lib/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,784 copying build/lib/unitxt/catalog/templates/classification/multi_class/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,785 copying build/lib/unitxt/catalog/templates/classification/multi_class/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,787 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-13T10:37:17,789 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:37:17,791 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:37:17,793 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:37:17,795 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,796 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,798 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,800 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,801 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,803 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,805 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,806 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,809 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-13T10:37:17,810 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-13T10:37:17,813 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment 2026-01-13T10:37:17,814 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,816 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,818 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,821 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,824 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,828 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,832 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,835 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,838 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-13T10:37:17,841 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:17,842 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:17,844 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:17,846 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:17,848 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:17,850 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,851 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,853 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,855 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,856 copying build/lib/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,858 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,860 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,862 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-13T10:37:17,864 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection 2026-01-13T10:37:17,866 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:37:17,867 copying build/lib/unitxt/catalog/templates/selection/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:37:17,869 copying build/lib/unitxt/catalog/templates/selection/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-01-13T10:37:17,871 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion 2026-01-13T10:37:17,873 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,875 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,879 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,883 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,885 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,887 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,889 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-13T10:37:17,891 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/abstractive 2026-01-13T10:37:17,892 copying build/lib/unitxt/catalog/templates/completion/abstractive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-13T10:37:17,894 copying build/lib/unitxt/catalog/templates/completion/abstractive/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-13T10:37:17,896 copying build/lib/unitxt/catalog/templates/completion/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-13T10:37:17,900 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics 2026-01-13T10:37:17,902 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/sentence_bert 2026-01-13T10:37:17,903 copying build/lib/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-13T10:37:17,905 copying build/lib/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-13T10:37:17,906 copying build/lib/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-13T10:37:17,909 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag 2026-01-13T10:37:17,910 copying build/lib/unitxt/catalog/metrics/rag/answer_inference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,912 copying build/lib/unitxt/catalog/metrics/rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,914 copying build/lib/unitxt/catalog/metrics/rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,916 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,917 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,919 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,921 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,922 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,924 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,926 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,928 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,929 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,931 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,933 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,934 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,936 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,938 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,940 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,941 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,943 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,945 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,947 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-13T10:37:17,949 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,951 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:37:17,952 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:37:17,954 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:37:17,956 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-13T10:37:17,957 copying build/lib/unitxt/catalog/metrics/rag/context_perplexity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,960 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,961 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,963 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,964 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,966 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,968 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,969 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-13T10:37:17,971 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,973 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,976 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:17,979 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,980 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,983 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,985 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,987 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,989 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,991 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,992 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,994 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,996 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-13T10:37:17,998 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation 2026-01-13T10:37:18,000 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,001 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,003 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,005 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,007 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,008 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,010 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,012 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,014 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,015 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,017 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,019 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,020 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,022 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,024 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,026 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,028 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,030 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-13T10:37:18,032 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended 2026-01-13T10:37:18,033 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-13T10:37:18,035 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-13T10:37:18,037 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-13T10:37:18,038 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-13T10:37:18,040 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-13T10:37:18,041 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-13T10:37:18,043 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-13T10:37:18,044 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-13T10:37:18,047 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-13T10:37:18,048 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-13T10:37:18,050 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,051 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,053 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,055 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,057 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,059 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,062 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,064 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,066 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,068 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,070 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,072 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,074 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,076 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-13T10:37:18,078 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-13T10:37:18,079 copying build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-13T10:37:18,081 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,082 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,084 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,086 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,088 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,090 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,092 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,093 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,095 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,097 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,099 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,100 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,102 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,104 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,105 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,107 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,109 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-13T10:37:18,111 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-13T10:37:18,112 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-13T10:37:18,114 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-13T10:37:18,116 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:37:18,117 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:37:18,119 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-13T10:37:18,121 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-13T10:37:18,123 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-13T10:37:18,124 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-13T10:37:18,127 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,128 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,130 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,134 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,135 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,139 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,142 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,145 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,148 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,150 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,152 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,153 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,155 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,157 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,159 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,160 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,162 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,164 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,165 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,167 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,169 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-13T10:37:18,171 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:37:18,172 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:37:18,174 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:37:18,176 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-13T10:37:18,178 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended 2026-01-13T10:37:18,179 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-13T10:37:18,181 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-13T10:37:18,183 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-13T10:37:18,184 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-13T10:37:18,187 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-13T10:37:18,188 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-13T10:37:18,190 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-13T10:37:18,191 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-13T10:37:18,194 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-13T10:37:18,195 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-13T10:37:18,197 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,198 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,200 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,202 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,204 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,206 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,207 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,209 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,211 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,213 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,215 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,217 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,220 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,222 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-13T10:37:18,224 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,227 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,230 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,231 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,233 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,235 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,237 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,239 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,241 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,243 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,244 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,246 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,248 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,249 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,251 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,253 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,254 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,256 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-13T10:37:18,258 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-13T10:37:18,260 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,261 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,263 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,265 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,266 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,268 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,270 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,272 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,273 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,275 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,277 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,279 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,281 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,282 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,284 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,286 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,288 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-13T10:37:18,290 copying build/lib/unitxt/catalog/metrics/rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:18,293 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,294 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,297 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,299 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,301 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,302 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,304 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,306 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,308 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,309 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,311 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-13T10:37:18,313 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,314 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,316 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,318 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,320 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,321 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-13T10:37:18,323 copying build/lib/unitxt/catalog/metrics/rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-13T10:37:18,326 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,326 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,329 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,331 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,332 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,334 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,336 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,337 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,339 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,341 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,342 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,344 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,346 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,347 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,349 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,351 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,353 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,354 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,356 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,358 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,365 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-13T10:37:18,368 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:37:18,369 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:37:18,371 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:37:18,372 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-13T10:37:18,375 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended 2026-01-13T10:37:18,376 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-13T10:37:18,377 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-13T10:37:18,379 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-13T10:37:18,380 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-13T10:37:18,383 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-13T10:37:18,384 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-13T10:37:18,386 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-13T10:37:18,387 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-13T10:37:18,389 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-13T10:37:18,390 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-13T10:37:18,393 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,394 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,396 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,397 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,399 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,401 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,403 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,405 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,407 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,409 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,411 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,413 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,415 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,417 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-13T10:37:18,419 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,421 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,423 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,425 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,427 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,429 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,431 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,433 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,435 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,437 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,440 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,442 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,444 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,446 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,448 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,451 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,453 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-13T10:37:18,455 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,457 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,458 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,461 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,463 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,465 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,467 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,469 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,472 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,474 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,476 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,479 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,481 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,484 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,486 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,489 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,491 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,493 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-13T10:37:18,496 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-13T10:37:18,498 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness 2026-01-13T10:37:18,500 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-01-13T10:37:18,502 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-01-13T10:37:18,504 copying build/lib/unitxt/catalog/metrics/anls.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,506 copying build/lib/unitxt/catalog/metrics/spearman.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,509 copying build/lib/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,511 copying build/lib/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,513 copying build/lib/unitxt/catalog/metrics/kendalltau_b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,515 copying build/lib/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,518 copying build/lib/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,520 copying build/lib/unitxt/catalog/metrics/kpa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,522 copying build/lib/unitxt/catalog/metrics/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,525 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/reward 2026-01-13T10:37:18,526 copying build/lib/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/reward 2026-01-13T10:37:18,529 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_q 2026-01-13T10:37:18,530 copying build/lib/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_q 2026-01-13T10:37:18,533 copying build/lib/unitxt/catalog/metrics/max_accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,535 copying build/lib/unitxt/catalog/metrics/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,539 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,540 copying build/lib/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,542 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,544 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,547 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,549 copying build/lib/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,551 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-13T10:37:18,553 copying build/lib/unitxt/catalog/metrics/regard_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,555 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_nli 2026-01-13T10:37:18,556 copying build/lib/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_nli 2026-01-13T10:37:18,559 copying build/lib/unitxt/catalog/metrics/rouge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,562 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling 2026-01-13T10:37:18,563 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/reflection 2026-01-13T10:37:18,564 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/reflection 2026-01-13T10:37:18,567 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:18,568 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:18,570 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-01-13T10:37:18,572 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling 2026-01-13T10:37:18,574 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-13T10:37:18,575 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-13T10:37:18,578 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-13T10:37:18,579 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-13T10:37:18,582 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/correctness 2026-01-13T10:37:18,583 copying build/lib/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/correctness 2026-01-13T10:37:18,585 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/text2sql 2026-01-13T10:37:18,586 copying build/lib/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-13T10:37:18,589 copying build/lib/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-13T10:37:18,590 copying build/lib/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-13T10:37:18,592 copying build/lib/unitxt/catalog/metrics/f1_micro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,594 copying build/lib/unitxt/catalog/metrics/recall_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,597 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:18,598 copying build/lib/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:18,601 copying build/lib/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-01-13T10:37:18,603 copying build/lib/unitxt/catalog/metrics/root_mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,606 copying build/lib/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,608 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa 2026-01-13T10:37:18,610 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa/open 2026-01-13T10:37:18,611 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-13T10:37:18,613 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-13T10:37:18,614 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-13T10:37:18,616 copying build/lib/unitxt/catalog/metrics/f1_macro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,618 copying build/lib/unitxt/catalog/metrics/max_f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,619 copying build/lib/unitxt/catalog/metrics/matthews_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,621 copying build/lib/unitxt/catalog/metrics/is_code_mixed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,623 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_a 2026-01-13T10:37:18,624 copying build/lib/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_a 2026-01-13T10:37:18,626 copying build/lib/unitxt/catalog/metrics/bleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,628 copying build/lib/unitxt/catalog/metrics/ndcg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,630 copying build/lib/unitxt/catalog/metrics/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,631 copying build/lib/unitxt/catalog/metrics/meteor_hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,633 copying build/lib/unitxt/catalog/metrics/rerank_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,635 copying build/lib/unitxt/catalog/metrics/relaxed_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,636 copying build/lib/unitxt/catalog/metrics/pearson.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:18,639 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,640 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,642 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,644 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,646 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,648 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,650 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,652 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,654 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,656 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,658 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,661 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,663 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,666 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,668 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,671 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,674 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,676 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,678 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,680 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-13T10:37:18,682 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge 2026-01-13T10:37:18,684 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise 2026-01-13T10:37:18,685 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:18,686 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:18,688 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:18,690 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-13T10:37:18,693 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,694 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,695 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,697 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,699 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,700 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,702 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-13T10:37:18,704 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,705 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,707 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,709 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,711 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,713 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,714 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,716 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,718 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,720 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-13T10:37:18,723 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,724 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,726 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,728 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,730 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,732 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-13T10:37:18,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,735 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,737 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,739 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,741 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,743 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,745 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,747 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,749 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,750 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,752 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,754 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,756 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-13T10:37:18,758 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,759 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,761 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,763 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,765 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,767 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,769 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,770 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-13T10:37:18,773 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,773 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,775 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,777 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,779 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,780 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,782 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-13T10:37:18,784 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:18,785 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:18,787 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-13T10:37:18,789 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,790 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,792 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,794 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,796 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,798 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,799 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,801 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-13T10:37:18,803 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,805 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,807 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,808 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,810 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,812 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,814 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,816 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,819 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,821 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-13T10:37:18,825 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,827 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,829 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,831 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,832 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,834 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,836 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,838 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,840 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,841 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,844 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,846 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,848 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,849 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,851 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,853 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,854 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,856 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,858 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-13T10:37:18,860 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,861 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-13T10:37:18,862 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-13T10:37:18,865 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-13T10:37:18,866 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-13T10:37:18,868 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,870 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-13T10:37:18,871 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-13T10:37:18,874 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,876 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,878 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,879 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,881 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-13T10:37:18,883 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct 2026-01-13T10:37:18,885 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:18,886 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:18,888 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:18,890 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-13T10:37:18,893 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,894 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,896 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,899 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,901 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,902 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,904 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-13T10:37:18,906 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,907 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,909 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,911 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,913 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,915 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,916 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,918 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,920 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,921 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-13T10:37:18,923 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,924 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,926 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,928 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,929 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,931 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-13T10:37:18,933 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,934 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,936 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,938 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,940 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,941 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,943 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,945 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,947 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,948 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,950 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,952 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,954 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-13T10:37:18,957 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,958 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,960 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,961 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,963 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,965 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,966 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,968 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,970 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,973 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,975 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,977 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,980 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,983 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,986 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,988 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,990 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,992 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,993 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,995 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,997 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:18,999 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,000 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,002 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,004 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,006 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,007 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,009 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,011 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,012 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,014 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,016 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,018 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,020 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,021 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,023 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,025 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,027 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,029 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,031 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,032 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,034 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,035 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,037 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,039 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,041 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,042 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,044 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,046 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,048 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,049 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,051 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,053 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,054 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,056 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,058 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,060 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,062 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,064 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,065 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,067 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,069 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,070 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,072 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,074 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,075 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,077 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-13T10:37:19,080 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,081 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,083 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,084 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,086 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,088 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,090 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-13T10:37:19,092 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:19,093 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:19,095 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-13T10:37:19,097 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,098 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,100 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,102 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,103 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,105 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,106 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,108 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-13T10:37:19,110 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,111 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,113 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,115 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,117 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,119 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,121 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,122 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,124 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,126 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-13T10:37:19,128 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:19,129 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:19,131 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-01-13T10:37:19,133 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:19,135 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:19,136 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:19,139 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-13T10:37:19,140 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-13T10:37:19,142 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:19,143 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:19,145 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:19,146 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-13T10:37:19,148 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-13T10:37:19,150 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian 2026-01-13T10:37:19,152 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,153 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,155 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,157 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,158 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,160 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,162 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-13T10:37:19,164 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-13T10:37:19,165 copying build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-13T10:37:19,168 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,169 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,171 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,173 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,175 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,176 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-13T10:37:19,179 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:19,180 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:19,182 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:19,184 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-13T10:37:19,186 copying build/lib/unitxt/catalog/metrics/accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,188 copying build/lib/unitxt/catalog/metrics/websrc_squad_f1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,190 copying build/lib/unitxt/catalog/metrics/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,192 copying build/lib/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,194 copying build/lib/unitxt/catalog/metrics/roc_auc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,196 copying build/lib/unitxt/catalog/metrics/token_overlap_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,198 copying build/lib/unitxt/catalog/metrics/jaccard_index_words.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,200 copying build/lib/unitxt/catalog/metrics/fuzzyner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,202 copying build/lib/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,204 copying build/lib/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,206 copying build/lib/unitxt/catalog/metrics/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,208 copying build/lib/unitxt/catalog/metrics/safety_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,210 copying build/lib/unitxt/catalog/metrics/meteor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,212 copying build/lib/unitxt/catalog/metrics/f1_weighted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,214 copying build/lib/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,217 copying build/lib/unitxt/catalog/metrics/precision_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,219 copying build/lib/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,221 copying build/lib/unitxt/catalog/metrics/char_edit_distance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_chat 2026-01-13T10:37:19,225 copying build/lib/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_chat 2026-01-13T10:37:19,228 copying build/lib/unitxt/catalog/metrics/ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,231 copying build/lib/unitxt/catalog/metrics/string_containment_ratio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,233 copying build/lib/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,235 copying build/lib/unitxt/catalog/metrics/string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,238 copying build/lib/unitxt/catalog/metrics/mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,240 copying build/lib/unitxt/catalog/metrics/sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,243 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity 2026-01-13T10:37:19,244 copying build/lib/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity 2026-01-13T10:37:19,246 copying build/lib/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,248 copying build/lib/unitxt/catalog/metrics/exact_match_mm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,250 copying build/lib/unitxt/catalog/metrics/metric_based_ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,252 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:19,254 copying build/lib/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:19,256 copying build/lib/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-01-13T10:37:19,258 copying build/lib/unitxt/catalog/metrics/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,260 copying build/lib/unitxt/catalog/metrics/f1_strings.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,261 copying build/lib/unitxt/catalog/metrics/jaccard_index.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,263 copying build/lib/unitxt/catalog/metrics/prediction_length.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,265 copying build/lib/unitxt/catalog/metrics/wer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,267 copying build/lib/unitxt/catalog/metrics/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,269 copying build/lib/unitxt/catalog/metrics/f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,271 copying build/lib/unitxt/catalog/metrics/fin_qa_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-13T10:37:19,274 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/benchmarks 2026-01-13T10:37:19,275 copying build/lib/unitxt/catalog/benchmarks/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,278 copying build/lib/unitxt/catalog/benchmarks/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,280 copying build/lib/unitxt/catalog/benchmarks/vision_default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,282 copying build/lib/unitxt/catalog/benchmarks/vision_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,284 copying build/lib/unitxt/catalog/benchmarks/torr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,287 copying build/lib/unitxt/catalog/benchmarks/llama_vision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,289 copying build/lib/unitxt/catalog/benchmarks/glue.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-13T10:37:19,292 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors 2026-01-13T10:37:19,293 copying build/lib/unitxt/catalog/augmentors/no_augmentation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-13T10:37:19,296 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/table 2026-01-13T10:37:19,297 copying build/lib/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,299 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,301 copying build/lib/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,303 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,305 copying build/lib/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,307 copying build/lib/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,309 copying build/lib/unitxt/catalog/augmentors/table/truncate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,311 copying build/lib/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,313 copying build/lib/unitxt/catalog/augmentors/table/transpose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-13T10:37:19,315 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-13T10:37:19,317 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-13T10:37:19,320 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/text 2026-01-13T10:37:19,321 copying build/lib/unitxt/catalog/augmentors/text/white_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-01-13T10:37:19,323 copying build/lib/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-01-13T10:37:19,326 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/image 2026-01-13T10:37:19,328 copying build/lib/unitxt/catalog/augmentors/image/grey_scale.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-13T10:37:19,330 copying build/lib/unitxt/catalog/augmentors/image/oldify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-13T10:37:19,332 copying build/lib/unitxt/catalog/augmentors/image/grid_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-13T10:37:19,334 copying build/lib/unitxt/catalog/augmentors/image/white_noise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-13T10:37:19,338 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards 2026-01-13T10:37:19,340 copying build/lib/unitxt/catalog/cards/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:19,342 copying build/lib/unitxt/catalog/cards/simple_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:19,344 copying build/lib/unitxt/catalog/cards/unfair_tos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:19,347 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag 2026-01-13T10:37:19,349 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents 2026-01-13T10:37:19,351 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/bioasq 2026-01-13T10:37:19,352 copying build/lib/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/bioasq 2026-01-13T10:37:19,355 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-13T10:37:19,356 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-13T10:37:19,359 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-13T10:37:19,361 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-13T10:37:19,363 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-13T10:37:19,365 copying build/lib/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/miniwiki 2026-01-13T10:37:19,367 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-13T10:37:19,369 copying build/lib/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/clap_nq 2026-01-13T10:37:19,371 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-13T10:37:19,373 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-13T10:37:19,376 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-13T10:37:19,377 copying build/lib/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-13T10:37:19,380 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-13T10:37:19,381 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-13T10:37:19,384 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-13T10:37:19,385 copying build/lib/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-13T10:37:19,388 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation 2026-01-13T10:37:19,389 copying build/lib/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation 2026-01-13T10:37:19,392 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:19,394 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:19,396 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-01-13T10:37:19,399 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,400 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,403 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,404 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,406 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,408 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,410 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,411 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,413 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,415 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,417 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,419 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,420 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-13T10:37:19,423 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench 2026-01-13T10:37:19,424 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,426 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,428 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,429 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,431 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,433 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-13T10:37:19,435 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train 2026-01-13T10:37:19,437 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,438 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,440 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,442 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,444 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,445 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-13T10:37:19,448 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag 2026-01-13T10:37:19,449 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:19,450 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:19,452 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:19,454 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:19,456 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-13T10:37:19,458 copying build/lib/unitxt/catalog/cards/rag/mtrag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag 2026-01-13T10:37:19,460 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark 2026-01-13T10:37:19,462 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-13T10:37:19,463 copying build/lib/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-13T10:37:19,465 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-13T10:37:19,466 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-13T10:37:19,469 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-13T10:37:19,470 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-13T10:37:19,473 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-13T10:37:19,474 copying build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-13T10:37:19,476 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-13T10:37:19,477 copying build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-13T10:37:19,480 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-13T10:37:19,481 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-13T10:37:19,483 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-13T10:37:19,484 copying build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-13T10:37:19,486 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-13T10:37:19,487 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-13T10:37:19,490 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-13T10:37:19,491 copying build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-13T10:37:19,494 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu 2026-01-13T10:37:19,496 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,497 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,499 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,501 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,503 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,505 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,507 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,510 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,512 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,513 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,515 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,517 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,519 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,521 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,523 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,525 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,527 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,528 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,530 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,532 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,534 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,535 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,537 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,539 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,541 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,543 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,545 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,546 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,548 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,550 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,552 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,554 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,556 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,558 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,560 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,562 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,564 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,565 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,567 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,569 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,571 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,573 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,574 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,576 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,578 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,580 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,582 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,584 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,586 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,588 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,590 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,592 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,594 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,597 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,599 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,601 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,603 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,605 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-13T10:37:19,608 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,609 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,611 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,613 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,614 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,616 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,620 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,622 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,624 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,625 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,627 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,629 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,631 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,634 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,636 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,638 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,640 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,642 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,644 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,648 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,650 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,653 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,655 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,657 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,659 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,662 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,664 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,669 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,671 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,673 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,675 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,677 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,679 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,681 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,683 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,685 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,688 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,690 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,692 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,693 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,695 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,697 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,699 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,701 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,703 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,704 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,706 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,708 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,710 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,712 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,713 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,716 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-13T10:37:19,720 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,721 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,723 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,725 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,727 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,730 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,732 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,735 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,737 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,739 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,741 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,744 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,746 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,749 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,753 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,755 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,757 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,759 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,761 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,763 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,765 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,766 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,768 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,770 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,772 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,774 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,776 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,777 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,779 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,781 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,783 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,785 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,786 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,788 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,791 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,792 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,795 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,797 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,799 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,800 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,802 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,804 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,806 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,808 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,809 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,811 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,813 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,815 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,817 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,819 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,822 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,824 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,826 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,828 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,830 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,832 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,834 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,836 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-13T10:37:19,839 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,840 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,842 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,844 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,845 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,847 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,849 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,851 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,853 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,855 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,856 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,859 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,861 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,863 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,866 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,868 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,870 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,872 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,874 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,876 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,877 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,879 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,881 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,883 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,885 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,887 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,889 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,891 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,892 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,894 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,896 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,898 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,900 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,902 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,904 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,906 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,908 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,910 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,912 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,914 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,916 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,919 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,921 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,923 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,925 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,927 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,929 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,930 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,932 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,934 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,936 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,938 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,940 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,942 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,944 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,946 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,948 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,950 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-13T10:37:19,953 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,954 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,956 copying build/lib/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,958 copying build/lib/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,960 copying build/lib/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,962 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,964 copying build/lib/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,965 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,967 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,969 copying build/lib/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,971 copying build/lib/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,973 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,976 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,978 copying build/lib/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,981 copying build/lib/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,983 copying build/lib/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,986 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,989 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,992 copying build/lib/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,994 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,996 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:19,999 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,001 copying build/lib/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,004 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,007 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,009 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,013 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,015 copying build/lib/unitxt/catalog/cards/global_mmlu/de/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,018 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,021 copying build/lib/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,024 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,027 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,030 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,032 copying build/lib/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,035 copying build/lib/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,038 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,041 copying build/lib/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,044 copying build/lib/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,047 copying build/lib/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,049 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,052 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,054 copying build/lib/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,057 copying build/lib/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,060 copying build/lib/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,062 copying build/lib/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,065 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,067 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,070 copying build/lib/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,072 copying build/lib/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,074 copying build/lib/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,077 copying build/lib/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,079 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,081 copying build/lib/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,083 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,086 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,088 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,090 copying build/lib/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,093 copying build/lib/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-13T10:37:20,097 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,098 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,101 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,104 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,106 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,108 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,111 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,113 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,115 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,118 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,120 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,123 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,125 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,127 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,129 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,132 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,134 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,136 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,139 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,141 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,144 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,146 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,148 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,151 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,153 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,155 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,158 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,160 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,162 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,165 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,167 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,169 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,171 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,173 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,175 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,177 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,179 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,182 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,184 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,186 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,188 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,190 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,192 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,194 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,196 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,198 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,200 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,202 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,203 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,205 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,207 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,209 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,211 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,214 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,215 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,217 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,219 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,221 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-13T10:37:20,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,225 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,227 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,229 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,231 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,233 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,235 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,237 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,239 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,240 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,242 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,244 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,246 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,248 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,249 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,251 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,253 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,255 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,257 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,261 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,262 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,264 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,266 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,268 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,270 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,272 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,273 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,275 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,277 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,279 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,281 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,283 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,285 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,287 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,289 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,290 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,292 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,294 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,296 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,298 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,300 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,302 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,304 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,307 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,310 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,311 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,313 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,315 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,317 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,319 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,320 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,322 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,324 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,326 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,328 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,330 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,333 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,336 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-13T10:37:20,342 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,344 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,349 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,351 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,353 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,354 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,356 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,358 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,360 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,362 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,365 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,366 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,368 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,370 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,373 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,375 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,378 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,380 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,386 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,388 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,390 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,392 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,395 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,396 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,399 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,401 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,403 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,404 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,406 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,408 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,410 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,412 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,415 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,419 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,422 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,425 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,429 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,432 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,435 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,437 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,439 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,442 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,445 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,447 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,449 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,451 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,454 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,456 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,458 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,460 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,462 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,463 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,465 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,467 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,469 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-13T10:37:20,472 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,473 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,475 copying build/lib/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,477 copying build/lib/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,480 copying build/lib/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,482 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,485 copying build/lib/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,487 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,489 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,492 copying build/lib/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,494 copying build/lib/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,496 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,498 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,501 copying build/lib/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,503 copying build/lib/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,505 copying build/lib/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,507 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,510 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,511 copying build/lib/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,514 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,516 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,518 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,520 copying build/lib/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,522 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,524 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,526 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,528 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,529 copying build/lib/unitxt/catalog/cards/global_mmlu/el/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,531 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,533 copying build/lib/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,535 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,536 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,539 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,540 copying build/lib/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,542 copying build/lib/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,544 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,546 copying build/lib/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,549 copying build/lib/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,552 copying build/lib/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,554 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,556 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,558 copying build/lib/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,560 copying build/lib/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,562 copying build/lib/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,563 copying build/lib/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,566 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,569 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,572 copying build/lib/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,576 copying build/lib/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,580 copying build/lib/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,585 copying build/lib/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,590 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,595 copying build/lib/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,600 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,606 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,610 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,612 copying build/lib/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,614 copying build/lib/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-13T10:37:20,617 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,618 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,620 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,622 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,624 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,625 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,627 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,629 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,631 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,633 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,635 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,637 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,639 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,641 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,643 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,645 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,647 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,649 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,651 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,654 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,656 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,659 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,662 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,666 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,668 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,670 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,673 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,888 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,891 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,894 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,897 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,899 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,902 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,905 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,908 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,911 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,914 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,916 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,919 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,922 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,925 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,927 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,930 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,933 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,936 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,938 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,940 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,943 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,945 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,948 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,950 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,952 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,955 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,957 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,960 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,962 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,965 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,967 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-13T10:37:20,971 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,972 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,975 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,977 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,980 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,982 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,984 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,987 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,989 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,991 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,993 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,994 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,996 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:20,998 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,000 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,002 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,004 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,006 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,008 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,009 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,011 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,013 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,015 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,017 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,019 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,021 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,022 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,024 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,026 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,027 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,029 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,031 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,033 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,035 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,036 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,038 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,040 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,042 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,044 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,046 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,047 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,049 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,051 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,053 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,055 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,057 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,058 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,060 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,062 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,064 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,065 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,067 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,069 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,071 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,073 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,074 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,076 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,078 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-13T10:37:21,081 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,082 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,084 copying build/lib/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,086 copying build/lib/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,088 copying build/lib/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,090 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,092 copying build/lib/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,094 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,096 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,098 copying build/lib/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,100 copying build/lib/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,102 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,104 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,106 copying build/lib/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,107 copying build/lib/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,109 copying build/lib/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,111 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,113 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,114 copying build/lib/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,116 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,118 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,120 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,122 copying build/lib/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,124 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,125 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,127 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,129 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,131 copying build/lib/unitxt/catalog/cards/global_mmlu/te/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,133 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,135 copying build/lib/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,137 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,139 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,140 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,142 copying build/lib/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,144 copying build/lib/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,146 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,149 copying build/lib/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,150 copying build/lib/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,152 copying build/lib/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,154 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,156 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,157 copying build/lib/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,159 copying build/lib/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,161 copying build/lib/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,163 copying build/lib/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,165 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,166 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,168 copying build/lib/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,170 copying build/lib/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,172 copying build/lib/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,174 copying build/lib/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,176 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,178 copying build/lib/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,180 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,182 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,183 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,185 copying build/lib/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,187 copying build/lib/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-13T10:37:21,190 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,191 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,193 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,195 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,197 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,198 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,200 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,202 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,204 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,206 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,208 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,210 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,211 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,213 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,215 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,217 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,219 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,221 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,222 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,224 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,226 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,228 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,230 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,232 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,233 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,235 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,237 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,239 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,241 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,243 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,245 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,246 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,248 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,250 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,252 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,254 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,256 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,258 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,260 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,262 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,263 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,265 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,267 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,269 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,271 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,272 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,274 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,276 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,278 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,280 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,282 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,284 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,286 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,288 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,289 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,291 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,294 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,295 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-13T10:37:21,299 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,300 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,302 copying build/lib/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,304 copying build/lib/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,306 copying build/lib/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,307 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,309 copying build/lib/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,311 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,313 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,315 copying build/lib/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,317 copying build/lib/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,319 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,320 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,322 copying build/lib/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,324 copying build/lib/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,326 copying build/lib/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,328 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,330 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,331 copying build/lib/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,333 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,335 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,337 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,338 copying build/lib/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,340 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,342 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,344 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,346 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,348 copying build/lib/unitxt/catalog/cards/global_mmlu/so/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,349 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,351 copying build/lib/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,353 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,355 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,357 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,359 copying build/lib/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,361 copying build/lib/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,363 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,365 copying build/lib/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,367 copying build/lib/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,369 copying build/lib/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,370 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,372 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,374 copying build/lib/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,376 copying build/lib/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,378 copying build/lib/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,380 copying build/lib/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,382 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,384 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,385 copying build/lib/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,387 copying build/lib/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,389 copying build/lib/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,391 copying build/lib/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,393 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,395 copying build/lib/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,397 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,399 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,401 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,402 copying build/lib/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,404 copying build/lib/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-13T10:37:21,408 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,409 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,411 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,412 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,414 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,416 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,418 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,419 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,421 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,423 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,425 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,427 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,428 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,430 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,432 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,434 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,436 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,438 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,440 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,442 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,443 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,445 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,448 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,449 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,451 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,453 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,455 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,457 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,459 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,461 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,462 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,464 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,466 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,468 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,469 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,471 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,473 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,475 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,477 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,478 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,480 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,482 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,484 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,486 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,488 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,490 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,492 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,493 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,495 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,497 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,499 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,501 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,503 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,505 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,506 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,508 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,510 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,512 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-13T10:37:21,515 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,516 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,518 copying build/lib/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,520 copying build/lib/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,522 copying build/lib/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,523 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,525 copying build/lib/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,527 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,529 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,531 copying build/lib/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,533 copying build/lib/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,535 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,537 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,539 copying build/lib/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,541 copying build/lib/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,543 copying build/lib/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,545 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,547 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,548 copying build/lib/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,550 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,552 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,554 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,556 copying build/lib/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,557 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,559 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,561 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,563 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,565 copying build/lib/unitxt/catalog/cards/global_mmlu/am/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,567 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,569 copying build/lib/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,570 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,572 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,574 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,576 copying build/lib/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,578 copying build/lib/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,580 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,582 copying build/lib/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,584 copying build/lib/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,586 copying build/lib/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,587 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,589 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,591 copying build/lib/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,593 copying build/lib/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,595 copying build/lib/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,596 copying build/lib/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,598 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,600 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,602 copying build/lib/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,604 copying build/lib/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,605 copying build/lib/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,608 copying build/lib/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,609 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,611 copying build/lib/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,613 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,615 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,617 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,619 copying build/lib/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,620 copying build/lib/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-13T10:37:21,624 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,625 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,627 copying build/lib/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,629 copying build/lib/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,630 copying build/lib/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,632 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,634 copying build/lib/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,636 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,638 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,640 copying build/lib/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,642 copying build/lib/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,643 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,645 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,647 copying build/lib/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,649 copying build/lib/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,651 copying build/lib/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,653 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,655 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,657 copying build/lib/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,659 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,661 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,662 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,664 copying build/lib/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,666 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,668 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,670 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,672 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,674 copying build/lib/unitxt/catalog/cards/global_mmlu/id/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,675 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,677 copying build/lib/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,679 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,681 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,683 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,684 copying build/lib/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,686 copying build/lib/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,688 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,690 copying build/lib/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,692 copying build/lib/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,695 copying build/lib/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,698 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,700 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,703 copying build/lib/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,707 copying build/lib/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,711 copying build/lib/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,714 copying build/lib/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,716 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,718 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,721 copying build/lib/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,723 copying build/lib/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,725 copying build/lib/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,728 copying build/lib/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,730 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,732 copying build/lib/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,734 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,736 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,739 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,741 copying build/lib/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,743 copying build/lib/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-13T10:37:21,747 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,748 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,750 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,752 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,754 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,757 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,759 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,761 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,763 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,766 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,768 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,770 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,773 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,775 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,778 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,780 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,783 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,785 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,788 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,790 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,793 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,795 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,797 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,800 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,802 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,805 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,808 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,811 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,813 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,815 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,817 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,819 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,822 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,824 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,826 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,828 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,831 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,833 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,835 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,838 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,840 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,842 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,845 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,847 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,849 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,851 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,853 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,856 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,858 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,860 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,862 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,864 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,867 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,869 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,871 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,873 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,876 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,878 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-13T10:37:21,882 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,883 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,886 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,888 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,890 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,893 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,895 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,897 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,899 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,901 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,902 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,904 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,906 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,908 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,910 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,912 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,913 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,915 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,917 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,919 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,921 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,923 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,925 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,926 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,928 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,930 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,932 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,934 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,936 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,937 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,939 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,941 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,943 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,945 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,946 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,948 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,950 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,952 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,953 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,955 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,957 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,959 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,961 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,963 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,964 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,966 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,968 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,970 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,972 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,974 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,976 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,977 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,979 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,981 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,983 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,985 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,987 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,988 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-13T10:37:21,991 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:21,992 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:21,994 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:21,996 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:21,998 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,000 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,002 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,004 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,005 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,008 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,009 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,011 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,013 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,015 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,017 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,019 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,021 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,022 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,024 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,026 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,028 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,030 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,032 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,034 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,035 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,037 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,039 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,041 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,043 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,045 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,046 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,048 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,050 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,052 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,054 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,056 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,058 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,060 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,062 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,063 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,065 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,067 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,069 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,071 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,073 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,075 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,077 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,079 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,080 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,082 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,084 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,086 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,088 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,089 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,091 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,093 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,095 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,097 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-13T10:37:22,100 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,101 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,103 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,105 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,107 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,109 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,111 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,113 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,115 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,117 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,119 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,120 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,122 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,124 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,126 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,128 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,130 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,132 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,133 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,135 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,137 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,139 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,141 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,143 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,145 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,147 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,149 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,151 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,153 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,156 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,158 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,160 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,162 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,164 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,165 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,167 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,169 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,171 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,173 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,175 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,176 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,178 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,180 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,182 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,184 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,186 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,188 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,189 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,191 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,193 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,195 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,197 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,199 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,201 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,203 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,205 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,207 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,209 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-13T10:37:22,212 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,213 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,215 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,217 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,219 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,220 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,222 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,224 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,226 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,228 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,230 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,232 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,234 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,236 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,238 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,240 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,242 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,244 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,246 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,248 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,250 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,252 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,254 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,256 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,257 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,259 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,261 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,263 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,265 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,267 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,269 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,271 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,272 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,274 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,276 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,278 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,280 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,282 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,284 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,286 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,288 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,290 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,292 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,294 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,296 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,298 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,300 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,301 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,303 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,305 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,307 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,309 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,312 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,314 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,316 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,318 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,320 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,322 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-13T10:37:22,325 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,326 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,328 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,330 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,332 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,334 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,336 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,338 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,340 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,342 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,344 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,346 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,348 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,349 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,351 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,353 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,355 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,357 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,359 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,361 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,363 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,364 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,366 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,368 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,370 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,374 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,376 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,378 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,380 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,387 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,609 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,612 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,615 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,621 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,623 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,626 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,628 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,630 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,632 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,642 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,644 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,649 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,653 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,656 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,658 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,663 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,668 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-13T10:37:22,672 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,673 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,676 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,678 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,680 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,682 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,684 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,687 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,689 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,691 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,693 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,696 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,698 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,701 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,704 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,708 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,711 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,715 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,719 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,724 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,730 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,734 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,738 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,740 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,742 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,743 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,745 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,747 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,749 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,751 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,753 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,755 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,757 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,759 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,760 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,762 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,764 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,766 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,768 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,770 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,772 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,774 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,776 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,778 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,780 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,782 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,784 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,787 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,789 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,791 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,793 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,795 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,798 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,800 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,802 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,804 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,807 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,810 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-13T10:37:22,816 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,817 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,819 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,821 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,823 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,825 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,827 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,829 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,831 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,833 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,835 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,837 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,839 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,841 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,843 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,845 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,847 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,849 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,851 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,852 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,854 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,856 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,858 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,860 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,862 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,864 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,866 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,868 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,870 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,871 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,873 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,875 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,878 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,880 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,882 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,884 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,885 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,887 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,889 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,891 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,893 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,895 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,897 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,899 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,901 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,903 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,905 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,907 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,909 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,911 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,913 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,915 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,917 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,919 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,921 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,923 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,925 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,927 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-13T10:37:22,930 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,931 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,933 copying build/lib/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,935 copying build/lib/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,937 copying build/lib/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,939 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,941 copying build/lib/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,943 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,945 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,947 copying build/lib/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,949 copying build/lib/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,950 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,952 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,954 copying build/lib/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,956 copying build/lib/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,958 copying build/lib/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,960 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,962 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,964 copying build/lib/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,966 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,968 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,970 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,972 copying build/lib/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,974 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,976 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,978 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,980 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,982 copying build/lib/unitxt/catalog/cards/global_mmlu/it/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,984 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,985 copying build/lib/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,987 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,989 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,991 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,993 copying build/lib/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,995 copying build/lib/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,997 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:22,999 copying build/lib/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,001 copying build/lib/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,003 copying build/lib/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,005 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,006 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,008 copying build/lib/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,010 copying build/lib/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,012 copying build/lib/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,015 copying build/lib/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,017 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,019 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,021 copying build/lib/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,023 copying build/lib/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,025 copying build/lib/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,027 copying build/lib/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,028 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,030 copying build/lib/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,032 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,034 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,036 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,037 copying build/lib/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,039 copying build/lib/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-13T10:37:23,042 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,043 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,045 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,048 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,050 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,052 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,054 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,055 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,057 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,059 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,061 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,063 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,065 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,068 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,070 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,072 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,073 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,075 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,077 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,079 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,081 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,083 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,085 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,086 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,088 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,090 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,092 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,094 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,096 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,099 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,101 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,103 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,105 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,107 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,109 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,111 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,113 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,115 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,117 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,119 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,121 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,122 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,124 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,126 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,128 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,130 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,132 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,134 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,136 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,138 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,140 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,142 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,144 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,146 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,148 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,150 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,152 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,154 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-13T10:37:23,157 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,158 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,160 copying build/lib/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,162 copying build/lib/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,164 copying build/lib/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,165 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,167 copying build/lib/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,169 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,171 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,173 copying build/lib/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,174 copying build/lib/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,176 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,178 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,181 copying build/lib/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,183 copying build/lib/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,185 copying build/lib/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,186 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,188 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,190 copying build/lib/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,192 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,194 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,196 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,198 copying build/lib/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,200 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,202 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,203 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,205 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,207 copying build/lib/unitxt/catalog/cards/global_mmlu/en/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,209 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,211 copying build/lib/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,214 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,215 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,218 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,220 copying build/lib/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,222 copying build/lib/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,224 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,226 copying build/lib/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,228 copying build/lib/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,230 copying build/lib/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,232 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,234 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,236 copying build/lib/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,238 copying build/lib/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,240 copying build/lib/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,241 copying build/lib/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,243 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,245 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,247 copying build/lib/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,249 copying build/lib/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,251 copying build/lib/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,254 copying build/lib/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,256 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,259 copying build/lib/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,261 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,264 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,268 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,271 copying build/lib/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,274 copying build/lib/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-13T10:37:23,277 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,280 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,282 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,284 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,286 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,289 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,291 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,293 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,295 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,297 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,299 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,301 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,303 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,305 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,307 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,309 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,311 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,312 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,314 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,316 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,318 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,320 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,322 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,324 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,326 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,328 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,330 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,331 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,333 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,336 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,338 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,340 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,342 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,344 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,346 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,349 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,351 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,353 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,355 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,358 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,360 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,361 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,363 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,365 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,367 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,369 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,371 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,373 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,375 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,376 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,378 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,380 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,382 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,384 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,386 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,388 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,389 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,392 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-13T10:37:23,395 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,396 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,398 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,400 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,402 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,404 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,406 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,408 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,410 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,412 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,414 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,416 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,418 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,421 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,424 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,427 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,429 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,431 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,433 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,435 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,436 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,438 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,440 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,442 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,444 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,446 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,448 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,451 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,453 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,455 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,457 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,459 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,461 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,463 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,466 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,468 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,470 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,472 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,474 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,476 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,478 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,480 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,482 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,485 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,487 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,490 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,493 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,495 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,497 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,500 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,503 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,506 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,509 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,512 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,514 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,516 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,518 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,520 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-13T10:37:23,523 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,524 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,526 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,528 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,530 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,532 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,534 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,536 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,538 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,539 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,541 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,543 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,545 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,547 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,549 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,551 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,553 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,555 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,557 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,559 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,561 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,563 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,565 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,567 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,569 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,571 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,572 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,575 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,576 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,579 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,581 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,583 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,585 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,589 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,592 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,595 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,597 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,599 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,601 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,603 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,605 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,607 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,609 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,611 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,613 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,615 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,617 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,619 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,621 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,623 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,625 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,627 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,630 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,632 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,634 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,636 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,638 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,640 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-13T10:37:23,643 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,644 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,646 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,649 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,651 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,653 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,655 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,657 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,659 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,661 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,663 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,665 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,667 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,669 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,670 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,672 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,674 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,676 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,678 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,680 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,682 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,684 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,686 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,688 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,690 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,692 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,694 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,696 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,698 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,700 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,703 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,704 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,706 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,708 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,710 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,712 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,714 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,715 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,717 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,725 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,727 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,729 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,731 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,733 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,735 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,737 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,739 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,741 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,743 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,745 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,747 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,749 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,751 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,752 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,754 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,756 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,758 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,760 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-13T10:37:23,763 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,764 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,766 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,768 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,770 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,772 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,773 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,775 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,777 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,779 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,781 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,783 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,785 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,787 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,789 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,791 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,793 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,795 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,797 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,800 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,802 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,803 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,805 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,807 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,809 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,811 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,813 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,815 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,816 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,818 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,820 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,822 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,824 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,826 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,828 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,830 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,832 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,834 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,836 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,838 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,840 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,842 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,844 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,845 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,847 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,849 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,851 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,853 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,855 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,856 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,859 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,861 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,863 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,865 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,866 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,868 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,870 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,872 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-13T10:37:23,875 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,876 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,879 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,881 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,883 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,884 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,886 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,888 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,890 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,892 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,894 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,896 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,898 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,900 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,902 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,903 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,905 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,907 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,909 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,911 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,913 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,915 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,917 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,919 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,921 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,923 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,925 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,926 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,928 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,930 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,932 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,934 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,936 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,938 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,940 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,942 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,944 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,946 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,947 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,949 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,951 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,953 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,955 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,957 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,959 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,961 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,962 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,964 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,966 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,968 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,971 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,974 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,976 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,978 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,980 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,982 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,983 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,985 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-13T10:37:23,988 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,989 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,991 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,993 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,995 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,997 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:23,999 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,001 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,003 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,005 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,007 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,009 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,010 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,012 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,014 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,017 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,019 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,020 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,023 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,024 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,026 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,028 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,030 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,032 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,034 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,036 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,037 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,039 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,041 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,043 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,045 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,046 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,048 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,050 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,052 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,054 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,056 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,058 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,061 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,063 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,064 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,066 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,068 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,070 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,072 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,074 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,076 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,078 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,080 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,082 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,084 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,086 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,088 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,090 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,091 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,093 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,095 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,097 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-13T10:37:24,101 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,102 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,104 copying build/lib/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,106 copying build/lib/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,108 copying build/lib/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,110 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,111 copying build/lib/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,113 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,115 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,117 copying build/lib/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,119 copying build/lib/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,121 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,123 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,125 copying build/lib/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,127 copying build/lib/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,129 copying build/lib/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,131 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,132 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,134 copying build/lib/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,136 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,138 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,141 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,143 copying build/lib/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,146 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,150 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,151 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,153 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,155 copying build/lib/unitxt/catalog/cards/global_mmlu/si/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,157 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,159 copying build/lib/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,161 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,163 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,165 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,167 copying build/lib/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,169 copying build/lib/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,170 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,172 copying build/lib/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,174 copying build/lib/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,176 copying build/lib/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,178 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,179 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,181 copying build/lib/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,183 copying build/lib/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,185 copying build/lib/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,187 copying build/lib/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,189 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,191 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,193 copying build/lib/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,195 copying build/lib/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,198 copying build/lib/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,200 copying build/lib/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,202 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,204 copying build/lib/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,206 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,208 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,209 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,211 copying build/lib/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,213 copying build/lib/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-13T10:37:24,216 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,217 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,219 copying build/lib/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,221 copying build/lib/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,223 copying build/lib/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,225 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,226 copying build/lib/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,228 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,230 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,232 copying build/lib/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,234 copying build/lib/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,236 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,238 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,240 copying build/lib/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,242 copying build/lib/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,244 copying build/lib/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,246 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,249 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,251 copying build/lib/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,253 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,255 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,257 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,259 copying build/lib/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,261 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,263 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,265 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,267 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,268 copying build/lib/unitxt/catalog/cards/global_mmlu/he/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,270 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,272 copying build/lib/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,274 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,276 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,278 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,280 copying build/lib/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,282 copying build/lib/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,284 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,286 copying build/lib/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,289 copying build/lib/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,291 copying build/lib/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,293 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,295 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,297 copying build/lib/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,299 copying build/lib/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,301 copying build/lib/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,303 copying build/lib/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,306 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,308 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,311 copying build/lib/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,313 copying build/lib/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,315 copying build/lib/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,317 copying build/lib/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,319 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,321 copying build/lib/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,323 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,324 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,326 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,328 copying build/lib/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,330 copying build/lib/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-13T10:37:24,333 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,334 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,336 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,338 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,340 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,342 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,343 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,345 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,347 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,349 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,351 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,353 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,356 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,358 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,360 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,362 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,364 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,365 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,367 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,369 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,371 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,373 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,375 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,377 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,379 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,381 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,386 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,388 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,390 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,392 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,394 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,396 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,398 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,401 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,402 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,404 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,406 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,408 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,410 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,414 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,416 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,418 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,420 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,422 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,424 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,425 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,428 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,430 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,431 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,433 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,435 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,437 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,439 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,441 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,443 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,445 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-13T10:37:24,449 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,450 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,452 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,454 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,455 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,457 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,459 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,461 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,463 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,465 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,467 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,469 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,470 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,472 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,474 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,476 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,478 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,479 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,481 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,483 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,485 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,488 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,490 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,492 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,495 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,497 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,499 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,501 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,503 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,504 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,506 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,508 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,510 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,512 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,513 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,515 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,517 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,519 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,521 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,523 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,525 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,527 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,529 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,531 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,533 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,535 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,537 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,539 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,541 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,543 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,544 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,546 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,548 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,550 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,552 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,553 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,555 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,557 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-13T10:37:24,560 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,561 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,563 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,565 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,567 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,569 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,571 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,573 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,574 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,576 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,578 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,580 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,582 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,584 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,586 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,588 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,590 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,591 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,593 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,595 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,597 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,599 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,601 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,603 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,605 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,607 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,608 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,610 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,612 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,614 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,616 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,620 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,622 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,624 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,626 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,628 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,630 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,632 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,634 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,645 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,648 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,650 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,652 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,654 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,657 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,660 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,663 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,669 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,671 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,673 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-13T10:37:24,676 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,678 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,680 copying build/lib/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,682 copying build/lib/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,684 copying build/lib/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,686 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,687 copying build/lib/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,689 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,691 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,693 copying build/lib/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,695 copying build/lib/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,697 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,699 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,701 copying build/lib/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,702 copying build/lib/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,704 copying build/lib/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,706 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,709 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,711 copying build/lib/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,713 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,715 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,716 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,719 copying build/lib/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,721 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,722 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,725 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,726 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,728 copying build/lib/unitxt/catalog/cards/global_mmlu/es/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,730 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,732 copying build/lib/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,734 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,735 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,737 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,739 copying build/lib/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,741 copying build/lib/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,743 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,745 copying build/lib/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,747 copying build/lib/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,749 copying build/lib/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,751 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,753 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,755 copying build/lib/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,757 copying build/lib/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,759 copying build/lib/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,761 copying build/lib/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,762 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,764 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,766 copying build/lib/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,768 copying build/lib/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,770 copying build/lib/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,772 copying build/lib/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,773 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,775 copying build/lib/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,777 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,779 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,781 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,783 copying build/lib/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,784 copying build/lib/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-13T10:37:24,788 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,789 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,791 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,793 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,795 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,797 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,799 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,801 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,803 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,805 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,807 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,809 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,811 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,812 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,814 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,816 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,818 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,820 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,822 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,823 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,825 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,827 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,830 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,833 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,836 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,839 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,843 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,845 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,847 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,849 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,851 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,853 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,855 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,857 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,859 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,861 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,863 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,865 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,867 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,869 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,870 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,872 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,874 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,876 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,878 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,880 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,882 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,884 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,886 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,888 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,890 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,892 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,894 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,896 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,898 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,900 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,902 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,904 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-13T10:37:24,906 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner 2026-01-13T10:37:24,908 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ru 2026-01-13T10:37:24,909 copying build/lib/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ru 2026-01-13T10:37:24,912 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/de 2026-01-13T10:37:24,913 copying build/lib/unitxt/catalog/cards/universal_ner/de/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/de 2026-01-13T10:37:24,915 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sk 2026-01-13T10:37:24,916 copying build/lib/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sk 2026-01-13T10:37:24,919 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sr 2026-01-13T10:37:24,920 copying build/lib/unitxt/catalog/cards/universal_ner/sr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sr 2026-01-13T10:37:24,922 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/hr 2026-01-13T10:37:24,923 copying build/lib/unitxt/catalog/cards/universal_ner/hr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/hr 2026-01-13T10:37:24,926 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:24,927 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:24,929 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:24,931 copying build/lib/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-13T10:37:24,933 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/da 2026-01-13T10:37:24,934 copying build/lib/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/da 2026-01-13T10:37:24,937 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:24,938 copying build/lib/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:24,940 copying build/lib/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-01-13T10:37:24,942 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ceb 2026-01-13T10:37:24,943 copying build/lib/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ceb 2026-01-13T10:37:24,946 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:24,947 copying build/lib/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:24,949 copying build/lib/unitxt/catalog/cards/universal_ner/en/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-01-13T10:37:24,951 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:24,952 copying build/lib/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:24,954 copying build/lib/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-01-13T10:37:24,956 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:24,957 copying build/lib/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:24,959 copying build/lib/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-01-13T10:37:24,962 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,963 copying build/lib/unitxt/catalog/cards/xlsum/russian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,966 copying build/lib/unitxt/catalog/cards/xlsum/spanish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,967 copying build/lib/unitxt/catalog/cards/xlsum/tigrinya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,969 copying build/lib/unitxt/catalog/cards/xlsum/persian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,971 copying build/lib/unitxt/catalog/cards/xlsum/sinhala.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,973 copying build/lib/unitxt/catalog/cards/xlsum/vietnamese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,975 copying build/lib/unitxt/catalog/cards/xlsum/bengali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,976 copying build/lib/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,978 copying build/lib/unitxt/catalog/cards/xlsum/telugu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,980 copying build/lib/unitxt/catalog/cards/xlsum/french.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,982 copying build/lib/unitxt/catalog/cards/xlsum/uzbek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,984 copying build/lib/unitxt/catalog/cards/xlsum/english.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,985 copying build/lib/unitxt/catalog/cards/xlsum/ukrainian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,987 copying build/lib/unitxt/catalog/cards/xlsum/thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,989 copying build/lib/unitxt/catalog/cards/xlsum/korean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,991 copying build/lib/unitxt/catalog/cards/xlsum/pashto.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,993 copying build/lib/unitxt/catalog/cards/xlsum/nepali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,995 copying build/lib/unitxt/catalog/cards/xlsum/kirundi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,996 copying build/lib/unitxt/catalog/cards/xlsum/marathi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:24,998 copying build/lib/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,000 copying build/lib/unitxt/catalog/cards/xlsum/punjabi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,002 copying build/lib/unitxt/catalog/cards/xlsum/japanese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,004 copying build/lib/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,006 copying build/lib/unitxt/catalog/cards/xlsum/welsh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,007 copying build/lib/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,009 copying build/lib/unitxt/catalog/cards/xlsum/tamil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,011 copying build/lib/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,013 copying build/lib/unitxt/catalog/cards/xlsum/yoruba.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,015 copying build/lib/unitxt/catalog/cards/xlsum/turkish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,017 copying build/lib/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,019 copying build/lib/unitxt/catalog/cards/xlsum/indonesian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,020 copying build/lib/unitxt/catalog/cards/xlsum/swahili.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,022 copying build/lib/unitxt/catalog/cards/xlsum/portuguese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,024 copying build/lib/unitxt/catalog/cards/xlsum/igbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,026 copying build/lib/unitxt/catalog/cards/xlsum/burmese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,028 copying build/lib/unitxt/catalog/cards/xlsum/urdu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,030 copying build/lib/unitxt/catalog/cards/xlsum/arabic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,031 copying build/lib/unitxt/catalog/cards/xlsum/hindi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,033 copying build/lib/unitxt/catalog/cards/xlsum/amharic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,035 copying build/lib/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,038 copying build/lib/unitxt/catalog/cards/xlsum/gujarati.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,040 copying build/lib/unitxt/catalog/cards/xlsum/oromo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,042 copying build/lib/unitxt/catalog/cards/xlsum/hausa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,044 copying build/lib/unitxt/catalog/cards/xlsum/somali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,046 copying build/lib/unitxt/catalog/cards/xlsum/pidgin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-13T10:37:25,048 copying build/lib/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,051 copying build/lib/unitxt/catalog/cards/race_middle.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,054 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coqa 2026-01-13T10:37:25,055 copying build/lib/unitxt/catalog/cards/coqa/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-13T10:37:25,058 copying build/lib/unitxt/catalog/cards/coqa/completion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-13T10:37:25,061 copying build/lib/unitxt/catalog/cards/coqa/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-13T10:37:25,064 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,066 copying build/lib/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,068 copying build/lib/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,070 copying build/lib/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,072 copying build/lib/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,075 copying build/lib/unitxt/catalog/cards/amazon_mass/en_US.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,078 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,080 copying build/lib/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,082 copying build/lib/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,085 copying build/lib/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,087 copying build/lib/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,090 copying build/lib/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,092 copying build/lib/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,094 copying build/lib/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,096 copying build/lib/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,099 copying build/lib/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,101 copying build/lib/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,103 copying build/lib/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,105 copying build/lib/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,108 copying build/lib/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,110 copying build/lib/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,112 copying build/lib/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,115 copying build/lib/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,117 copying build/lib/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,119 copying build/lib/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,122 copying build/lib/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,124 copying build/lib/unitxt/catalog/cards/amazon_mass/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,126 copying build/lib/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,129 copying build/lib/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,131 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass/all_1 2026-01-13T10:37:25,132 copying build/lib/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass/all_1 2026-01-13T10:37:25,135 copying build/lib/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,137 copying build/lib/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,139 copying build/lib/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,141 copying build/lib/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,144 copying build/lib/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,146 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,148 copying build/lib/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,150 copying build/lib/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,152 copying build/lib/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,155 copying build/lib/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,157 copying build/lib/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,159 copying build/lib/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,162 copying build/lib/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,164 copying build/lib/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,166 copying build/lib/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,169 copying build/lib/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,171 copying build/lib/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,173 copying build/lib/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,176 copying build/lib/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,178 copying build/lib/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,180 copying build/lib/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,183 copying build/lib/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,185 copying build/lib/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,187 copying build/lib/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,190 copying build/lib/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-13T10:37:25,192 copying build/lib/unitxt/catalog/cards/news_category_classification_headline.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,194 copying build/lib/unitxt/catalog/cards/law_stack_exchange.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,196 copying build/lib/unitxt/catalog/cards/mbpp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,198 copying build/lib/unitxt/catalog/cards/medical_abstracts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,201 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard 2026-01-13T10:37:25,202 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/generation 2026-01-13T10:37:25,204 copying build/lib/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/generation 2026-01-13T10:37:25,206 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment 2026-01-13T10:37:25,208 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:25,209 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:25,211 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:25,213 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-13T10:37:25,215 copying build/lib/unitxt/catalog/cards/bold.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,217 copying build/lib/unitxt/catalog/cards/argument_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,219 copying build/lib/unitxt/catalog/cards/tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,221 copying build/lib/unitxt/catalog/cards/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,224 copying build/lib/unitxt/catalog/cards/ethos_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,226 copying build/lib/unitxt/catalog/cards/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,228 copying build/lib/unitxt/catalog/cards/social_iqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,230 copying build/lib/unitxt/catalog/cards/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,232 copying build/lib/unitxt/catalog/cards/claim_stance_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,234 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coedit 2026-01-13T10:37:25,235 copying build/lib/unitxt/catalog/cards/coedit/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-13T10:37:25,237 copying build/lib/unitxt/catalog/cards/coedit/rewriting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-13T10:37:25,239 copying build/lib/unitxt/catalog/cards/coedit/selection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-13T10:37:25,241 copying build/lib/unitxt/catalog/cards/coedit/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-13T10:37:25,243 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/text2sql 2026-01-13T10:37:25,245 copying build/lib/unitxt/catalog/cards/text2sql/bird.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/text2sql 2026-01-13T10:37:25,247 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai 2026-01-13T10:37:25,249 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,250 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,252 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,254 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,256 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,258 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,260 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,262 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-13T10:37:25,264 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,265 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,267 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,269 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,271 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,273 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,275 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-13T10:37:25,278 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:25,278 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:25,281 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-13T10:37:25,283 copying build/lib/unitxt/catalog/cards/financial_tweets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,284 copying build/lib/unitxt/catalog/cards/qnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,286 copying build/lib/unitxt/catalog/cards/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,288 copying build/lib/unitxt/catalog/cards/numeric_nlg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,290 copying build/lib/unitxt/catalog/cards/20_newsgroups.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,292 copying build/lib/unitxt/catalog/cards/scigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,294 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reward_bench 2026-01-13T10:37:25,296 copying build/lib/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-13T10:37:25,297 copying build/lib/unitxt/catalog/cards/reward_bench/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-13T10:37:25,299 copying build/lib/unitxt/catalog/cards/reward_bench/reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-13T10:37:25,301 copying build/lib/unitxt/catalog/cards/reward_bench/chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-13T10:37:25,303 copying build/lib/unitxt/catalog/cards/cola.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,304 copying build/lib/unitxt/catalog/cards/coedit_gec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,307 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:25,308 copying build/lib/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:25,310 copying build/lib/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:25,312 copying build/lib/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:25,313 copying build/lib/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-13T10:37:25,316 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:25,317 copying build/lib/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:25,319 copying build/lib/unitxt/catalog/cards/doc_vqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:25,320 copying build/lib/unitxt/catalog/cards/doc_vqa/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-13T10:37:25,322 copying build/lib/unitxt/catalog/cards/tablerow_classify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,324 copying build/lib/unitxt/catalog/cards/toxigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,328 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,329 copying build/lib/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,331 copying build/lib/unitxt/catalog/cards/mmlu/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,333 copying build/lib/unitxt/catalog/cards/mmlu/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,335 copying build/lib/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,336 copying build/lib/unitxt/catalog/cards/mmlu/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,338 copying build/lib/unitxt/catalog/cards/mmlu/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,340 copying build/lib/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,342 copying build/lib/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,344 copying build/lib/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,346 copying build/lib/unitxt/catalog/cards/mmlu/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,348 copying build/lib/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,350 copying build/lib/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,352 copying build/lib/unitxt/catalog/cards/mmlu/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,353 copying build/lib/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,355 copying build/lib/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,357 copying build/lib/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,359 copying build/lib/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,361 copying build/lib/unitxt/catalog/cards/mmlu/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,362 copying build/lib/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,364 copying build/lib/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,366 copying build/lib/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,368 copying build/lib/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,370 copying build/lib/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,372 copying build/lib/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,374 copying build/lib/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,375 copying build/lib/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,377 copying build/lib/unitxt/catalog/cards/mmlu/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,379 copying build/lib/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,381 copying build/lib/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,383 copying build/lib/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,385 copying build/lib/unitxt/catalog/cards/mmlu/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,387 copying build/lib/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,389 copying build/lib/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,391 copying build/lib/unitxt/catalog/cards/mmlu/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,393 copying build/lib/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,395 copying build/lib/unitxt/catalog/cards/mmlu/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,397 copying build/lib/unitxt/catalog/cards/mmlu/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,398 copying build/lib/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,400 copying build/lib/unitxt/catalog/cards/mmlu/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,402 copying build/lib/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,404 copying build/lib/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,406 copying build/lib/unitxt/catalog/cards/mmlu/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,408 copying build/lib/unitxt/catalog/cards/mmlu/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,410 copying build/lib/unitxt/catalog/cards/mmlu/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,411 copying build/lib/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,413 copying build/lib/unitxt/catalog/cards/mmlu/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,415 copying build/lib/unitxt/catalog/cards/mmlu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,417 copying build/lib/unitxt/catalog/cards/mmlu/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,419 copying build/lib/unitxt/catalog/cards/mmlu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,421 copying build/lib/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,423 copying build/lib/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,425 copying build/lib/unitxt/catalog/cards/mmlu/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,427 copying build/lib/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,429 copying build/lib/unitxt/catalog/cards/mmlu/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,431 copying build/lib/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,432 copying build/lib/unitxt/catalog/cards/mmlu/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,434 copying build/lib/unitxt/catalog/cards/mmlu/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-13T10:37:25,436 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,439 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_data_analysis 2026-01-13T10:37:25,440 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_data_analysis 2026-01-13T10:37:25,442 copying build/lib/unitxt/catalog/cards/trec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,444 copying build/lib/unitxt/catalog/cards/rte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,446 copying build/lib/unitxt/catalog/cards/billsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,448 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wmt 2026-01-13T10:37:25,449 copying build/lib/unitxt/catalog/cards/wmt/en_fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-13T10:37:25,451 copying build/lib/unitxt/catalog/cards/wmt/en_de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-13T10:37:25,453 copying build/lib/unitxt/catalog/cards/wmt/en_ro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-13T10:37:25,455 copying build/lib/unitxt/catalog/cards/tablebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,458 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,459 copying build/lib/unitxt/catalog/cards/head_qa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,461 copying build/lib/unitxt/catalog/cards/head_qa/gl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,463 copying build/lib/unitxt/catalog/cards/head_qa/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,465 copying build/lib/unitxt/catalog/cards/head_qa/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,467 copying build/lib/unitxt/catalog/cards/head_qa/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-13T10:37:25,470 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq 2026-01-13T10:37:25,471 copying build/lib/unitxt/catalog/cards/boolq/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-01-13T10:37:25,474 copying build/lib/unitxt/catalog/cards/boolq/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-01-13T10:37:25,476 copying build/lib/unitxt/catalog/cards/copa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,478 copying build/lib/unitxt/catalog/cards/wiki_bio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,480 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,483 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench 2026-01-13T10:37:25,485 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:25,486 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:25,489 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:25,491 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:25,493 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-13T10:37:25,496 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe 2026-01-13T10:37:25,498 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall 2026-01-13T10:37:25,500 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:25,502 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:25,504 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:25,506 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:25,509 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-13T10:37:25,511 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:25,512 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:25,515 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:25,517 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:25,519 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-13T10:37:25,522 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:25,524 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:25,526 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:25,528 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:25,530 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-13T10:37:25,533 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise 2026-01-13T10:37:25,535 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,537 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,539 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,541 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,543 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,546 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,548 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,550 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,553 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,555 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-13T10:37:25,558 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,559 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,561 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,563 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,566 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,568 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,570 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,572 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,575 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,577 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-13T10:37:25,579 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,581 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,583 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,585 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,588 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,590 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,592 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,595 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,597 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,599 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-13T10:37:25,602 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/cola 2026-01-13T10:37:25,603 copying build/lib/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/cola 2026-01-13T10:37:25,606 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:25,608 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:25,610 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-13T10:37:25,612 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/dices 2026-01-13T10:37:25,614 copying build/lib/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/dices 2026-01-13T10:37:25,616 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human 2026-01-13T10:37:25,618 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-13T10:37:25,620 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-13T10:37:25,622 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-13T10:37:25,624 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-13T10:37:25,627 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-13T10:37:25,628 copying build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-13T10:37:25,630 copying build/lib/unitxt/catalog/cards/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,632 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,635 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_fact_checking 2026-01-13T10:37:25,636 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_fact_checking 2026-01-13T10:37:25,639 copying build/lib/unitxt/catalog/cards/atis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,641 copying build/lib/unitxt/catalog/cards/tab_fact.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,644 copying build/lib/unitxt/catalog/cards/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,646 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xnli 2026-01-13T10:37:25,648 copying build/lib/unitxt/catalog/cards/xnli/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,650 copying build/lib/unitxt/catalog/cards/xnli/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,652 copying build/lib/unitxt/catalog/cards/xnli/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,654 copying build/lib/unitxt/catalog/cards/xnli/el.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,656 copying build/lib/unitxt/catalog/cards/xnli/th.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,659 copying build/lib/unitxt/catalog/cards/xnli/ur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,661 copying build/lib/unitxt/catalog/cards/xnli/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,663 copying build/lib/unitxt/catalog/cards/xnli/bg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,665 copying build/lib/unitxt/catalog/cards/xnli/vi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,667 copying build/lib/unitxt/catalog/cards/xnli/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,669 copying build/lib/unitxt/catalog/cards/xnli/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,671 copying build/lib/unitxt/catalog/cards/xnli/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,673 copying build/lib/unitxt/catalog/cards/xnli/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,675 copying build/lib/unitxt/catalog/cards/xnli/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,677 copying build/lib/unitxt/catalog/cards/xnli/tr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-13T10:37:25,680 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,682 copying build/lib/unitxt/catalog/cards/mmmu/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,684 copying build/lib/unitxt/catalog/cards/mmmu/art.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,686 copying build/lib/unitxt/catalog/cards/mmmu/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,688 copying build/lib/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,690 copying build/lib/unitxt/catalog/cards/mmmu/art_theory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,693 copying build/lib/unitxt/catalog/cards/mmmu/literature.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,695 copying build/lib/unitxt/catalog/cards/mmmu/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,697 copying build/lib/unitxt/catalog/cards/mmmu/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,699 copying build/lib/unitxt/catalog/cards/mmmu/accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,701 copying build/lib/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,703 copying build/lib/unitxt/catalog/cards/mmmu/pharmacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,706 copying build/lib/unitxt/catalog/cards/mmmu/music.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,708 copying build/lib/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,710 copying build/lib/unitxt/catalog/cards/mmmu/finance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,712 copying build/lib/unitxt/catalog/cards/mmmu/design.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,714 copying build/lib/unitxt/catalog/cards/mmmu/electronics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,716 copying build/lib/unitxt/catalog/cards/mmmu/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,719 copying build/lib/unitxt/catalog/cards/mmmu/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,721 copying build/lib/unitxt/catalog/cards/mmmu/manage.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,723 copying build/lib/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,725 copying build/lib/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,727 copying build/lib/unitxt/catalog/cards/mmmu/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,729 copying build/lib/unitxt/catalog/cards/mmmu/materials.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,731 copying build/lib/unitxt/catalog/cards/mmmu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,733 copying build/lib/unitxt/catalog/cards/mmmu/geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,736 copying build/lib/unitxt/catalog/cards/mmmu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,738 copying build/lib/unitxt/catalog/cards/mmmu/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,740 copying build/lib/unitxt/catalog/cards/mmmu/public_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,742 copying build/lib/unitxt/catalog/cards/mmmu/agriculture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,744 copying build/lib/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-13T10:37:25,746 copying build/lib/unitxt/catalog/cards/atta_q.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,748 copying build/lib/unitxt/catalog/cards/frames.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,751 copying build/lib/unitxt/catalog/cards/wnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,753 copying build/lib/unitxt/catalog/cards/mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,755 copying build/lib/unitxt/catalog/cards/dbpedia_14.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,757 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,759 copying build/lib/unitxt/catalog/cards/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,761 copying build/lib/unitxt/catalog/cards/qqp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,764 copying build/lib/unitxt/catalog/cards/race_all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,766 copying build/lib/unitxt/catalog/cards/cnn_dailymail.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,768 copying build/lib/unitxt/catalog/cards/long_bench_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,771 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/gpqa 2026-01-13T10:37:25,772 copying build/lib/unitxt/catalog/cards/gpqa/main.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-13T10:37:25,775 copying build/lib/unitxt/catalog/cards/gpqa/diamond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-13T10:37:25,777 copying build/lib/unitxt/catalog/cards/gpqa/extended.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-13T10:37:25,779 copying build/lib/unitxt/catalog/cards/stsb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,782 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,784 copying build/lib/unitxt/catalog/cards/almost_evil/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,786 copying build/lib/unitxt/catalog/cards/almost_evil/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,788 copying build/lib/unitxt/catalog/cards/almost_evil/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,794 copying build/lib/unitxt/catalog/cards/almost_evil/nl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,805 copying build/lib/unitxt/catalog/cards/almost_evil/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,807 copying build/lib/unitxt/catalog/cards/almost_evil/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,810 copying build/lib/unitxt/catalog/cards/almost_evil/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,812 copying build/lib/unitxt/catalog/cards/almost_evil/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-13T10:37:25,814 copying build/lib/unitxt/catalog/cards/attaq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,816 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench 2026-01-13T10:37:25,818 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:25,820 copying build/lib/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:25,822 copying build/lib/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-01-13T10:37:25,825 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment 2026-01-13T10:37:25,848 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:25,850 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:25,852 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:25,855 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:25,857 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-13T10:37:25,860 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:25,862 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:25,864 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:25,866 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:25,868 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-13T10:37:25,871 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:25,872 copying build/lib/unitxt/catalog/cards/clinc_oos/plus.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:25,875 copying build/lib/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:25,878 copying build/lib/unitxt/catalog/cards/clinc_oos/small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-13T10:37:25,880 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,882 copying build/lib/unitxt/catalog/cards/ledgar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,885 copying build/lib/unitxt/catalog/cards/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,888 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reuters21578 2026-01-13T10:37:25,889 copying build/lib/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-13T10:37:25,892 copying build/lib/unitxt/catalog/cards/reuters21578/ModApte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-13T10:37:25,894 copying build/lib/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-13T10:37:25,897 copying build/lib/unitxt/catalog/cards/turl_col_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,900 copying build/lib/unitxt/catalog/cards/yahoo_answers_topics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,902 copying build/lib/unitxt/catalog/cards/pop_qa_robust.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,904 copying build/lib/unitxt/catalog/cards/pop_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:25,907 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic 2026-01-13T10:37:25,909 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:25,911 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:25,913 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-01-13T10:37:25,916 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:25,918 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:25,920 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-01-13T10:37:25,923 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:25,924 copying build/lib/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:25,927 copying build/lib/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-01-13T10:37:25,930 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:25,931 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:25,933 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-01-13T10:37:25,936 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:25,938 copying build/lib/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:25,940 copying build/lib/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-01-13T10:37:25,943 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:25,944 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:25,946 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-01-13T10:37:25,949 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:25,950 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:25,953 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-01-13T10:37:25,955 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:25,957 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:25,959 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-01-13T10:37:25,962 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:25,963 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:25,966 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-01-13T10:37:25,968 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:25,970 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:25,972 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-01-13T10:37:25,975 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,976 copying build/lib/unitxt/catalog/cards/mlsum/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,978 copying build/lib/unitxt/catalog/cards/mlsum/tu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,981 copying build/lib/unitxt/catalog/cards/mlsum/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,983 copying build/lib/unitxt/catalog/cards/mlsum/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,985 copying build/lib/unitxt/catalog/cards/mlsum/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-13T10:37:25,988 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt 2026-01-13T10:37:25,990 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:25,992 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:25,994 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:25,996 copying build/lib/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:25,999 copying build/lib/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,001 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,003 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,005 copying build/lib/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,008 copying build/lib/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,010 copying build/lib/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,012 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,014 copying build/lib/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,016 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,018 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,020 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,022 copying build/lib/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,024 copying build/lib/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-13T10:37:26,027 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu 2026-01-13T10:37:26,029 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,031 copying build/lib/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,033 copying build/lib/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,036 copying build/lib/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,038 copying build/lib/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,040 copying build/lib/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,042 copying build/lib/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,045 copying build/lib/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,047 copying build/lib/unitxt/catalog/cards/milu/Telugu/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-13T10:37:26,050 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,052 copying build/lib/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,054 copying build/lib/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,057 copying build/lib/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,059 copying build/lib/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,061 copying build/lib/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,063 copying build/lib/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,065 copying build/lib/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,068 copying build/lib/unitxt/catalog/cards/milu/English/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-13T10:37:26,070 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,072 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,074 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,076 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,079 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,081 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,083 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,086 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,088 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-13T10:37:26,091 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,093 copying build/lib/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,096 copying build/lib/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,098 copying build/lib/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,100 copying build/lib/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,103 copying build/lib/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,105 copying build/lib/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,107 copying build/lib/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,109 copying build/lib/unitxt/catalog/cards/milu/Bengali/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-13T10:37:26,112 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,114 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,116 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,118 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,120 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,122 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,125 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,127 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,129 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-13T10:37:26,132 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,133 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,135 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,138 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,140 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,142 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,144 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,147 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,149 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-13T10:37:26,152 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,153 copying build/lib/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,155 copying build/lib/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,158 copying build/lib/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,160 copying build/lib/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,162 copying build/lib/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,165 copying build/lib/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,167 copying build/lib/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,169 copying build/lib/unitxt/catalog/cards/milu/Kannada/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-13T10:37:26,172 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,173 copying build/lib/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,175 copying build/lib/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,178 copying build/lib/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,180 copying build/lib/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,182 copying build/lib/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,184 copying build/lib/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,186 copying build/lib/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,188 copying build/lib/unitxt/catalog/cards/milu/Hindi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-13T10:37:26,191 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,192 copying build/lib/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,195 copying build/lib/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,197 copying build/lib/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,199 copying build/lib/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,201 copying build/lib/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,203 copying build/lib/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,205 copying build/lib/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,207 copying build/lib/unitxt/catalog/cards/milu/Odia/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-13T10:37:26,209 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,210 copying build/lib/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,212 copying build/lib/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,214 copying build/lib/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,216 copying build/lib/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,218 copying build/lib/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,220 copying build/lib/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,222 copying build/lib/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,224 copying build/lib/unitxt/catalog/cards/milu/Tamil/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-13T10:37:26,226 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,227 copying build/lib/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,229 copying build/lib/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,231 copying build/lib/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,233 copying build/lib/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,234 copying build/lib/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,236 copying build/lib/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,238 copying build/lib/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,240 copying build/lib/unitxt/catalog/cards/milu/Marathi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-13T10:37:26,242 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,243 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,246 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,248 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,251 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,253 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,255 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,257 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,259 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,262 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,264 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,266 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,269 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,271 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,274 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-13T10:37:26,276 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wnli 2026-01-13T10:37:26,277 copying build/lib/unitxt/catalog/cards/wnli/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wnli 2026-01-13T10:37:26,279 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/go_emotions 2026-01-13T10:37:26,280 copying build/lib/unitxt/catalog/cards/go_emotions/simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/go_emotions 2026-01-13T10:37:26,282 copying build/lib/unitxt/catalog/cards/banking77.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,285 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:26,286 copying build/lib/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:26,288 copying build/lib/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-01-13T10:37:26,290 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,291 copying build/lib/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,294 copying build/lib/unitxt/catalog/cards/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,295 copying build/lib/unitxt/catalog/cards/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,297 copying build/lib/unitxt/catalog/cards/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,299 copying build/lib/unitxt/catalog/cards/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,301 copying build/lib/unitxt/catalog/cards/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,303 copying build/lib/unitxt/catalog/cards/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,304 copying build/lib/unitxt/catalog/cards/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,306 copying build/lib/unitxt/catalog/cards/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,308 copying build/lib/unitxt/catalog/cards/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,309 copying build/lib/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,311 copying build/lib/unitxt/catalog/cards/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-13T10:37:26,313 copying build/lib/unitxt/catalog/cards/coedit_error_detection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,316 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety 2026-01-13T10:37:26,317 copying build/lib/unitxt/catalog/cards/safety/truthful_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,319 copying build/lib/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,320 copying build/lib/unitxt/catalog/cards/safety/provoq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,322 copying build/lib/unitxt/catalog/cards/safety/xstest.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,324 copying build/lib/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,326 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:26,327 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:26,329 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-01-13T10:37:26,331 copying build/lib/unitxt/catalog/cards/safety/airbench2024.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-13T10:37:26,333 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,334 copying build/lib/unitxt/catalog/cards/safety/bbq/SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,336 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,338 copying build/lib/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,340 copying build/lib/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,342 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,343 copying build/lib/unitxt/catalog/cards/safety/bbq/Age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,345 copying build/lib/unitxt/catalog/cards/safety/bbq/Religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,347 copying build/lib/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,349 copying build/lib/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,350 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,352 copying build/lib/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-13T10:37:26,355 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl 2026-01-13T10:37:26,356 copying build/lib/unitxt/catalog/cards/bfcl/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl 2026-01-13T10:37:26,359 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,360 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,362 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,364 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,366 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,368 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,370 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,372 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,374 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,376 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,378 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,380 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,381 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-13T10:37:26,384 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,385 copying build/lib/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,387 copying build/lib/unitxt/catalog/cards/legalbench/proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,389 copying build/lib/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,391 copying build/lib/unitxt/catalog/cards/legalbench/abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,394 copying build/lib/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-13T10:37:26,396 copying build/lib/unitxt/catalog/cards/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,403 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/belebele 2026-01-13T10:37:26,404 copying build/lib/unitxt/catalog/cards/belebele/wol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,408 copying build/lib/unitxt/catalog/cards/belebele/hye_armn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,410 copying build/lib/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,413 copying build/lib/unitxt/catalog/cards/belebele/tur_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,415 copying build/lib/unitxt/catalog/cards/belebele/slv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,417 copying build/lib/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,419 copying build/lib/unitxt/catalog/cards/belebele/kat_geor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,421 copying build/lib/unitxt/catalog/cards/belebele/spa_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,423 copying build/lib/unitxt/catalog/cards/belebele/sin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,427 copying build/lib/unitxt/catalog/cards/belebele/pol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,429 copying build/lib/unitxt/catalog/cards/belebele/eus_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,431 copying build/lib/unitxt/catalog/cards/belebele/tgl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,433 copying build/lib/unitxt/catalog/cards/belebele/cat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,435 copying build/lib/unitxt/catalog/cards/belebele/npi_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,437 copying build/lib/unitxt/catalog/cards/belebele/pbt_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,438 copying build/lib/unitxt/catalog/cards/belebele/jav_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,440 copying build/lib/unitxt/catalog/cards/belebele/uzn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,442 copying build/lib/unitxt/catalog/cards/belebele/afr_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,444 copying build/lib/unitxt/catalog/cards/belebele/vie_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,446 copying build/lib/unitxt/catalog/cards/belebele/pan_guru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,448 copying build/lib/unitxt/catalog/cards/belebele/ron_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,450 copying build/lib/unitxt/catalog/cards/belebele/kac_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,453 copying build/lib/unitxt/catalog/cards/belebele/deu_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,454 copying build/lib/unitxt/catalog/cards/belebele/kor_hang.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,456 copying build/lib/unitxt/catalog/cards/belebele/heb_hebr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,458 copying build/lib/unitxt/catalog/cards/belebele/zul_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,460 copying build/lib/unitxt/catalog/cards/belebele/hau_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,462 copying build/lib/unitxt/catalog/cards/belebele/nld_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,464 copying build/lib/unitxt/catalog/cards/belebele/tel_telu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,466 copying build/lib/unitxt/catalog/cards/belebele/hin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,468 copying build/lib/unitxt/catalog/cards/belebele/mlt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,470 copying build/lib/unitxt/catalog/cards/belebele/tha_thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,471 copying build/lib/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,473 copying build/lib/unitxt/catalog/cards/belebele/tso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,475 copying build/lib/unitxt/catalog/cards/belebele/ben_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,477 copying build/lib/unitxt/catalog/cards/belebele/ben_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,479 copying build/lib/unitxt/catalog/cards/belebele/ceb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,481 copying build/lib/unitxt/catalog/cards/belebele/por_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,483 copying build/lib/unitxt/catalog/cards/belebele/urd_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,485 copying build/lib/unitxt/catalog/cards/belebele/fuv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,486 copying build/lib/unitxt/catalog/cards/belebele/mar_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,488 copying build/lib/unitxt/catalog/cards/belebele/luo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,490 copying build/lib/unitxt/catalog/cards/belebele/dan_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,492 copying build/lib/unitxt/catalog/cards/belebele/ary_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,494 copying build/lib/unitxt/catalog/cards/belebele/nob_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,496 copying build/lib/unitxt/catalog/cards/belebele/lvs_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,498 copying build/lib/unitxt/catalog/cards/belebele/zho_hant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,500 copying build/lib/unitxt/catalog/cards/belebele/zsm_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,501 copying build/lib/unitxt/catalog/cards/belebele/hun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,503 copying build/lib/unitxt/catalog/cards/belebele/ssw_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,505 copying build/lib/unitxt/catalog/cards/belebele/snd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,507 copying build/lib/unitxt/catalog/cards/belebele/lug_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,509 copying build/lib/unitxt/catalog/cards/belebele/ell_grek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,511 copying build/lib/unitxt/catalog/cards/belebele/hat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,513 copying build/lib/unitxt/catalog/cards/belebele/lit_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,515 copying build/lib/unitxt/catalog/cards/belebele/zho_hans.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,516 copying build/lib/unitxt/catalog/cards/belebele/grn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,518 copying build/lib/unitxt/catalog/cards/belebele/mri_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,520 copying build/lib/unitxt/catalog/cards/belebele/tam_taml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,522 copying build/lib/unitxt/catalog/cards/belebele/urd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,524 copying build/lib/unitxt/catalog/cards/belebele/hin_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,526 copying build/lib/unitxt/catalog/cards/belebele/ckb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,528 copying build/lib/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,530 copying build/lib/unitxt/catalog/cards/belebele/kan_knda.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,532 copying build/lib/unitxt/catalog/cards/belebele/hrv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,533 copying build/lib/unitxt/catalog/cards/belebele/ibo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,535 copying build/lib/unitxt/catalog/cards/belebele/azj_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,538 copying build/lib/unitxt/catalog/cards/belebele/ars_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,540 copying build/lib/unitxt/catalog/cards/belebele/apc_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,542 copying build/lib/unitxt/catalog/cards/belebele/ita_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,544 copying build/lib/unitxt/catalog/cards/belebele/guj_gujr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,547 copying build/lib/unitxt/catalog/cards/belebele/ind_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,548 copying build/lib/unitxt/catalog/cards/belebele/asm_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,550 copying build/lib/unitxt/catalog/cards/belebele/nya_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,552 copying build/lib/unitxt/catalog/cards/belebele/fin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,554 copying build/lib/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,556 copying build/lib/unitxt/catalog/cards/belebele/tsn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,558 copying build/lib/unitxt/catalog/cards/belebele/ory_orya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,560 copying build/lib/unitxt/catalog/cards/belebele/khm_khmr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,561 copying build/lib/unitxt/catalog/cards/belebele/sin_sinh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,563 copying build/lib/unitxt/catalog/cards/belebele/kea_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,565 copying build/lib/unitxt/catalog/cards/belebele/sot_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,567 copying build/lib/unitxt/catalog/cards/belebele/arz_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,569 copying build/lib/unitxt/catalog/cards/belebele/isl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,571 copying build/lib/unitxt/catalog/cards/belebele/npi_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,573 copying build/lib/unitxt/catalog/cards/belebele/est_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,575 copying build/lib/unitxt/catalog/cards/belebele/mya_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,576 copying build/lib/unitxt/catalog/cards/belebele/kin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,578 copying build/lib/unitxt/catalog/cards/belebele/shn_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,580 copying build/lib/unitxt/catalog/cards/belebele/amh_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,582 copying build/lib/unitxt/catalog/cards/belebele/acm_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,584 copying build/lib/unitxt/catalog/cards/belebele/ces_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,587 copying build/lib/unitxt/catalog/cards/belebele/bam_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,588 copying build/lib/unitxt/catalog/cards/belebele/sna_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,590 copying build/lib/unitxt/catalog/cards/belebele/lao_laoo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,592 copying build/lib/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,594 copying build/lib/unitxt/catalog/cards/belebele/fra_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,596 copying build/lib/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,598 copying build/lib/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,599 copying build/lib/unitxt/catalog/cards/belebele/slk_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,601 copying build/lib/unitxt/catalog/cards/belebele/som_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,603 copying build/lib/unitxt/catalog/cards/belebele/swh_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,605 copying build/lib/unitxt/catalog/cards/belebele/mal_mlym.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,607 copying build/lib/unitxt/catalog/cards/belebele/arb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,609 copying build/lib/unitxt/catalog/cards/belebele/bod_tibt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,610 copying build/lib/unitxt/catalog/cards/belebele/gaz_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,612 copying build/lib/unitxt/catalog/cards/belebele/tir_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,614 copying build/lib/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,616 copying build/lib/unitxt/catalog/cards/belebele/pes_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,618 copying build/lib/unitxt/catalog/cards/belebele/swe_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,620 copying build/lib/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,622 copying build/lib/unitxt/catalog/cards/belebele/yor_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,624 copying build/lib/unitxt/catalog/cards/belebele/plt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,626 copying build/lib/unitxt/catalog/cards/belebele/als_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,628 copying build/lib/unitxt/catalog/cards/belebele/eng_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,630 copying build/lib/unitxt/catalog/cards/belebele/xho_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,632 copying build/lib/unitxt/catalog/cards/belebele/arb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,634 copying build/lib/unitxt/catalog/cards/belebele/sun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,636 copying build/lib/unitxt/catalog/cards/belebele/lin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,637 copying build/lib/unitxt/catalog/cards/belebele/ilo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,639 copying build/lib/unitxt/catalog/cards/belebele/war_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,641 copying build/lib/unitxt/catalog/cards/belebele/nso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-13T10:37:26,643 copying build/lib/unitxt/catalog/cards/sciq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,645 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval 2026-01-13T10:37:26,647 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness 2026-01-13T10:37:26,649 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,650 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,653 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,656 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,658 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,661 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,663 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,664 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,666 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,668 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,670 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,672 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,674 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-13T10:37:26,675 copying build/lib/unitxt/catalog/cards/hh_rlhf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,677 copying build/lib/unitxt/catalog/cards/dart.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,680 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench 2026-01-13T10:37:26,681 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench/results 2026-01-13T10:37:26,682 copying build/lib/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/biggen_bench/results 2026-01-13T10:37:26,685 copying build/lib/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,686 copying build/lib/unitxt/catalog/cards/almost_evil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,688 copying build/lib/unitxt/catalog/cards/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,690 copying build/lib/unitxt/catalog/cards/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,692 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:26,693 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:26,695 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-01-13T10:37:26,697 copying build/lib/unitxt/catalog/cards/seed_bench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,699 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-13T10:37:26,700 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-13T10:37:26,703 copying build/lib/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,705 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB 2026-01-13T10:37:26,707 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:26,709 copying build/lib/unitxt/catalog/cards/CFPB/product/2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:26,711 copying build/lib/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-01-13T10:37:26,713 copying build/lib/unitxt/catalog/cards/ag_news.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,715 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,717 copying build/lib/unitxt/catalog/cards/mmlu_pro/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,719 copying build/lib/unitxt/catalog/cards/mmlu_pro/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,721 copying build/lib/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,723 copying build/lib/unitxt/catalog/cards/mmlu_pro/health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,725 copying build/lib/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,727 copying build/lib/unitxt/catalog/cards/mmlu_pro/law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,730 copying build/lib/unitxt/catalog/cards/mmlu_pro/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,732 copying build/lib/unitxt/catalog/cards/mmlu_pro/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,734 copying build/lib/unitxt/catalog/cards/mmlu_pro/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,736 copying build/lib/unitxt/catalog/cards/mmlu_pro/business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,738 copying build/lib/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,740 copying build/lib/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,742 copying build/lib/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,743 copying build/lib/unitxt/catalog/cards/mmlu_pro/other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-13T10:37:26,745 copying build/lib/unitxt/catalog/cards/wsc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,748 copying build/lib/unitxt/catalog/cards/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,751 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,753 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,755 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,757 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,760 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,762 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,764 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,766 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,768 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,770 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,773 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,775 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,777 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,779 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-13T10:37:26,782 copying build/lib/unitxt/catalog/cards/race_high.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,785 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tot 2026-01-13T10:37:26,786 copying build/lib/unitxt/catalog/cards/tot/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-01-13T10:37:26,788 copying build/lib/unitxt/catalog/cards/tot/semantic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-01-13T10:37:26,790 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,792 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/babi 2026-01-13T10:37:26,793 copying build/lib/unitxt/catalog/cards/babi/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/babi 2026-01-13T10:37:26,796 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,797 copying build/lib/unitxt/catalog/cards/xwinogrande/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,799 copying build/lib/unitxt/catalog/cards/xwinogrande/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,800 copying build/lib/unitxt/catalog/cards/xwinogrande/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,802 copying build/lib/unitxt/catalog/cards/xwinogrande/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,804 copying build/lib/unitxt/catalog/cards/xwinogrande/jp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-13T10:37:26,806 copying build/lib/unitxt/catalog/cards/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,808 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges 2026-01-13T10:37:26,810 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-13T10:37:26,811 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-13T10:37:26,813 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:26,814 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:26,816 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-13T10:37:26,818 copying build/lib/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,820 copying build/lib/unitxt/catalog/cards/piqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,822 copying build/lib/unitxt/catalog/cards/wikitq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,824 copying build/lib/unitxt/catalog/cards/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,826 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,828 copying build/lib/unitxt/catalog/cards/xsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,830 copying build/lib/unitxt/catalog/cards/sst2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,832 copying build/lib/unitxt/catalog/cards/mrpc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-13T10:37:26,834 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,835 copying build/lib/unitxt/catalog/cards/winogrande/debiased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,837 copying build/lib/unitxt/catalog/cards/winogrande/m.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,839 copying build/lib/unitxt/catalog/cards/winogrande/xl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,841 copying build/lib/unitxt/catalog/cards/winogrande/s.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,843 copying build/lib/unitxt/catalog/cards/winogrande/l.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,844 copying build/lib/unitxt/catalog/cards/winogrande/xs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-13T10:37:26,847 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/20_newsgroups 2026-01-13T10:37:26,848 copying build/lib/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/20_newsgroups 2026-01-13T10:37:26,851 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/splitters 2026-01-13T10:37:26,852 copying build/lib/unitxt/catalog/splitters/large_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,854 copying build/lib/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,856 copying build/lib/unitxt/catalog/splitters/small_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,857 copying build/lib/unitxt/catalog/splitters/small_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,859 copying build/lib/unitxt/catalog/splitters/large_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,861 copying build/lib/unitxt/catalog/splitters/test_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-13T10:37:26,863 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats 2026-01-13T10:37:26,864 copying build/lib/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,867 copying build/lib/unitxt/catalog/formats/user_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,869 copying build/lib/unitxt/catalog/formats/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,871 copying build/lib/unitxt/catalog/formats/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,872 copying build/lib/unitxt/catalog/formats/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,874 copying build/lib/unitxt/catalog/formats/textual_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,876 copying build/lib/unitxt/catalog/formats/llamaguard2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,878 copying build/lib/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,880 copying build/lib/unitxt/catalog/formats/user_agent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,881 copying build/lib/unitxt/catalog/formats/chat_api.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,884 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models 2026-01-13T10:37:26,885 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:26,886 copying build/lib/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:26,888 copying build/lib/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-01-13T10:37:26,890 copying build/lib/unitxt/catalog/formats/models/alpaca_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,892 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral 2026-01-13T10:37:26,893 copying build/lib/unitxt/catalog/formats/models/mistral/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral 2026-01-13T10:37:26,896 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral/instruction 2026-01-13T10:37:26,897 copying build/lib/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral/instruction 2026-01-13T10:37:26,899 copying build/lib/unitxt/catalog/formats/models/llava.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,900 copying build/lib/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,902 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/flan 2026-01-13T10:37:26,903 copying build/lib/unitxt/catalog/formats/models/flan/exq_exa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-01-13T10:37:26,905 copying build/lib/unitxt/catalog/formats/models/flan/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-01-13T10:37:26,907 copying build/lib/unitxt/catalog/formats/models/phi_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,909 copying build/lib/unitxt/catalog/formats/models/starling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,910 copying build/lib/unitxt/catalog/formats/models/llava_interleave.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-13T10:37:26,912 copying build/lib/unitxt/catalog/formats/human_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,914 copying build/lib/unitxt/catalog/formats/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,916 copying build/lib/unitxt/catalog/formats/llama3_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,918 copying build/lib/unitxt/catalog/formats/empty_input_output_separator.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-13T10:37:26,920 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines 2026-01-13T10:37:26,921 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model 2026-01-13T10:37:26,923 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan 2026-01-13T10:37:26,924 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan/t5_small 2026-01-13T10:37:26,926 copying build/lib/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model/flan/t5_small 2026-01-13T10:37:26,927 copying build/lib/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model 2026-01-13T10:37:26,930 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ollama 2026-01-13T10:37:26,931 copying build/lib/unitxt/catalog/engines/ollama/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ollama 2026-01-13T10:37:26,933 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits 2026-01-13T10:37:26,934 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-01-13T10:37:26,936 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-01-13T10:37:26,938 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits/llama_3 2026-01-13T10:37:26,939 copying build/lib/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits/llama_3 2026-01-13T10:37:26,941 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ibm_wml 2026-01-13T10:37:26,942 copying build/lib/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ibm_wml 2026-01-13T10:37:26,945 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/openai 2026-01-13T10:37:26,946 copying build/lib/unitxt/catalog/engines/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/openai 2026-01-13T10:37:26,949 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/classification 2026-01-13T10:37:26,949 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,951 copying build/lib/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,953 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,955 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,957 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,958 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,960 copying build/lib/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,963 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,964 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,966 copying build/lib/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,968 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,969 copying build/lib/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,971 copying build/lib/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,973 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,975 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,976 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,978 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,980 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,982 copying build/lib/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,984 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,986 copying build/lib/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,987 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-13T10:37:26,990 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/cross_provider 2026-01-13T10:37:26,991 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-01-13T10:37:26,992 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-01-13T10:37:26,995 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators 2026-01-13T10:37:26,996 copying build/lib/unitxt/catalog/operators/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:26,998 copying build/lib/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:26,999 copying build/lib/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,001 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,003 copying build/lib/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,005 copying build/lib/unitxt/catalog/operators/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,007 copying build/lib/unitxt/catalog/operators/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,009 copying build/lib/unitxt/catalog/operators/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,011 copying build/lib/unitxt/catalog/operators/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,012 copying build/lib/unitxt/catalog/operators/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,014 copying build/lib/unitxt/catalog/operators/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,017 copying build/lib/unitxt/catalog/operators/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,019 copying build/lib/unitxt/catalog/operators/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,021 copying build/lib/unitxt/catalog/operators/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,023 copying build/lib/unitxt/catalog/operators/fix_json_schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,024 copying build/lib/unitxt/catalog/operators/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,026 copying build/lib/unitxt/catalog/operators/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,028 copying build/lib/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,030 copying build/lib/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,032 copying build/lib/unitxt/catalog/operators/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,034 copying build/lib/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,036 copying build/lib/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,038 copying build/lib/unitxt/catalog/operators/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,039 copying build/lib/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,041 copying build/lib/unitxt/catalog/operators/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,043 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/mt_bench 2026-01-13T10:37:27,044 copying build/lib/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-01-13T10:37:27,047 copying build/lib/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-01-13T10:37:27,048 copying build/lib/unitxt/catalog/operators/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,050 copying build/lib/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,052 copying build/lib/unitxt/catalog/operators/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,054 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers 2026-01-13T10:37:27,055 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/multi_label 2026-01-13T10:37:27,056 copying build/lib/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/multi_label 2026-01-13T10:37:27,059 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/ner 2026-01-13T10:37:27,060 copying build/lib/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/ner 2026-01-13T10:37:27,063 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/qa 2026-01-13T10:37:27,064 copying build/lib/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/qa 2026-01-13T10:37:27,067 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:27,068 copying build/lib/unitxt/catalog/operators/balancers/classification/by_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:27,070 copying build/lib/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-01-13T10:37:27,072 copying build/lib/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,074 copying build/lib/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,076 copying build/lib/unitxt/catalog/operators/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,078 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,080 copying build/lib/unitxt/catalog/operators/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,081 copying build/lib/unitxt/catalog/operators/regex_parser.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,083 copying build/lib/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,085 copying build/lib/unitxt/catalog/operators/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,087 copying build/lib/unitxt/catalog/operators/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,089 copying build/lib/unitxt/catalog/operators/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-13T10:37:27,091 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts 2026-01-13T10:37:27,092 copying build/lib/unitxt/catalog/system_prompts/boolqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-01-13T10:37:27,094 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/model 2026-01-13T10:37:27,095 copying build/lib/unitxt/catalog/system_prompts/model/granite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/model 2026-01-13T10:37:27,097 copying build/lib/unitxt/catalog/system_prompts/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-01-13T10:37:27,099 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/general 2026-01-13T10:37:27,100 copying build/lib/unitxt/catalog/system_prompts/general/be_concise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/general 2026-01-13T10:37:27,102 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,103 copying build/lib/unitxt/catalog/system_prompts/models/labradorite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,106 copying build/lib/unitxt/catalog/system_prompts/models/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,108 copying build/lib/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,110 copying build/lib/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,112 copying build/lib/unitxt/catalog/system_prompts/models/alpaca.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,113 copying build/lib/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,115 copying build/lib/unitxt/catalog/system_prompts/models/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-13T10:37:27,117 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes 2026-01-13T10:37:27,119 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench 2026-01-13T10:37:27,120 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:27,122 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:27,123 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-01-13T10:37:27,126 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:27,127 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:27,129 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-01-13T10:37:27,131 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,132 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,134 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,136 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,138 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,139 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,142 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,143 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,145 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,147 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,149 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,151 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-13T10:37:27,153 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:27,154 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:27,156 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-01-13T10:37:27,158 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-13T10:37:27,159 copying build/lib/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/qa_finance 2026-01-13T10:37:27,162 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,163 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,165 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,166 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,168 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,170 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,172 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,173 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,175 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,177 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,178 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,180 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,182 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,184 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,186 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,187 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-13T10:37:27,190 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/rag_general 2026-01-13T10:37:27,191 copying build/lib/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/rag_general 2026-01-13T10:37:27,193 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-13T10:37:27,194 copying build/lib/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-13T10:37:27,196 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/safety 2026-01-13T10:37:27,197 copying build/lib/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/safety 2026-01-13T10:37:27,200 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-13T10:37:27,201 copying build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-13T10:37:27,204 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,205 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,207 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,209 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,210 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,212 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,214 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,216 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,217 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,219 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,221 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,223 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,225 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,226 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,228 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-13T10:37:27,231 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,232 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,233 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,235 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,237 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,239 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-13T10:37:27,242 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/news_classification 2026-01-13T10:37:27,243 copying build/lib/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/news_classification 2026-01-13T10:37:27,246 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr 2026-01-13T10:37:27,247 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa 2026-01-13T10:37:27,249 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,250 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,252 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,254 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,256 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,258 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-13T10:37:27,260 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,261 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,263 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,265 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,268 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,270 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-13T10:37:27,272 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,273 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,275 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,277 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,279 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,281 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-13T10:37:27,283 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,284 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,286 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,288 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,290 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,292 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-13T10:37:27,295 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,296 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,298 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,300 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,302 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,303 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-13T10:37:27,305 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,306 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,308 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,311 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,313 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,315 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-13T10:37:27,318 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,319 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,322 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,324 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,326 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,328 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-13T10:37:27,331 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact 2026-01-13T10:37:27,333 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,334 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,336 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,338 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,339 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,341 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-13T10:37:27,344 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,345 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,346 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,348 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,350 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,352 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-13T10:37:27,355 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,356 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,358 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,359 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,361 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,363 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-13T10:37:27,365 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,366 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,368 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,370 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,372 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,374 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-13T10:37:27,376 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,377 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,379 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,381 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,383 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,384 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-13T10:37:27,387 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,388 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,389 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,391 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,393 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,394 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-13T10:37:27,397 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,398 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,400 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,402 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,404 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,406 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-13T10:37:27,408 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis 2026-01-13T10:37:27,410 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,411 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,413 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,414 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,416 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,418 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-13T10:37:27,420 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,421 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,423 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,425 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,426 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,428 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-13T10:37:27,430 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,431 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,433 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,435 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,436 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,438 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-13T10:37:27,440 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,441 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,443 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,445 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,447 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,449 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-13T10:37:27,451 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,452 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,454 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,456 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,457 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,459 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-13T10:37:27,461 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,462 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,464 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,466 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,468 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,469 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-13T10:37:27,471 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,472 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,474 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,476 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,478 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,480 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-13T10:37:27,482 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking 2026-01-13T10:37:27,484 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,485 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,487 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,489 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,490 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,492 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-13T10:37:27,494 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,495 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,497 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,499 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,501 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,502 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-13T10:37:27,505 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,506 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,508 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,509 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,511 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,513 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-13T10:37:27,515 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,516 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,518 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,520 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,521 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,523 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-13T10:37:27,525 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,526 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,528 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,530 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,532 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,534 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-13T10:37:27,536 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,537 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,539 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,541 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,543 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,544 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-13T10:37:27,547 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,548 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,550 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,552 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,553 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,555 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-13T10:37:27,557 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type 2026-01-13T10:37:27,559 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,560 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,562 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,564 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,566 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,568 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-13T10:37:27,570 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,571 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,573 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,575 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,577 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,579 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-13T10:37:27,581 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,582 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,584 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,586 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,588 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,590 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-13T10:37:27,592 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,593 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,595 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,596 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,598 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,600 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-13T10:37:27,602 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,603 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,605 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,608 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,609 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,611 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-13T10:37:27,613 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,614 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,616 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,618 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,620 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,621 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-13T10:37:27,624 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,625 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,627 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,629 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,630 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,632 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-13T10:37:27,634 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen 2026-01-13T10:37:27,636 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,637 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,639 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,641 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,643 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,645 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-13T10:37:27,647 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,648 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,651 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,653 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,655 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,656 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-13T10:37:27,659 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,660 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,662 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,663 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,665 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,667 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-13T10:37:27,669 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,670 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,672 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,674 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,676 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,677 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-13T10:37:27,680 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,681 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,683 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,685 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,686 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,688 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-13T10:37:27,690 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,691 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,694 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,697 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,698 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,700 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-13T10:37:27,703 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,704 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,706 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,707 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,709 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,711 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-13T10:37:27,713 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm 2026-01-13T10:37:27,714 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,716 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,717 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,719 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,721 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,723 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-13T10:37:27,725 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,726 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,728 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,730 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,732 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,733 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-13T10:37:27,736 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,737 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,739 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,740 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,742 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,744 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-13T10:37:27,746 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,748 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,749 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,751 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,753 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,754 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-13T10:37:27,757 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,758 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,760 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,761 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,763 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,765 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-13T10:37:27,767 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,768 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,770 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,772 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,773 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,775 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-13T10:37:27,777 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,779 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,781 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,782 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,784 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,785 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-13T10:37:27,788 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq 2026-01-13T10:37:27,789 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,790 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,792 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,794 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,796 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,797 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-13T10:37:27,800 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,801 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,803 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,805 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,806 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,808 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-13T10:37:27,811 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,812 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,813 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,815 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,817 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,819 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-13T10:37:27,821 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,822 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,824 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,826 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,827 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,829 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-13T10:37:27,831 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,832 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,834 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,836 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,838 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,839 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-13T10:37:27,842 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,843 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,845 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,846 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,848 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,850 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-13T10:37:27,852 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,853 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,855 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,857 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,859 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,861 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-13T10:37:27,863 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning 2026-01-13T10:37:27,865 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,866 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,868 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,871 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,872 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,874 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-13T10:37:27,877 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,878 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,880 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,882 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,884 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,887 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-13T10:37:27,890 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,891 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,893 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,895 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,897 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,899 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-13T10:37:27,901 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,902 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,904 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,905 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,907 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,909 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-13T10:37:27,911 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,912 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,914 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,916 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,918 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,920 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-13T10:37:27,922 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,923 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,925 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,927 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,929 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,930 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-13T10:37:27,933 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,934 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,936 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,937 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,939 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,941 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-13T10:37:27,943 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg 2026-01-13T10:37:27,945 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,946 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,948 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,949 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,951 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,953 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-13T10:37:27,955 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,956 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,958 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,960 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,962 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,964 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-13T10:37:27,966 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,967 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,969 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,970 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,972 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,974 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-13T10:37:27,976 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,977 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,979 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,981 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,982 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,984 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-13T10:37:27,986 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,988 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,990 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,991 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,993 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,995 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-13T10:37:27,997 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:27,999 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:28,001 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:28,002 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:28,004 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:28,006 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-13T10:37:28,008 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,009 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,011 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,013 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,014 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,016 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-13T10:37:28,019 copying build/lib/unitxt/fusion.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,021 copying build/lib/unitxt/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,024 copying build/lib/unitxt/stream.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,026 copying build/lib/unitxt/llm_as_judge_constants.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,030 copying build/lib/unitxt/dataset.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,032 copying build/lib/unitxt/hf_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,034 copying build/lib/unitxt/llm_as_judge_from_template.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,037 copying build/lib/unitxt/string_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,039 copying build/lib/unitxt/collections_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,041 copying build/lib/unitxt/loaders.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,045 copying build/lib/unitxt/evaluate_cli.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,048 creating build/bdist.linux-armv7l/wheel/unitxt/service 2026-01-13T10:37:28,049 creating build/bdist.linux-armv7l/wheel/unitxt/service/metrics 2026-01-13T10:37:28,051 copying build/lib/unitxt/service/metrics/main.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-13T10:37:28,053 copying build/lib/unitxt/service/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-13T10:37:28,054 copying build/lib/unitxt/service/metrics/tokens.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-13T10:37:28,056 copying build/lib/unitxt/service/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service 2026-01-13T10:37:28,058 copying build/lib/unitxt/stream_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,061 creating build/bdist.linux-armv7l/wheel/unitxt/ui 2026-01-13T10:37:28,062 copying build/lib/unitxt/ui/settings.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,064 copying build/lib/unitxt/ui/ui_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,066 copying build/lib/unitxt/ui/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,067 copying build/lib/unitxt/ui/ui_tester.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,069 copying build/lib/unitxt/ui/load_catalog_data.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,071 copying build/lib/unitxt/ui/run.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,074 copying build/lib/unitxt/ui/banner.png -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,078 copying build/lib/unitxt/ui/gradio_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-13T10:37:28,080 copying build/lib/unitxt/eval_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,082 copying build/lib/unitxt/schema.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-13T10:37:28,085 running install_egg_info 2026-01-13T10:37:28,094 Copying src/unitxt.egg-info to build/bdist.linux-armv7l/wheel/./unitxt-1.26.9-py3.11.egg-info 2026-01-13T10:37:28,112 running install_scripts 2026-01-13T10:37:28,124 creating build/bdist.linux-armv7l/wheel/unitxt-1.26.9.dist-info/WHEEL 2026-01-13T10:37:28,128 creating '/tmp/pip-wheel-aeq5i_54/.tmp-04et06ak/unitxt-1.26.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-01-13T10:37:28,131 adding 'unitxt/__init__.py' 2026-01-13T10:37:28,133 adding 'unitxt/api.py' 2026-01-13T10:37:28,137 adding 'unitxt/artifact.py' 2026-01-13T10:37:28,139 adding 'unitxt/augmentors.py' 2026-01-13T10:37:28,141 adding 'unitxt/base_metric.py' 2026-01-13T10:37:28,142 adding 'unitxt/benchmark.py' 2026-01-13T10:37:28,143 adding 'unitxt/blocks.py' 2026-01-13T10:37:28,145 adding 'unitxt/card.py' 2026-01-13T10:37:28,146 adding 'unitxt/catalog.py' 2026-01-13T10:37:28,148 adding 'unitxt/collections.py' 2026-01-13T10:37:28,149 adding 'unitxt/collections_operators.py' 2026-01-13T10:37:28,152 adding 'unitxt/dataclass.py' 2026-01-13T10:37:28,154 adding 'unitxt/dataset.py' 2026-01-13T10:37:28,155 adding 'unitxt/dataset_utils.py' 2026-01-13T10:37:28,156 adding 'unitxt/deprecation_utils.py' 2026-01-13T10:37:28,158 adding 'unitxt/dialog_operators.py' 2026-01-13T10:37:28,161 adding 'unitxt/dict_utils.py' 2026-01-13T10:37:28,163 adding 'unitxt/error_utils.py' 2026-01-13T10:37:28,165 adding 'unitxt/eval_utils.py' 2026-01-13T10:37:28,169 adding 'unitxt/evaluate_cli.py' 2026-01-13T10:37:28,170 adding 'unitxt/file_utils.py' 2026-01-13T10:37:28,173 adding 'unitxt/formats.py' 2026-01-13T10:37:28,175 adding 'unitxt/fusion.py' 2026-01-13T10:37:28,176 adding 'unitxt/generator_utils.py' 2026-01-13T10:37:28,178 adding 'unitxt/hf_utils.py' 2026-01-13T10:37:28,179 adding 'unitxt/image_operators.py' 2026-01-13T10:37:28,194 adding 'unitxt/inference.py' 2026-01-13T10:37:28,196 adding 'unitxt/instructions.py' 2026-01-13T10:37:28,202 adding 'unitxt/llm_as_judge.py' 2026-01-13T10:37:28,204 adding 'unitxt/llm_as_judge_chat_templates.py' 2026-01-13T10:37:28,209 adding 'unitxt/llm_as_judge_constants.py' 2026-01-13T10:37:28,212 adding 'unitxt/llm_as_judge_from_template.py' 2026-01-13T10:37:28,213 adding 'unitxt/llm_as_judge_operators.py' 2026-01-13T10:37:28,215 adding 'unitxt/llm_as_judge_utils.py' 2026-01-13T10:37:28,221 adding 'unitxt/loaders.py' 2026-01-13T10:37:28,223 adding 'unitxt/logging_utils.py' 2026-01-13T10:37:28,224 adding 'unitxt/metric.py' 2026-01-13T10:37:28,228 adding 'unitxt/metric_utils.py' 2026-01-13T10:37:28,259 adding 'unitxt/metrics.py' 2026-01-13T10:37:28,262 adding 'unitxt/normalizers.py' 2026-01-13T10:37:28,265 adding 'unitxt/operator.py' 2026-01-13T10:37:28,279 adding 'unitxt/operators.py' 2026-01-13T10:37:28,281 adding 'unitxt/parsing_utils.py' 2026-01-13T10:37:28,284 adding 'unitxt/processors.py' 2026-01-13T10:37:28,285 adding 'unitxt/random_utils.py' 2026-01-13T10:37:28,286 adding 'unitxt/recipe.py' 2026-01-13T10:37:28,288 adding 'unitxt/register.py' 2026-01-13T10:37:28,289 adding 'unitxt/schema.py' 2026-01-13T10:37:28,291 adding 'unitxt/serializers.py' 2026-01-13T10:37:28,293 adding 'unitxt/settings_utils.py' 2026-01-13T10:37:28,295 adding 'unitxt/span_lableing_operators.py' 2026-01-13T10:37:28,296 adding 'unitxt/split_utils.py' 2026-01-13T10:37:28,299 adding 'unitxt/splitters.py' 2026-01-13T10:37:28,302 adding 'unitxt/standard.py' 2026-01-13T10:37:28,304 adding 'unitxt/stream.py' 2026-01-13T10:37:28,306 adding 'unitxt/stream_operators.py' 2026-01-13T10:37:28,307 adding 'unitxt/string_operators.py' 2026-01-13T10:37:28,312 adding 'unitxt/struct_data_operators.py' 2026-01-13T10:37:28,313 adding 'unitxt/system_prompts.py' 2026-01-13T10:37:28,315 adding 'unitxt/task.py' 2026-01-13T10:37:28,319 adding 'unitxt/templates.py' 2026-01-13T10:37:28,325 adding 'unitxt/text2sql_utils.py' 2026-01-13T10:37:28,327 adding 'unitxt/text_utils.py' 2026-01-13T10:37:28,332 adding 'unitxt/type_utils.py' 2026-01-13T10:37:28,333 adding 'unitxt/types.py' 2026-01-13T10:37:28,336 adding 'unitxt/utils.py' 2026-01-13T10:37:28,337 adding 'unitxt/validate.py' 2026-01-13T10:37:28,338 adding 'unitxt/version.py' 2026-01-13T10:37:28,340 adding 'unitxt/assistant/__init__.py' 2026-01-13T10:37:28,342 adding 'unitxt/assistant/app.py' 2026-01-13T10:37:31,134 adding 'unitxt/assistant/embeddings.npz' 2026-01-13T10:37:31,297 adding 'unitxt/assistant/index.py' 2026-01-13T10:37:31,512 adding 'unitxt/assistant/metadata.parquet' 2026-01-13T10:37:31,526 adding 'unitxt/assistant/assessment/__init__.py' 2026-01-13T10:37:31,527 adding 'unitxt/assistant/assessment/assistant_inference_engine.py' 2026-01-13T10:37:31,528 adding 'unitxt/assistant/assessment/my_pretty_table.py' 2026-01-13T10:37:31,531 adding 'unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json' 2026-01-13T10:37:31,532 adding 'unitxt/catalog/augmentors/augment_whitespace_task_input.json' 2026-01-13T10:37:31,533 adding 'unitxt/catalog/augmentors/no_augmentation.json' 2026-01-13T10:37:31,535 adding 'unitxt/catalog/augmentors/image/grey_scale.json' 2026-01-13T10:37:31,536 adding 'unitxt/catalog/augmentors/image/grid_lines.json' 2026-01-13T10:37:31,537 adding 'unitxt/catalog/augmentors/image/oldify.json' 2026-01-13T10:37:31,538 adding 'unitxt/catalog/augmentors/image/white_noise.json' 2026-01-13T10:37:31,540 adding 'unitxt/catalog/augmentors/table/duplicate_columns.json' 2026-01-13T10:37:31,541 adding 'unitxt/catalog/augmentors/table/duplicate_rows.json' 2026-01-13T10:37:31,542 adding 'unitxt/catalog/augmentors/table/insert_empty_rows.json' 2026-01-13T10:37:31,543 adding 'unitxt/catalog/augmentors/table/mask_cols_names.json' 2026-01-13T10:37:31,544 adding 'unitxt/catalog/augmentors/table/shuffle_cols.json' 2026-01-13T10:37:31,546 adding 'unitxt/catalog/augmentors/table/shuffle_cols_names.json' 2026-01-13T10:37:31,547 adding 'unitxt/catalog/augmentors/table/shuffle_rows.json' 2026-01-13T10:37:31,548 adding 'unitxt/catalog/augmentors/table/transpose.json' 2026-01-13T10:37:31,549 adding 'unitxt/catalog/augmentors/table/truncate_rows.json' 2026-01-13T10:37:31,550 adding 'unitxt/catalog/augmentors/text/white_space.json' 2026-01-13T10:37:31,552 adding 'unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json' 2026-01-13T10:37:31,554 adding 'unitxt/catalog/benchmarks/bluebench.json' 2026-01-13T10:37:31,555 adding 'unitxt/catalog/benchmarks/glue.json' 2026-01-13T10:37:31,556 adding 'unitxt/catalog/benchmarks/llama_vision.json' 2026-01-13T10:37:31,557 adding 'unitxt/catalog/benchmarks/tool_calling.json' 2026-01-13T10:37:31,560 adding 'unitxt/catalog/benchmarks/torr.json' 2026-01-13T10:37:31,562 adding 'unitxt/catalog/benchmarks/vision_default.json' 2026-01-13T10:37:31,563 adding 'unitxt/catalog/benchmarks/vision_full.json' 2026-01-13T10:37:31,566 adding 'unitxt/catalog/cards/20_newsgroups.json' 2026-01-13T10:37:31,568 adding 'unitxt/catalog/cards/20_newsgroups_short.json' 2026-01-13T10:37:31,569 adding 'unitxt/catalog/cards/ag_news.json' 2026-01-13T10:37:31,570 adding 'unitxt/catalog/cards/ai2d.json' 2026-01-13T10:37:31,571 adding 'unitxt/catalog/cards/almost_evil.json' 2026-01-13T10:37:31,573 adding 'unitxt/catalog/cards/argument_topic.json' 2026-01-13T10:37:31,574 adding 'unitxt/catalog/cards/atis.json' 2026-01-13T10:37:31,575 adding 'unitxt/catalog/cards/atta_q.json' 2026-01-13T10:37:31,576 adding 'unitxt/catalog/cards/attaq.json' 2026-01-13T10:37:31,589 adding 'unitxt/catalog/cards/attaq_500.json' 2026-01-13T10:37:31,591 adding 'unitxt/catalog/cards/banking77.json' 2026-01-13T10:37:31,592 adding 'unitxt/catalog/cards/billsum.json' 2026-01-13T10:37:31,594 adding 'unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json' 2026-01-13T10:37:31,595 adding 'unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json' 2026-01-13T10:37:31,596 adding 'unitxt/catalog/cards/bold.json' 2026-01-13T10:37:31,597 adding 'unitxt/catalog/cards/chart_qa.json' 2026-01-13T10:37:31,599 adding 'unitxt/catalog/cards/chart_qa_lmms_eval.json' 2026-01-13T10:37:31,600 adding 'unitxt/catalog/cards/claim_stance_topic.json' 2026-01-13T10:37:31,601 adding 'unitxt/catalog/cards/cnn_dailymail.json' 2026-01-13T10:37:31,603 adding 'unitxt/catalog/cards/coedit_error_detection.json' 2026-01-13T10:37:31,604 adding 'unitxt/catalog/cards/coedit_gec.json' 2026-01-13T10:37:31,605 adding 'unitxt/catalog/cards/cola.json' 2026-01-13T10:37:31,606 adding 'unitxt/catalog/cards/copa.json' 2026-01-13T10:37:31,608 adding 'unitxt/catalog/cards/dart.json' 2026-01-13T10:37:31,609 adding 'unitxt/catalog/cards/dbpedia_14.json' 2026-01-13T10:37:31,610 adding 'unitxt/catalog/cards/ethos_binary.json' 2026-01-13T10:37:31,612 adding 'unitxt/catalog/cards/fin_qa.json' 2026-01-13T10:37:31,613 adding 'unitxt/catalog/cards/financial_tweets.json' 2026-01-13T10:37:31,615 adding 'unitxt/catalog/cards/frames.json' 2026-01-13T10:37:31,616 adding 'unitxt/catalog/cards/hellaswag.json' 2026-01-13T10:37:31,617 adding 'unitxt/catalog/cards/hh_rlhf.json' 2026-01-13T10:37:31,618 adding 'unitxt/catalog/cards/human_eval.json' 2026-01-13T10:37:31,620 adding 'unitxt/catalog/cards/info_vqa.json' 2026-01-13T10:37:31,621 adding 'unitxt/catalog/cards/info_vqa_lmms_eval.json' 2026-01-13T10:37:31,622 adding 'unitxt/catalog/cards/language_identification.json' 2026-01-13T10:37:31,624 adding 'unitxt/catalog/cards/law_stack_exchange.json' 2026-01-13T10:37:31,625 adding 'unitxt/catalog/cards/ledgar.json' 2026-01-13T10:37:31,627 adding 'unitxt/catalog/cards/long_bench_v2.json' 2026-01-13T10:37:31,628 adding 'unitxt/catalog/cards/mbpp.json' 2026-01-13T10:37:31,629 adding 'unitxt/catalog/cards/medical_abstracts.json' 2026-01-13T10:37:31,631 adding 'unitxt/catalog/cards/mnli.json' 2026-01-13T10:37:31,632 adding 'unitxt/catalog/cards/mrpc.json' 2026-01-13T10:37:31,634 adding 'unitxt/catalog/cards/news_category_classification_headline.json' 2026-01-13T10:37:31,635 adding 'unitxt/catalog/cards/numeric_nlg.json' 2026-01-13T10:37:31,636 adding 'unitxt/catalog/cards/open_australian_legal_qa.json' 2026-01-13T10:37:31,638 adding 'unitxt/catalog/cards/openbook_qa.json' 2026-01-13T10:37:31,639 adding 'unitxt/catalog/cards/piqa.json' 2026-01-13T10:37:31,640 adding 'unitxt/catalog/cards/pop_qa.json' 2026-01-13T10:37:31,642 adding 'unitxt/catalog/cards/pop_qa_robust.json' 2026-01-13T10:37:31,643 adding 'unitxt/catalog/cards/qnli.json' 2026-01-13T10:37:31,644 adding 'unitxt/catalog/cards/qqp.json' 2026-01-13T10:37:31,645 adding 'unitxt/catalog/cards/qtsumm.json' 2026-01-13T10:37:31,647 adding 'unitxt/catalog/cards/quality.json' 2026-01-13T10:37:31,648 adding 'unitxt/catalog/cards/race_all.json' 2026-01-13T10:37:31,649 adding 'unitxt/catalog/cards/race_high.json' 2026-01-13T10:37:31,650 adding 'unitxt/catalog/cards/race_middle.json' 2026-01-13T10:37:31,652 adding 'unitxt/catalog/cards/rte.json' 2026-01-13T10:37:31,653 adding 'unitxt/catalog/cards/scigen.json' 2026-01-13T10:37:31,654 adding 'unitxt/catalog/cards/sciq.json' 2026-01-13T10:37:31,655 adding 'unitxt/catalog/cards/seed_bench.json' 2026-01-13T10:37:31,656 adding 'unitxt/catalog/cards/simple_qa.json' 2026-01-13T10:37:31,658 adding 'unitxt/catalog/cards/social_iqa.json' 2026-01-13T10:37:31,659 adding 'unitxt/catalog/cards/squad.json' 2026-01-13T10:37:31,660 adding 'unitxt/catalog/cards/sst2.json' 2026-01-13T10:37:31,661 adding 'unitxt/catalog/cards/stsb.json' 2026-01-13T10:37:31,662 adding 'unitxt/catalog/cards/summarize_from_human_feedback.json' 2026-01-13T10:37:31,664 adding 'unitxt/catalog/cards/tab_fact.json' 2026-01-13T10:37:31,665 adding 'unitxt/catalog/cards/tablebench.json' 2026-01-13T10:37:31,666 adding 'unitxt/catalog/cards/tablebench_data_analysis.json' 2026-01-13T10:37:31,668 adding 'unitxt/catalog/cards/tablebench_fact_checking.json' 2026-01-13T10:37:31,669 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning.json' 2026-01-13T10:37:31,670 adding 'unitxt/catalog/cards/tablerow_classify.json' 2026-01-13T10:37:31,671 adding 'unitxt/catalog/cards/tldr.json' 2026-01-13T10:37:31,673 adding 'unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json' 2026-01-13T10:37:31,674 adding 'unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json' 2026-01-13T10:37:31,675 adding 'unitxt/catalog/cards/toxigen.json' 2026-01-13T10:37:31,677 adding 'unitxt/catalog/cards/trec.json' 2026-01-13T10:37:31,679 adding 'unitxt/catalog/cards/turl_col_type.json' 2026-01-13T10:37:31,680 adding 'unitxt/catalog/cards/unfair_tos.json' 2026-01-13T10:37:31,681 adding 'unitxt/catalog/cards/websrc.json' 2026-01-13T10:37:31,683 adding 'unitxt/catalog/cards/wiki_bio.json' 2026-01-13T10:37:31,684 adding 'unitxt/catalog/cards/wikitq.json' 2026-01-13T10:37:31,685 adding 'unitxt/catalog/cards/wnli.json' 2026-01-13T10:37:31,687 adding 'unitxt/catalog/cards/wsc.json' 2026-01-13T10:37:31,688 adding 'unitxt/catalog/cards/xlam_function_calling_60k.json' 2026-01-13T10:37:31,689 adding 'unitxt/catalog/cards/xsum.json' 2026-01-13T10:37:31,691 adding 'unitxt/catalog/cards/yahoo_answers_topics.json' 2026-01-13T10:37:31,693 adding 'unitxt/catalog/cards/20_newsgroups/sklearn.json' 2026-01-13T10:37:31,695 adding 'unitxt/catalog/cards/CFPB/product/2023.json' 2026-01-13T10:37:31,696 adding 'unitxt/catalog/cards/CFPB/product/watsonx.json' 2026-01-13T10:37:31,698 adding 'unitxt/catalog/cards/ai2_arc/arc_challenge.json' 2026-01-13T10:37:31,699 adding 'unitxt/catalog/cards/ai2_arc/arc_easy.json' 2026-01-13T10:37:31,701 adding 'unitxt/catalog/cards/almost_evil/de.json' 2026-01-13T10:37:31,702 adding 'unitxt/catalog/cards/almost_evil/en.json' 2026-01-13T10:37:31,704 adding 'unitxt/catalog/cards/almost_evil/es.json' 2026-01-13T10:37:31,705 adding 'unitxt/catalog/cards/almost_evil/fr.json' 2026-01-13T10:37:31,706 adding 'unitxt/catalog/cards/almost_evil/it.json' 2026-01-13T10:37:31,708 adding 'unitxt/catalog/cards/almost_evil/nl.json' 2026-01-13T10:37:31,709 adding 'unitxt/catalog/cards/almost_evil/pt.json' 2026-01-13T10:37:31,710 adding 'unitxt/catalog/cards/almost_evil/ru.json' 2026-01-13T10:37:31,713 adding 'unitxt/catalog/cards/amazon_mass/af_ZA.json' 2026-01-13T10:37:31,715 adding 'unitxt/catalog/cards/amazon_mass/all.json' 2026-01-13T10:37:31,716 adding 'unitxt/catalog/cards/amazon_mass/am_ET.json' 2026-01-13T10:37:31,718 adding 'unitxt/catalog/cards/amazon_mass/ar_SA.json' 2026-01-13T10:37:31,720 adding 'unitxt/catalog/cards/amazon_mass/az_AZ.json' 2026-01-13T10:37:31,721 adding 'unitxt/catalog/cards/amazon_mass/bn_BD.json' 2026-01-13T10:37:31,723 adding 'unitxt/catalog/cards/amazon_mass/ca_ES.json' 2026-01-13T10:37:31,724 adding 'unitxt/catalog/cards/amazon_mass/cy_GB.json' 2026-01-13T10:37:31,726 adding 'unitxt/catalog/cards/amazon_mass/da_DK.json' 2026-01-13T10:37:31,727 adding 'unitxt/catalog/cards/amazon_mass/de_DE.json' 2026-01-13T10:37:31,729 adding 'unitxt/catalog/cards/amazon_mass/el_GR.json' 2026-01-13T10:37:31,730 adding 'unitxt/catalog/cards/amazon_mass/en_US.json' 2026-01-13T10:37:31,732 adding 'unitxt/catalog/cards/amazon_mass/es_ES.json' 2026-01-13T10:37:31,733 adding 'unitxt/catalog/cards/amazon_mass/fa_IR.json' 2026-01-13T10:37:31,735 adding 'unitxt/catalog/cards/amazon_mass/fi_FI.json' 2026-01-13T10:37:31,736 adding 'unitxt/catalog/cards/amazon_mass/fr_FR.json' 2026-01-13T10:37:31,738 adding 'unitxt/catalog/cards/amazon_mass/he_IL.json' 2026-01-13T10:37:31,739 adding 'unitxt/catalog/cards/amazon_mass/hi_IN.json' 2026-01-13T10:37:31,741 adding 'unitxt/catalog/cards/amazon_mass/hu_HU.json' 2026-01-13T10:37:31,742 adding 'unitxt/catalog/cards/amazon_mass/hy_AM.json' 2026-01-13T10:37:31,744 adding 'unitxt/catalog/cards/amazon_mass/id_ID.json' 2026-01-13T10:37:31,745 adding 'unitxt/catalog/cards/amazon_mass/is_IS.json' 2026-01-13T10:37:31,747 adding 'unitxt/catalog/cards/amazon_mass/it_IT.json' 2026-01-13T10:37:31,749 adding 'unitxt/catalog/cards/amazon_mass/ja_JP.json' 2026-01-13T10:37:31,750 adding 'unitxt/catalog/cards/amazon_mass/jv_ID.json' 2026-01-13T10:37:31,752 adding 'unitxt/catalog/cards/amazon_mass/ka_GE.json' 2026-01-13T10:37:31,754 adding 'unitxt/catalog/cards/amazon_mass/km_KH.json' 2026-01-13T10:37:31,755 adding 'unitxt/catalog/cards/amazon_mass/kn_IN.json' 2026-01-13T10:37:31,757 adding 'unitxt/catalog/cards/amazon_mass/ko_KR.json' 2026-01-13T10:37:31,758 adding 'unitxt/catalog/cards/amazon_mass/lv_LV.json' 2026-01-13T10:37:31,760 adding 'unitxt/catalog/cards/amazon_mass/ml_IN.json' 2026-01-13T10:37:31,762 adding 'unitxt/catalog/cards/amazon_mass/mn_MN.json' 2026-01-13T10:37:31,763 adding 'unitxt/catalog/cards/amazon_mass/ms_MY.json' 2026-01-13T10:37:31,765 adding 'unitxt/catalog/cards/amazon_mass/my_MM.json' 2026-01-13T10:37:31,766 adding 'unitxt/catalog/cards/amazon_mass/nb_NO.json' 2026-01-13T10:37:31,768 adding 'unitxt/catalog/cards/amazon_mass/nl_NL.json' 2026-01-13T10:37:31,770 adding 'unitxt/catalog/cards/amazon_mass/pl_PL.json' 2026-01-13T10:37:31,771 adding 'unitxt/catalog/cards/amazon_mass/pt_PT.json' 2026-01-13T10:37:31,773 adding 'unitxt/catalog/cards/amazon_mass/ro_RO.json' 2026-01-13T10:37:31,774 adding 'unitxt/catalog/cards/amazon_mass/ru_RU.json' 2026-01-13T10:37:31,776 adding 'unitxt/catalog/cards/amazon_mass/sl_SL.json' 2026-01-13T10:37:31,778 adding 'unitxt/catalog/cards/amazon_mass/sq_AL.json' 2026-01-13T10:37:31,779 adding 'unitxt/catalog/cards/amazon_mass/sv_SE.json' 2026-01-13T10:37:31,781 adding 'unitxt/catalog/cards/amazon_mass/sw_KE.json' 2026-01-13T10:37:31,782 adding 'unitxt/catalog/cards/amazon_mass/ta_IN.json' 2026-01-13T10:37:31,784 adding 'unitxt/catalog/cards/amazon_mass/te_IN.json' 2026-01-13T10:37:31,786 adding 'unitxt/catalog/cards/amazon_mass/th_TH.json' 2026-01-13T10:37:31,787 adding 'unitxt/catalog/cards/amazon_mass/tl_PH.json' 2026-01-13T10:37:31,789 adding 'unitxt/catalog/cards/amazon_mass/tr_TR.json' 2026-01-13T10:37:31,791 adding 'unitxt/catalog/cards/amazon_mass/ur_PK.json' 2026-01-13T10:37:31,792 adding 'unitxt/catalog/cards/amazon_mass/vi_VN.json' 2026-01-13T10:37:31,794 adding 'unitxt/catalog/cards/amazon_mass/zh_CN.json' 2026-01-13T10:37:31,795 adding 'unitxt/catalog/cards/amazon_mass/zh_TW.json' 2026-01-13T10:37:31,798 adding 'unitxt/catalog/cards/amazon_mass/all_1/1.json' 2026-01-13T10:37:31,800 adding 'unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json' 2026-01-13T10:37:31,802 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json' 2026-01-13T10:37:31,803 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json' 2026-01-13T10:37:31,805 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json' 2026-01-13T10:37:31,806 adding 'unitxt/catalog/cards/babi/qa.json' 2026-01-13T10:37:31,810 adding 'unitxt/catalog/cards/belebele/acm_arab.json' 2026-01-13T10:37:31,811 adding 'unitxt/catalog/cards/belebele/afr_latn.json' 2026-01-13T10:37:31,812 adding 'unitxt/catalog/cards/belebele/als_latn.json' 2026-01-13T10:37:31,814 adding 'unitxt/catalog/cards/belebele/amh_ethi.json' 2026-01-13T10:37:31,815 adding 'unitxt/catalog/cards/belebele/apc_arab.json' 2026-01-13T10:37:31,816 adding 'unitxt/catalog/cards/belebele/arb_arab.json' 2026-01-13T10:37:31,817 adding 'unitxt/catalog/cards/belebele/arb_latn.json' 2026-01-13T10:37:31,819 adding 'unitxt/catalog/cards/belebele/ars_arab.json' 2026-01-13T10:37:31,820 adding 'unitxt/catalog/cards/belebele/ary_arab.json' 2026-01-13T10:37:31,821 adding 'unitxt/catalog/cards/belebele/arz_arab.json' 2026-01-13T10:37:31,823 adding 'unitxt/catalog/cards/belebele/asm_beng.json' 2026-01-13T10:37:31,824 adding 'unitxt/catalog/cards/belebele/azj_latn.json' 2026-01-13T10:37:31,825 adding 'unitxt/catalog/cards/belebele/bam_latn.json' 2026-01-13T10:37:31,827 adding 'unitxt/catalog/cards/belebele/ben_beng.json' 2026-01-13T10:37:31,828 adding 'unitxt/catalog/cards/belebele/ben_latn.json' 2026-01-13T10:37:31,829 adding 'unitxt/catalog/cards/belebele/bod_tibt.json' 2026-01-13T10:37:31,830 adding 'unitxt/catalog/cards/belebele/bul_cyrl.json' 2026-01-13T10:37:31,832 adding 'unitxt/catalog/cards/belebele/cat_latn.json' 2026-01-13T10:37:31,833 adding 'unitxt/catalog/cards/belebele/ceb_latn.json' 2026-01-13T10:37:31,835 adding 'unitxt/catalog/cards/belebele/ces_latn.json' 2026-01-13T10:37:31,836 adding 'unitxt/catalog/cards/belebele/ckb_arab.json' 2026-01-13T10:37:31,837 adding 'unitxt/catalog/cards/belebele/dan_latn.json' 2026-01-13T10:37:31,839 adding 'unitxt/catalog/cards/belebele/deu_latn.json' 2026-01-13T10:37:31,840 adding 'unitxt/catalog/cards/belebele/ell_grek.json' 2026-01-13T10:37:31,841 adding 'unitxt/catalog/cards/belebele/eng_latn.json' 2026-01-13T10:37:31,843 adding 'unitxt/catalog/cards/belebele/est_latn.json' 2026-01-13T10:37:31,844 adding 'unitxt/catalog/cards/belebele/eus_latn.json' 2026-01-13T10:37:31,845 adding 'unitxt/catalog/cards/belebele/fin_latn.json' 2026-01-13T10:37:31,847 adding 'unitxt/catalog/cards/belebele/fra_latn.json' 2026-01-13T10:37:31,848 adding 'unitxt/catalog/cards/belebele/fuv_latn.json' 2026-01-13T10:37:31,850 adding 'unitxt/catalog/cards/belebele/gaz_latn.json' 2026-01-13T10:37:31,851 adding 'unitxt/catalog/cards/belebele/grn_latn.json' 2026-01-13T10:37:31,852 adding 'unitxt/catalog/cards/belebele/guj_gujr.json' 2026-01-13T10:37:31,854 adding 'unitxt/catalog/cards/belebele/hat_latn.json' 2026-01-13T10:37:31,856 adding 'unitxt/catalog/cards/belebele/hau_latn.json' 2026-01-13T10:37:31,857 adding 'unitxt/catalog/cards/belebele/heb_hebr.json' 2026-01-13T10:37:31,858 adding 'unitxt/catalog/cards/belebele/hin_deva.json' 2026-01-13T10:37:31,860 adding 'unitxt/catalog/cards/belebele/hin_latn.json' 2026-01-13T10:37:31,861 adding 'unitxt/catalog/cards/belebele/hrv_latn.json' 2026-01-13T10:37:31,862 adding 'unitxt/catalog/cards/belebele/hun_latn.json' 2026-01-13T10:37:31,864 adding 'unitxt/catalog/cards/belebele/hye_armn.json' 2026-01-13T10:37:31,865 adding 'unitxt/catalog/cards/belebele/ibo_latn.json' 2026-01-13T10:37:31,866 adding 'unitxt/catalog/cards/belebele/ilo_latn.json' 2026-01-13T10:37:31,868 adding 'unitxt/catalog/cards/belebele/ind_latn.json' 2026-01-13T10:37:31,869 adding 'unitxt/catalog/cards/belebele/isl_latn.json' 2026-01-13T10:37:31,871 adding 'unitxt/catalog/cards/belebele/ita_latn.json' 2026-01-13T10:37:31,872 adding 'unitxt/catalog/cards/belebele/jav_latn.json' 2026-01-13T10:37:31,873 adding 'unitxt/catalog/cards/belebele/jpn_jpan.json' 2026-01-13T10:37:31,875 adding 'unitxt/catalog/cards/belebele/kac_latn.json' 2026-01-13T10:37:31,876 adding 'unitxt/catalog/cards/belebele/kan_knda.json' 2026-01-13T10:37:31,877 adding 'unitxt/catalog/cards/belebele/kat_geor.json' 2026-01-13T10:37:31,879 adding 'unitxt/catalog/cards/belebele/kaz_cyrl.json' 2026-01-13T10:37:31,880 adding 'unitxt/catalog/cards/belebele/kea_latn.json' 2026-01-13T10:37:31,881 adding 'unitxt/catalog/cards/belebele/khk_cyrl.json' 2026-01-13T10:37:31,883 adding 'unitxt/catalog/cards/belebele/khm_khmr.json' 2026-01-13T10:37:31,884 adding 'unitxt/catalog/cards/belebele/kin_latn.json' 2026-01-13T10:37:31,885 adding 'unitxt/catalog/cards/belebele/kir_cyrl.json' 2026-01-13T10:37:31,886 adding 'unitxt/catalog/cards/belebele/kor_hang.json' 2026-01-13T10:37:31,888 adding 'unitxt/catalog/cards/belebele/lao_laoo.json' 2026-01-13T10:37:31,889 adding 'unitxt/catalog/cards/belebele/lin_latn.json' 2026-01-13T10:37:31,891 adding 'unitxt/catalog/cards/belebele/lit_latn.json' 2026-01-13T10:37:31,892 adding 'unitxt/catalog/cards/belebele/lug_latn.json' 2026-01-13T10:37:31,893 adding 'unitxt/catalog/cards/belebele/luo_latn.json' 2026-01-13T10:37:31,895 adding 'unitxt/catalog/cards/belebele/lvs_latn.json' 2026-01-13T10:37:31,896 adding 'unitxt/catalog/cards/belebele/mal_mlym.json' 2026-01-13T10:37:31,897 adding 'unitxt/catalog/cards/belebele/mar_deva.json' 2026-01-13T10:37:31,899 adding 'unitxt/catalog/cards/belebele/mkd_cyrl.json' 2026-01-13T10:37:31,900 adding 'unitxt/catalog/cards/belebele/mlt_latn.json' 2026-01-13T10:37:31,902 adding 'unitxt/catalog/cards/belebele/mri_latn.json' 2026-01-13T10:37:31,903 adding 'unitxt/catalog/cards/belebele/mya_mymr.json' 2026-01-13T10:37:31,904 adding 'unitxt/catalog/cards/belebele/nld_latn.json' 2026-01-13T10:37:31,906 adding 'unitxt/catalog/cards/belebele/nob_latn.json' 2026-01-13T10:37:31,907 adding 'unitxt/catalog/cards/belebele/npi_deva.json' 2026-01-13T10:37:31,908 adding 'unitxt/catalog/cards/belebele/npi_latn.json' 2026-01-13T10:37:31,910 adding 'unitxt/catalog/cards/belebele/nso_latn.json' 2026-01-13T10:37:31,911 adding 'unitxt/catalog/cards/belebele/nya_latn.json' 2026-01-13T10:37:31,912 adding 'unitxt/catalog/cards/belebele/ory_orya.json' 2026-01-13T10:37:31,914 adding 'unitxt/catalog/cards/belebele/pan_guru.json' 2026-01-13T10:37:31,915 adding 'unitxt/catalog/cards/belebele/pbt_arab.json' 2026-01-13T10:37:31,916 adding 'unitxt/catalog/cards/belebele/pes_arab.json' 2026-01-13T10:37:31,918 adding 'unitxt/catalog/cards/belebele/plt_latn.json' 2026-01-13T10:37:31,919 adding 'unitxt/catalog/cards/belebele/pol_latn.json' 2026-01-13T10:37:31,920 adding 'unitxt/catalog/cards/belebele/por_latn.json' 2026-01-13T10:37:31,922 adding 'unitxt/catalog/cards/belebele/ron_latn.json' 2026-01-13T10:37:31,923 adding 'unitxt/catalog/cards/belebele/rus_cyrl.json' 2026-01-13T10:37:31,924 adding 'unitxt/catalog/cards/belebele/shn_mymr.json' 2026-01-13T10:37:31,926 adding 'unitxt/catalog/cards/belebele/sin_latn.json' 2026-01-13T10:37:31,927 adding 'unitxt/catalog/cards/belebele/sin_sinh.json' 2026-01-13T10:37:31,929 adding 'unitxt/catalog/cards/belebele/slk_latn.json' 2026-01-13T10:37:31,930 adding 'unitxt/catalog/cards/belebele/slv_latn.json' 2026-01-13T10:37:31,931 adding 'unitxt/catalog/cards/belebele/sna_latn.json' 2026-01-13T10:37:31,933 adding 'unitxt/catalog/cards/belebele/snd_arab.json' 2026-01-13T10:37:31,934 adding 'unitxt/catalog/cards/belebele/som_latn.json' 2026-01-13T10:37:31,935 adding 'unitxt/catalog/cards/belebele/sot_latn.json' 2026-01-13T10:37:31,937 adding 'unitxt/catalog/cards/belebele/spa_latn.json' 2026-01-13T10:37:31,938 adding 'unitxt/catalog/cards/belebele/srp_cyrl.json' 2026-01-13T10:37:31,940 adding 'unitxt/catalog/cards/belebele/ssw_latn.json' 2026-01-13T10:37:31,941 adding 'unitxt/catalog/cards/belebele/sun_latn.json' 2026-01-13T10:37:31,942 adding 'unitxt/catalog/cards/belebele/swe_latn.json' 2026-01-13T10:37:31,944 adding 'unitxt/catalog/cards/belebele/swh_latn.json' 2026-01-13T10:37:31,945 adding 'unitxt/catalog/cards/belebele/tam_taml.json' 2026-01-13T10:37:31,946 adding 'unitxt/catalog/cards/belebele/tel_telu.json' 2026-01-13T10:37:31,948 adding 'unitxt/catalog/cards/belebele/tgk_cyrl.json' 2026-01-13T10:37:31,949 adding 'unitxt/catalog/cards/belebele/tgl_latn.json' 2026-01-13T10:37:31,950 adding 'unitxt/catalog/cards/belebele/tha_thai.json' 2026-01-13T10:37:31,952 adding 'unitxt/catalog/cards/belebele/tir_ethi.json' 2026-01-13T10:37:31,953 adding 'unitxt/catalog/cards/belebele/tsn_latn.json' 2026-01-13T10:37:31,954 adding 'unitxt/catalog/cards/belebele/tso_latn.json' 2026-01-13T10:37:31,956 adding 'unitxt/catalog/cards/belebele/tur_latn.json' 2026-01-13T10:37:31,957 adding 'unitxt/catalog/cards/belebele/ukr_cyrl.json' 2026-01-13T10:37:31,958 adding 'unitxt/catalog/cards/belebele/urd_arab.json' 2026-01-13T10:37:31,960 adding 'unitxt/catalog/cards/belebele/urd_latn.json' 2026-01-13T10:37:31,961 adding 'unitxt/catalog/cards/belebele/uzn_latn.json' 2026-01-13T10:37:31,962 adding 'unitxt/catalog/cards/belebele/vie_latn.json' 2026-01-13T10:37:31,964 adding 'unitxt/catalog/cards/belebele/war_latn.json' 2026-01-13T10:37:31,965 adding 'unitxt/catalog/cards/belebele/wol_latn.json' 2026-01-13T10:37:31,966 adding 'unitxt/catalog/cards/belebele/xho_latn.json' 2026-01-13T10:37:31,968 adding 'unitxt/catalog/cards/belebele/yor_latn.json' 2026-01-13T10:37:31,969 adding 'unitxt/catalog/cards/belebele/zho_hans.json' 2026-01-13T10:37:31,970 adding 'unitxt/catalog/cards/belebele/zho_hant.json' 2026-01-13T10:37:31,972 adding 'unitxt/catalog/cards/belebele/zsm_latn.json' 2026-01-13T10:37:31,973 adding 'unitxt/catalog/cards/belebele/zul_latn.json' 2026-01-13T10:37:31,975 adding 'unitxt/catalog/cards/bfcl/simple_v3.json' 2026-01-13T10:37:31,977 adding 'unitxt/catalog/cards/bfcl/multi_turn/java_v3.json' 2026-01-13T10:37:31,978 adding 'unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json' 2026-01-13T10:37:31,980 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json' 2026-01-13T10:37:31,981 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json' 2026-01-13T10:37:31,982 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json' 2026-01-13T10:37:31,984 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json' 2026-01-13T10:37:31,985 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json' 2026-01-13T10:37:31,986 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json' 2026-01-13T10:37:31,988 adding 'unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json' 2026-01-13T10:37:31,989 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json' 2026-01-13T10:37:31,991 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json' 2026-01-13T10:37:31,992 adding 'unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json' 2026-01-13T10:37:31,994 adding 'unitxt/catalog/cards/biggen_bench/results/human_eval.json' 2026-01-13T10:37:31,996 adding 'unitxt/catalog/cards/boolq/classification.json' 2026-01-13T10:37:31,998 adding 'unitxt/catalog/cards/boolq/multiple_choice.json' 2026-01-13T10:37:32,000 adding 'unitxt/catalog/cards/boolq_indic/bn/classification.json' 2026-01-13T10:37:32,001 adding 'unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json' 2026-01-13T10:37:32,003 adding 'unitxt/catalog/cards/boolq_indic/gu/classification.json' 2026-01-13T10:37:32,004 adding 'unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json' 2026-01-13T10:37:32,006 adding 'unitxt/catalog/cards/boolq_indic/hi/classification.json' 2026-01-13T10:37:32,008 adding 'unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json' 2026-01-13T10:37:32,009 adding 'unitxt/catalog/cards/boolq_indic/kn/classification.json' 2026-01-13T10:37:32,011 adding 'unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json' 2026-01-13T10:37:32,013 adding 'unitxt/catalog/cards/boolq_indic/ml/classification.json' 2026-01-13T10:37:32,014 adding 'unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json' 2026-01-13T10:37:32,016 adding 'unitxt/catalog/cards/boolq_indic/mr/classification.json' 2026-01-13T10:37:32,017 adding 'unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json' 2026-01-13T10:37:32,019 adding 'unitxt/catalog/cards/boolq_indic/or/classification.json' 2026-01-13T10:37:32,020 adding 'unitxt/catalog/cards/boolq_indic/or/multiple_choice.json' 2026-01-13T10:37:32,022 adding 'unitxt/catalog/cards/boolq_indic/pa/classification.json' 2026-01-13T10:37:32,024 adding 'unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json' 2026-01-13T10:37:32,025 adding 'unitxt/catalog/cards/boolq_indic/ta/classification.json' 2026-01-13T10:37:32,027 adding 'unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json' 2026-01-13T10:37:32,029 adding 'unitxt/catalog/cards/boolq_indic/te/classification.json' 2026-01-13T10:37:32,030 adding 'unitxt/catalog/cards/boolq_indic/te/multiple_choice.json' 2026-01-13T10:37:32,032 adding 'unitxt/catalog/cards/clinc_oos/imbalanced.json' 2026-01-13T10:37:32,034 adding 'unitxt/catalog/cards/clinc_oos/plus.json' 2026-01-13T10:37:32,036 adding 'unitxt/catalog/cards/clinc_oos/small.json' 2026-01-13T10:37:32,038 adding 'unitxt/catalog/cards/coedit/paraphrase.json' 2026-01-13T10:37:32,039 adding 'unitxt/catalog/cards/coedit/preference.json' 2026-01-13T10:37:32,041 adding 'unitxt/catalog/cards/coedit/rewriting.json' 2026-01-13T10:37:32,042 adding 'unitxt/catalog/cards/coedit/selection.json' 2026-01-13T10:37:32,045 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json' 2026-01-13T10:37:32,046 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json' 2026-01-13T10:37:32,048 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json' 2026-01-13T10:37:32,049 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json' 2026-01-13T10:37:32,051 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json' 2026-01-13T10:37:32,052 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json' 2026-01-13T10:37:32,053 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json' 2026-01-13T10:37:32,055 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json' 2026-01-13T10:37:32,057 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json' 2026-01-13T10:37:32,059 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json' 2026-01-13T10:37:32,060 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json' 2026-01-13T10:37:32,062 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json' 2026-01-13T10:37:32,063 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json' 2026-01-13T10:37:32,064 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json' 2026-01-13T10:37:32,066 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json' 2026-01-13T10:37:32,068 adding 'unitxt/catalog/cards/coqa/completion.json' 2026-01-13T10:37:32,069 adding 'unitxt/catalog/cards/coqa/multi_turn.json' 2026-01-13T10:37:32,071 adding 'unitxt/catalog/cards/coqa/qa.json' 2026-01-13T10:37:32,073 adding 'unitxt/catalog/cards/doc_vqa/en.json' 2026-01-13T10:37:32,074 adding 'unitxt/catalog/cards/doc_vqa/fr.json' 2026-01-13T10:37:32,075 adding 'unitxt/catalog/cards/doc_vqa/lmms_eval.json' 2026-01-13T10:37:32,077 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json' 2026-01-13T10:37:32,079 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json' 2026-01-13T10:37:32,080 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json' 2026-01-13T10:37:32,082 adding 'unitxt/catalog/cards/ffqa_filtered/16k.json' 2026-01-13T10:37:32,083 adding 'unitxt/catalog/cards/ffqa_filtered/2k.json' 2026-01-13T10:37:32,085 adding 'unitxt/catalog/cards/ffqa_filtered/4k.json' 2026-01-13T10:37:32,086 adding 'unitxt/catalog/cards/ffqa_filtered/8k.json' 2026-01-13T10:37:32,090 adding 'unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json' 2026-01-13T10:37:32,091 adding 'unitxt/catalog/cards/global_mmlu/am/anatomy.json' 2026-01-13T10:37:32,092 adding 'unitxt/catalog/cards/global_mmlu/am/astronomy.json' 2026-01-13T10:37:32,094 adding 'unitxt/catalog/cards/global_mmlu/am/business_ethics.json' 2026-01-13T10:37:32,095 adding 'unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json' 2026-01-13T10:37:32,096 adding 'unitxt/catalog/cards/global_mmlu/am/college_biology.json' 2026-01-13T10:37:32,098 adding 'unitxt/catalog/cards/global_mmlu/am/college_chemistry.json' 2026-01-13T10:37:32,099 adding 'unitxt/catalog/cards/global_mmlu/am/college_computer_science.json' 2026-01-13T10:37:32,100 adding 'unitxt/catalog/cards/global_mmlu/am/college_mathematics.json' 2026-01-13T10:37:32,102 adding 'unitxt/catalog/cards/global_mmlu/am/college_medicine.json' 2026-01-13T10:37:32,103 adding 'unitxt/catalog/cards/global_mmlu/am/college_physics.json' 2026-01-13T10:37:32,104 adding 'unitxt/catalog/cards/global_mmlu/am/computer_security.json' 2026-01-13T10:37:32,106 adding 'unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json' 2026-01-13T10:37:32,107 adding 'unitxt/catalog/cards/global_mmlu/am/econometrics.json' 2026-01-13T10:37:32,108 adding 'unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json' 2026-01-13T10:37:32,110 adding 'unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json' 2026-01-13T10:37:32,112 adding 'unitxt/catalog/cards/global_mmlu/am/formal_logic.json' 2026-01-13T10:37:32,113 adding 'unitxt/catalog/cards/global_mmlu/am/global_facts.json' 2026-01-13T10:37:32,115 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_biology.json' 2026-01-13T10:37:32,116 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json' 2026-01-13T10:37:32,118 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json' 2026-01-13T10:37:32,119 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json' 2026-01-13T10:37:32,121 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_geography.json' 2026-01-13T10:37:32,123 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json' 2026-01-13T10:37:32,124 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json' 2026-01-13T10:37:32,125 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json' 2026-01-13T10:37:32,127 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json' 2026-01-13T10:37:32,128 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_physics.json' 2026-01-13T10:37:32,130 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json' 2026-01-13T10:37:32,131 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json' 2026-01-13T10:37:32,133 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json' 2026-01-13T10:37:32,134 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json' 2026-01-13T10:37:32,136 adding 'unitxt/catalog/cards/global_mmlu/am/human_aging.json' 2026-01-13T10:37:32,137 adding 'unitxt/catalog/cards/global_mmlu/am/human_sexuality.json' 2026-01-13T10:37:32,138 adding 'unitxt/catalog/cards/global_mmlu/am/international_law.json' 2026-01-13T10:37:32,140 adding 'unitxt/catalog/cards/global_mmlu/am/jurisprudence.json' 2026-01-13T10:37:32,141 adding 'unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json' 2026-01-13T10:37:32,142 adding 'unitxt/catalog/cards/global_mmlu/am/machine_learning.json' 2026-01-13T10:37:32,144 adding 'unitxt/catalog/cards/global_mmlu/am/management.json' 2026-01-13T10:37:32,145 adding 'unitxt/catalog/cards/global_mmlu/am/marketing.json' 2026-01-13T10:37:32,146 adding 'unitxt/catalog/cards/global_mmlu/am/medical_genetics.json' 2026-01-13T10:37:32,148 adding 'unitxt/catalog/cards/global_mmlu/am/miscellaneous.json' 2026-01-13T10:37:32,149 adding 'unitxt/catalog/cards/global_mmlu/am/moral_disputes.json' 2026-01-13T10:37:32,150 adding 'unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json' 2026-01-13T10:37:32,152 adding 'unitxt/catalog/cards/global_mmlu/am/nutrition.json' 2026-01-13T10:37:32,153 adding 'unitxt/catalog/cards/global_mmlu/am/philosophy.json' 2026-01-13T10:37:32,154 adding 'unitxt/catalog/cards/global_mmlu/am/prehistory.json' 2026-01-13T10:37:32,156 adding 'unitxt/catalog/cards/global_mmlu/am/professional_accounting.json' 2026-01-13T10:37:32,157 adding 'unitxt/catalog/cards/global_mmlu/am/professional_law.json' 2026-01-13T10:37:32,158 adding 'unitxt/catalog/cards/global_mmlu/am/professional_medicine.json' 2026-01-13T10:37:32,159 adding 'unitxt/catalog/cards/global_mmlu/am/professional_psychology.json' 2026-01-13T10:37:32,161 adding 'unitxt/catalog/cards/global_mmlu/am/public_relations.json' 2026-01-13T10:37:32,162 adding 'unitxt/catalog/cards/global_mmlu/am/security_studies.json' 2026-01-13T10:37:32,163 adding 'unitxt/catalog/cards/global_mmlu/am/sociology.json' 2026-01-13T10:37:32,165 adding 'unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json' 2026-01-13T10:37:32,166 adding 'unitxt/catalog/cards/global_mmlu/am/virology.json' 2026-01-13T10:37:32,167 adding 'unitxt/catalog/cards/global_mmlu/am/world_religions.json' 2026-01-13T10:37:32,170 adding 'unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json' 2026-01-13T10:37:32,171 adding 'unitxt/catalog/cards/global_mmlu/ar/anatomy.json' 2026-01-13T10:37:32,172 adding 'unitxt/catalog/cards/global_mmlu/ar/astronomy.json' 2026-01-13T10:37:32,174 adding 'unitxt/catalog/cards/global_mmlu/ar/business_ethics.json' 2026-01-13T10:37:32,175 adding 'unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json' 2026-01-13T10:37:32,176 adding 'unitxt/catalog/cards/global_mmlu/ar/college_biology.json' 2026-01-13T10:37:32,178 adding 'unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json' 2026-01-13T10:37:32,179 adding 'unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json' 2026-01-13T10:37:32,180 adding 'unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json' 2026-01-13T10:37:32,182 adding 'unitxt/catalog/cards/global_mmlu/ar/college_medicine.json' 2026-01-13T10:37:32,183 adding 'unitxt/catalog/cards/global_mmlu/ar/college_physics.json' 2026-01-13T10:37:32,184 adding 'unitxt/catalog/cards/global_mmlu/ar/computer_security.json' 2026-01-13T10:37:32,186 adding 'unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json' 2026-01-13T10:37:32,187 adding 'unitxt/catalog/cards/global_mmlu/ar/econometrics.json' 2026-01-13T10:37:32,188 adding 'unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json' 2026-01-13T10:37:32,190 adding 'unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json' 2026-01-13T10:37:32,191 adding 'unitxt/catalog/cards/global_mmlu/ar/formal_logic.json' 2026-01-13T10:37:32,192 adding 'unitxt/catalog/cards/global_mmlu/ar/global_facts.json' 2026-01-13T10:37:32,194 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json' 2026-01-13T10:37:32,195 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json' 2026-01-13T10:37:32,196 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json' 2026-01-13T10:37:32,198 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json' 2026-01-13T10:37:32,199 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json' 2026-01-13T10:37:32,200 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json' 2026-01-13T10:37:32,202 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json' 2026-01-13T10:37:32,203 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json' 2026-01-13T10:37:32,204 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json' 2026-01-13T10:37:32,206 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json' 2026-01-13T10:37:32,207 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json' 2026-01-13T10:37:32,209 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json' 2026-01-13T10:37:32,210 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json' 2026-01-13T10:37:32,211 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json' 2026-01-13T10:37:32,212 adding 'unitxt/catalog/cards/global_mmlu/ar/human_aging.json' 2026-01-13T10:37:32,214 adding 'unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json' 2026-01-13T10:37:32,215 adding 'unitxt/catalog/cards/global_mmlu/ar/international_law.json' 2026-01-13T10:37:32,216 adding 'unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json' 2026-01-13T10:37:32,218 adding 'unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json' 2026-01-13T10:37:32,219 adding 'unitxt/catalog/cards/global_mmlu/ar/machine_learning.json' 2026-01-13T10:37:32,220 adding 'unitxt/catalog/cards/global_mmlu/ar/management.json' 2026-01-13T10:37:32,222 adding 'unitxt/catalog/cards/global_mmlu/ar/marketing.json' 2026-01-13T10:37:32,223 adding 'unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json' 2026-01-13T10:37:32,224 adding 'unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json' 2026-01-13T10:37:32,226 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json' 2026-01-13T10:37:32,227 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json' 2026-01-13T10:37:32,228 adding 'unitxt/catalog/cards/global_mmlu/ar/nutrition.json' 2026-01-13T10:37:32,230 adding 'unitxt/catalog/cards/global_mmlu/ar/philosophy.json' 2026-01-13T10:37:32,231 adding 'unitxt/catalog/cards/global_mmlu/ar/prehistory.json' 2026-01-13T10:37:32,232 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json' 2026-01-13T10:37:32,234 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_law.json' 2026-01-13T10:37:32,235 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json' 2026-01-13T10:37:32,236 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json' 2026-01-13T10:37:32,238 adding 'unitxt/catalog/cards/global_mmlu/ar/public_relations.json' 2026-01-13T10:37:32,239 adding 'unitxt/catalog/cards/global_mmlu/ar/security_studies.json' 2026-01-13T10:37:32,240 adding 'unitxt/catalog/cards/global_mmlu/ar/sociology.json' 2026-01-13T10:37:32,242 adding 'unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json' 2026-01-13T10:37:32,243 adding 'unitxt/catalog/cards/global_mmlu/ar/virology.json' 2026-01-13T10:37:32,244 adding 'unitxt/catalog/cards/global_mmlu/ar/world_religions.json' 2026-01-13T10:37:32,247 adding 'unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json' 2026-01-13T10:37:32,248 adding 'unitxt/catalog/cards/global_mmlu/bn/anatomy.json' 2026-01-13T10:37:32,250 adding 'unitxt/catalog/cards/global_mmlu/bn/astronomy.json' 2026-01-13T10:37:32,251 adding 'unitxt/catalog/cards/global_mmlu/bn/business_ethics.json' 2026-01-13T10:37:32,253 adding 'unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json' 2026-01-13T10:37:32,254 adding 'unitxt/catalog/cards/global_mmlu/bn/college_biology.json' 2026-01-13T10:37:32,256 adding 'unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json' 2026-01-13T10:37:32,257 adding 'unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json' 2026-01-13T10:37:32,259 adding 'unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json' 2026-01-13T10:37:32,260 adding 'unitxt/catalog/cards/global_mmlu/bn/college_medicine.json' 2026-01-13T10:37:32,262 adding 'unitxt/catalog/cards/global_mmlu/bn/college_physics.json' 2026-01-13T10:37:32,263 adding 'unitxt/catalog/cards/global_mmlu/bn/computer_security.json' 2026-01-13T10:37:32,264 adding 'unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json' 2026-01-13T10:37:32,266 adding 'unitxt/catalog/cards/global_mmlu/bn/econometrics.json' 2026-01-13T10:37:32,267 adding 'unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json' 2026-01-13T10:37:32,269 adding 'unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json' 2026-01-13T10:37:32,270 adding 'unitxt/catalog/cards/global_mmlu/bn/formal_logic.json' 2026-01-13T10:37:32,271 adding 'unitxt/catalog/cards/global_mmlu/bn/global_facts.json' 2026-01-13T10:37:32,272 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json' 2026-01-13T10:37:32,274 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json' 2026-01-13T10:37:32,275 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json' 2026-01-13T10:37:32,276 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json' 2026-01-13T10:37:32,278 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json' 2026-01-13T10:37:32,279 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json' 2026-01-13T10:37:32,280 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json' 2026-01-13T10:37:32,282 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json' 2026-01-13T10:37:32,283 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json' 2026-01-13T10:37:32,284 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json' 2026-01-13T10:37:32,286 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json' 2026-01-13T10:37:32,287 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json' 2026-01-13T10:37:32,289 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json' 2026-01-13T10:37:32,290 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json' 2026-01-13T10:37:32,291 adding 'unitxt/catalog/cards/global_mmlu/bn/human_aging.json' 2026-01-13T10:37:32,292 adding 'unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json' 2026-01-13T10:37:32,294 adding 'unitxt/catalog/cards/global_mmlu/bn/international_law.json' 2026-01-13T10:37:32,295 adding 'unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json' 2026-01-13T10:37:32,296 adding 'unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json' 2026-01-13T10:37:32,298 adding 'unitxt/catalog/cards/global_mmlu/bn/machine_learning.json' 2026-01-13T10:37:32,299 adding 'unitxt/catalog/cards/global_mmlu/bn/management.json' 2026-01-13T10:37:32,300 adding 'unitxt/catalog/cards/global_mmlu/bn/marketing.json' 2026-01-13T10:37:32,302 adding 'unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json' 2026-01-13T10:37:32,303 adding 'unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json' 2026-01-13T10:37:32,305 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json' 2026-01-13T10:37:32,306 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json' 2026-01-13T10:37:32,307 adding 'unitxt/catalog/cards/global_mmlu/bn/nutrition.json' 2026-01-13T10:37:32,309 adding 'unitxt/catalog/cards/global_mmlu/bn/philosophy.json' 2026-01-13T10:37:32,310 adding 'unitxt/catalog/cards/global_mmlu/bn/prehistory.json' 2026-01-13T10:37:32,311 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json' 2026-01-13T10:37:32,313 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_law.json' 2026-01-13T10:37:32,314 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json' 2026-01-13T10:37:32,315 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json' 2026-01-13T10:37:32,317 adding 'unitxt/catalog/cards/global_mmlu/bn/public_relations.json' 2026-01-13T10:37:32,319 adding 'unitxt/catalog/cards/global_mmlu/bn/security_studies.json' 2026-01-13T10:37:32,320 adding 'unitxt/catalog/cards/global_mmlu/bn/sociology.json' 2026-01-13T10:37:32,322 adding 'unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json' 2026-01-13T10:37:32,323 adding 'unitxt/catalog/cards/global_mmlu/bn/virology.json' 2026-01-13T10:37:32,325 adding 'unitxt/catalog/cards/global_mmlu/bn/world_religions.json' 2026-01-13T10:37:32,327 adding 'unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json' 2026-01-13T10:37:32,329 adding 'unitxt/catalog/cards/global_mmlu/cs/anatomy.json' 2026-01-13T10:37:32,330 adding 'unitxt/catalog/cards/global_mmlu/cs/astronomy.json' 2026-01-13T10:37:32,332 adding 'unitxt/catalog/cards/global_mmlu/cs/business_ethics.json' 2026-01-13T10:37:32,333 adding 'unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json' 2026-01-13T10:37:32,334 adding 'unitxt/catalog/cards/global_mmlu/cs/college_biology.json' 2026-01-13T10:37:32,336 adding 'unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json' 2026-01-13T10:37:32,337 adding 'unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json' 2026-01-13T10:37:32,338 adding 'unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json' 2026-01-13T10:37:32,340 adding 'unitxt/catalog/cards/global_mmlu/cs/college_medicine.json' 2026-01-13T10:37:32,341 adding 'unitxt/catalog/cards/global_mmlu/cs/college_physics.json' 2026-01-13T10:37:32,342 adding 'unitxt/catalog/cards/global_mmlu/cs/computer_security.json' 2026-01-13T10:37:32,344 adding 'unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json' 2026-01-13T10:37:32,345 adding 'unitxt/catalog/cards/global_mmlu/cs/econometrics.json' 2026-01-13T10:37:32,346 adding 'unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json' 2026-01-13T10:37:32,348 adding 'unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json' 2026-01-13T10:37:32,349 adding 'unitxt/catalog/cards/global_mmlu/cs/formal_logic.json' 2026-01-13T10:37:32,350 adding 'unitxt/catalog/cards/global_mmlu/cs/global_facts.json' 2026-01-13T10:37:32,352 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json' 2026-01-13T10:37:32,353 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json' 2026-01-13T10:37:32,354 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json' 2026-01-13T10:37:32,356 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json' 2026-01-13T10:37:32,357 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json' 2026-01-13T10:37:32,358 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json' 2026-01-13T10:37:32,360 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json' 2026-01-13T10:37:32,361 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json' 2026-01-13T10:37:32,362 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json' 2026-01-13T10:37:32,364 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json' 2026-01-13T10:37:32,365 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json' 2026-01-13T10:37:32,366 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json' 2026-01-13T10:37:32,368 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json' 2026-01-13T10:37:32,369 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json' 2026-01-13T10:37:32,370 adding 'unitxt/catalog/cards/global_mmlu/cs/human_aging.json' 2026-01-13T10:37:32,372 adding 'unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json' 2026-01-13T10:37:32,373 adding 'unitxt/catalog/cards/global_mmlu/cs/international_law.json' 2026-01-13T10:37:32,375 adding 'unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json' 2026-01-13T10:37:32,376 adding 'unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json' 2026-01-13T10:37:32,378 adding 'unitxt/catalog/cards/global_mmlu/cs/machine_learning.json' 2026-01-13T10:37:32,379 adding 'unitxt/catalog/cards/global_mmlu/cs/management.json' 2026-01-13T10:37:32,381 adding 'unitxt/catalog/cards/global_mmlu/cs/marketing.json' 2026-01-13T10:37:32,382 adding 'unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json' 2026-01-13T10:37:32,384 adding 'unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json' 2026-01-13T10:37:32,385 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json' 2026-01-13T10:37:32,387 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json' 2026-01-13T10:37:32,388 adding 'unitxt/catalog/cards/global_mmlu/cs/nutrition.json' 2026-01-13T10:37:32,390 adding 'unitxt/catalog/cards/global_mmlu/cs/philosophy.json' 2026-01-13T10:37:32,391 adding 'unitxt/catalog/cards/global_mmlu/cs/prehistory.json' 2026-01-13T10:37:32,393 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json' 2026-01-13T10:37:32,394 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_law.json' 2026-01-13T10:37:32,395 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json' 2026-01-13T10:37:32,396 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json' 2026-01-13T10:37:32,398 adding 'unitxt/catalog/cards/global_mmlu/cs/public_relations.json' 2026-01-13T10:37:32,399 adding 'unitxt/catalog/cards/global_mmlu/cs/security_studies.json' 2026-01-13T10:37:32,400 adding 'unitxt/catalog/cards/global_mmlu/cs/sociology.json' 2026-01-13T10:37:32,402 adding 'unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json' 2026-01-13T10:37:32,403 adding 'unitxt/catalog/cards/global_mmlu/cs/virology.json' 2026-01-13T10:37:32,404 adding 'unitxt/catalog/cards/global_mmlu/cs/world_religions.json' 2026-01-13T10:37:32,407 adding 'unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json' 2026-01-13T10:37:32,408 adding 'unitxt/catalog/cards/global_mmlu/de/anatomy.json' 2026-01-13T10:37:32,410 adding 'unitxt/catalog/cards/global_mmlu/de/astronomy.json' 2026-01-13T10:37:32,411 adding 'unitxt/catalog/cards/global_mmlu/de/business_ethics.json' 2026-01-13T10:37:32,412 adding 'unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json' 2026-01-13T10:37:32,414 adding 'unitxt/catalog/cards/global_mmlu/de/college_biology.json' 2026-01-13T10:37:32,415 adding 'unitxt/catalog/cards/global_mmlu/de/college_chemistry.json' 2026-01-13T10:37:32,416 adding 'unitxt/catalog/cards/global_mmlu/de/college_computer_science.json' 2026-01-13T10:37:32,418 adding 'unitxt/catalog/cards/global_mmlu/de/college_mathematics.json' 2026-01-13T10:37:32,419 adding 'unitxt/catalog/cards/global_mmlu/de/college_medicine.json' 2026-01-13T10:37:32,420 adding 'unitxt/catalog/cards/global_mmlu/de/college_physics.json' 2026-01-13T10:37:32,422 adding 'unitxt/catalog/cards/global_mmlu/de/computer_security.json' 2026-01-13T10:37:32,423 adding 'unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json' 2026-01-13T10:37:32,424 adding 'unitxt/catalog/cards/global_mmlu/de/econometrics.json' 2026-01-13T10:37:32,426 adding 'unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json' 2026-01-13T10:37:32,427 adding 'unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json' 2026-01-13T10:37:32,429 adding 'unitxt/catalog/cards/global_mmlu/de/formal_logic.json' 2026-01-13T10:37:32,430 adding 'unitxt/catalog/cards/global_mmlu/de/global_facts.json' 2026-01-13T10:37:32,431 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_biology.json' 2026-01-13T10:37:32,433 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json' 2026-01-13T10:37:32,434 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json' 2026-01-13T10:37:32,435 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json' 2026-01-13T10:37:32,437 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_geography.json' 2026-01-13T10:37:32,438 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json' 2026-01-13T10:37:32,440 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json' 2026-01-13T10:37:32,441 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json' 2026-01-13T10:37:32,443 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json' 2026-01-13T10:37:32,444 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_physics.json' 2026-01-13T10:37:32,446 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json' 2026-01-13T10:37:32,447 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json' 2026-01-13T10:37:32,449 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json' 2026-01-13T10:37:32,450 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json' 2026-01-13T10:37:32,452 adding 'unitxt/catalog/cards/global_mmlu/de/human_aging.json' 2026-01-13T10:37:32,453 adding 'unitxt/catalog/cards/global_mmlu/de/human_sexuality.json' 2026-01-13T10:37:32,455 adding 'unitxt/catalog/cards/global_mmlu/de/international_law.json' 2026-01-13T10:37:32,456 adding 'unitxt/catalog/cards/global_mmlu/de/jurisprudence.json' 2026-01-13T10:37:32,457 adding 'unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json' 2026-01-13T10:37:32,459 adding 'unitxt/catalog/cards/global_mmlu/de/machine_learning.json' 2026-01-13T10:37:32,460 adding 'unitxt/catalog/cards/global_mmlu/de/management.json' 2026-01-13T10:37:32,461 adding 'unitxt/catalog/cards/global_mmlu/de/marketing.json' 2026-01-13T10:37:32,462 adding 'unitxt/catalog/cards/global_mmlu/de/medical_genetics.json' 2026-01-13T10:37:32,464 adding 'unitxt/catalog/cards/global_mmlu/de/miscellaneous.json' 2026-01-13T10:37:32,465 adding 'unitxt/catalog/cards/global_mmlu/de/moral_disputes.json' 2026-01-13T10:37:32,466 adding 'unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json' 2026-01-13T10:37:32,468 adding 'unitxt/catalog/cards/global_mmlu/de/nutrition.json' 2026-01-13T10:37:32,470 adding 'unitxt/catalog/cards/global_mmlu/de/philosophy.json' 2026-01-13T10:37:32,471 adding 'unitxt/catalog/cards/global_mmlu/de/prehistory.json' 2026-01-13T10:37:32,474 adding 'unitxt/catalog/cards/global_mmlu/de/professional_accounting.json' 2026-01-13T10:37:32,475 adding 'unitxt/catalog/cards/global_mmlu/de/professional_law.json' 2026-01-13T10:37:32,476 adding 'unitxt/catalog/cards/global_mmlu/de/professional_medicine.json' 2026-01-13T10:37:32,478 adding 'unitxt/catalog/cards/global_mmlu/de/professional_psychology.json' 2026-01-13T10:37:32,479 adding 'unitxt/catalog/cards/global_mmlu/de/public_relations.json' 2026-01-13T10:37:32,480 adding 'unitxt/catalog/cards/global_mmlu/de/security_studies.json' 2026-01-13T10:37:32,482 adding 'unitxt/catalog/cards/global_mmlu/de/sociology.json' 2026-01-13T10:37:32,483 adding 'unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json' 2026-01-13T10:37:32,484 adding 'unitxt/catalog/cards/global_mmlu/de/virology.json' 2026-01-13T10:37:32,485 adding 'unitxt/catalog/cards/global_mmlu/de/world_religions.json' 2026-01-13T10:37:32,488 adding 'unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json' 2026-01-13T10:37:32,490 adding 'unitxt/catalog/cards/global_mmlu/el/anatomy.json' 2026-01-13T10:37:32,491 adding 'unitxt/catalog/cards/global_mmlu/el/astronomy.json' 2026-01-13T10:37:32,492 adding 'unitxt/catalog/cards/global_mmlu/el/business_ethics.json' 2026-01-13T10:37:32,494 adding 'unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json' 2026-01-13T10:37:32,495 adding 'unitxt/catalog/cards/global_mmlu/el/college_biology.json' 2026-01-13T10:37:32,497 adding 'unitxt/catalog/cards/global_mmlu/el/college_chemistry.json' 2026-01-13T10:37:32,498 adding 'unitxt/catalog/cards/global_mmlu/el/college_computer_science.json' 2026-01-13T10:37:32,500 adding 'unitxt/catalog/cards/global_mmlu/el/college_mathematics.json' 2026-01-13T10:37:32,501 adding 'unitxt/catalog/cards/global_mmlu/el/college_medicine.json' 2026-01-13T10:37:32,502 adding 'unitxt/catalog/cards/global_mmlu/el/college_physics.json' 2026-01-13T10:37:32,504 adding 'unitxt/catalog/cards/global_mmlu/el/computer_security.json' 2026-01-13T10:37:32,506 adding 'unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json' 2026-01-13T10:37:32,507 adding 'unitxt/catalog/cards/global_mmlu/el/econometrics.json' 2026-01-13T10:37:32,509 adding 'unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json' 2026-01-13T10:37:32,510 adding 'unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json' 2026-01-13T10:37:32,511 adding 'unitxt/catalog/cards/global_mmlu/el/formal_logic.json' 2026-01-13T10:37:32,513 adding 'unitxt/catalog/cards/global_mmlu/el/global_facts.json' 2026-01-13T10:37:32,514 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_biology.json' 2026-01-13T10:37:32,515 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json' 2026-01-13T10:37:32,517 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json' 2026-01-13T10:37:32,518 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json' 2026-01-13T10:37:32,519 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_geography.json' 2026-01-13T10:37:32,521 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json' 2026-01-13T10:37:32,522 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json' 2026-01-13T10:37:32,523 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json' 2026-01-13T10:37:32,524 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json' 2026-01-13T10:37:32,526 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_physics.json' 2026-01-13T10:37:32,527 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json' 2026-01-13T10:37:32,528 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json' 2026-01-13T10:37:32,529 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json' 2026-01-13T10:37:32,531 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json' 2026-01-13T10:37:32,532 adding 'unitxt/catalog/cards/global_mmlu/el/human_aging.json' 2026-01-13T10:37:32,534 adding 'unitxt/catalog/cards/global_mmlu/el/human_sexuality.json' 2026-01-13T10:37:32,535 adding 'unitxt/catalog/cards/global_mmlu/el/international_law.json' 2026-01-13T10:37:32,536 adding 'unitxt/catalog/cards/global_mmlu/el/jurisprudence.json' 2026-01-13T10:37:32,538 adding 'unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json' 2026-01-13T10:37:32,539 adding 'unitxt/catalog/cards/global_mmlu/el/machine_learning.json' 2026-01-13T10:37:32,540 adding 'unitxt/catalog/cards/global_mmlu/el/management.json' 2026-01-13T10:37:32,542 adding 'unitxt/catalog/cards/global_mmlu/el/marketing.json' 2026-01-13T10:37:32,543 adding 'unitxt/catalog/cards/global_mmlu/el/medical_genetics.json' 2026-01-13T10:37:32,544 adding 'unitxt/catalog/cards/global_mmlu/el/miscellaneous.json' 2026-01-13T10:37:32,545 adding 'unitxt/catalog/cards/global_mmlu/el/moral_disputes.json' 2026-01-13T10:37:32,547 adding 'unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json' 2026-01-13T10:37:32,548 adding 'unitxt/catalog/cards/global_mmlu/el/nutrition.json' 2026-01-13T10:37:32,549 adding 'unitxt/catalog/cards/global_mmlu/el/philosophy.json' 2026-01-13T10:37:32,551 adding 'unitxt/catalog/cards/global_mmlu/el/prehistory.json' 2026-01-13T10:37:32,552 adding 'unitxt/catalog/cards/global_mmlu/el/professional_accounting.json' 2026-01-13T10:37:32,553 adding 'unitxt/catalog/cards/global_mmlu/el/professional_law.json' 2026-01-13T10:37:32,555 adding 'unitxt/catalog/cards/global_mmlu/el/professional_medicine.json' 2026-01-13T10:37:32,556 adding 'unitxt/catalog/cards/global_mmlu/el/professional_psychology.json' 2026-01-13T10:37:32,557 adding 'unitxt/catalog/cards/global_mmlu/el/public_relations.json' 2026-01-13T10:37:32,559 adding 'unitxt/catalog/cards/global_mmlu/el/security_studies.json' 2026-01-13T10:37:32,560 adding 'unitxt/catalog/cards/global_mmlu/el/sociology.json' 2026-01-13T10:37:32,561 adding 'unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json' 2026-01-13T10:37:32,563 adding 'unitxt/catalog/cards/global_mmlu/el/virology.json' 2026-01-13T10:37:32,564 adding 'unitxt/catalog/cards/global_mmlu/el/world_religions.json' 2026-01-13T10:37:32,567 adding 'unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json' 2026-01-13T10:37:32,568 adding 'unitxt/catalog/cards/global_mmlu/en/anatomy.json' 2026-01-13T10:37:32,569 adding 'unitxt/catalog/cards/global_mmlu/en/astronomy.json' 2026-01-13T10:37:32,571 adding 'unitxt/catalog/cards/global_mmlu/en/business_ethics.json' 2026-01-13T10:37:32,572 adding 'unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json' 2026-01-13T10:37:32,573 adding 'unitxt/catalog/cards/global_mmlu/en/college_biology.json' 2026-01-13T10:37:32,575 adding 'unitxt/catalog/cards/global_mmlu/en/college_chemistry.json' 2026-01-13T10:37:32,576 adding 'unitxt/catalog/cards/global_mmlu/en/college_computer_science.json' 2026-01-13T10:37:32,577 adding 'unitxt/catalog/cards/global_mmlu/en/college_mathematics.json' 2026-01-13T10:37:32,578 adding 'unitxt/catalog/cards/global_mmlu/en/college_medicine.json' 2026-01-13T10:37:32,579 adding 'unitxt/catalog/cards/global_mmlu/en/college_physics.json' 2026-01-13T10:37:32,581 adding 'unitxt/catalog/cards/global_mmlu/en/computer_security.json' 2026-01-13T10:37:32,582 adding 'unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json' 2026-01-13T10:37:32,583 adding 'unitxt/catalog/cards/global_mmlu/en/econometrics.json' 2026-01-13T10:37:32,584 adding 'unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json' 2026-01-13T10:37:32,586 adding 'unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json' 2026-01-13T10:37:32,587 adding 'unitxt/catalog/cards/global_mmlu/en/formal_logic.json' 2026-01-13T10:37:32,588 adding 'unitxt/catalog/cards/global_mmlu/en/global_facts.json' 2026-01-13T10:37:32,590 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_biology.json' 2026-01-13T10:37:32,591 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json' 2026-01-13T10:37:32,592 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json' 2026-01-13T10:37:32,593 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json' 2026-01-13T10:37:32,595 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_geography.json' 2026-01-13T10:37:32,596 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json' 2026-01-13T10:37:32,597 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json' 2026-01-13T10:37:32,599 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json' 2026-01-13T10:37:32,600 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json' 2026-01-13T10:37:32,601 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_physics.json' 2026-01-13T10:37:32,602 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json' 2026-01-13T10:37:32,604 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json' 2026-01-13T10:37:32,605 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json' 2026-01-13T10:37:32,606 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json' 2026-01-13T10:37:32,608 adding 'unitxt/catalog/cards/global_mmlu/en/human_aging.json' 2026-01-13T10:37:32,609 adding 'unitxt/catalog/cards/global_mmlu/en/human_sexuality.json' 2026-01-13T10:37:32,610 adding 'unitxt/catalog/cards/global_mmlu/en/international_law.json' 2026-01-13T10:37:32,612 adding 'unitxt/catalog/cards/global_mmlu/en/jurisprudence.json' 2026-01-13T10:37:32,613 adding 'unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json' 2026-01-13T10:37:32,614 adding 'unitxt/catalog/cards/global_mmlu/en/machine_learning.json' 2026-01-13T10:37:32,616 adding 'unitxt/catalog/cards/global_mmlu/en/management.json' 2026-01-13T10:37:32,617 adding 'unitxt/catalog/cards/global_mmlu/en/marketing.json' 2026-01-13T10:37:32,618 adding 'unitxt/catalog/cards/global_mmlu/en/medical_genetics.json' 2026-01-13T10:37:32,620 adding 'unitxt/catalog/cards/global_mmlu/en/miscellaneous.json' 2026-01-13T10:37:32,621 adding 'unitxt/catalog/cards/global_mmlu/en/moral_disputes.json' 2026-01-13T10:37:32,622 adding 'unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json' 2026-01-13T10:37:32,623 adding 'unitxt/catalog/cards/global_mmlu/en/nutrition.json' 2026-01-13T10:37:32,625 adding 'unitxt/catalog/cards/global_mmlu/en/philosophy.json' 2026-01-13T10:37:32,626 adding 'unitxt/catalog/cards/global_mmlu/en/prehistory.json' 2026-01-13T10:37:32,627 adding 'unitxt/catalog/cards/global_mmlu/en/professional_accounting.json' 2026-01-13T10:37:32,629 adding 'unitxt/catalog/cards/global_mmlu/en/professional_law.json' 2026-01-13T10:37:32,630 adding 'unitxt/catalog/cards/global_mmlu/en/professional_medicine.json' 2026-01-13T10:37:32,631 adding 'unitxt/catalog/cards/global_mmlu/en/professional_psychology.json' 2026-01-13T10:37:32,633 adding 'unitxt/catalog/cards/global_mmlu/en/public_relations.json' 2026-01-13T10:37:32,634 adding 'unitxt/catalog/cards/global_mmlu/en/security_studies.json' 2026-01-13T10:37:32,635 adding 'unitxt/catalog/cards/global_mmlu/en/sociology.json' 2026-01-13T10:37:32,636 adding 'unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json' 2026-01-13T10:37:32,637 adding 'unitxt/catalog/cards/global_mmlu/en/virology.json' 2026-01-13T10:37:32,639 adding 'unitxt/catalog/cards/global_mmlu/en/world_religions.json' 2026-01-13T10:37:32,641 adding 'unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json' 2026-01-13T10:37:32,643 adding 'unitxt/catalog/cards/global_mmlu/es/anatomy.json' 2026-01-13T10:37:32,644 adding 'unitxt/catalog/cards/global_mmlu/es/astronomy.json' 2026-01-13T10:37:32,645 adding 'unitxt/catalog/cards/global_mmlu/es/business_ethics.json' 2026-01-13T10:37:32,647 adding 'unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json' 2026-01-13T10:37:32,648 adding 'unitxt/catalog/cards/global_mmlu/es/college_biology.json' 2026-01-13T10:37:32,649 adding 'unitxt/catalog/cards/global_mmlu/es/college_chemistry.json' 2026-01-13T10:37:32,650 adding 'unitxt/catalog/cards/global_mmlu/es/college_computer_science.json' 2026-01-13T10:37:32,652 adding 'unitxt/catalog/cards/global_mmlu/es/college_mathematics.json' 2026-01-13T10:37:32,653 adding 'unitxt/catalog/cards/global_mmlu/es/college_medicine.json' 2026-01-13T10:37:32,654 adding 'unitxt/catalog/cards/global_mmlu/es/college_physics.json' 2026-01-13T10:37:32,655 adding 'unitxt/catalog/cards/global_mmlu/es/computer_security.json' 2026-01-13T10:37:32,657 adding 'unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json' 2026-01-13T10:37:32,658 adding 'unitxt/catalog/cards/global_mmlu/es/econometrics.json' 2026-01-13T10:37:32,659 adding 'unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json' 2026-01-13T10:37:32,660 adding 'unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json' 2026-01-13T10:37:32,662 adding 'unitxt/catalog/cards/global_mmlu/es/formal_logic.json' 2026-01-13T10:37:32,663 adding 'unitxt/catalog/cards/global_mmlu/es/global_facts.json' 2026-01-13T10:37:32,664 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_biology.json' 2026-01-13T10:37:32,666 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json' 2026-01-13T10:37:32,667 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json' 2026-01-13T10:37:32,668 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json' 2026-01-13T10:37:32,670 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_geography.json' 2026-01-13T10:37:32,671 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json' 2026-01-13T10:37:32,672 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json' 2026-01-13T10:37:32,673 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json' 2026-01-13T10:37:32,675 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json' 2026-01-13T10:37:32,676 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_physics.json' 2026-01-13T10:37:32,677 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json' 2026-01-13T10:37:32,679 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json' 2026-01-13T10:37:32,680 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json' 2026-01-13T10:37:32,681 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json' 2026-01-13T10:37:32,683 adding 'unitxt/catalog/cards/global_mmlu/es/human_aging.json' 2026-01-13T10:37:32,684 adding 'unitxt/catalog/cards/global_mmlu/es/human_sexuality.json' 2026-01-13T10:37:32,685 adding 'unitxt/catalog/cards/global_mmlu/es/international_law.json' 2026-01-13T10:37:32,687 adding 'unitxt/catalog/cards/global_mmlu/es/jurisprudence.json' 2026-01-13T10:37:32,688 adding 'unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json' 2026-01-13T10:37:32,689 adding 'unitxt/catalog/cards/global_mmlu/es/machine_learning.json' 2026-01-13T10:37:32,691 adding 'unitxt/catalog/cards/global_mmlu/es/management.json' 2026-01-13T10:37:32,692 adding 'unitxt/catalog/cards/global_mmlu/es/marketing.json' 2026-01-13T10:37:32,693 adding 'unitxt/catalog/cards/global_mmlu/es/medical_genetics.json' 2026-01-13T10:37:32,694 adding 'unitxt/catalog/cards/global_mmlu/es/miscellaneous.json' 2026-01-13T10:37:32,696 adding 'unitxt/catalog/cards/global_mmlu/es/moral_disputes.json' 2026-01-13T10:37:32,697 adding 'unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json' 2026-01-13T10:37:32,698 adding 'unitxt/catalog/cards/global_mmlu/es/nutrition.json' 2026-01-13T10:37:32,700 adding 'unitxt/catalog/cards/global_mmlu/es/philosophy.json' 2026-01-13T10:37:32,701 adding 'unitxt/catalog/cards/global_mmlu/es/prehistory.json' 2026-01-13T10:37:32,702 adding 'unitxt/catalog/cards/global_mmlu/es/professional_accounting.json' 2026-01-13T10:37:32,704 adding 'unitxt/catalog/cards/global_mmlu/es/professional_law.json' 2026-01-13T10:37:32,705 adding 'unitxt/catalog/cards/global_mmlu/es/professional_medicine.json' 2026-01-13T10:37:32,706 adding 'unitxt/catalog/cards/global_mmlu/es/professional_psychology.json' 2026-01-13T10:37:32,707 adding 'unitxt/catalog/cards/global_mmlu/es/public_relations.json' 2026-01-13T10:37:32,709 adding 'unitxt/catalog/cards/global_mmlu/es/security_studies.json' 2026-01-13T10:37:32,710 adding 'unitxt/catalog/cards/global_mmlu/es/sociology.json' 2026-01-13T10:37:32,711 adding 'unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json' 2026-01-13T10:37:32,713 adding 'unitxt/catalog/cards/global_mmlu/es/virology.json' 2026-01-13T10:37:32,714 adding 'unitxt/catalog/cards/global_mmlu/es/world_religions.json' 2026-01-13T10:37:32,717 adding 'unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json' 2026-01-13T10:37:32,718 adding 'unitxt/catalog/cards/global_mmlu/fa/anatomy.json' 2026-01-13T10:37:32,719 adding 'unitxt/catalog/cards/global_mmlu/fa/astronomy.json' 2026-01-13T10:37:32,720 adding 'unitxt/catalog/cards/global_mmlu/fa/business_ethics.json' 2026-01-13T10:37:32,722 adding 'unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json' 2026-01-13T10:37:32,723 adding 'unitxt/catalog/cards/global_mmlu/fa/college_biology.json' 2026-01-13T10:37:32,724 adding 'unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json' 2026-01-13T10:37:32,726 adding 'unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json' 2026-01-13T10:37:32,727 adding 'unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json' 2026-01-13T10:37:32,728 adding 'unitxt/catalog/cards/global_mmlu/fa/college_medicine.json' 2026-01-13T10:37:32,730 adding 'unitxt/catalog/cards/global_mmlu/fa/college_physics.json' 2026-01-13T10:37:32,731 adding 'unitxt/catalog/cards/global_mmlu/fa/computer_security.json' 2026-01-13T10:37:32,732 adding 'unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json' 2026-01-13T10:37:32,733 adding 'unitxt/catalog/cards/global_mmlu/fa/econometrics.json' 2026-01-13T10:37:32,735 adding 'unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json' 2026-01-13T10:37:32,736 adding 'unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json' 2026-01-13T10:37:32,737 adding 'unitxt/catalog/cards/global_mmlu/fa/formal_logic.json' 2026-01-13T10:37:32,739 adding 'unitxt/catalog/cards/global_mmlu/fa/global_facts.json' 2026-01-13T10:37:32,740 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json' 2026-01-13T10:37:32,741 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json' 2026-01-13T10:37:32,743 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json' 2026-01-13T10:37:32,744 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json' 2026-01-13T10:37:32,745 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json' 2026-01-13T10:37:32,747 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json' 2026-01-13T10:37:32,748 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json' 2026-01-13T10:37:32,749 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json' 2026-01-13T10:37:32,750 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json' 2026-01-13T10:37:32,751 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json' 2026-01-13T10:37:32,753 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json' 2026-01-13T10:37:32,754 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json' 2026-01-13T10:37:32,755 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json' 2026-01-13T10:37:32,756 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json' 2026-01-13T10:37:32,758 adding 'unitxt/catalog/cards/global_mmlu/fa/human_aging.json' 2026-01-13T10:37:32,759 adding 'unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json' 2026-01-13T10:37:32,760 adding 'unitxt/catalog/cards/global_mmlu/fa/international_law.json' 2026-01-13T10:37:32,762 adding 'unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json' 2026-01-13T10:37:32,763 adding 'unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json' 2026-01-13T10:37:32,764 adding 'unitxt/catalog/cards/global_mmlu/fa/machine_learning.json' 2026-01-13T10:37:32,765 adding 'unitxt/catalog/cards/global_mmlu/fa/management.json' 2026-01-13T10:37:32,767 adding 'unitxt/catalog/cards/global_mmlu/fa/marketing.json' 2026-01-13T10:37:32,768 adding 'unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json' 2026-01-13T10:37:32,769 adding 'unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json' 2026-01-13T10:37:32,770 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json' 2026-01-13T10:37:32,772 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json' 2026-01-13T10:37:32,773 adding 'unitxt/catalog/cards/global_mmlu/fa/nutrition.json' 2026-01-13T10:37:32,775 adding 'unitxt/catalog/cards/global_mmlu/fa/philosophy.json' 2026-01-13T10:37:32,776 adding 'unitxt/catalog/cards/global_mmlu/fa/prehistory.json' 2026-01-13T10:37:32,778 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json' 2026-01-13T10:37:32,779 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_law.json' 2026-01-13T10:37:32,780 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json' 2026-01-13T10:37:32,782 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json' 2026-01-13T10:37:32,783 adding 'unitxt/catalog/cards/global_mmlu/fa/public_relations.json' 2026-01-13T10:37:32,784 adding 'unitxt/catalog/cards/global_mmlu/fa/security_studies.json' 2026-01-13T10:37:32,786 adding 'unitxt/catalog/cards/global_mmlu/fa/sociology.json' 2026-01-13T10:37:32,787 adding 'unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json' 2026-01-13T10:37:32,789 adding 'unitxt/catalog/cards/global_mmlu/fa/virology.json' 2026-01-13T10:37:32,790 adding 'unitxt/catalog/cards/global_mmlu/fa/world_religions.json' 2026-01-13T10:37:32,793 adding 'unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json' 2026-01-13T10:37:32,795 adding 'unitxt/catalog/cards/global_mmlu/fil/anatomy.json' 2026-01-13T10:37:32,796 adding 'unitxt/catalog/cards/global_mmlu/fil/astronomy.json' 2026-01-13T10:37:32,798 adding 'unitxt/catalog/cards/global_mmlu/fil/business_ethics.json' 2026-01-13T10:37:32,799 adding 'unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json' 2026-01-13T10:37:32,800 adding 'unitxt/catalog/cards/global_mmlu/fil/college_biology.json' 2026-01-13T10:37:32,801 adding 'unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json' 2026-01-13T10:37:32,803 adding 'unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json' 2026-01-13T10:37:32,804 adding 'unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json' 2026-01-13T10:37:32,805 adding 'unitxt/catalog/cards/global_mmlu/fil/college_medicine.json' 2026-01-13T10:37:32,807 adding 'unitxt/catalog/cards/global_mmlu/fil/college_physics.json' 2026-01-13T10:37:32,808 adding 'unitxt/catalog/cards/global_mmlu/fil/computer_security.json' 2026-01-13T10:37:32,809 adding 'unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json' 2026-01-13T10:37:32,810 adding 'unitxt/catalog/cards/global_mmlu/fil/econometrics.json' 2026-01-13T10:37:32,811 adding 'unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json' 2026-01-13T10:37:32,813 adding 'unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json' 2026-01-13T10:37:32,814 adding 'unitxt/catalog/cards/global_mmlu/fil/formal_logic.json' 2026-01-13T10:37:32,815 adding 'unitxt/catalog/cards/global_mmlu/fil/global_facts.json' 2026-01-13T10:37:32,816 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json' 2026-01-13T10:37:32,818 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json' 2026-01-13T10:37:32,819 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json' 2026-01-13T10:37:32,820 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json' 2026-01-13T10:37:32,822 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json' 2026-01-13T10:37:32,823 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json' 2026-01-13T10:37:32,824 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json' 2026-01-13T10:37:32,825 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json' 2026-01-13T10:37:32,826 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json' 2026-01-13T10:37:32,828 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json' 2026-01-13T10:37:32,829 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json' 2026-01-13T10:37:32,830 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json' 2026-01-13T10:37:32,832 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json' 2026-01-13T10:37:32,833 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json' 2026-01-13T10:37:32,834 adding 'unitxt/catalog/cards/global_mmlu/fil/human_aging.json' 2026-01-13T10:37:32,835 adding 'unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json' 2026-01-13T10:37:32,837 adding 'unitxt/catalog/cards/global_mmlu/fil/international_law.json' 2026-01-13T10:37:32,838 adding 'unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json' 2026-01-13T10:37:32,839 adding 'unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json' 2026-01-13T10:37:32,841 adding 'unitxt/catalog/cards/global_mmlu/fil/machine_learning.json' 2026-01-13T10:37:32,842 adding 'unitxt/catalog/cards/global_mmlu/fil/management.json' 2026-01-13T10:37:32,843 adding 'unitxt/catalog/cards/global_mmlu/fil/marketing.json' 2026-01-13T10:37:32,845 adding 'unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json' 2026-01-13T10:37:32,846 adding 'unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json' 2026-01-13T10:37:32,847 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json' 2026-01-13T10:37:32,849 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json' 2026-01-13T10:37:32,850 adding 'unitxt/catalog/cards/global_mmlu/fil/nutrition.json' 2026-01-13T10:37:32,851 adding 'unitxt/catalog/cards/global_mmlu/fil/philosophy.json' 2026-01-13T10:37:32,853 adding 'unitxt/catalog/cards/global_mmlu/fil/prehistory.json' 2026-01-13T10:37:32,854 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json' 2026-01-13T10:37:32,855 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_law.json' 2026-01-13T10:37:32,857 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json' 2026-01-13T10:37:32,858 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json' 2026-01-13T10:37:32,859 adding 'unitxt/catalog/cards/global_mmlu/fil/public_relations.json' 2026-01-13T10:37:32,860 adding 'unitxt/catalog/cards/global_mmlu/fil/security_studies.json' 2026-01-13T10:37:32,862 adding 'unitxt/catalog/cards/global_mmlu/fil/sociology.json' 2026-01-13T10:37:32,863 adding 'unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json' 2026-01-13T10:37:32,864 adding 'unitxt/catalog/cards/global_mmlu/fil/virology.json' 2026-01-13T10:37:32,865 adding 'unitxt/catalog/cards/global_mmlu/fil/world_religions.json' 2026-01-13T10:37:32,868 adding 'unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json' 2026-01-13T10:37:32,869 adding 'unitxt/catalog/cards/global_mmlu/fr/anatomy.json' 2026-01-13T10:37:32,870 adding 'unitxt/catalog/cards/global_mmlu/fr/astronomy.json' 2026-01-13T10:37:32,871 adding 'unitxt/catalog/cards/global_mmlu/fr/business_ethics.json' 2026-01-13T10:37:32,873 adding 'unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json' 2026-01-13T10:37:32,874 adding 'unitxt/catalog/cards/global_mmlu/fr/college_biology.json' 2026-01-13T10:37:32,875 adding 'unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json' 2026-01-13T10:37:32,876 adding 'unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json' 2026-01-13T10:37:32,878 adding 'unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json' 2026-01-13T10:37:32,879 adding 'unitxt/catalog/cards/global_mmlu/fr/college_medicine.json' 2026-01-13T10:37:32,880 adding 'unitxt/catalog/cards/global_mmlu/fr/college_physics.json' 2026-01-13T10:37:32,881 adding 'unitxt/catalog/cards/global_mmlu/fr/computer_security.json' 2026-01-13T10:37:32,883 adding 'unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json' 2026-01-13T10:37:32,884 adding 'unitxt/catalog/cards/global_mmlu/fr/econometrics.json' 2026-01-13T10:37:32,885 adding 'unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json' 2026-01-13T10:37:32,887 adding 'unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json' 2026-01-13T10:37:32,888 adding 'unitxt/catalog/cards/global_mmlu/fr/formal_logic.json' 2026-01-13T10:37:32,889 adding 'unitxt/catalog/cards/global_mmlu/fr/global_facts.json' 2026-01-13T10:37:32,890 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json' 2026-01-13T10:37:32,892 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json' 2026-01-13T10:37:32,893 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json' 2026-01-13T10:37:32,894 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json' 2026-01-13T10:37:32,896 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json' 2026-01-13T10:37:32,897 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json' 2026-01-13T10:37:32,898 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json' 2026-01-13T10:37:32,900 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json' 2026-01-13T10:37:32,901 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json' 2026-01-13T10:37:32,902 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json' 2026-01-13T10:37:32,903 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json' 2026-01-13T10:37:32,905 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json' 2026-01-13T10:37:32,906 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json' 2026-01-13T10:37:32,907 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json' 2026-01-13T10:37:32,909 adding 'unitxt/catalog/cards/global_mmlu/fr/human_aging.json' 2026-01-13T10:37:32,910 adding 'unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json' 2026-01-13T10:37:32,911 adding 'unitxt/catalog/cards/global_mmlu/fr/international_law.json' 2026-01-13T10:37:32,913 adding 'unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json' 2026-01-13T10:37:32,914 adding 'unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json' 2026-01-13T10:37:32,915 adding 'unitxt/catalog/cards/global_mmlu/fr/machine_learning.json' 2026-01-13T10:37:32,917 adding 'unitxt/catalog/cards/global_mmlu/fr/management.json' 2026-01-13T10:37:32,918 adding 'unitxt/catalog/cards/global_mmlu/fr/marketing.json' 2026-01-13T10:37:32,919 adding 'unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json' 2026-01-13T10:37:32,920 adding 'unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json' 2026-01-13T10:37:32,921 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json' 2026-01-13T10:37:32,923 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json' 2026-01-13T10:37:32,924 adding 'unitxt/catalog/cards/global_mmlu/fr/nutrition.json' 2026-01-13T10:37:32,925 adding 'unitxt/catalog/cards/global_mmlu/fr/philosophy.json' 2026-01-13T10:37:32,926 adding 'unitxt/catalog/cards/global_mmlu/fr/prehistory.json' 2026-01-13T10:37:32,928 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json' 2026-01-13T10:37:32,929 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_law.json' 2026-01-13T10:37:32,930 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json' 2026-01-13T10:37:32,932 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json' 2026-01-13T10:37:32,933 adding 'unitxt/catalog/cards/global_mmlu/fr/public_relations.json' 2026-01-13T10:37:32,934 adding 'unitxt/catalog/cards/global_mmlu/fr/security_studies.json' 2026-01-13T10:37:32,935 adding 'unitxt/catalog/cards/global_mmlu/fr/sociology.json' 2026-01-13T10:37:32,936 adding 'unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json' 2026-01-13T10:37:32,938 adding 'unitxt/catalog/cards/global_mmlu/fr/virology.json' 2026-01-13T10:37:32,939 adding 'unitxt/catalog/cards/global_mmlu/fr/world_religions.json' 2026-01-13T10:37:32,942 adding 'unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json' 2026-01-13T10:37:32,943 adding 'unitxt/catalog/cards/global_mmlu/ha/anatomy.json' 2026-01-13T10:37:32,944 adding 'unitxt/catalog/cards/global_mmlu/ha/astronomy.json' 2026-01-13T10:37:32,946 adding 'unitxt/catalog/cards/global_mmlu/ha/business_ethics.json' 2026-01-13T10:37:32,947 adding 'unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json' 2026-01-13T10:37:32,948 adding 'unitxt/catalog/cards/global_mmlu/ha/college_biology.json' 2026-01-13T10:37:32,950 adding 'unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json' 2026-01-13T10:37:32,951 adding 'unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json' 2026-01-13T10:37:32,952 adding 'unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json' 2026-01-13T10:37:32,953 adding 'unitxt/catalog/cards/global_mmlu/ha/college_medicine.json' 2026-01-13T10:37:32,955 adding 'unitxt/catalog/cards/global_mmlu/ha/college_physics.json' 2026-01-13T10:37:32,956 adding 'unitxt/catalog/cards/global_mmlu/ha/computer_security.json' 2026-01-13T10:37:32,957 adding 'unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json' 2026-01-13T10:37:32,959 adding 'unitxt/catalog/cards/global_mmlu/ha/econometrics.json' 2026-01-13T10:37:32,960 adding 'unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json' 2026-01-13T10:37:32,961 adding 'unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json' 2026-01-13T10:37:32,963 adding 'unitxt/catalog/cards/global_mmlu/ha/formal_logic.json' 2026-01-13T10:37:32,964 adding 'unitxt/catalog/cards/global_mmlu/ha/global_facts.json' 2026-01-13T10:37:32,965 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json' 2026-01-13T10:37:32,967 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json' 2026-01-13T10:37:32,968 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json' 2026-01-13T10:37:32,969 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json' 2026-01-13T10:37:32,971 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json' 2026-01-13T10:37:32,972 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json' 2026-01-13T10:37:32,973 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json' 2026-01-13T10:37:32,974 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json' 2026-01-13T10:37:32,976 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json' 2026-01-13T10:37:32,977 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json' 2026-01-13T10:37:32,978 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json' 2026-01-13T10:37:32,979 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json' 2026-01-13T10:37:32,980 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json' 2026-01-13T10:37:32,982 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json' 2026-01-13T10:37:32,983 adding 'unitxt/catalog/cards/global_mmlu/ha/human_aging.json' 2026-01-13T10:37:32,984 adding 'unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json' 2026-01-13T10:37:32,986 adding 'unitxt/catalog/cards/global_mmlu/ha/international_law.json' 2026-01-13T10:37:32,987 adding 'unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json' 2026-01-13T10:37:32,989 adding 'unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json' 2026-01-13T10:37:32,990 adding 'unitxt/catalog/cards/global_mmlu/ha/machine_learning.json' 2026-01-13T10:37:32,991 adding 'unitxt/catalog/cards/global_mmlu/ha/management.json' 2026-01-13T10:37:32,992 adding 'unitxt/catalog/cards/global_mmlu/ha/marketing.json' 2026-01-13T10:37:32,994 adding 'unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json' 2026-01-13T10:37:32,995 adding 'unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json' 2026-01-13T10:37:32,996 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json' 2026-01-13T10:37:32,997 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json' 2026-01-13T10:37:32,999 adding 'unitxt/catalog/cards/global_mmlu/ha/nutrition.json' 2026-01-13T10:37:33,000 adding 'unitxt/catalog/cards/global_mmlu/ha/philosophy.json' 2026-01-13T10:37:33,001 adding 'unitxt/catalog/cards/global_mmlu/ha/prehistory.json' 2026-01-13T10:37:33,003 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json' 2026-01-13T10:37:33,004 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_law.json' 2026-01-13T10:37:33,005 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json' 2026-01-13T10:37:33,006 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json' 2026-01-13T10:37:33,008 adding 'unitxt/catalog/cards/global_mmlu/ha/public_relations.json' 2026-01-13T10:37:33,009 adding 'unitxt/catalog/cards/global_mmlu/ha/security_studies.json' 2026-01-13T10:37:33,010 adding 'unitxt/catalog/cards/global_mmlu/ha/sociology.json' 2026-01-13T10:37:33,012 adding 'unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json' 2026-01-13T10:37:33,013 adding 'unitxt/catalog/cards/global_mmlu/ha/virology.json' 2026-01-13T10:37:33,014 adding 'unitxt/catalog/cards/global_mmlu/ha/world_religions.json' 2026-01-13T10:37:33,017 adding 'unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json' 2026-01-13T10:37:33,018 adding 'unitxt/catalog/cards/global_mmlu/he/anatomy.json' 2026-01-13T10:37:33,020 adding 'unitxt/catalog/cards/global_mmlu/he/astronomy.json' 2026-01-13T10:37:33,021 adding 'unitxt/catalog/cards/global_mmlu/he/business_ethics.json' 2026-01-13T10:37:33,022 adding 'unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json' 2026-01-13T10:37:33,024 adding 'unitxt/catalog/cards/global_mmlu/he/college_biology.json' 2026-01-13T10:37:33,025 adding 'unitxt/catalog/cards/global_mmlu/he/college_chemistry.json' 2026-01-13T10:37:33,026 adding 'unitxt/catalog/cards/global_mmlu/he/college_computer_science.json' 2026-01-13T10:37:33,028 adding 'unitxt/catalog/cards/global_mmlu/he/college_mathematics.json' 2026-01-13T10:37:33,029 adding 'unitxt/catalog/cards/global_mmlu/he/college_medicine.json' 2026-01-13T10:37:33,030 adding 'unitxt/catalog/cards/global_mmlu/he/college_physics.json' 2026-01-13T10:37:33,032 adding 'unitxt/catalog/cards/global_mmlu/he/computer_security.json' 2026-01-13T10:37:33,033 adding 'unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json' 2026-01-13T10:37:33,034 adding 'unitxt/catalog/cards/global_mmlu/he/econometrics.json' 2026-01-13T10:37:33,035 adding 'unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json' 2026-01-13T10:37:33,036 adding 'unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json' 2026-01-13T10:37:33,038 adding 'unitxt/catalog/cards/global_mmlu/he/formal_logic.json' 2026-01-13T10:37:33,039 adding 'unitxt/catalog/cards/global_mmlu/he/global_facts.json' 2026-01-13T10:37:33,040 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_biology.json' 2026-01-13T10:37:33,042 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json' 2026-01-13T10:37:33,043 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json' 2026-01-13T10:37:33,044 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json' 2026-01-13T10:37:33,046 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_geography.json' 2026-01-13T10:37:33,047 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json' 2026-01-13T10:37:33,048 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json' 2026-01-13T10:37:33,049 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json' 2026-01-13T10:37:33,051 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json' 2026-01-13T10:37:33,052 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_physics.json' 2026-01-13T10:37:33,053 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json' 2026-01-13T10:37:33,054 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json' 2026-01-13T10:37:33,056 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json' 2026-01-13T10:37:33,057 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json' 2026-01-13T10:37:33,058 adding 'unitxt/catalog/cards/global_mmlu/he/human_aging.json' 2026-01-13T10:37:33,060 adding 'unitxt/catalog/cards/global_mmlu/he/human_sexuality.json' 2026-01-13T10:37:33,061 adding 'unitxt/catalog/cards/global_mmlu/he/international_law.json' 2026-01-13T10:37:33,062 adding 'unitxt/catalog/cards/global_mmlu/he/jurisprudence.json' 2026-01-13T10:37:33,064 adding 'unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json' 2026-01-13T10:37:33,065 adding 'unitxt/catalog/cards/global_mmlu/he/machine_learning.json' 2026-01-13T10:37:33,066 adding 'unitxt/catalog/cards/global_mmlu/he/management.json' 2026-01-13T10:37:33,067 adding 'unitxt/catalog/cards/global_mmlu/he/marketing.json' 2026-01-13T10:37:33,069 adding 'unitxt/catalog/cards/global_mmlu/he/medical_genetics.json' 2026-01-13T10:37:33,070 adding 'unitxt/catalog/cards/global_mmlu/he/miscellaneous.json' 2026-01-13T10:37:33,071 adding 'unitxt/catalog/cards/global_mmlu/he/moral_disputes.json' 2026-01-13T10:37:33,073 adding 'unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json' 2026-01-13T10:37:33,074 adding 'unitxt/catalog/cards/global_mmlu/he/nutrition.json' 2026-01-13T10:37:33,075 adding 'unitxt/catalog/cards/global_mmlu/he/philosophy.json' 2026-01-13T10:37:33,077 adding 'unitxt/catalog/cards/global_mmlu/he/prehistory.json' 2026-01-13T10:37:33,078 adding 'unitxt/catalog/cards/global_mmlu/he/professional_accounting.json' 2026-01-13T10:37:33,079 adding 'unitxt/catalog/cards/global_mmlu/he/professional_law.json' 2026-01-13T10:37:33,081 adding 'unitxt/catalog/cards/global_mmlu/he/professional_medicine.json' 2026-01-13T10:37:33,082 adding 'unitxt/catalog/cards/global_mmlu/he/professional_psychology.json' 2026-01-13T10:37:33,083 adding 'unitxt/catalog/cards/global_mmlu/he/public_relations.json' 2026-01-13T10:37:33,084 adding 'unitxt/catalog/cards/global_mmlu/he/security_studies.json' 2026-01-13T10:37:33,086 adding 'unitxt/catalog/cards/global_mmlu/he/sociology.json' 2026-01-13T10:37:33,087 adding 'unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json' 2026-01-13T10:37:33,088 adding 'unitxt/catalog/cards/global_mmlu/he/virology.json' 2026-01-13T10:37:33,090 adding 'unitxt/catalog/cards/global_mmlu/he/world_religions.json' 2026-01-13T10:37:33,092 adding 'unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json' 2026-01-13T10:37:33,093 adding 'unitxt/catalog/cards/global_mmlu/hi/anatomy.json' 2026-01-13T10:37:33,094 adding 'unitxt/catalog/cards/global_mmlu/hi/astronomy.json' 2026-01-13T10:37:33,096 adding 'unitxt/catalog/cards/global_mmlu/hi/business_ethics.json' 2026-01-13T10:37:33,097 adding 'unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json' 2026-01-13T10:37:33,098 adding 'unitxt/catalog/cards/global_mmlu/hi/college_biology.json' 2026-01-13T10:37:33,099 adding 'unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json' 2026-01-13T10:37:33,101 adding 'unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json' 2026-01-13T10:37:33,102 adding 'unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json' 2026-01-13T10:37:33,103 adding 'unitxt/catalog/cards/global_mmlu/hi/college_medicine.json' 2026-01-13T10:37:33,104 adding 'unitxt/catalog/cards/global_mmlu/hi/college_physics.json' 2026-01-13T10:37:33,106 adding 'unitxt/catalog/cards/global_mmlu/hi/computer_security.json' 2026-01-13T10:37:33,107 adding 'unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json' 2026-01-13T10:37:33,108 adding 'unitxt/catalog/cards/global_mmlu/hi/econometrics.json' 2026-01-13T10:37:33,110 adding 'unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json' 2026-01-13T10:37:33,111 adding 'unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json' 2026-01-13T10:37:33,112 adding 'unitxt/catalog/cards/global_mmlu/hi/formal_logic.json' 2026-01-13T10:37:33,113 adding 'unitxt/catalog/cards/global_mmlu/hi/global_facts.json' 2026-01-13T10:37:33,115 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json' 2026-01-13T10:37:33,116 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json' 2026-01-13T10:37:33,117 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json' 2026-01-13T10:37:33,119 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json' 2026-01-13T10:37:33,120 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json' 2026-01-13T10:37:33,121 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json' 2026-01-13T10:37:33,123 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json' 2026-01-13T10:37:33,124 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json' 2026-01-13T10:37:33,125 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json' 2026-01-13T10:37:33,126 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json' 2026-01-13T10:37:33,128 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json' 2026-01-13T10:37:33,129 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json' 2026-01-13T10:37:33,131 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json' 2026-01-13T10:37:33,132 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json' 2026-01-13T10:37:33,133 adding 'unitxt/catalog/cards/global_mmlu/hi/human_aging.json' 2026-01-13T10:37:33,134 adding 'unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json' 2026-01-13T10:37:33,136 adding 'unitxt/catalog/cards/global_mmlu/hi/international_law.json' 2026-01-13T10:37:33,137 adding 'unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json' 2026-01-13T10:37:33,138 adding 'unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json' 2026-01-13T10:37:33,140 adding 'unitxt/catalog/cards/global_mmlu/hi/machine_learning.json' 2026-01-13T10:37:33,141 adding 'unitxt/catalog/cards/global_mmlu/hi/management.json' 2026-01-13T10:37:33,142 adding 'unitxt/catalog/cards/global_mmlu/hi/marketing.json' 2026-01-13T10:37:33,144 adding 'unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json' 2026-01-13T10:37:33,145 adding 'unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json' 2026-01-13T10:37:33,146 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json' 2026-01-13T10:37:33,147 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json' 2026-01-13T10:37:33,149 adding 'unitxt/catalog/cards/global_mmlu/hi/nutrition.json' 2026-01-13T10:37:33,150 adding 'unitxt/catalog/cards/global_mmlu/hi/philosophy.json' 2026-01-13T10:37:33,151 adding 'unitxt/catalog/cards/global_mmlu/hi/prehistory.json' 2026-01-13T10:37:33,152 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json' 2026-01-13T10:37:33,153 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_law.json' 2026-01-13T10:37:33,155 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json' 2026-01-13T10:37:33,156 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json' 2026-01-13T10:37:33,157 adding 'unitxt/catalog/cards/global_mmlu/hi/public_relations.json' 2026-01-13T10:37:33,159 adding 'unitxt/catalog/cards/global_mmlu/hi/security_studies.json' 2026-01-13T10:37:33,160 adding 'unitxt/catalog/cards/global_mmlu/hi/sociology.json' 2026-01-13T10:37:33,161 adding 'unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json' 2026-01-13T10:37:33,162 adding 'unitxt/catalog/cards/global_mmlu/hi/virology.json' 2026-01-13T10:37:33,164 adding 'unitxt/catalog/cards/global_mmlu/hi/world_religions.json' 2026-01-13T10:37:33,166 adding 'unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json' 2026-01-13T10:37:33,168 adding 'unitxt/catalog/cards/global_mmlu/id/anatomy.json' 2026-01-13T10:37:33,169 adding 'unitxt/catalog/cards/global_mmlu/id/astronomy.json' 2026-01-13T10:37:33,170 adding 'unitxt/catalog/cards/global_mmlu/id/business_ethics.json' 2026-01-13T10:37:33,172 adding 'unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json' 2026-01-13T10:37:33,173 adding 'unitxt/catalog/cards/global_mmlu/id/college_biology.json' 2026-01-13T10:37:33,174 adding 'unitxt/catalog/cards/global_mmlu/id/college_chemistry.json' 2026-01-13T10:37:33,176 adding 'unitxt/catalog/cards/global_mmlu/id/college_computer_science.json' 2026-01-13T10:37:33,177 adding 'unitxt/catalog/cards/global_mmlu/id/college_mathematics.json' 2026-01-13T10:37:33,178 adding 'unitxt/catalog/cards/global_mmlu/id/college_medicine.json' 2026-01-13T10:37:33,179 adding 'unitxt/catalog/cards/global_mmlu/id/college_physics.json' 2026-01-13T10:37:33,181 adding 'unitxt/catalog/cards/global_mmlu/id/computer_security.json' 2026-01-13T10:37:33,182 adding 'unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json' 2026-01-13T10:37:33,183 adding 'unitxt/catalog/cards/global_mmlu/id/econometrics.json' 2026-01-13T10:37:33,185 adding 'unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json' 2026-01-13T10:37:33,186 adding 'unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json' 2026-01-13T10:37:33,188 adding 'unitxt/catalog/cards/global_mmlu/id/formal_logic.json' 2026-01-13T10:37:33,189 adding 'unitxt/catalog/cards/global_mmlu/id/global_facts.json' 2026-01-13T10:37:33,190 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_biology.json' 2026-01-13T10:37:33,191 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json' 2026-01-13T10:37:33,193 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json' 2026-01-13T10:37:33,194 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json' 2026-01-13T10:37:33,195 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_geography.json' 2026-01-13T10:37:33,197 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json' 2026-01-13T10:37:33,198 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json' 2026-01-13T10:37:33,199 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json' 2026-01-13T10:37:33,201 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json' 2026-01-13T10:37:33,202 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_physics.json' 2026-01-13T10:37:33,203 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json' 2026-01-13T10:37:33,205 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json' 2026-01-13T10:37:33,206 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json' 2026-01-13T10:37:33,207 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json' 2026-01-13T10:37:33,208 adding 'unitxt/catalog/cards/global_mmlu/id/human_aging.json' 2026-01-13T10:37:33,210 adding 'unitxt/catalog/cards/global_mmlu/id/human_sexuality.json' 2026-01-13T10:37:33,211 adding 'unitxt/catalog/cards/global_mmlu/id/international_law.json' 2026-01-13T10:37:33,212 adding 'unitxt/catalog/cards/global_mmlu/id/jurisprudence.json' 2026-01-13T10:37:33,213 adding 'unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json' 2026-01-13T10:37:33,215 adding 'unitxt/catalog/cards/global_mmlu/id/machine_learning.json' 2026-01-13T10:37:33,216 adding 'unitxt/catalog/cards/global_mmlu/id/management.json' 2026-01-13T10:37:33,217 adding 'unitxt/catalog/cards/global_mmlu/id/marketing.json' 2026-01-13T10:37:33,219 adding 'unitxt/catalog/cards/global_mmlu/id/medical_genetics.json' 2026-01-13T10:37:33,220 adding 'unitxt/catalog/cards/global_mmlu/id/miscellaneous.json' 2026-01-13T10:37:33,221 adding 'unitxt/catalog/cards/global_mmlu/id/moral_disputes.json' 2026-01-13T10:37:33,222 adding 'unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json' 2026-01-13T10:37:33,224 adding 'unitxt/catalog/cards/global_mmlu/id/nutrition.json' 2026-01-13T10:37:33,225 adding 'unitxt/catalog/cards/global_mmlu/id/philosophy.json' 2026-01-13T10:37:33,226 adding 'unitxt/catalog/cards/global_mmlu/id/prehistory.json' 2026-01-13T10:37:33,228 adding 'unitxt/catalog/cards/global_mmlu/id/professional_accounting.json' 2026-01-13T10:37:33,229 adding 'unitxt/catalog/cards/global_mmlu/id/professional_law.json' 2026-01-13T10:37:33,230 adding 'unitxt/catalog/cards/global_mmlu/id/professional_medicine.json' 2026-01-13T10:37:33,231 adding 'unitxt/catalog/cards/global_mmlu/id/professional_psychology.json' 2026-01-13T10:37:33,233 adding 'unitxt/catalog/cards/global_mmlu/id/public_relations.json' 2026-01-13T10:37:33,234 adding 'unitxt/catalog/cards/global_mmlu/id/security_studies.json' 2026-01-13T10:37:33,235 adding 'unitxt/catalog/cards/global_mmlu/id/sociology.json' 2026-01-13T10:37:33,237 adding 'unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json' 2026-01-13T10:37:33,238 adding 'unitxt/catalog/cards/global_mmlu/id/virology.json' 2026-01-13T10:37:33,239 adding 'unitxt/catalog/cards/global_mmlu/id/world_religions.json' 2026-01-13T10:37:33,242 adding 'unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json' 2026-01-13T10:37:33,243 adding 'unitxt/catalog/cards/global_mmlu/ig/anatomy.json' 2026-01-13T10:37:33,245 adding 'unitxt/catalog/cards/global_mmlu/ig/astronomy.json' 2026-01-13T10:37:33,246 adding 'unitxt/catalog/cards/global_mmlu/ig/business_ethics.json' 2026-01-13T10:37:33,247 adding 'unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json' 2026-01-13T10:37:33,249 adding 'unitxt/catalog/cards/global_mmlu/ig/college_biology.json' 2026-01-13T10:37:33,250 adding 'unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json' 2026-01-13T10:37:33,251 adding 'unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json' 2026-01-13T10:37:33,253 adding 'unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json' 2026-01-13T10:37:33,254 adding 'unitxt/catalog/cards/global_mmlu/ig/college_medicine.json' 2026-01-13T10:37:33,255 adding 'unitxt/catalog/cards/global_mmlu/ig/college_physics.json' 2026-01-13T10:37:33,257 adding 'unitxt/catalog/cards/global_mmlu/ig/computer_security.json' 2026-01-13T10:37:33,258 adding 'unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json' 2026-01-13T10:37:33,259 adding 'unitxt/catalog/cards/global_mmlu/ig/econometrics.json' 2026-01-13T10:37:33,261 adding 'unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json' 2026-01-13T10:37:33,262 adding 'unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json' 2026-01-13T10:37:33,263 adding 'unitxt/catalog/cards/global_mmlu/ig/formal_logic.json' 2026-01-13T10:37:33,264 adding 'unitxt/catalog/cards/global_mmlu/ig/global_facts.json' 2026-01-13T10:37:33,265 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json' 2026-01-13T10:37:33,267 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json' 2026-01-13T10:37:33,268 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json' 2026-01-13T10:37:33,269 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json' 2026-01-13T10:37:33,270 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json' 2026-01-13T10:37:33,272 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json' 2026-01-13T10:37:33,273 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json' 2026-01-13T10:37:33,274 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json' 2026-01-13T10:37:33,276 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json' 2026-01-13T10:37:33,277 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json' 2026-01-13T10:37:33,278 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json' 2026-01-13T10:37:33,279 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json' 2026-01-13T10:37:33,281 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json' 2026-01-13T10:37:33,282 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json' 2026-01-13T10:37:33,283 adding 'unitxt/catalog/cards/global_mmlu/ig/human_aging.json' 2026-01-13T10:37:33,285 adding 'unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json' 2026-01-13T10:37:33,286 adding 'unitxt/catalog/cards/global_mmlu/ig/international_law.json' 2026-01-13T10:37:33,287 adding 'unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json' 2026-01-13T10:37:33,289 adding 'unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json' 2026-01-13T10:37:33,290 adding 'unitxt/catalog/cards/global_mmlu/ig/machine_learning.json' 2026-01-13T10:37:33,292 adding 'unitxt/catalog/cards/global_mmlu/ig/management.json' 2026-01-13T10:37:33,293 adding 'unitxt/catalog/cards/global_mmlu/ig/marketing.json' 2026-01-13T10:37:33,294 adding 'unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json' 2026-01-13T10:37:33,296 adding 'unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json' 2026-01-13T10:37:33,297 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json' 2026-01-13T10:37:33,298 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json' 2026-01-13T10:37:33,300 adding 'unitxt/catalog/cards/global_mmlu/ig/nutrition.json' 2026-01-13T10:37:33,301 adding 'unitxt/catalog/cards/global_mmlu/ig/philosophy.json' 2026-01-13T10:37:33,302 adding 'unitxt/catalog/cards/global_mmlu/ig/prehistory.json' 2026-01-13T10:37:33,304 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json' 2026-01-13T10:37:33,305 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_law.json' 2026-01-13T10:37:33,307 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json' 2026-01-13T10:37:33,308 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json' 2026-01-13T10:37:33,310 adding 'unitxt/catalog/cards/global_mmlu/ig/public_relations.json' 2026-01-13T10:37:33,311 adding 'unitxt/catalog/cards/global_mmlu/ig/security_studies.json' 2026-01-13T10:37:33,313 adding 'unitxt/catalog/cards/global_mmlu/ig/sociology.json' 2026-01-13T10:37:33,314 adding 'unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json' 2026-01-13T10:37:33,316 adding 'unitxt/catalog/cards/global_mmlu/ig/virology.json' 2026-01-13T10:37:33,317 adding 'unitxt/catalog/cards/global_mmlu/ig/world_religions.json' 2026-01-13T10:37:33,320 adding 'unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json' 2026-01-13T10:37:33,321 adding 'unitxt/catalog/cards/global_mmlu/it/anatomy.json' 2026-01-13T10:37:33,323 adding 'unitxt/catalog/cards/global_mmlu/it/astronomy.json' 2026-01-13T10:37:33,324 adding 'unitxt/catalog/cards/global_mmlu/it/business_ethics.json' 2026-01-13T10:37:33,325 adding 'unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json' 2026-01-13T10:37:33,327 adding 'unitxt/catalog/cards/global_mmlu/it/college_biology.json' 2026-01-13T10:37:33,328 adding 'unitxt/catalog/cards/global_mmlu/it/college_chemistry.json' 2026-01-13T10:37:33,329 adding 'unitxt/catalog/cards/global_mmlu/it/college_computer_science.json' 2026-01-13T10:37:33,331 adding 'unitxt/catalog/cards/global_mmlu/it/college_mathematics.json' 2026-01-13T10:37:33,332 adding 'unitxt/catalog/cards/global_mmlu/it/college_medicine.json' 2026-01-13T10:37:33,333 adding 'unitxt/catalog/cards/global_mmlu/it/college_physics.json' 2026-01-13T10:37:33,334 adding 'unitxt/catalog/cards/global_mmlu/it/computer_security.json' 2026-01-13T10:37:33,336 adding 'unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json' 2026-01-13T10:37:33,337 adding 'unitxt/catalog/cards/global_mmlu/it/econometrics.json' 2026-01-13T10:37:33,339 adding 'unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json' 2026-01-13T10:37:33,340 adding 'unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json' 2026-01-13T10:37:33,342 adding 'unitxt/catalog/cards/global_mmlu/it/formal_logic.json' 2026-01-13T10:37:33,343 adding 'unitxt/catalog/cards/global_mmlu/it/global_facts.json' 2026-01-13T10:37:33,344 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_biology.json' 2026-01-13T10:37:33,346 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json' 2026-01-13T10:37:33,347 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json' 2026-01-13T10:37:33,348 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json' 2026-01-13T10:37:33,350 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_geography.json' 2026-01-13T10:37:33,351 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json' 2026-01-13T10:37:33,352 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json' 2026-01-13T10:37:33,354 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json' 2026-01-13T10:37:33,355 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json' 2026-01-13T10:37:33,357 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_physics.json' 2026-01-13T10:37:33,358 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json' 2026-01-13T10:37:33,359 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json' 2026-01-13T10:37:33,361 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json' 2026-01-13T10:37:33,362 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json' 2026-01-13T10:37:33,364 adding 'unitxt/catalog/cards/global_mmlu/it/human_aging.json' 2026-01-13T10:37:33,365 adding 'unitxt/catalog/cards/global_mmlu/it/human_sexuality.json' 2026-01-13T10:37:33,366 adding 'unitxt/catalog/cards/global_mmlu/it/international_law.json' 2026-01-13T10:37:33,368 adding 'unitxt/catalog/cards/global_mmlu/it/jurisprudence.json' 2026-01-13T10:37:33,369 adding 'unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json' 2026-01-13T10:37:33,371 adding 'unitxt/catalog/cards/global_mmlu/it/machine_learning.json' 2026-01-13T10:37:33,372 adding 'unitxt/catalog/cards/global_mmlu/it/management.json' 2026-01-13T10:37:33,373 adding 'unitxt/catalog/cards/global_mmlu/it/marketing.json' 2026-01-13T10:37:33,375 adding 'unitxt/catalog/cards/global_mmlu/it/medical_genetics.json' 2026-01-13T10:37:33,376 adding 'unitxt/catalog/cards/global_mmlu/it/miscellaneous.json' 2026-01-13T10:37:33,377 adding 'unitxt/catalog/cards/global_mmlu/it/moral_disputes.json' 2026-01-13T10:37:33,379 adding 'unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json' 2026-01-13T10:37:33,380 adding 'unitxt/catalog/cards/global_mmlu/it/nutrition.json' 2026-01-13T10:37:33,381 adding 'unitxt/catalog/cards/global_mmlu/it/philosophy.json' 2026-01-13T10:37:33,382 adding 'unitxt/catalog/cards/global_mmlu/it/prehistory.json' 2026-01-13T10:37:33,383 adding 'unitxt/catalog/cards/global_mmlu/it/professional_accounting.json' 2026-01-13T10:37:33,385 adding 'unitxt/catalog/cards/global_mmlu/it/professional_law.json' 2026-01-13T10:37:33,386 adding 'unitxt/catalog/cards/global_mmlu/it/professional_medicine.json' 2026-01-13T10:37:33,387 adding 'unitxt/catalog/cards/global_mmlu/it/professional_psychology.json' 2026-01-13T10:37:33,388 adding 'unitxt/catalog/cards/global_mmlu/it/public_relations.json' 2026-01-13T10:37:33,390 adding 'unitxt/catalog/cards/global_mmlu/it/security_studies.json' 2026-01-13T10:37:33,391 adding 'unitxt/catalog/cards/global_mmlu/it/sociology.json' 2026-01-13T10:37:33,392 adding 'unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json' 2026-01-13T10:37:33,393 adding 'unitxt/catalog/cards/global_mmlu/it/virology.json' 2026-01-13T10:37:33,395 adding 'unitxt/catalog/cards/global_mmlu/it/world_religions.json' 2026-01-13T10:37:33,397 adding 'unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json' 2026-01-13T10:37:33,399 adding 'unitxt/catalog/cards/global_mmlu/ja/anatomy.json' 2026-01-13T10:37:33,400 adding 'unitxt/catalog/cards/global_mmlu/ja/astronomy.json' 2026-01-13T10:37:33,401 adding 'unitxt/catalog/cards/global_mmlu/ja/business_ethics.json' 2026-01-13T10:37:33,402 adding 'unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json' 2026-01-13T10:37:33,404 adding 'unitxt/catalog/cards/global_mmlu/ja/college_biology.json' 2026-01-13T10:37:33,405 adding 'unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json' 2026-01-13T10:37:33,406 adding 'unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json' 2026-01-13T10:37:33,408 adding 'unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json' 2026-01-13T10:37:33,409 adding 'unitxt/catalog/cards/global_mmlu/ja/college_medicine.json' 2026-01-13T10:37:33,410 adding 'unitxt/catalog/cards/global_mmlu/ja/college_physics.json' 2026-01-13T10:37:33,412 adding 'unitxt/catalog/cards/global_mmlu/ja/computer_security.json' 2026-01-13T10:37:33,413 adding 'unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json' 2026-01-13T10:37:33,414 adding 'unitxt/catalog/cards/global_mmlu/ja/econometrics.json' 2026-01-13T10:37:33,416 adding 'unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json' 2026-01-13T10:37:33,417 adding 'unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json' 2026-01-13T10:37:33,419 adding 'unitxt/catalog/cards/global_mmlu/ja/formal_logic.json' 2026-01-13T10:37:33,420 adding 'unitxt/catalog/cards/global_mmlu/ja/global_facts.json' 2026-01-13T10:37:33,421 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json' 2026-01-13T10:37:33,422 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json' 2026-01-13T10:37:33,424 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json' 2026-01-13T10:37:33,425 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json' 2026-01-13T10:37:33,426 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json' 2026-01-13T10:37:33,428 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json' 2026-01-13T10:37:33,429 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json' 2026-01-13T10:37:33,430 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json' 2026-01-13T10:37:33,432 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json' 2026-01-13T10:37:33,433 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json' 2026-01-13T10:37:33,434 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json' 2026-01-13T10:37:33,436 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json' 2026-01-13T10:37:33,437 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json' 2026-01-13T10:37:33,438 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json' 2026-01-13T10:37:33,440 adding 'unitxt/catalog/cards/global_mmlu/ja/human_aging.json' 2026-01-13T10:37:33,441 adding 'unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json' 2026-01-13T10:37:33,442 adding 'unitxt/catalog/cards/global_mmlu/ja/international_law.json' 2026-01-13T10:37:33,444 adding 'unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json' 2026-01-13T10:37:33,445 adding 'unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json' 2026-01-13T10:37:33,446 adding 'unitxt/catalog/cards/global_mmlu/ja/machine_learning.json' 2026-01-13T10:37:33,448 adding 'unitxt/catalog/cards/global_mmlu/ja/management.json' 2026-01-13T10:37:33,449 adding 'unitxt/catalog/cards/global_mmlu/ja/marketing.json' 2026-01-13T10:37:33,451 adding 'unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json' 2026-01-13T10:37:33,452 adding 'unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json' 2026-01-13T10:37:33,453 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json' 2026-01-13T10:37:33,455 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json' 2026-01-13T10:37:33,456 adding 'unitxt/catalog/cards/global_mmlu/ja/nutrition.json' 2026-01-13T10:37:33,457 adding 'unitxt/catalog/cards/global_mmlu/ja/philosophy.json' 2026-01-13T10:37:33,459 adding 'unitxt/catalog/cards/global_mmlu/ja/prehistory.json' 2026-01-13T10:37:33,460 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json' 2026-01-13T10:37:33,461 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_law.json' 2026-01-13T10:37:33,463 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json' 2026-01-13T10:37:33,464 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json' 2026-01-13T10:37:33,465 adding 'unitxt/catalog/cards/global_mmlu/ja/public_relations.json' 2026-01-13T10:37:33,467 adding 'unitxt/catalog/cards/global_mmlu/ja/security_studies.json' 2026-01-13T10:37:33,468 adding 'unitxt/catalog/cards/global_mmlu/ja/sociology.json' 2026-01-13T10:37:33,469 adding 'unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json' 2026-01-13T10:37:33,471 adding 'unitxt/catalog/cards/global_mmlu/ja/virology.json' 2026-01-13T10:37:33,472 adding 'unitxt/catalog/cards/global_mmlu/ja/world_religions.json' 2026-01-13T10:37:33,475 adding 'unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json' 2026-01-13T10:37:33,476 adding 'unitxt/catalog/cards/global_mmlu/ko/anatomy.json' 2026-01-13T10:37:33,477 adding 'unitxt/catalog/cards/global_mmlu/ko/astronomy.json' 2026-01-13T10:37:33,479 adding 'unitxt/catalog/cards/global_mmlu/ko/business_ethics.json' 2026-01-13T10:37:33,480 adding 'unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json' 2026-01-13T10:37:33,481 adding 'unitxt/catalog/cards/global_mmlu/ko/college_biology.json' 2026-01-13T10:37:33,483 adding 'unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json' 2026-01-13T10:37:33,484 adding 'unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json' 2026-01-13T10:37:33,485 adding 'unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json' 2026-01-13T10:37:33,487 adding 'unitxt/catalog/cards/global_mmlu/ko/college_medicine.json' 2026-01-13T10:37:33,488 adding 'unitxt/catalog/cards/global_mmlu/ko/college_physics.json' 2026-01-13T10:37:33,489 adding 'unitxt/catalog/cards/global_mmlu/ko/computer_security.json' 2026-01-13T10:37:33,491 adding 'unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json' 2026-01-13T10:37:33,492 adding 'unitxt/catalog/cards/global_mmlu/ko/econometrics.json' 2026-01-13T10:37:33,494 adding 'unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json' 2026-01-13T10:37:33,495 adding 'unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json' 2026-01-13T10:37:33,496 adding 'unitxt/catalog/cards/global_mmlu/ko/formal_logic.json' 2026-01-13T10:37:33,498 adding 'unitxt/catalog/cards/global_mmlu/ko/global_facts.json' 2026-01-13T10:37:33,499 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json' 2026-01-13T10:37:33,500 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json' 2026-01-13T10:37:33,501 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json' 2026-01-13T10:37:33,503 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json' 2026-01-13T10:37:33,504 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json' 2026-01-13T10:37:33,505 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json' 2026-01-13T10:37:33,507 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json' 2026-01-13T10:37:33,508 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json' 2026-01-13T10:37:33,509 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json' 2026-01-13T10:37:33,511 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json' 2026-01-13T10:37:33,512 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json' 2026-01-13T10:37:33,513 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json' 2026-01-13T10:37:33,515 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json' 2026-01-13T10:37:33,516 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json' 2026-01-13T10:37:33,517 adding 'unitxt/catalog/cards/global_mmlu/ko/human_aging.json' 2026-01-13T10:37:33,519 adding 'unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json' 2026-01-13T10:37:33,520 adding 'unitxt/catalog/cards/global_mmlu/ko/international_law.json' 2026-01-13T10:37:33,521 adding 'unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json' 2026-01-13T10:37:33,523 adding 'unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json' 2026-01-13T10:37:33,524 adding 'unitxt/catalog/cards/global_mmlu/ko/machine_learning.json' 2026-01-13T10:37:33,525 adding 'unitxt/catalog/cards/global_mmlu/ko/management.json' 2026-01-13T10:37:33,527 adding 'unitxt/catalog/cards/global_mmlu/ko/marketing.json' 2026-01-13T10:37:33,528 adding 'unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json' 2026-01-13T10:37:33,529 adding 'unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json' 2026-01-13T10:37:33,531 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json' 2026-01-13T10:37:33,532 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json' 2026-01-13T10:37:33,533 adding 'unitxt/catalog/cards/global_mmlu/ko/nutrition.json' 2026-01-13T10:37:33,535 adding 'unitxt/catalog/cards/global_mmlu/ko/philosophy.json' 2026-01-13T10:37:33,536 adding 'unitxt/catalog/cards/global_mmlu/ko/prehistory.json' 2026-01-13T10:37:33,537 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json' 2026-01-13T10:37:33,539 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_law.json' 2026-01-13T10:37:33,540 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json' 2026-01-13T10:37:33,541 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json' 2026-01-13T10:37:33,543 adding 'unitxt/catalog/cards/global_mmlu/ko/public_relations.json' 2026-01-13T10:37:33,544 adding 'unitxt/catalog/cards/global_mmlu/ko/security_studies.json' 2026-01-13T10:37:33,545 adding 'unitxt/catalog/cards/global_mmlu/ko/sociology.json' 2026-01-13T10:37:33,547 adding 'unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json' 2026-01-13T10:37:33,548 adding 'unitxt/catalog/cards/global_mmlu/ko/virology.json' 2026-01-13T10:37:33,549 adding 'unitxt/catalog/cards/global_mmlu/ko/world_religions.json' 2026-01-13T10:37:33,552 adding 'unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json' 2026-01-13T10:37:33,553 adding 'unitxt/catalog/cards/global_mmlu/ky/anatomy.json' 2026-01-13T10:37:33,555 adding 'unitxt/catalog/cards/global_mmlu/ky/astronomy.json' 2026-01-13T10:37:33,556 adding 'unitxt/catalog/cards/global_mmlu/ky/business_ethics.json' 2026-01-13T10:37:33,557 adding 'unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json' 2026-01-13T10:37:33,559 adding 'unitxt/catalog/cards/global_mmlu/ky/college_biology.json' 2026-01-13T10:37:33,560 adding 'unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json' 2026-01-13T10:37:33,561 adding 'unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json' 2026-01-13T10:37:33,562 adding 'unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json' 2026-01-13T10:37:33,563 adding 'unitxt/catalog/cards/global_mmlu/ky/college_medicine.json' 2026-01-13T10:37:33,565 adding 'unitxt/catalog/cards/global_mmlu/ky/college_physics.json' 2026-01-13T10:37:33,566 adding 'unitxt/catalog/cards/global_mmlu/ky/computer_security.json' 2026-01-13T10:37:33,567 adding 'unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json' 2026-01-13T10:37:33,569 adding 'unitxt/catalog/cards/global_mmlu/ky/econometrics.json' 2026-01-13T10:37:33,570 adding 'unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json' 2026-01-13T10:37:33,571 adding 'unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json' 2026-01-13T10:37:33,573 adding 'unitxt/catalog/cards/global_mmlu/ky/formal_logic.json' 2026-01-13T10:37:33,574 adding 'unitxt/catalog/cards/global_mmlu/ky/global_facts.json' 2026-01-13T10:37:33,575 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json' 2026-01-13T10:37:33,577 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json' 2026-01-13T10:37:33,578 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json' 2026-01-13T10:37:33,579 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json' 2026-01-13T10:37:33,581 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json' 2026-01-13T10:37:33,582 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json' 2026-01-13T10:37:33,583 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json' 2026-01-13T10:37:33,585 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json' 2026-01-13T10:37:33,586 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json' 2026-01-13T10:37:33,587 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json' 2026-01-13T10:37:33,589 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json' 2026-01-13T10:37:33,590 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json' 2026-01-13T10:37:33,591 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json' 2026-01-13T10:37:33,593 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json' 2026-01-13T10:37:33,594 adding 'unitxt/catalog/cards/global_mmlu/ky/human_aging.json' 2026-01-13T10:37:33,595 adding 'unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json' 2026-01-13T10:37:33,596 adding 'unitxt/catalog/cards/global_mmlu/ky/international_law.json' 2026-01-13T10:37:33,598 adding 'unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json' 2026-01-13T10:37:33,599 adding 'unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json' 2026-01-13T10:37:33,600 adding 'unitxt/catalog/cards/global_mmlu/ky/machine_learning.json' 2026-01-13T10:37:33,602 adding 'unitxt/catalog/cards/global_mmlu/ky/management.json' 2026-01-13T10:37:33,603 adding 'unitxt/catalog/cards/global_mmlu/ky/marketing.json' 2026-01-13T10:37:33,605 adding 'unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json' 2026-01-13T10:37:33,606 adding 'unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json' 2026-01-13T10:37:33,608 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json' 2026-01-13T10:37:33,609 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json' 2026-01-13T10:37:33,611 adding 'unitxt/catalog/cards/global_mmlu/ky/nutrition.json' 2026-01-13T10:37:33,612 adding 'unitxt/catalog/cards/global_mmlu/ky/philosophy.json' 2026-01-13T10:37:33,614 adding 'unitxt/catalog/cards/global_mmlu/ky/prehistory.json' 2026-01-13T10:37:33,615 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json' 2026-01-13T10:37:33,616 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_law.json' 2026-01-13T10:37:33,618 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json' 2026-01-13T10:37:33,619 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json' 2026-01-13T10:37:33,620 adding 'unitxt/catalog/cards/global_mmlu/ky/public_relations.json' 2026-01-13T10:37:33,622 adding 'unitxt/catalog/cards/global_mmlu/ky/security_studies.json' 2026-01-13T10:37:33,623 adding 'unitxt/catalog/cards/global_mmlu/ky/sociology.json' 2026-01-13T10:37:33,624 adding 'unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json' 2026-01-13T10:37:33,626 adding 'unitxt/catalog/cards/global_mmlu/ky/virology.json' 2026-01-13T10:37:33,627 adding 'unitxt/catalog/cards/global_mmlu/ky/world_religions.json' 2026-01-13T10:37:33,630 adding 'unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json' 2026-01-13T10:37:33,631 adding 'unitxt/catalog/cards/global_mmlu/lt/anatomy.json' 2026-01-13T10:37:33,632 adding 'unitxt/catalog/cards/global_mmlu/lt/astronomy.json' 2026-01-13T10:37:33,634 adding 'unitxt/catalog/cards/global_mmlu/lt/business_ethics.json' 2026-01-13T10:37:33,635 adding 'unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json' 2026-01-13T10:37:33,636 adding 'unitxt/catalog/cards/global_mmlu/lt/college_biology.json' 2026-01-13T10:37:33,637 adding 'unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json' 2026-01-13T10:37:33,639 adding 'unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json' 2026-01-13T10:37:33,640 adding 'unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json' 2026-01-13T10:37:33,641 adding 'unitxt/catalog/cards/global_mmlu/lt/college_medicine.json' 2026-01-13T10:37:33,643 adding 'unitxt/catalog/cards/global_mmlu/lt/college_physics.json' 2026-01-13T10:37:33,644 adding 'unitxt/catalog/cards/global_mmlu/lt/computer_security.json' 2026-01-13T10:37:33,645 adding 'unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json' 2026-01-13T10:37:33,647 adding 'unitxt/catalog/cards/global_mmlu/lt/econometrics.json' 2026-01-13T10:37:33,648 adding 'unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json' 2026-01-13T10:37:33,649 adding 'unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json' 2026-01-13T10:37:33,651 adding 'unitxt/catalog/cards/global_mmlu/lt/formal_logic.json' 2026-01-13T10:37:33,652 adding 'unitxt/catalog/cards/global_mmlu/lt/global_facts.json' 2026-01-13T10:37:33,653 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json' 2026-01-13T10:37:33,655 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json' 2026-01-13T10:37:33,656 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json' 2026-01-13T10:37:33,658 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json' 2026-01-13T10:37:33,659 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json' 2026-01-13T10:37:33,661 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json' 2026-01-13T10:37:33,662 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json' 2026-01-13T10:37:33,664 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json' 2026-01-13T10:37:33,665 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json' 2026-01-13T10:37:33,667 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json' 2026-01-13T10:37:33,668 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json' 2026-01-13T10:37:33,670 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json' 2026-01-13T10:37:33,671 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json' 2026-01-13T10:37:33,673 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json' 2026-01-13T10:37:33,674 adding 'unitxt/catalog/cards/global_mmlu/lt/human_aging.json' 2026-01-13T10:37:33,676 adding 'unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json' 2026-01-13T10:37:33,677 adding 'unitxt/catalog/cards/global_mmlu/lt/international_law.json' 2026-01-13T10:37:33,678 adding 'unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json' 2026-01-13T10:37:33,680 adding 'unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json' 2026-01-13T10:37:33,681 adding 'unitxt/catalog/cards/global_mmlu/lt/machine_learning.json' 2026-01-13T10:37:33,682 adding 'unitxt/catalog/cards/global_mmlu/lt/management.json' 2026-01-13T10:37:33,683 adding 'unitxt/catalog/cards/global_mmlu/lt/marketing.json' 2026-01-13T10:37:33,685 adding 'unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json' 2026-01-13T10:37:33,686 adding 'unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json' 2026-01-13T10:37:33,687 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json' 2026-01-13T10:37:33,689 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json' 2026-01-13T10:37:33,690 adding 'unitxt/catalog/cards/global_mmlu/lt/nutrition.json' 2026-01-13T10:37:33,691 adding 'unitxt/catalog/cards/global_mmlu/lt/philosophy.json' 2026-01-13T10:37:33,693 adding 'unitxt/catalog/cards/global_mmlu/lt/prehistory.json' 2026-01-13T10:37:33,694 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json' 2026-01-13T10:37:33,695 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_law.json' 2026-01-13T10:37:33,697 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json' 2026-01-13T10:37:33,698 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json' 2026-01-13T10:37:33,699 adding 'unitxt/catalog/cards/global_mmlu/lt/public_relations.json' 2026-01-13T10:37:33,701 adding 'unitxt/catalog/cards/global_mmlu/lt/security_studies.json' 2026-01-13T10:37:33,702 adding 'unitxt/catalog/cards/global_mmlu/lt/sociology.json' 2026-01-13T10:37:33,703 adding 'unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json' 2026-01-13T10:37:33,704 adding 'unitxt/catalog/cards/global_mmlu/lt/virology.json' 2026-01-13T10:37:33,706 adding 'unitxt/catalog/cards/global_mmlu/lt/world_religions.json' 2026-01-13T10:37:33,709 adding 'unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json' 2026-01-13T10:37:33,710 adding 'unitxt/catalog/cards/global_mmlu/mg/anatomy.json' 2026-01-13T10:37:33,711 adding 'unitxt/catalog/cards/global_mmlu/mg/astronomy.json' 2026-01-13T10:37:33,713 adding 'unitxt/catalog/cards/global_mmlu/mg/business_ethics.json' 2026-01-13T10:37:33,714 adding 'unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json' 2026-01-13T10:37:33,715 adding 'unitxt/catalog/cards/global_mmlu/mg/college_biology.json' 2026-01-13T10:37:33,717 adding 'unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json' 2026-01-13T10:37:33,718 adding 'unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json' 2026-01-13T10:37:33,719 adding 'unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json' 2026-01-13T10:37:33,721 adding 'unitxt/catalog/cards/global_mmlu/mg/college_medicine.json' 2026-01-13T10:37:33,722 adding 'unitxt/catalog/cards/global_mmlu/mg/college_physics.json' 2026-01-13T10:37:33,723 adding 'unitxt/catalog/cards/global_mmlu/mg/computer_security.json' 2026-01-13T10:37:33,725 adding 'unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json' 2026-01-13T10:37:33,726 adding 'unitxt/catalog/cards/global_mmlu/mg/econometrics.json' 2026-01-13T10:37:33,728 adding 'unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json' 2026-01-13T10:37:33,729 adding 'unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json' 2026-01-13T10:37:33,731 adding 'unitxt/catalog/cards/global_mmlu/mg/formal_logic.json' 2026-01-13T10:37:33,732 adding 'unitxt/catalog/cards/global_mmlu/mg/global_facts.json' 2026-01-13T10:37:33,733 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json' 2026-01-13T10:37:33,735 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json' 2026-01-13T10:37:33,736 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json' 2026-01-13T10:37:33,737 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json' 2026-01-13T10:37:33,739 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json' 2026-01-13T10:37:33,740 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json' 2026-01-13T10:37:33,741 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json' 2026-01-13T10:37:33,743 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json' 2026-01-13T10:37:33,744 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json' 2026-01-13T10:37:33,745 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json' 2026-01-13T10:37:33,746 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json' 2026-01-13T10:37:33,748 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json' 2026-01-13T10:37:33,749 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json' 2026-01-13T10:37:33,750 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json' 2026-01-13T10:37:33,752 adding 'unitxt/catalog/cards/global_mmlu/mg/human_aging.json' 2026-01-13T10:37:33,753 adding 'unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json' 2026-01-13T10:37:33,754 adding 'unitxt/catalog/cards/global_mmlu/mg/international_law.json' 2026-01-13T10:37:33,756 adding 'unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json' 2026-01-13T10:37:33,757 adding 'unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json' 2026-01-13T10:37:33,758 adding 'unitxt/catalog/cards/global_mmlu/mg/machine_learning.json' 2026-01-13T10:37:33,760 adding 'unitxt/catalog/cards/global_mmlu/mg/management.json' 2026-01-13T10:37:33,761 adding 'unitxt/catalog/cards/global_mmlu/mg/marketing.json' 2026-01-13T10:37:33,762 adding 'unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json' 2026-01-13T10:37:33,764 adding 'unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json' 2026-01-13T10:37:33,765 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json' 2026-01-13T10:37:33,766 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json' 2026-01-13T10:37:33,768 adding 'unitxt/catalog/cards/global_mmlu/mg/nutrition.json' 2026-01-13T10:37:33,769 adding 'unitxt/catalog/cards/global_mmlu/mg/philosophy.json' 2026-01-13T10:37:33,770 adding 'unitxt/catalog/cards/global_mmlu/mg/prehistory.json' 2026-01-13T10:37:33,771 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json' 2026-01-13T10:37:33,773 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_law.json' 2026-01-13T10:37:33,774 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json' 2026-01-13T10:37:33,776 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json' 2026-01-13T10:37:33,777 adding 'unitxt/catalog/cards/global_mmlu/mg/public_relations.json' 2026-01-13T10:37:33,779 adding 'unitxt/catalog/cards/global_mmlu/mg/security_studies.json' 2026-01-13T10:37:33,780 adding 'unitxt/catalog/cards/global_mmlu/mg/sociology.json' 2026-01-13T10:37:33,781 adding 'unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json' 2026-01-13T10:37:33,783 adding 'unitxt/catalog/cards/global_mmlu/mg/virology.json' 2026-01-13T10:37:33,784 adding 'unitxt/catalog/cards/global_mmlu/mg/world_religions.json' 2026-01-13T10:37:33,787 adding 'unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json' 2026-01-13T10:37:33,789 adding 'unitxt/catalog/cards/global_mmlu/ms/anatomy.json' 2026-01-13T10:37:33,790 adding 'unitxt/catalog/cards/global_mmlu/ms/astronomy.json' 2026-01-13T10:37:33,792 adding 'unitxt/catalog/cards/global_mmlu/ms/business_ethics.json' 2026-01-13T10:37:33,793 adding 'unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json' 2026-01-13T10:37:33,795 adding 'unitxt/catalog/cards/global_mmlu/ms/college_biology.json' 2026-01-13T10:37:33,796 adding 'unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json' 2026-01-13T10:37:33,797 adding 'unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json' 2026-01-13T10:37:33,799 adding 'unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json' 2026-01-13T10:37:33,800 adding 'unitxt/catalog/cards/global_mmlu/ms/college_medicine.json' 2026-01-13T10:37:33,801 adding 'unitxt/catalog/cards/global_mmlu/ms/college_physics.json' 2026-01-13T10:37:33,803 adding 'unitxt/catalog/cards/global_mmlu/ms/computer_security.json' 2026-01-13T10:37:33,804 adding 'unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json' 2026-01-13T10:37:33,805 adding 'unitxt/catalog/cards/global_mmlu/ms/econometrics.json' 2026-01-13T10:37:33,807 adding 'unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json' 2026-01-13T10:37:33,808 adding 'unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json' 2026-01-13T10:37:33,809 adding 'unitxt/catalog/cards/global_mmlu/ms/formal_logic.json' 2026-01-13T10:37:33,811 adding 'unitxt/catalog/cards/global_mmlu/ms/global_facts.json' 2026-01-13T10:37:33,812 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json' 2026-01-13T10:37:33,813 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json' 2026-01-13T10:37:33,814 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json' 2026-01-13T10:37:33,816 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json' 2026-01-13T10:37:33,817 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json' 2026-01-13T10:37:33,818 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json' 2026-01-13T10:37:33,820 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json' 2026-01-13T10:37:33,821 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json' 2026-01-13T10:37:33,822 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json' 2026-01-13T10:37:33,824 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json' 2026-01-13T10:37:33,825 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json' 2026-01-13T10:37:33,826 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json' 2026-01-13T10:37:33,828 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json' 2026-01-13T10:37:33,829 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json' 2026-01-13T10:37:33,830 adding 'unitxt/catalog/cards/global_mmlu/ms/human_aging.json' 2026-01-13T10:37:33,832 adding 'unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json' 2026-01-13T10:37:33,833 adding 'unitxt/catalog/cards/global_mmlu/ms/international_law.json' 2026-01-13T10:37:33,834 adding 'unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json' 2026-01-13T10:37:33,836 adding 'unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json' 2026-01-13T10:37:33,837 adding 'unitxt/catalog/cards/global_mmlu/ms/machine_learning.json' 2026-01-13T10:37:33,838 adding 'unitxt/catalog/cards/global_mmlu/ms/management.json' 2026-01-13T10:37:33,840 adding 'unitxt/catalog/cards/global_mmlu/ms/marketing.json' 2026-01-13T10:37:33,841 adding 'unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json' 2026-01-13T10:37:33,842 adding 'unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json' 2026-01-13T10:37:33,844 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json' 2026-01-13T10:37:33,845 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json' 2026-01-13T10:37:33,846 adding 'unitxt/catalog/cards/global_mmlu/ms/nutrition.json' 2026-01-13T10:37:33,848 adding 'unitxt/catalog/cards/global_mmlu/ms/philosophy.json' 2026-01-13T10:37:33,849 adding 'unitxt/catalog/cards/global_mmlu/ms/prehistory.json' 2026-01-13T10:37:33,850 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json' 2026-01-13T10:37:33,851 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_law.json' 2026-01-13T10:37:33,853 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json' 2026-01-13T10:37:33,854 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json' 2026-01-13T10:37:33,855 adding 'unitxt/catalog/cards/global_mmlu/ms/public_relations.json' 2026-01-13T10:37:33,856 adding 'unitxt/catalog/cards/global_mmlu/ms/security_studies.json' 2026-01-13T10:37:33,858 adding 'unitxt/catalog/cards/global_mmlu/ms/sociology.json' 2026-01-13T10:37:33,859 adding 'unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json' 2026-01-13T10:37:33,860 adding 'unitxt/catalog/cards/global_mmlu/ms/virology.json' 2026-01-13T10:37:33,862 adding 'unitxt/catalog/cards/global_mmlu/ms/world_religions.json' 2026-01-13T10:37:33,864 adding 'unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json' 2026-01-13T10:37:33,866 adding 'unitxt/catalog/cards/global_mmlu/ne/anatomy.json' 2026-01-13T10:37:33,867 adding 'unitxt/catalog/cards/global_mmlu/ne/astronomy.json' 2026-01-13T10:37:33,868 adding 'unitxt/catalog/cards/global_mmlu/ne/business_ethics.json' 2026-01-13T10:37:33,870 adding 'unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json' 2026-01-13T10:37:33,871 adding 'unitxt/catalog/cards/global_mmlu/ne/college_biology.json' 2026-01-13T10:37:33,872 adding 'unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json' 2026-01-13T10:37:33,873 adding 'unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json' 2026-01-13T10:37:33,875 adding 'unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json' 2026-01-13T10:37:33,876 adding 'unitxt/catalog/cards/global_mmlu/ne/college_medicine.json' 2026-01-13T10:37:33,877 adding 'unitxt/catalog/cards/global_mmlu/ne/college_physics.json' 2026-01-13T10:37:33,879 adding 'unitxt/catalog/cards/global_mmlu/ne/computer_security.json' 2026-01-13T10:37:33,880 adding 'unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json' 2026-01-13T10:37:33,881 adding 'unitxt/catalog/cards/global_mmlu/ne/econometrics.json' 2026-01-13T10:37:33,882 adding 'unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json' 2026-01-13T10:37:33,884 adding 'unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json' 2026-01-13T10:37:33,885 adding 'unitxt/catalog/cards/global_mmlu/ne/formal_logic.json' 2026-01-13T10:37:33,886 adding 'unitxt/catalog/cards/global_mmlu/ne/global_facts.json' 2026-01-13T10:37:33,888 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json' 2026-01-13T10:37:33,889 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json' 2026-01-13T10:37:33,890 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json' 2026-01-13T10:37:33,892 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json' 2026-01-13T10:37:33,893 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json' 2026-01-13T10:37:33,894 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json' 2026-01-13T10:37:33,896 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json' 2026-01-13T10:37:33,897 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json' 2026-01-13T10:37:33,899 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json' 2026-01-13T10:37:33,900 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json' 2026-01-13T10:37:33,901 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json' 2026-01-13T10:37:33,903 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json' 2026-01-13T10:37:33,904 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json' 2026-01-13T10:37:33,905 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json' 2026-01-13T10:37:33,907 adding 'unitxt/catalog/cards/global_mmlu/ne/human_aging.json' 2026-01-13T10:37:33,908 adding 'unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json' 2026-01-13T10:37:33,909 adding 'unitxt/catalog/cards/global_mmlu/ne/international_law.json' 2026-01-13T10:37:33,911 adding 'unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json' 2026-01-13T10:37:33,912 adding 'unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json' 2026-01-13T10:37:33,913 adding 'unitxt/catalog/cards/global_mmlu/ne/machine_learning.json' 2026-01-13T10:37:33,915 adding 'unitxt/catalog/cards/global_mmlu/ne/management.json' 2026-01-13T10:37:33,916 adding 'unitxt/catalog/cards/global_mmlu/ne/marketing.json' 2026-01-13T10:37:33,917 adding 'unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json' 2026-01-13T10:37:33,919 adding 'unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json' 2026-01-13T10:37:33,920 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json' 2026-01-13T10:37:33,922 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json' 2026-01-13T10:37:33,923 adding 'unitxt/catalog/cards/global_mmlu/ne/nutrition.json' 2026-01-13T10:37:33,924 adding 'unitxt/catalog/cards/global_mmlu/ne/philosophy.json' 2026-01-13T10:37:33,926 adding 'unitxt/catalog/cards/global_mmlu/ne/prehistory.json' 2026-01-13T10:37:33,927 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json' 2026-01-13T10:37:33,928 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_law.json' 2026-01-13T10:37:33,930 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json' 2026-01-13T10:37:33,931 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json' 2026-01-13T10:37:33,932 adding 'unitxt/catalog/cards/global_mmlu/ne/public_relations.json' 2026-01-13T10:37:33,934 adding 'unitxt/catalog/cards/global_mmlu/ne/security_studies.json' 2026-01-13T10:37:33,935 adding 'unitxt/catalog/cards/global_mmlu/ne/sociology.json' 2026-01-13T10:37:33,936 adding 'unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json' 2026-01-13T10:37:33,938 adding 'unitxt/catalog/cards/global_mmlu/ne/virology.json' 2026-01-13T10:37:33,939 adding 'unitxt/catalog/cards/global_mmlu/ne/world_religions.json' 2026-01-13T10:37:33,942 adding 'unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json' 2026-01-13T10:37:33,943 adding 'unitxt/catalog/cards/global_mmlu/nl/anatomy.json' 2026-01-13T10:37:33,945 adding 'unitxt/catalog/cards/global_mmlu/nl/astronomy.json' 2026-01-13T10:37:33,946 adding 'unitxt/catalog/cards/global_mmlu/nl/business_ethics.json' 2026-01-13T10:37:33,947 adding 'unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json' 2026-01-13T10:37:33,949 adding 'unitxt/catalog/cards/global_mmlu/nl/college_biology.json' 2026-01-13T10:37:33,950 adding 'unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json' 2026-01-13T10:37:33,951 adding 'unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json' 2026-01-13T10:37:33,953 adding 'unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json' 2026-01-13T10:37:33,954 adding 'unitxt/catalog/cards/global_mmlu/nl/college_medicine.json' 2026-01-13T10:37:33,956 adding 'unitxt/catalog/cards/global_mmlu/nl/college_physics.json' 2026-01-13T10:37:33,957 adding 'unitxt/catalog/cards/global_mmlu/nl/computer_security.json' 2026-01-13T10:37:33,959 adding 'unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json' 2026-01-13T10:37:33,960 adding 'unitxt/catalog/cards/global_mmlu/nl/econometrics.json' 2026-01-13T10:37:33,961 adding 'unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json' 2026-01-13T10:37:33,963 adding 'unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json' 2026-01-13T10:37:33,964 adding 'unitxt/catalog/cards/global_mmlu/nl/formal_logic.json' 2026-01-13T10:37:33,965 adding 'unitxt/catalog/cards/global_mmlu/nl/global_facts.json' 2026-01-13T10:37:33,966 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json' 2026-01-13T10:37:33,968 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json' 2026-01-13T10:37:33,969 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json' 2026-01-13T10:37:33,971 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json' 2026-01-13T10:37:33,972 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json' 2026-01-13T10:37:33,973 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json' 2026-01-13T10:37:33,974 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json' 2026-01-13T10:37:33,976 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json' 2026-01-13T10:37:33,977 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json' 2026-01-13T10:37:33,978 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json' 2026-01-13T10:37:33,979 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json' 2026-01-13T10:37:33,981 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json' 2026-01-13T10:37:33,982 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json' 2026-01-13T10:37:33,983 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json' 2026-01-13T10:37:33,984 adding 'unitxt/catalog/cards/global_mmlu/nl/human_aging.json' 2026-01-13T10:37:33,986 adding 'unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json' 2026-01-13T10:37:33,987 adding 'unitxt/catalog/cards/global_mmlu/nl/international_law.json' 2026-01-13T10:37:33,988 adding 'unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json' 2026-01-13T10:37:33,990 adding 'unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json' 2026-01-13T10:37:33,991 adding 'unitxt/catalog/cards/global_mmlu/nl/machine_learning.json' 2026-01-13T10:37:33,992 adding 'unitxt/catalog/cards/global_mmlu/nl/management.json' 2026-01-13T10:37:33,993 adding 'unitxt/catalog/cards/global_mmlu/nl/marketing.json' 2026-01-13T10:37:33,994 adding 'unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json' 2026-01-13T10:37:33,996 adding 'unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json' 2026-01-13T10:37:33,997 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json' 2026-01-13T10:37:33,999 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json' 2026-01-13T10:37:34,000 adding 'unitxt/catalog/cards/global_mmlu/nl/nutrition.json' 2026-01-13T10:37:34,001 adding 'unitxt/catalog/cards/global_mmlu/nl/philosophy.json' 2026-01-13T10:37:34,002 adding 'unitxt/catalog/cards/global_mmlu/nl/prehistory.json' 2026-01-13T10:37:34,004 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json' 2026-01-13T10:37:34,005 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_law.json' 2026-01-13T10:37:34,006 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json' 2026-01-13T10:37:34,008 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json' 2026-01-13T10:37:34,009 adding 'unitxt/catalog/cards/global_mmlu/nl/public_relations.json' 2026-01-13T10:37:34,010 adding 'unitxt/catalog/cards/global_mmlu/nl/security_studies.json' 2026-01-13T10:37:34,012 adding 'unitxt/catalog/cards/global_mmlu/nl/sociology.json' 2026-01-13T10:37:34,013 adding 'unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json' 2026-01-13T10:37:34,014 adding 'unitxt/catalog/cards/global_mmlu/nl/virology.json' 2026-01-13T10:37:34,016 adding 'unitxt/catalog/cards/global_mmlu/nl/world_religions.json' 2026-01-13T10:37:34,019 adding 'unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json' 2026-01-13T10:37:34,020 adding 'unitxt/catalog/cards/global_mmlu/ny/anatomy.json' 2026-01-13T10:37:34,021 adding 'unitxt/catalog/cards/global_mmlu/ny/astronomy.json' 2026-01-13T10:37:34,023 adding 'unitxt/catalog/cards/global_mmlu/ny/business_ethics.json' 2026-01-13T10:37:34,024 adding 'unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json' 2026-01-13T10:37:34,025 adding 'unitxt/catalog/cards/global_mmlu/ny/college_biology.json' 2026-01-13T10:37:34,027 adding 'unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json' 2026-01-13T10:37:34,028 adding 'unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json' 2026-01-13T10:37:34,030 adding 'unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json' 2026-01-13T10:37:34,031 adding 'unitxt/catalog/cards/global_mmlu/ny/college_medicine.json' 2026-01-13T10:37:34,032 adding 'unitxt/catalog/cards/global_mmlu/ny/college_physics.json' 2026-01-13T10:37:34,034 adding 'unitxt/catalog/cards/global_mmlu/ny/computer_security.json' 2026-01-13T10:37:34,035 adding 'unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json' 2026-01-13T10:37:34,036 adding 'unitxt/catalog/cards/global_mmlu/ny/econometrics.json' 2026-01-13T10:37:34,037 adding 'unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json' 2026-01-13T10:37:34,039 adding 'unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json' 2026-01-13T10:37:34,040 adding 'unitxt/catalog/cards/global_mmlu/ny/formal_logic.json' 2026-01-13T10:37:34,041 adding 'unitxt/catalog/cards/global_mmlu/ny/global_facts.json' 2026-01-13T10:37:34,042 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json' 2026-01-13T10:37:34,044 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json' 2026-01-13T10:37:34,045 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json' 2026-01-13T10:37:34,046 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json' 2026-01-13T10:37:34,048 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json' 2026-01-13T10:37:34,049 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json' 2026-01-13T10:37:34,050 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json' 2026-01-13T10:37:34,051 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json' 2026-01-13T10:37:34,053 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json' 2026-01-13T10:37:34,054 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json' 2026-01-13T10:37:34,055 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json' 2026-01-13T10:37:34,057 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json' 2026-01-13T10:37:34,058 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json' 2026-01-13T10:37:34,059 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json' 2026-01-13T10:37:34,061 adding 'unitxt/catalog/cards/global_mmlu/ny/human_aging.json' 2026-01-13T10:37:34,062 adding 'unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json' 2026-01-13T10:37:34,063 adding 'unitxt/catalog/cards/global_mmlu/ny/international_law.json' 2026-01-13T10:37:34,065 adding 'unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json' 2026-01-13T10:37:34,066 adding 'unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json' 2026-01-13T10:37:34,067 adding 'unitxt/catalog/cards/global_mmlu/ny/machine_learning.json' 2026-01-13T10:37:34,069 adding 'unitxt/catalog/cards/global_mmlu/ny/management.json' 2026-01-13T10:37:34,070 adding 'unitxt/catalog/cards/global_mmlu/ny/marketing.json' 2026-01-13T10:37:34,071 adding 'unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json' 2026-01-13T10:37:34,073 adding 'unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json' 2026-01-13T10:37:34,074 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json' 2026-01-13T10:37:34,075 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json' 2026-01-13T10:37:34,077 adding 'unitxt/catalog/cards/global_mmlu/ny/nutrition.json' 2026-01-13T10:37:34,078 adding 'unitxt/catalog/cards/global_mmlu/ny/philosophy.json' 2026-01-13T10:37:34,079 adding 'unitxt/catalog/cards/global_mmlu/ny/prehistory.json' 2026-01-13T10:37:34,081 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json' 2026-01-13T10:37:34,082 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_law.json' 2026-01-13T10:37:34,083 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json' 2026-01-13T10:37:34,085 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json' 2026-01-13T10:37:34,086 adding 'unitxt/catalog/cards/global_mmlu/ny/public_relations.json' 2026-01-13T10:37:34,088 adding 'unitxt/catalog/cards/global_mmlu/ny/security_studies.json' 2026-01-13T10:37:34,089 adding 'unitxt/catalog/cards/global_mmlu/ny/sociology.json' 2026-01-13T10:37:34,090 adding 'unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json' 2026-01-13T10:37:34,091 adding 'unitxt/catalog/cards/global_mmlu/ny/virology.json' 2026-01-13T10:37:34,092 adding 'unitxt/catalog/cards/global_mmlu/ny/world_religions.json' 2026-01-13T10:37:34,095 adding 'unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json' 2026-01-13T10:37:34,096 adding 'unitxt/catalog/cards/global_mmlu/pl/anatomy.json' 2026-01-13T10:37:34,097 adding 'unitxt/catalog/cards/global_mmlu/pl/astronomy.json' 2026-01-13T10:37:34,099 adding 'unitxt/catalog/cards/global_mmlu/pl/business_ethics.json' 2026-01-13T10:37:34,100 adding 'unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json' 2026-01-13T10:37:34,101 adding 'unitxt/catalog/cards/global_mmlu/pl/college_biology.json' 2026-01-13T10:37:34,102 adding 'unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json' 2026-01-13T10:37:34,104 adding 'unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json' 2026-01-13T10:37:34,105 adding 'unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json' 2026-01-13T10:37:34,106 adding 'unitxt/catalog/cards/global_mmlu/pl/college_medicine.json' 2026-01-13T10:37:34,108 adding 'unitxt/catalog/cards/global_mmlu/pl/college_physics.json' 2026-01-13T10:37:34,109 adding 'unitxt/catalog/cards/global_mmlu/pl/computer_security.json' 2026-01-13T10:37:34,110 adding 'unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json' 2026-01-13T10:37:34,112 adding 'unitxt/catalog/cards/global_mmlu/pl/econometrics.json' 2026-01-13T10:37:34,113 adding 'unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json' 2026-01-13T10:37:34,114 adding 'unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json' 2026-01-13T10:37:34,116 adding 'unitxt/catalog/cards/global_mmlu/pl/formal_logic.json' 2026-01-13T10:37:34,117 adding 'unitxt/catalog/cards/global_mmlu/pl/global_facts.json' 2026-01-13T10:37:34,119 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json' 2026-01-13T10:37:34,120 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json' 2026-01-13T10:37:34,122 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json' 2026-01-13T10:37:34,123 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json' 2026-01-13T10:37:34,124 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json' 2026-01-13T10:37:34,125 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json' 2026-01-13T10:37:34,127 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json' 2026-01-13T10:37:34,128 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json' 2026-01-13T10:37:34,130 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json' 2026-01-13T10:37:34,131 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json' 2026-01-13T10:37:34,132 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json' 2026-01-13T10:37:34,134 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json' 2026-01-13T10:37:34,135 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json' 2026-01-13T10:37:34,137 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json' 2026-01-13T10:37:34,138 adding 'unitxt/catalog/cards/global_mmlu/pl/human_aging.json' 2026-01-13T10:37:34,139 adding 'unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json' 2026-01-13T10:37:34,141 adding 'unitxt/catalog/cards/global_mmlu/pl/international_law.json' 2026-01-13T10:37:34,142 adding 'unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json' 2026-01-13T10:37:34,143 adding 'unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json' 2026-01-13T10:37:34,145 adding 'unitxt/catalog/cards/global_mmlu/pl/machine_learning.json' 2026-01-13T10:37:34,146 adding 'unitxt/catalog/cards/global_mmlu/pl/management.json' 2026-01-13T10:37:34,147 adding 'unitxt/catalog/cards/global_mmlu/pl/marketing.json' 2026-01-13T10:37:34,149 adding 'unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json' 2026-01-13T10:37:34,150 adding 'unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json' 2026-01-13T10:37:34,151 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json' 2026-01-13T10:37:34,152 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json' 2026-01-13T10:37:34,154 adding 'unitxt/catalog/cards/global_mmlu/pl/nutrition.json' 2026-01-13T10:37:34,155 adding 'unitxt/catalog/cards/global_mmlu/pl/philosophy.json' 2026-01-13T10:37:34,156 adding 'unitxt/catalog/cards/global_mmlu/pl/prehistory.json' 2026-01-13T10:37:34,158 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json' 2026-01-13T10:37:34,159 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_law.json' 2026-01-13T10:37:34,161 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json' 2026-01-13T10:37:34,162 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json' 2026-01-13T10:37:34,163 adding 'unitxt/catalog/cards/global_mmlu/pl/public_relations.json' 2026-01-13T10:37:34,164 adding 'unitxt/catalog/cards/global_mmlu/pl/security_studies.json' 2026-01-13T10:37:34,166 adding 'unitxt/catalog/cards/global_mmlu/pl/sociology.json' 2026-01-13T10:37:34,167 adding 'unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json' 2026-01-13T10:37:34,168 adding 'unitxt/catalog/cards/global_mmlu/pl/virology.json' 2026-01-13T10:37:34,170 adding 'unitxt/catalog/cards/global_mmlu/pl/world_religions.json' 2026-01-13T10:37:34,173 adding 'unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json' 2026-01-13T10:37:34,174 adding 'unitxt/catalog/cards/global_mmlu/pt/anatomy.json' 2026-01-13T10:37:34,175 adding 'unitxt/catalog/cards/global_mmlu/pt/astronomy.json' 2026-01-13T10:37:34,177 adding 'unitxt/catalog/cards/global_mmlu/pt/business_ethics.json' 2026-01-13T10:37:34,178 adding 'unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json' 2026-01-13T10:37:34,179 adding 'unitxt/catalog/cards/global_mmlu/pt/college_biology.json' 2026-01-13T10:37:34,180 adding 'unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json' 2026-01-13T10:37:34,182 adding 'unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json' 2026-01-13T10:37:34,183 adding 'unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json' 2026-01-13T10:37:34,184 adding 'unitxt/catalog/cards/global_mmlu/pt/college_medicine.json' 2026-01-13T10:37:34,186 adding 'unitxt/catalog/cards/global_mmlu/pt/college_physics.json' 2026-01-13T10:37:34,187 adding 'unitxt/catalog/cards/global_mmlu/pt/computer_security.json' 2026-01-13T10:37:34,188 adding 'unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json' 2026-01-13T10:37:34,190 adding 'unitxt/catalog/cards/global_mmlu/pt/econometrics.json' 2026-01-13T10:37:34,191 adding 'unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json' 2026-01-13T10:37:34,193 adding 'unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json' 2026-01-13T10:37:34,194 adding 'unitxt/catalog/cards/global_mmlu/pt/formal_logic.json' 2026-01-13T10:37:34,196 adding 'unitxt/catalog/cards/global_mmlu/pt/global_facts.json' 2026-01-13T10:37:34,197 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json' 2026-01-13T10:37:34,199 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json' 2026-01-13T10:37:34,200 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json' 2026-01-13T10:37:34,202 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json' 2026-01-13T10:37:34,203 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json' 2026-01-13T10:37:34,205 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json' 2026-01-13T10:37:34,206 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json' 2026-01-13T10:37:34,208 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json' 2026-01-13T10:37:34,209 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json' 2026-01-13T10:37:34,210 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json' 2026-01-13T10:37:34,211 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json' 2026-01-13T10:37:34,212 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json' 2026-01-13T10:37:34,214 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json' 2026-01-13T10:37:34,215 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json' 2026-01-13T10:37:34,216 adding 'unitxt/catalog/cards/global_mmlu/pt/human_aging.json' 2026-01-13T10:37:34,217 adding 'unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json' 2026-01-13T10:37:34,219 adding 'unitxt/catalog/cards/global_mmlu/pt/international_law.json' 2026-01-13T10:37:34,220 adding 'unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json' 2026-01-13T10:37:34,221 adding 'unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json' 2026-01-13T10:37:34,223 adding 'unitxt/catalog/cards/global_mmlu/pt/machine_learning.json' 2026-01-13T10:37:34,224 adding 'unitxt/catalog/cards/global_mmlu/pt/management.json' 2026-01-13T10:37:34,225 adding 'unitxt/catalog/cards/global_mmlu/pt/marketing.json' 2026-01-13T10:37:34,227 adding 'unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json' 2026-01-13T10:37:34,228 adding 'unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json' 2026-01-13T10:37:34,229 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json' 2026-01-13T10:37:34,231 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json' 2026-01-13T10:37:34,232 adding 'unitxt/catalog/cards/global_mmlu/pt/nutrition.json' 2026-01-13T10:37:34,233 adding 'unitxt/catalog/cards/global_mmlu/pt/philosophy.json' 2026-01-13T10:37:34,235 adding 'unitxt/catalog/cards/global_mmlu/pt/prehistory.json' 2026-01-13T10:37:34,236 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json' 2026-01-13T10:37:34,237 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_law.json' 2026-01-13T10:37:34,239 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json' 2026-01-13T10:37:34,240 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json' 2026-01-13T10:37:34,241 adding 'unitxt/catalog/cards/global_mmlu/pt/public_relations.json' 2026-01-13T10:37:34,243 adding 'unitxt/catalog/cards/global_mmlu/pt/security_studies.json' 2026-01-13T10:37:34,244 adding 'unitxt/catalog/cards/global_mmlu/pt/sociology.json' 2026-01-13T10:37:34,245 adding 'unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json' 2026-01-13T10:37:34,247 adding 'unitxt/catalog/cards/global_mmlu/pt/virology.json' 2026-01-13T10:37:34,248 adding 'unitxt/catalog/cards/global_mmlu/pt/world_religions.json' 2026-01-13T10:37:34,251 adding 'unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json' 2026-01-13T10:37:34,252 adding 'unitxt/catalog/cards/global_mmlu/ro/anatomy.json' 2026-01-13T10:37:34,253 adding 'unitxt/catalog/cards/global_mmlu/ro/astronomy.json' 2026-01-13T10:37:34,255 adding 'unitxt/catalog/cards/global_mmlu/ro/business_ethics.json' 2026-01-13T10:37:34,256 adding 'unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json' 2026-01-13T10:37:34,258 adding 'unitxt/catalog/cards/global_mmlu/ro/college_biology.json' 2026-01-13T10:37:34,259 adding 'unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json' 2026-01-13T10:37:34,261 adding 'unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json' 2026-01-13T10:37:34,262 adding 'unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json' 2026-01-13T10:37:34,264 adding 'unitxt/catalog/cards/global_mmlu/ro/college_medicine.json' 2026-01-13T10:37:34,265 adding 'unitxt/catalog/cards/global_mmlu/ro/college_physics.json' 2026-01-13T10:37:34,267 adding 'unitxt/catalog/cards/global_mmlu/ro/computer_security.json' 2026-01-13T10:37:34,268 adding 'unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json' 2026-01-13T10:37:34,270 adding 'unitxt/catalog/cards/global_mmlu/ro/econometrics.json' 2026-01-13T10:37:34,271 adding 'unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json' 2026-01-13T10:37:34,272 adding 'unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json' 2026-01-13T10:37:34,274 adding 'unitxt/catalog/cards/global_mmlu/ro/formal_logic.json' 2026-01-13T10:37:34,275 adding 'unitxt/catalog/cards/global_mmlu/ro/global_facts.json' 2026-01-13T10:37:34,276 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json' 2026-01-13T10:37:34,277 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json' 2026-01-13T10:37:34,279 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json' 2026-01-13T10:37:34,280 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json' 2026-01-13T10:37:34,281 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json' 2026-01-13T10:37:34,283 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json' 2026-01-13T10:37:34,284 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json' 2026-01-13T10:37:34,285 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json' 2026-01-13T10:37:34,287 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json' 2026-01-13T10:37:34,288 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json' 2026-01-13T10:37:34,289 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json' 2026-01-13T10:37:34,291 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json' 2026-01-13T10:37:34,292 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json' 2026-01-13T10:37:34,293 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json' 2026-01-13T10:37:34,294 adding 'unitxt/catalog/cards/global_mmlu/ro/human_aging.json' 2026-01-13T10:37:34,296 adding 'unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json' 2026-01-13T10:37:34,298 adding 'unitxt/catalog/cards/global_mmlu/ro/international_law.json' 2026-01-13T10:37:34,299 adding 'unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json' 2026-01-13T10:37:34,301 adding 'unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json' 2026-01-13T10:37:34,303 adding 'unitxt/catalog/cards/global_mmlu/ro/machine_learning.json' 2026-01-13T10:37:34,304 adding 'unitxt/catalog/cards/global_mmlu/ro/management.json' 2026-01-13T10:37:34,306 adding 'unitxt/catalog/cards/global_mmlu/ro/marketing.json' 2026-01-13T10:37:34,307 adding 'unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json' 2026-01-13T10:37:34,309 adding 'unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json' 2026-01-13T10:37:34,310 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json' 2026-01-13T10:37:34,312 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json' 2026-01-13T10:37:34,313 adding 'unitxt/catalog/cards/global_mmlu/ro/nutrition.json' 2026-01-13T10:37:34,315 adding 'unitxt/catalog/cards/global_mmlu/ro/philosophy.json' 2026-01-13T10:37:34,317 adding 'unitxt/catalog/cards/global_mmlu/ro/prehistory.json' 2026-01-13T10:37:34,318 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json' 2026-01-13T10:37:34,320 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_law.json' 2026-01-13T10:37:34,322 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json' 2026-01-13T10:37:34,323 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json' 2026-01-13T10:37:34,325 adding 'unitxt/catalog/cards/global_mmlu/ro/public_relations.json' 2026-01-13T10:37:34,327 adding 'unitxt/catalog/cards/global_mmlu/ro/security_studies.json' 2026-01-13T10:37:34,328 adding 'unitxt/catalog/cards/global_mmlu/ro/sociology.json' 2026-01-13T10:37:34,330 adding 'unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json' 2026-01-13T10:37:34,331 adding 'unitxt/catalog/cards/global_mmlu/ro/virology.json' 2026-01-13T10:37:34,333 adding 'unitxt/catalog/cards/global_mmlu/ro/world_religions.json' 2026-01-13T10:37:34,336 adding 'unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json' 2026-01-13T10:37:34,338 adding 'unitxt/catalog/cards/global_mmlu/ru/anatomy.json' 2026-01-13T10:37:34,340 adding 'unitxt/catalog/cards/global_mmlu/ru/astronomy.json' 2026-01-13T10:37:34,341 adding 'unitxt/catalog/cards/global_mmlu/ru/business_ethics.json' 2026-01-13T10:37:34,343 adding 'unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json' 2026-01-13T10:37:34,345 adding 'unitxt/catalog/cards/global_mmlu/ru/college_biology.json' 2026-01-13T10:37:34,346 adding 'unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json' 2026-01-13T10:37:34,348 adding 'unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json' 2026-01-13T10:37:34,350 adding 'unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json' 2026-01-13T10:37:34,352 adding 'unitxt/catalog/cards/global_mmlu/ru/college_medicine.json' 2026-01-13T10:37:34,353 adding 'unitxt/catalog/cards/global_mmlu/ru/college_physics.json' 2026-01-13T10:37:34,355 adding 'unitxt/catalog/cards/global_mmlu/ru/computer_security.json' 2026-01-13T10:37:34,357 adding 'unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json' 2026-01-13T10:37:34,358 adding 'unitxt/catalog/cards/global_mmlu/ru/econometrics.json' 2026-01-13T10:37:34,360 adding 'unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json' 2026-01-13T10:37:34,362 adding 'unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json' 2026-01-13T10:37:34,364 adding 'unitxt/catalog/cards/global_mmlu/ru/formal_logic.json' 2026-01-13T10:37:34,365 adding 'unitxt/catalog/cards/global_mmlu/ru/global_facts.json' 2026-01-13T10:37:34,367 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json' 2026-01-13T10:37:34,369 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json' 2026-01-13T10:37:34,371 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json' 2026-01-13T10:37:34,372 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json' 2026-01-13T10:37:34,374 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json' 2026-01-13T10:37:34,376 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json' 2026-01-13T10:37:34,378 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json' 2026-01-13T10:37:34,380 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json' 2026-01-13T10:37:34,382 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json' 2026-01-13T10:37:34,384 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json' 2026-01-13T10:37:34,386 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json' 2026-01-13T10:37:34,388 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json' 2026-01-13T10:37:34,390 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json' 2026-01-13T10:37:34,392 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json' 2026-01-13T10:37:34,397 adding 'unitxt/catalog/cards/global_mmlu/ru/human_aging.json' 2026-01-13T10:37:34,400 adding 'unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json' 2026-01-13T10:37:34,402 adding 'unitxt/catalog/cards/global_mmlu/ru/international_law.json' 2026-01-13T10:37:34,405 adding 'unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json' 2026-01-13T10:37:34,408 adding 'unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json' 2026-01-13T10:37:34,412 adding 'unitxt/catalog/cards/global_mmlu/ru/machine_learning.json' 2026-01-13T10:37:34,416 adding 'unitxt/catalog/cards/global_mmlu/ru/management.json' 2026-01-13T10:37:34,420 adding 'unitxt/catalog/cards/global_mmlu/ru/marketing.json' 2026-01-13T10:37:34,424 adding 'unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json' 2026-01-13T10:37:34,428 adding 'unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json' 2026-01-13T10:37:34,433 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json' 2026-01-13T10:37:34,438 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json' 2026-01-13T10:37:34,442 adding 'unitxt/catalog/cards/global_mmlu/ru/nutrition.json' 2026-01-13T10:37:34,444 adding 'unitxt/catalog/cards/global_mmlu/ru/philosophy.json' 2026-01-13T10:37:34,445 adding 'unitxt/catalog/cards/global_mmlu/ru/prehistory.json' 2026-01-13T10:37:34,447 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json' 2026-01-13T10:37:34,448 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_law.json' 2026-01-13T10:37:34,450 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json' 2026-01-13T10:37:34,452 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json' 2026-01-13T10:37:34,453 adding 'unitxt/catalog/cards/global_mmlu/ru/public_relations.json' 2026-01-13T10:37:34,455 adding 'unitxt/catalog/cards/global_mmlu/ru/security_studies.json' 2026-01-13T10:37:34,457 adding 'unitxt/catalog/cards/global_mmlu/ru/sociology.json' 2026-01-13T10:37:34,459 adding 'unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json' 2026-01-13T10:37:34,462 adding 'unitxt/catalog/cards/global_mmlu/ru/virology.json' 2026-01-13T10:37:34,465 adding 'unitxt/catalog/cards/global_mmlu/ru/world_religions.json' 2026-01-13T10:37:34,475 adding 'unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json' 2026-01-13T10:37:34,478 adding 'unitxt/catalog/cards/global_mmlu/si/anatomy.json' 2026-01-13T10:37:34,482 adding 'unitxt/catalog/cards/global_mmlu/si/astronomy.json' 2026-01-13T10:37:34,486 adding 'unitxt/catalog/cards/global_mmlu/si/business_ethics.json' 2026-01-13T10:37:34,490 adding 'unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json' 2026-01-13T10:37:34,495 adding 'unitxt/catalog/cards/global_mmlu/si/college_biology.json' 2026-01-13T10:37:34,499 adding 'unitxt/catalog/cards/global_mmlu/si/college_chemistry.json' 2026-01-13T10:37:34,503 adding 'unitxt/catalog/cards/global_mmlu/si/college_computer_science.json' 2026-01-13T10:37:34,506 adding 'unitxt/catalog/cards/global_mmlu/si/college_mathematics.json' 2026-01-13T10:37:34,509 adding 'unitxt/catalog/cards/global_mmlu/si/college_medicine.json' 2026-01-13T10:37:34,512 adding 'unitxt/catalog/cards/global_mmlu/si/college_physics.json' 2026-01-13T10:37:34,515 adding 'unitxt/catalog/cards/global_mmlu/si/computer_security.json' 2026-01-13T10:37:34,517 adding 'unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json' 2026-01-13T10:37:34,520 adding 'unitxt/catalog/cards/global_mmlu/si/econometrics.json' 2026-01-13T10:37:34,522 adding 'unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json' 2026-01-13T10:37:34,524 adding 'unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json' 2026-01-13T10:37:34,527 adding 'unitxt/catalog/cards/global_mmlu/si/formal_logic.json' 2026-01-13T10:37:34,529 adding 'unitxt/catalog/cards/global_mmlu/si/global_facts.json' 2026-01-13T10:37:34,531 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_biology.json' 2026-01-13T10:37:34,532 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json' 2026-01-13T10:37:34,534 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json' 2026-01-13T10:37:34,536 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json' 2026-01-13T10:37:34,537 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_geography.json' 2026-01-13T10:37:34,539 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json' 2026-01-13T10:37:34,540 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json' 2026-01-13T10:37:34,542 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json' 2026-01-13T10:37:34,543 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json' 2026-01-13T10:37:34,545 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_physics.json' 2026-01-13T10:37:34,546 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json' 2026-01-13T10:37:34,547 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json' 2026-01-13T10:37:34,549 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json' 2026-01-13T10:37:34,550 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json' 2026-01-13T10:37:34,551 adding 'unitxt/catalog/cards/global_mmlu/si/human_aging.json' 2026-01-13T10:37:34,553 adding 'unitxt/catalog/cards/global_mmlu/si/human_sexuality.json' 2026-01-13T10:37:34,554 adding 'unitxt/catalog/cards/global_mmlu/si/international_law.json' 2026-01-13T10:37:34,555 adding 'unitxt/catalog/cards/global_mmlu/si/jurisprudence.json' 2026-01-13T10:37:34,556 adding 'unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json' 2026-01-13T10:37:34,558 adding 'unitxt/catalog/cards/global_mmlu/si/machine_learning.json' 2026-01-13T10:37:34,559 adding 'unitxt/catalog/cards/global_mmlu/si/management.json' 2026-01-13T10:37:34,560 adding 'unitxt/catalog/cards/global_mmlu/si/marketing.json' 2026-01-13T10:37:34,562 adding 'unitxt/catalog/cards/global_mmlu/si/medical_genetics.json' 2026-01-13T10:37:34,563 adding 'unitxt/catalog/cards/global_mmlu/si/miscellaneous.json' 2026-01-13T10:37:34,564 adding 'unitxt/catalog/cards/global_mmlu/si/moral_disputes.json' 2026-01-13T10:37:34,566 adding 'unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json' 2026-01-13T10:37:34,567 adding 'unitxt/catalog/cards/global_mmlu/si/nutrition.json' 2026-01-13T10:37:34,568 adding 'unitxt/catalog/cards/global_mmlu/si/philosophy.json' 2026-01-13T10:37:34,570 adding 'unitxt/catalog/cards/global_mmlu/si/prehistory.json' 2026-01-13T10:37:34,571 adding 'unitxt/catalog/cards/global_mmlu/si/professional_accounting.json' 2026-01-13T10:37:34,572 adding 'unitxt/catalog/cards/global_mmlu/si/professional_law.json' 2026-01-13T10:37:34,573 adding 'unitxt/catalog/cards/global_mmlu/si/professional_medicine.json' 2026-01-13T10:37:34,575 adding 'unitxt/catalog/cards/global_mmlu/si/professional_psychology.json' 2026-01-13T10:37:34,576 adding 'unitxt/catalog/cards/global_mmlu/si/public_relations.json' 2026-01-13T10:37:34,577 adding 'unitxt/catalog/cards/global_mmlu/si/security_studies.json' 2026-01-13T10:37:34,579 adding 'unitxt/catalog/cards/global_mmlu/si/sociology.json' 2026-01-13T10:37:34,580 adding 'unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json' 2026-01-13T10:37:34,581 adding 'unitxt/catalog/cards/global_mmlu/si/virology.json' 2026-01-13T10:37:34,583 adding 'unitxt/catalog/cards/global_mmlu/si/world_religions.json' 2026-01-13T10:37:34,585 adding 'unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json' 2026-01-13T10:37:34,587 adding 'unitxt/catalog/cards/global_mmlu/sn/anatomy.json' 2026-01-13T10:37:34,588 adding 'unitxt/catalog/cards/global_mmlu/sn/astronomy.json' 2026-01-13T10:37:34,589 adding 'unitxt/catalog/cards/global_mmlu/sn/business_ethics.json' 2026-01-13T10:37:34,591 adding 'unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json' 2026-01-13T10:37:34,592 adding 'unitxt/catalog/cards/global_mmlu/sn/college_biology.json' 2026-01-13T10:37:34,594 adding 'unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json' 2026-01-13T10:37:34,595 adding 'unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json' 2026-01-13T10:37:34,596 adding 'unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json' 2026-01-13T10:37:34,598 adding 'unitxt/catalog/cards/global_mmlu/sn/college_medicine.json' 2026-01-13T10:37:34,599 adding 'unitxt/catalog/cards/global_mmlu/sn/college_physics.json' 2026-01-13T10:37:34,600 adding 'unitxt/catalog/cards/global_mmlu/sn/computer_security.json' 2026-01-13T10:37:34,602 adding 'unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json' 2026-01-13T10:37:34,603 adding 'unitxt/catalog/cards/global_mmlu/sn/econometrics.json' 2026-01-13T10:37:34,604 adding 'unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json' 2026-01-13T10:37:34,605 adding 'unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json' 2026-01-13T10:37:34,606 adding 'unitxt/catalog/cards/global_mmlu/sn/formal_logic.json' 2026-01-13T10:37:34,608 adding 'unitxt/catalog/cards/global_mmlu/sn/global_facts.json' 2026-01-13T10:37:34,609 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json' 2026-01-13T10:37:34,610 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json' 2026-01-13T10:37:34,611 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json' 2026-01-13T10:37:34,613 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json' 2026-01-13T10:37:34,614 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json' 2026-01-13T10:37:34,615 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json' 2026-01-13T10:37:34,616 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json' 2026-01-13T10:37:34,618 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json' 2026-01-13T10:37:34,619 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json' 2026-01-13T10:37:34,620 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json' 2026-01-13T10:37:34,622 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json' 2026-01-13T10:37:34,623 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json' 2026-01-13T10:37:34,624 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json' 2026-01-13T10:37:34,625 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json' 2026-01-13T10:37:34,627 adding 'unitxt/catalog/cards/global_mmlu/sn/human_aging.json' 2026-01-13T10:37:34,628 adding 'unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json' 2026-01-13T10:37:34,629 adding 'unitxt/catalog/cards/global_mmlu/sn/international_law.json' 2026-01-13T10:37:34,630 adding 'unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json' 2026-01-13T10:37:34,632 adding 'unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json' 2026-01-13T10:37:34,633 adding 'unitxt/catalog/cards/global_mmlu/sn/machine_learning.json' 2026-01-13T10:37:34,634 adding 'unitxt/catalog/cards/global_mmlu/sn/management.json' 2026-01-13T10:37:34,636 adding 'unitxt/catalog/cards/global_mmlu/sn/marketing.json' 2026-01-13T10:37:34,637 adding 'unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json' 2026-01-13T10:37:34,638 adding 'unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json' 2026-01-13T10:37:34,640 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json' 2026-01-13T10:37:34,641 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json' 2026-01-13T10:37:34,642 adding 'unitxt/catalog/cards/global_mmlu/sn/nutrition.json' 2026-01-13T10:37:34,643 adding 'unitxt/catalog/cards/global_mmlu/sn/philosophy.json' 2026-01-13T10:37:34,645 adding 'unitxt/catalog/cards/global_mmlu/sn/prehistory.json' 2026-01-13T10:37:34,646 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json' 2026-01-13T10:37:34,647 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_law.json' 2026-01-13T10:37:34,649 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json' 2026-01-13T10:37:34,650 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json' 2026-01-13T10:37:34,651 adding 'unitxt/catalog/cards/global_mmlu/sn/public_relations.json' 2026-01-13T10:37:34,653 adding 'unitxt/catalog/cards/global_mmlu/sn/security_studies.json' 2026-01-13T10:37:34,654 adding 'unitxt/catalog/cards/global_mmlu/sn/sociology.json' 2026-01-13T10:37:34,655 adding 'unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json' 2026-01-13T10:37:34,657 adding 'unitxt/catalog/cards/global_mmlu/sn/virology.json' 2026-01-13T10:37:34,658 adding 'unitxt/catalog/cards/global_mmlu/sn/world_religions.json' 2026-01-13T10:37:34,661 adding 'unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json' 2026-01-13T10:37:34,662 adding 'unitxt/catalog/cards/global_mmlu/so/anatomy.json' 2026-01-13T10:37:34,663 adding 'unitxt/catalog/cards/global_mmlu/so/astronomy.json' 2026-01-13T10:37:34,664 adding 'unitxt/catalog/cards/global_mmlu/so/business_ethics.json' 2026-01-13T10:37:34,665 adding 'unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json' 2026-01-13T10:37:34,667 adding 'unitxt/catalog/cards/global_mmlu/so/college_biology.json' 2026-01-13T10:37:34,668 adding 'unitxt/catalog/cards/global_mmlu/so/college_chemistry.json' 2026-01-13T10:37:34,669 adding 'unitxt/catalog/cards/global_mmlu/so/college_computer_science.json' 2026-01-13T10:37:34,670 adding 'unitxt/catalog/cards/global_mmlu/so/college_mathematics.json' 2026-01-13T10:37:34,671 adding 'unitxt/catalog/cards/global_mmlu/so/college_medicine.json' 2026-01-13T10:37:34,673 adding 'unitxt/catalog/cards/global_mmlu/so/college_physics.json' 2026-01-13T10:37:34,674 adding 'unitxt/catalog/cards/global_mmlu/so/computer_security.json' 2026-01-13T10:37:34,675 adding 'unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json' 2026-01-13T10:37:34,677 adding 'unitxt/catalog/cards/global_mmlu/so/econometrics.json' 2026-01-13T10:37:34,678 adding 'unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json' 2026-01-13T10:37:34,679 adding 'unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json' 2026-01-13T10:37:34,680 adding 'unitxt/catalog/cards/global_mmlu/so/formal_logic.json' 2026-01-13T10:37:34,682 adding 'unitxt/catalog/cards/global_mmlu/so/global_facts.json' 2026-01-13T10:37:34,683 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_biology.json' 2026-01-13T10:37:34,684 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json' 2026-01-13T10:37:34,686 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json' 2026-01-13T10:37:34,687 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json' 2026-01-13T10:37:34,688 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_geography.json' 2026-01-13T10:37:34,690 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json' 2026-01-13T10:37:34,691 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json' 2026-01-13T10:37:34,692 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json' 2026-01-13T10:37:34,694 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json' 2026-01-13T10:37:34,695 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_physics.json' 2026-01-13T10:37:34,697 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json' 2026-01-13T10:37:34,698 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json' 2026-01-13T10:37:34,699 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json' 2026-01-13T10:37:34,701 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json' 2026-01-13T10:37:34,702 adding 'unitxt/catalog/cards/global_mmlu/so/human_aging.json' 2026-01-13T10:37:34,704 adding 'unitxt/catalog/cards/global_mmlu/so/human_sexuality.json' 2026-01-13T10:37:34,705 adding 'unitxt/catalog/cards/global_mmlu/so/international_law.json' 2026-01-13T10:37:34,707 adding 'unitxt/catalog/cards/global_mmlu/so/jurisprudence.json' 2026-01-13T10:37:34,708 adding 'unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json' 2026-01-13T10:37:34,709 adding 'unitxt/catalog/cards/global_mmlu/so/machine_learning.json' 2026-01-13T10:37:34,711 adding 'unitxt/catalog/cards/global_mmlu/so/management.json' 2026-01-13T10:37:34,712 adding 'unitxt/catalog/cards/global_mmlu/so/marketing.json' 2026-01-13T10:37:34,713 adding 'unitxt/catalog/cards/global_mmlu/so/medical_genetics.json' 2026-01-13T10:37:34,715 adding 'unitxt/catalog/cards/global_mmlu/so/miscellaneous.json' 2026-01-13T10:37:34,716 adding 'unitxt/catalog/cards/global_mmlu/so/moral_disputes.json' 2026-01-13T10:37:34,717 adding 'unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json' 2026-01-13T10:37:34,719 adding 'unitxt/catalog/cards/global_mmlu/so/nutrition.json' 2026-01-13T10:37:34,720 adding 'unitxt/catalog/cards/global_mmlu/so/philosophy.json' 2026-01-13T10:37:34,721 adding 'unitxt/catalog/cards/global_mmlu/so/prehistory.json' 2026-01-13T10:37:34,722 adding 'unitxt/catalog/cards/global_mmlu/so/professional_accounting.json' 2026-01-13T10:37:34,723 adding 'unitxt/catalog/cards/global_mmlu/so/professional_law.json' 2026-01-13T10:37:34,725 adding 'unitxt/catalog/cards/global_mmlu/so/professional_medicine.json' 2026-01-13T10:37:34,726 adding 'unitxt/catalog/cards/global_mmlu/so/professional_psychology.json' 2026-01-13T10:37:34,727 adding 'unitxt/catalog/cards/global_mmlu/so/public_relations.json' 2026-01-13T10:37:34,729 adding 'unitxt/catalog/cards/global_mmlu/so/security_studies.json' 2026-01-13T10:37:34,730 adding 'unitxt/catalog/cards/global_mmlu/so/sociology.json' 2026-01-13T10:37:34,731 adding 'unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json' 2026-01-13T10:37:34,732 adding 'unitxt/catalog/cards/global_mmlu/so/virology.json' 2026-01-13T10:37:34,734 adding 'unitxt/catalog/cards/global_mmlu/so/world_religions.json' 2026-01-13T10:37:34,736 adding 'unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json' 2026-01-13T10:37:34,738 adding 'unitxt/catalog/cards/global_mmlu/sr/anatomy.json' 2026-01-13T10:37:34,739 adding 'unitxt/catalog/cards/global_mmlu/sr/astronomy.json' 2026-01-13T10:37:34,740 adding 'unitxt/catalog/cards/global_mmlu/sr/business_ethics.json' 2026-01-13T10:37:34,742 adding 'unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json' 2026-01-13T10:37:34,743 adding 'unitxt/catalog/cards/global_mmlu/sr/college_biology.json' 2026-01-13T10:37:34,744 adding 'unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json' 2026-01-13T10:37:34,746 adding 'unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json' 2026-01-13T10:37:34,747 adding 'unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json' 2026-01-13T10:37:34,748 adding 'unitxt/catalog/cards/global_mmlu/sr/college_medicine.json' 2026-01-13T10:37:34,749 adding 'unitxt/catalog/cards/global_mmlu/sr/college_physics.json' 2026-01-13T10:37:34,751 adding 'unitxt/catalog/cards/global_mmlu/sr/computer_security.json' 2026-01-13T10:37:34,752 adding 'unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json' 2026-01-13T10:37:34,753 adding 'unitxt/catalog/cards/global_mmlu/sr/econometrics.json' 2026-01-13T10:37:34,755 adding 'unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json' 2026-01-13T10:37:34,756 adding 'unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json' 2026-01-13T10:37:34,757 adding 'unitxt/catalog/cards/global_mmlu/sr/formal_logic.json' 2026-01-13T10:37:34,759 adding 'unitxt/catalog/cards/global_mmlu/sr/global_facts.json' 2026-01-13T10:37:34,760 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json' 2026-01-13T10:37:34,761 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json' 2026-01-13T10:37:34,762 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json' 2026-01-13T10:37:34,764 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json' 2026-01-13T10:37:34,765 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json' 2026-01-13T10:37:34,767 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json' 2026-01-13T10:37:34,768 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json' 2026-01-13T10:37:34,769 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json' 2026-01-13T10:37:34,771 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json' 2026-01-13T10:37:34,772 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json' 2026-01-13T10:37:34,773 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json' 2026-01-13T10:37:34,775 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json' 2026-01-13T10:37:34,776 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json' 2026-01-13T10:37:34,777 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json' 2026-01-13T10:37:34,779 adding 'unitxt/catalog/cards/global_mmlu/sr/human_aging.json' 2026-01-13T10:37:34,780 adding 'unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json' 2026-01-13T10:37:34,781 adding 'unitxt/catalog/cards/global_mmlu/sr/international_law.json' 2026-01-13T10:37:34,782 adding 'unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json' 2026-01-13T10:37:34,783 adding 'unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json' 2026-01-13T10:37:34,785 adding 'unitxt/catalog/cards/global_mmlu/sr/machine_learning.json' 2026-01-13T10:37:34,786 adding 'unitxt/catalog/cards/global_mmlu/sr/management.json' 2026-01-13T10:37:34,787 adding 'unitxt/catalog/cards/global_mmlu/sr/marketing.json' 2026-01-13T10:37:34,788 adding 'unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json' 2026-01-13T10:37:34,790 adding 'unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json' 2026-01-13T10:37:34,791 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json' 2026-01-13T10:37:34,792 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json' 2026-01-13T10:37:34,794 adding 'unitxt/catalog/cards/global_mmlu/sr/nutrition.json' 2026-01-13T10:37:34,795 adding 'unitxt/catalog/cards/global_mmlu/sr/philosophy.json' 2026-01-13T10:37:34,796 adding 'unitxt/catalog/cards/global_mmlu/sr/prehistory.json' 2026-01-13T10:37:34,797 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json' 2026-01-13T10:37:34,799 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_law.json' 2026-01-13T10:37:34,800 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json' 2026-01-13T10:37:34,801 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json' 2026-01-13T10:37:34,803 adding 'unitxt/catalog/cards/global_mmlu/sr/public_relations.json' 2026-01-13T10:37:34,804 adding 'unitxt/catalog/cards/global_mmlu/sr/security_studies.json' 2026-01-13T10:37:34,805 adding 'unitxt/catalog/cards/global_mmlu/sr/sociology.json' 2026-01-13T10:37:34,807 adding 'unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json' 2026-01-13T10:37:34,808 adding 'unitxt/catalog/cards/global_mmlu/sr/virology.json' 2026-01-13T10:37:34,809 adding 'unitxt/catalog/cards/global_mmlu/sr/world_religions.json' 2026-01-13T10:37:34,812 adding 'unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json' 2026-01-13T10:37:34,813 adding 'unitxt/catalog/cards/global_mmlu/sv/anatomy.json' 2026-01-13T10:37:34,815 adding 'unitxt/catalog/cards/global_mmlu/sv/astronomy.json' 2026-01-13T10:37:34,816 adding 'unitxt/catalog/cards/global_mmlu/sv/business_ethics.json' 2026-01-13T10:37:34,817 adding 'unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json' 2026-01-13T10:37:34,819 adding 'unitxt/catalog/cards/global_mmlu/sv/college_biology.json' 2026-01-13T10:37:34,820 adding 'unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json' 2026-01-13T10:37:34,821 adding 'unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json' 2026-01-13T10:37:34,823 adding 'unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json' 2026-01-13T10:37:34,824 adding 'unitxt/catalog/cards/global_mmlu/sv/college_medicine.json' 2026-01-13T10:37:34,826 adding 'unitxt/catalog/cards/global_mmlu/sv/college_physics.json' 2026-01-13T10:37:34,828 adding 'unitxt/catalog/cards/global_mmlu/sv/computer_security.json' 2026-01-13T10:37:34,830 adding 'unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json' 2026-01-13T10:37:34,831 adding 'unitxt/catalog/cards/global_mmlu/sv/econometrics.json' 2026-01-13T10:37:34,833 adding 'unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json' 2026-01-13T10:37:34,835 adding 'unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json' 2026-01-13T10:37:34,837 adding 'unitxt/catalog/cards/global_mmlu/sv/formal_logic.json' 2026-01-13T10:37:34,839 adding 'unitxt/catalog/cards/global_mmlu/sv/global_facts.json' 2026-01-13T10:37:34,841 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json' 2026-01-13T10:37:34,843 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json' 2026-01-13T10:37:34,844 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json' 2026-01-13T10:37:34,846 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json' 2026-01-13T10:37:34,848 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json' 2026-01-13T10:37:34,849 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json' 2026-01-13T10:37:34,851 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json' 2026-01-13T10:37:34,853 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json' 2026-01-13T10:37:34,855 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json' 2026-01-13T10:37:34,856 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json' 2026-01-13T10:37:34,858 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json' 2026-01-13T10:37:34,860 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json' 2026-01-13T10:37:34,862 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json' 2026-01-13T10:37:34,864 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json' 2026-01-13T10:37:34,865 adding 'unitxt/catalog/cards/global_mmlu/sv/human_aging.json' 2026-01-13T10:37:34,867 adding 'unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json' 2026-01-13T10:37:34,869 adding 'unitxt/catalog/cards/global_mmlu/sv/international_law.json' 2026-01-13T10:37:34,871 adding 'unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json' 2026-01-13T10:37:34,872 adding 'unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json' 2026-01-13T10:37:34,874 adding 'unitxt/catalog/cards/global_mmlu/sv/machine_learning.json' 2026-01-13T10:37:34,876 adding 'unitxt/catalog/cards/global_mmlu/sv/management.json' 2026-01-13T10:37:34,878 adding 'unitxt/catalog/cards/global_mmlu/sv/marketing.json' 2026-01-13T10:37:34,880 adding 'unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json' 2026-01-13T10:37:34,881 adding 'unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json' 2026-01-13T10:37:34,883 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json' 2026-01-13T10:37:34,885 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json' 2026-01-13T10:37:34,887 adding 'unitxt/catalog/cards/global_mmlu/sv/nutrition.json' 2026-01-13T10:37:34,889 adding 'unitxt/catalog/cards/global_mmlu/sv/philosophy.json' 2026-01-13T10:37:34,891 adding 'unitxt/catalog/cards/global_mmlu/sv/prehistory.json' 2026-01-13T10:37:34,893 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json' 2026-01-13T10:37:34,895 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_law.json' 2026-01-13T10:37:34,897 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json' 2026-01-13T10:37:34,899 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json' 2026-01-13T10:37:34,900 adding 'unitxt/catalog/cards/global_mmlu/sv/public_relations.json' 2026-01-13T10:37:34,902 adding 'unitxt/catalog/cards/global_mmlu/sv/security_studies.json' 2026-01-13T10:37:34,904 adding 'unitxt/catalog/cards/global_mmlu/sv/sociology.json' 2026-01-13T10:37:34,906 adding 'unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json' 2026-01-13T10:37:34,908 adding 'unitxt/catalog/cards/global_mmlu/sv/virology.json' 2026-01-13T10:37:34,910 adding 'unitxt/catalog/cards/global_mmlu/sv/world_religions.json' 2026-01-13T10:37:34,913 adding 'unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json' 2026-01-13T10:37:34,915 adding 'unitxt/catalog/cards/global_mmlu/sw/anatomy.json' 2026-01-13T10:37:34,917 adding 'unitxt/catalog/cards/global_mmlu/sw/astronomy.json' 2026-01-13T10:37:34,919 adding 'unitxt/catalog/cards/global_mmlu/sw/business_ethics.json' 2026-01-13T10:37:34,921 adding 'unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json' 2026-01-13T10:37:34,923 adding 'unitxt/catalog/cards/global_mmlu/sw/college_biology.json' 2026-01-13T10:37:34,924 adding 'unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json' 2026-01-13T10:37:34,926 adding 'unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json' 2026-01-13T10:37:34,927 adding 'unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json' 2026-01-13T10:37:34,928 adding 'unitxt/catalog/cards/global_mmlu/sw/college_medicine.json' 2026-01-13T10:37:34,929 adding 'unitxt/catalog/cards/global_mmlu/sw/college_physics.json' 2026-01-13T10:37:34,930 adding 'unitxt/catalog/cards/global_mmlu/sw/computer_security.json' 2026-01-13T10:37:34,932 adding 'unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json' 2026-01-13T10:37:34,933 adding 'unitxt/catalog/cards/global_mmlu/sw/econometrics.json' 2026-01-13T10:37:34,934 adding 'unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json' 2026-01-13T10:37:34,936 adding 'unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json' 2026-01-13T10:37:34,937 adding 'unitxt/catalog/cards/global_mmlu/sw/formal_logic.json' 2026-01-13T10:37:34,938 adding 'unitxt/catalog/cards/global_mmlu/sw/global_facts.json' 2026-01-13T10:37:34,939 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json' 2026-01-13T10:37:34,941 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json' 2026-01-13T10:37:34,942 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json' 2026-01-13T10:37:34,943 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json' 2026-01-13T10:37:34,945 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json' 2026-01-13T10:37:34,946 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json' 2026-01-13T10:37:34,947 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json' 2026-01-13T10:37:34,949 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json' 2026-01-13T10:37:34,950 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json' 2026-01-13T10:37:34,951 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json' 2026-01-13T10:37:34,952 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json' 2026-01-13T10:37:34,954 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json' 2026-01-13T10:37:34,955 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json' 2026-01-13T10:37:34,956 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json' 2026-01-13T10:37:34,958 adding 'unitxt/catalog/cards/global_mmlu/sw/human_aging.json' 2026-01-13T10:37:34,959 adding 'unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json' 2026-01-13T10:37:34,960 adding 'unitxt/catalog/cards/global_mmlu/sw/international_law.json' 2026-01-13T10:37:34,962 adding 'unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json' 2026-01-13T10:37:34,963 adding 'unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json' 2026-01-13T10:37:34,964 adding 'unitxt/catalog/cards/global_mmlu/sw/machine_learning.json' 2026-01-13T10:37:34,966 adding 'unitxt/catalog/cards/global_mmlu/sw/management.json' 2026-01-13T10:37:34,967 adding 'unitxt/catalog/cards/global_mmlu/sw/marketing.json' 2026-01-13T10:37:34,968 adding 'unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json' 2026-01-13T10:37:34,970 adding 'unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json' 2026-01-13T10:37:34,971 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json' 2026-01-13T10:37:34,972 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json' 2026-01-13T10:37:34,973 adding 'unitxt/catalog/cards/global_mmlu/sw/nutrition.json' 2026-01-13T10:37:34,975 adding 'unitxt/catalog/cards/global_mmlu/sw/philosophy.json' 2026-01-13T10:37:34,976 adding 'unitxt/catalog/cards/global_mmlu/sw/prehistory.json' 2026-01-13T10:37:34,978 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json' 2026-01-13T10:37:34,979 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_law.json' 2026-01-13T10:37:34,980 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json' 2026-01-13T10:37:34,981 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json' 2026-01-13T10:37:34,982 adding 'unitxt/catalog/cards/global_mmlu/sw/public_relations.json' 2026-01-13T10:37:34,983 adding 'unitxt/catalog/cards/global_mmlu/sw/security_studies.json' 2026-01-13T10:37:34,985 adding 'unitxt/catalog/cards/global_mmlu/sw/sociology.json' 2026-01-13T10:37:34,986 adding 'unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json' 2026-01-13T10:37:34,987 adding 'unitxt/catalog/cards/global_mmlu/sw/virology.json' 2026-01-13T10:37:34,988 adding 'unitxt/catalog/cards/global_mmlu/sw/world_religions.json' 2026-01-13T10:37:34,991 adding 'unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json' 2026-01-13T10:37:34,992 adding 'unitxt/catalog/cards/global_mmlu/te/anatomy.json' 2026-01-13T10:37:34,994 adding 'unitxt/catalog/cards/global_mmlu/te/astronomy.json' 2026-01-13T10:37:34,995 adding 'unitxt/catalog/cards/global_mmlu/te/business_ethics.json' 2026-01-13T10:37:34,996 adding 'unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json' 2026-01-13T10:37:34,998 adding 'unitxt/catalog/cards/global_mmlu/te/college_biology.json' 2026-01-13T10:37:34,999 adding 'unitxt/catalog/cards/global_mmlu/te/college_chemistry.json' 2026-01-13T10:37:35,000 adding 'unitxt/catalog/cards/global_mmlu/te/college_computer_science.json' 2026-01-13T10:37:35,001 adding 'unitxt/catalog/cards/global_mmlu/te/college_mathematics.json' 2026-01-13T10:37:35,003 adding 'unitxt/catalog/cards/global_mmlu/te/college_medicine.json' 2026-01-13T10:37:35,004 adding 'unitxt/catalog/cards/global_mmlu/te/college_physics.json' 2026-01-13T10:37:35,005 adding 'unitxt/catalog/cards/global_mmlu/te/computer_security.json' 2026-01-13T10:37:35,007 adding 'unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json' 2026-01-13T10:37:35,008 adding 'unitxt/catalog/cards/global_mmlu/te/econometrics.json' 2026-01-13T10:37:35,009 adding 'unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json' 2026-01-13T10:37:35,010 adding 'unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json' 2026-01-13T10:37:35,012 adding 'unitxt/catalog/cards/global_mmlu/te/formal_logic.json' 2026-01-13T10:37:35,013 adding 'unitxt/catalog/cards/global_mmlu/te/global_facts.json' 2026-01-13T10:37:35,014 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_biology.json' 2026-01-13T10:37:35,016 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json' 2026-01-13T10:37:35,017 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json' 2026-01-13T10:37:35,018 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json' 2026-01-13T10:37:35,020 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_geography.json' 2026-01-13T10:37:35,021 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json' 2026-01-13T10:37:35,022 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json' 2026-01-13T10:37:35,024 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json' 2026-01-13T10:37:35,025 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json' 2026-01-13T10:37:35,026 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_physics.json' 2026-01-13T10:37:35,028 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json' 2026-01-13T10:37:35,029 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json' 2026-01-13T10:37:35,030 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json' 2026-01-13T10:37:35,031 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json' 2026-01-13T10:37:35,033 adding 'unitxt/catalog/cards/global_mmlu/te/human_aging.json' 2026-01-13T10:37:35,034 adding 'unitxt/catalog/cards/global_mmlu/te/human_sexuality.json' 2026-01-13T10:37:35,035 adding 'unitxt/catalog/cards/global_mmlu/te/international_law.json' 2026-01-13T10:37:35,037 adding 'unitxt/catalog/cards/global_mmlu/te/jurisprudence.json' 2026-01-13T10:37:35,038 adding 'unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json' 2026-01-13T10:37:35,039 adding 'unitxt/catalog/cards/global_mmlu/te/machine_learning.json' 2026-01-13T10:37:35,040 adding 'unitxt/catalog/cards/global_mmlu/te/management.json' 2026-01-13T10:37:35,042 adding 'unitxt/catalog/cards/global_mmlu/te/marketing.json' 2026-01-13T10:37:35,043 adding 'unitxt/catalog/cards/global_mmlu/te/medical_genetics.json' 2026-01-13T10:37:35,044 adding 'unitxt/catalog/cards/global_mmlu/te/miscellaneous.json' 2026-01-13T10:37:35,045 adding 'unitxt/catalog/cards/global_mmlu/te/moral_disputes.json' 2026-01-13T10:37:35,047 adding 'unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json' 2026-01-13T10:37:35,048 adding 'unitxt/catalog/cards/global_mmlu/te/nutrition.json' 2026-01-13T10:37:35,049 adding 'unitxt/catalog/cards/global_mmlu/te/philosophy.json' 2026-01-13T10:37:35,050 adding 'unitxt/catalog/cards/global_mmlu/te/prehistory.json' 2026-01-13T10:37:35,052 adding 'unitxt/catalog/cards/global_mmlu/te/professional_accounting.json' 2026-01-13T10:37:35,053 adding 'unitxt/catalog/cards/global_mmlu/te/professional_law.json' 2026-01-13T10:37:35,054 adding 'unitxt/catalog/cards/global_mmlu/te/professional_medicine.json' 2026-01-13T10:37:35,056 adding 'unitxt/catalog/cards/global_mmlu/te/professional_psychology.json' 2026-01-13T10:37:35,057 adding 'unitxt/catalog/cards/global_mmlu/te/public_relations.json' 2026-01-13T10:37:35,058 adding 'unitxt/catalog/cards/global_mmlu/te/security_studies.json' 2026-01-13T10:37:35,060 adding 'unitxt/catalog/cards/global_mmlu/te/sociology.json' 2026-01-13T10:37:35,061 adding 'unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json' 2026-01-13T10:37:35,062 adding 'unitxt/catalog/cards/global_mmlu/te/virology.json' 2026-01-13T10:37:35,063 adding 'unitxt/catalog/cards/global_mmlu/te/world_religions.json' 2026-01-13T10:37:35,066 adding 'unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json' 2026-01-13T10:37:35,068 adding 'unitxt/catalog/cards/global_mmlu/tr/anatomy.json' 2026-01-13T10:37:35,069 adding 'unitxt/catalog/cards/global_mmlu/tr/astronomy.json' 2026-01-13T10:37:35,070 adding 'unitxt/catalog/cards/global_mmlu/tr/business_ethics.json' 2026-01-13T10:37:35,072 adding 'unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json' 2026-01-13T10:37:35,073 adding 'unitxt/catalog/cards/global_mmlu/tr/college_biology.json' 2026-01-13T10:37:35,074 adding 'unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json' 2026-01-13T10:37:35,076 adding 'unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json' 2026-01-13T10:37:35,077 adding 'unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json' 2026-01-13T10:37:35,078 adding 'unitxt/catalog/cards/global_mmlu/tr/college_medicine.json' 2026-01-13T10:37:35,079 adding 'unitxt/catalog/cards/global_mmlu/tr/college_physics.json' 2026-01-13T10:37:35,081 adding 'unitxt/catalog/cards/global_mmlu/tr/computer_security.json' 2026-01-13T10:37:35,082 adding 'unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json' 2026-01-13T10:37:35,083 adding 'unitxt/catalog/cards/global_mmlu/tr/econometrics.json' 2026-01-13T10:37:35,085 adding 'unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json' 2026-01-13T10:37:35,086 adding 'unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json' 2026-01-13T10:37:35,087 adding 'unitxt/catalog/cards/global_mmlu/tr/formal_logic.json' 2026-01-13T10:37:35,089 adding 'unitxt/catalog/cards/global_mmlu/tr/global_facts.json' 2026-01-13T10:37:35,090 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json' 2026-01-13T10:37:35,091 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json' 2026-01-13T10:37:35,093 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json' 2026-01-13T10:37:35,094 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json' 2026-01-13T10:37:35,095 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json' 2026-01-13T10:37:35,096 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json' 2026-01-13T10:37:35,098 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json' 2026-01-13T10:37:35,099 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json' 2026-01-13T10:37:35,100 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json' 2026-01-13T10:37:35,101 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json' 2026-01-13T10:37:35,103 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json' 2026-01-13T10:37:35,104 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json' 2026-01-13T10:37:35,105 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json' 2026-01-13T10:37:35,107 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json' 2026-01-13T10:37:35,108 adding 'unitxt/catalog/cards/global_mmlu/tr/human_aging.json' 2026-01-13T10:37:35,109 adding 'unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json' 2026-01-13T10:37:35,110 adding 'unitxt/catalog/cards/global_mmlu/tr/international_law.json' 2026-01-13T10:37:35,112 adding 'unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json' 2026-01-13T10:37:35,113 adding 'unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json' 2026-01-13T10:37:35,114 adding 'unitxt/catalog/cards/global_mmlu/tr/machine_learning.json' 2026-01-13T10:37:35,116 adding 'unitxt/catalog/cards/global_mmlu/tr/management.json' 2026-01-13T10:37:35,117 adding 'unitxt/catalog/cards/global_mmlu/tr/marketing.json' 2026-01-13T10:37:35,119 adding 'unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json' 2026-01-13T10:37:35,120 adding 'unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json' 2026-01-13T10:37:35,121 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json' 2026-01-13T10:37:35,123 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json' 2026-01-13T10:37:35,124 adding 'unitxt/catalog/cards/global_mmlu/tr/nutrition.json' 2026-01-13T10:37:35,126 adding 'unitxt/catalog/cards/global_mmlu/tr/philosophy.json' 2026-01-13T10:37:35,127 adding 'unitxt/catalog/cards/global_mmlu/tr/prehistory.json' 2026-01-13T10:37:35,129 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json' 2026-01-13T10:37:35,130 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_law.json' 2026-01-13T10:37:35,131 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json' 2026-01-13T10:37:35,133 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json' 2026-01-13T10:37:35,134 adding 'unitxt/catalog/cards/global_mmlu/tr/public_relations.json' 2026-01-13T10:37:35,135 adding 'unitxt/catalog/cards/global_mmlu/tr/security_studies.json' 2026-01-13T10:37:35,137 adding 'unitxt/catalog/cards/global_mmlu/tr/sociology.json' 2026-01-13T10:37:35,138 adding 'unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json' 2026-01-13T10:37:35,140 adding 'unitxt/catalog/cards/global_mmlu/tr/virology.json' 2026-01-13T10:37:35,141 adding 'unitxt/catalog/cards/global_mmlu/tr/world_religions.json' 2026-01-13T10:37:35,144 adding 'unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json' 2026-01-13T10:37:35,145 adding 'unitxt/catalog/cards/global_mmlu/uk/anatomy.json' 2026-01-13T10:37:35,146 adding 'unitxt/catalog/cards/global_mmlu/uk/astronomy.json' 2026-01-13T10:37:35,148 adding 'unitxt/catalog/cards/global_mmlu/uk/business_ethics.json' 2026-01-13T10:37:35,149 adding 'unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json' 2026-01-13T10:37:35,150 adding 'unitxt/catalog/cards/global_mmlu/uk/college_biology.json' 2026-01-13T10:37:35,152 adding 'unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json' 2026-01-13T10:37:35,153 adding 'unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json' 2026-01-13T10:37:35,154 adding 'unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json' 2026-01-13T10:37:35,156 adding 'unitxt/catalog/cards/global_mmlu/uk/college_medicine.json' 2026-01-13T10:37:35,157 adding 'unitxt/catalog/cards/global_mmlu/uk/college_physics.json' 2026-01-13T10:37:35,158 adding 'unitxt/catalog/cards/global_mmlu/uk/computer_security.json' 2026-01-13T10:37:35,159 adding 'unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json' 2026-01-13T10:37:35,161 adding 'unitxt/catalog/cards/global_mmlu/uk/econometrics.json' 2026-01-13T10:37:35,162 adding 'unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json' 2026-01-13T10:37:35,163 adding 'unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json' 2026-01-13T10:37:35,164 adding 'unitxt/catalog/cards/global_mmlu/uk/formal_logic.json' 2026-01-13T10:37:35,166 adding 'unitxt/catalog/cards/global_mmlu/uk/global_facts.json' 2026-01-13T10:37:35,167 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json' 2026-01-13T10:37:35,168 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json' 2026-01-13T10:37:35,170 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json' 2026-01-13T10:37:35,171 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json' 2026-01-13T10:37:35,172 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json' 2026-01-13T10:37:35,173 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json' 2026-01-13T10:37:35,175 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json' 2026-01-13T10:37:35,176 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json' 2026-01-13T10:37:35,177 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json' 2026-01-13T10:37:35,179 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json' 2026-01-13T10:37:35,180 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json' 2026-01-13T10:37:35,181 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json' 2026-01-13T10:37:35,182 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json' 2026-01-13T10:37:35,184 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json' 2026-01-13T10:37:35,185 adding 'unitxt/catalog/cards/global_mmlu/uk/human_aging.json' 2026-01-13T10:37:35,186 adding 'unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json' 2026-01-13T10:37:35,188 adding 'unitxt/catalog/cards/global_mmlu/uk/international_law.json' 2026-01-13T10:37:35,189 adding 'unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json' 2026-01-13T10:37:35,190 adding 'unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json' 2026-01-13T10:37:35,192 adding 'unitxt/catalog/cards/global_mmlu/uk/machine_learning.json' 2026-01-13T10:37:35,193 adding 'unitxt/catalog/cards/global_mmlu/uk/management.json' 2026-01-13T10:37:35,194 adding 'unitxt/catalog/cards/global_mmlu/uk/marketing.json' 2026-01-13T10:37:35,196 adding 'unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json' 2026-01-13T10:37:35,197 adding 'unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json' 2026-01-13T10:37:35,198 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json' 2026-01-13T10:37:35,200 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json' 2026-01-13T10:37:35,201 adding 'unitxt/catalog/cards/global_mmlu/uk/nutrition.json' 2026-01-13T10:37:35,202 adding 'unitxt/catalog/cards/global_mmlu/uk/philosophy.json' 2026-01-13T10:37:35,204 adding 'unitxt/catalog/cards/global_mmlu/uk/prehistory.json' 2026-01-13T10:37:35,205 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json' 2026-01-13T10:37:35,206 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_law.json' 2026-01-13T10:37:35,208 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json' 2026-01-13T10:37:35,209 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json' 2026-01-13T10:37:35,210 adding 'unitxt/catalog/cards/global_mmlu/uk/public_relations.json' 2026-01-13T10:37:35,211 adding 'unitxt/catalog/cards/global_mmlu/uk/security_studies.json' 2026-01-13T10:37:35,212 adding 'unitxt/catalog/cards/global_mmlu/uk/sociology.json' 2026-01-13T10:37:35,214 adding 'unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json' 2026-01-13T10:37:35,215 adding 'unitxt/catalog/cards/global_mmlu/uk/virology.json' 2026-01-13T10:37:35,216 adding 'unitxt/catalog/cards/global_mmlu/uk/world_religions.json' 2026-01-13T10:37:35,219 adding 'unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json' 2026-01-13T10:37:35,220 adding 'unitxt/catalog/cards/global_mmlu/vi/anatomy.json' 2026-01-13T10:37:35,221 adding 'unitxt/catalog/cards/global_mmlu/vi/astronomy.json' 2026-01-13T10:37:35,223 adding 'unitxt/catalog/cards/global_mmlu/vi/business_ethics.json' 2026-01-13T10:37:35,224 adding 'unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json' 2026-01-13T10:37:35,225 adding 'unitxt/catalog/cards/global_mmlu/vi/college_biology.json' 2026-01-13T10:37:35,227 adding 'unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json' 2026-01-13T10:37:35,228 adding 'unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json' 2026-01-13T10:37:35,229 adding 'unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json' 2026-01-13T10:37:35,231 adding 'unitxt/catalog/cards/global_mmlu/vi/college_medicine.json' 2026-01-13T10:37:35,232 adding 'unitxt/catalog/cards/global_mmlu/vi/college_physics.json' 2026-01-13T10:37:35,233 adding 'unitxt/catalog/cards/global_mmlu/vi/computer_security.json' 2026-01-13T10:37:35,235 adding 'unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json' 2026-01-13T10:37:35,236 adding 'unitxt/catalog/cards/global_mmlu/vi/econometrics.json' 2026-01-13T10:37:35,237 adding 'unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json' 2026-01-13T10:37:35,239 adding 'unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json' 2026-01-13T10:37:35,240 adding 'unitxt/catalog/cards/global_mmlu/vi/formal_logic.json' 2026-01-13T10:37:35,241 adding 'unitxt/catalog/cards/global_mmlu/vi/global_facts.json' 2026-01-13T10:37:35,242 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json' 2026-01-13T10:37:35,244 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json' 2026-01-13T10:37:35,245 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json' 2026-01-13T10:37:35,246 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json' 2026-01-13T10:37:35,248 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json' 2026-01-13T10:37:35,249 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json' 2026-01-13T10:37:35,250 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json' 2026-01-13T10:37:35,252 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json' 2026-01-13T10:37:35,253 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json' 2026-01-13T10:37:35,254 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json' 2026-01-13T10:37:35,256 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json' 2026-01-13T10:37:35,257 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json' 2026-01-13T10:37:35,258 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json' 2026-01-13T10:37:35,260 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json' 2026-01-13T10:37:35,261 adding 'unitxt/catalog/cards/global_mmlu/vi/human_aging.json' 2026-01-13T10:37:35,262 adding 'unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json' 2026-01-13T10:37:35,264 adding 'unitxt/catalog/cards/global_mmlu/vi/international_law.json' 2026-01-13T10:37:35,265 adding 'unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json' 2026-01-13T10:37:35,266 adding 'unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json' 2026-01-13T10:37:35,268 adding 'unitxt/catalog/cards/global_mmlu/vi/machine_learning.json' 2026-01-13T10:37:35,269 adding 'unitxt/catalog/cards/global_mmlu/vi/management.json' 2026-01-13T10:37:35,270 adding 'unitxt/catalog/cards/global_mmlu/vi/marketing.json' 2026-01-13T10:37:35,271 adding 'unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json' 2026-01-13T10:37:35,272 adding 'unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json' 2026-01-13T10:37:35,274 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json' 2026-01-13T10:37:35,275 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json' 2026-01-13T10:37:35,276 adding 'unitxt/catalog/cards/global_mmlu/vi/nutrition.json' 2026-01-13T10:37:35,278 adding 'unitxt/catalog/cards/global_mmlu/vi/philosophy.json' 2026-01-13T10:37:35,279 adding 'unitxt/catalog/cards/global_mmlu/vi/prehistory.json' 2026-01-13T10:37:35,280 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json' 2026-01-13T10:37:35,281 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_law.json' 2026-01-13T10:37:35,283 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json' 2026-01-13T10:37:35,284 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json' 2026-01-13T10:37:35,285 adding 'unitxt/catalog/cards/global_mmlu/vi/public_relations.json' 2026-01-13T10:37:35,286 adding 'unitxt/catalog/cards/global_mmlu/vi/security_studies.json' 2026-01-13T10:37:35,288 adding 'unitxt/catalog/cards/global_mmlu/vi/sociology.json' 2026-01-13T10:37:35,289 adding 'unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json' 2026-01-13T10:37:35,291 adding 'unitxt/catalog/cards/global_mmlu/vi/virology.json' 2026-01-13T10:37:35,292 adding 'unitxt/catalog/cards/global_mmlu/vi/world_religions.json' 2026-01-13T10:37:35,295 adding 'unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json' 2026-01-13T10:37:35,297 adding 'unitxt/catalog/cards/global_mmlu/yo/anatomy.json' 2026-01-13T10:37:35,298 adding 'unitxt/catalog/cards/global_mmlu/yo/astronomy.json' 2026-01-13T10:37:35,299 adding 'unitxt/catalog/cards/global_mmlu/yo/business_ethics.json' 2026-01-13T10:37:35,300 adding 'unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json' 2026-01-13T10:37:35,302 adding 'unitxt/catalog/cards/global_mmlu/yo/college_biology.json' 2026-01-13T10:37:35,303 adding 'unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json' 2026-01-13T10:37:35,304 adding 'unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json' 2026-01-13T10:37:35,306 adding 'unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json' 2026-01-13T10:37:35,307 adding 'unitxt/catalog/cards/global_mmlu/yo/college_medicine.json' 2026-01-13T10:37:35,308 adding 'unitxt/catalog/cards/global_mmlu/yo/college_physics.json' 2026-01-13T10:37:35,310 adding 'unitxt/catalog/cards/global_mmlu/yo/computer_security.json' 2026-01-13T10:37:35,311 adding 'unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json' 2026-01-13T10:37:35,313 adding 'unitxt/catalog/cards/global_mmlu/yo/econometrics.json' 2026-01-13T10:37:35,314 adding 'unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json' 2026-01-13T10:37:35,316 adding 'unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json' 2026-01-13T10:37:35,317 adding 'unitxt/catalog/cards/global_mmlu/yo/formal_logic.json' 2026-01-13T10:37:35,319 adding 'unitxt/catalog/cards/global_mmlu/yo/global_facts.json' 2026-01-13T10:37:35,320 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json' 2026-01-13T10:37:35,322 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json' 2026-01-13T10:37:35,323 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json' 2026-01-13T10:37:35,325 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json' 2026-01-13T10:37:35,326 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json' 2026-01-13T10:37:35,328 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json' 2026-01-13T10:37:35,329 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json' 2026-01-13T10:37:35,331 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json' 2026-01-13T10:37:35,332 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json' 2026-01-13T10:37:35,334 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json' 2026-01-13T10:37:35,335 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json' 2026-01-13T10:37:35,336 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json' 2026-01-13T10:37:35,338 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json' 2026-01-13T10:37:35,339 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json' 2026-01-13T10:37:35,341 adding 'unitxt/catalog/cards/global_mmlu/yo/human_aging.json' 2026-01-13T10:37:35,342 adding 'unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json' 2026-01-13T10:37:35,344 adding 'unitxt/catalog/cards/global_mmlu/yo/international_law.json' 2026-01-13T10:37:35,345 adding 'unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json' 2026-01-13T10:37:35,347 adding 'unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json' 2026-01-13T10:37:35,348 adding 'unitxt/catalog/cards/global_mmlu/yo/machine_learning.json' 2026-01-13T10:37:35,349 adding 'unitxt/catalog/cards/global_mmlu/yo/management.json' 2026-01-13T10:37:35,351 adding 'unitxt/catalog/cards/global_mmlu/yo/marketing.json' 2026-01-13T10:37:35,352 adding 'unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json' 2026-01-13T10:37:35,353 adding 'unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json' 2026-01-13T10:37:35,355 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json' 2026-01-13T10:37:35,356 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json' 2026-01-13T10:37:35,357 adding 'unitxt/catalog/cards/global_mmlu/yo/nutrition.json' 2026-01-13T10:37:35,359 adding 'unitxt/catalog/cards/global_mmlu/yo/philosophy.json' 2026-01-13T10:37:35,360 adding 'unitxt/catalog/cards/global_mmlu/yo/prehistory.json' 2026-01-13T10:37:35,361 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json' 2026-01-13T10:37:35,362 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_law.json' 2026-01-13T10:37:35,364 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json' 2026-01-13T10:37:35,365 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json' 2026-01-13T10:37:35,366 adding 'unitxt/catalog/cards/global_mmlu/yo/public_relations.json' 2026-01-13T10:37:35,368 adding 'unitxt/catalog/cards/global_mmlu/yo/security_studies.json' 2026-01-13T10:37:35,369 adding 'unitxt/catalog/cards/global_mmlu/yo/sociology.json' 2026-01-13T10:37:35,371 adding 'unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json' 2026-01-13T10:37:35,373 adding 'unitxt/catalog/cards/global_mmlu/yo/virology.json' 2026-01-13T10:37:35,374 adding 'unitxt/catalog/cards/global_mmlu/yo/world_religions.json' 2026-01-13T10:37:35,377 adding 'unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json' 2026-01-13T10:37:35,378 adding 'unitxt/catalog/cards/global_mmlu/zh/anatomy.json' 2026-01-13T10:37:35,380 adding 'unitxt/catalog/cards/global_mmlu/zh/astronomy.json' 2026-01-13T10:37:35,381 adding 'unitxt/catalog/cards/global_mmlu/zh/business_ethics.json' 2026-01-13T10:37:35,383 adding 'unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json' 2026-01-13T10:37:35,385 adding 'unitxt/catalog/cards/global_mmlu/zh/college_biology.json' 2026-01-13T10:37:35,386 adding 'unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json' 2026-01-13T10:37:35,388 adding 'unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json' 2026-01-13T10:37:35,389 adding 'unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json' 2026-01-13T10:37:35,391 adding 'unitxt/catalog/cards/global_mmlu/zh/college_medicine.json' 2026-01-13T10:37:35,392 adding 'unitxt/catalog/cards/global_mmlu/zh/college_physics.json' 2026-01-13T10:37:35,393 adding 'unitxt/catalog/cards/global_mmlu/zh/computer_security.json' 2026-01-13T10:37:35,394 adding 'unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json' 2026-01-13T10:37:35,396 adding 'unitxt/catalog/cards/global_mmlu/zh/econometrics.json' 2026-01-13T10:37:35,397 adding 'unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json' 2026-01-13T10:37:35,398 adding 'unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json' 2026-01-13T10:37:35,400 adding 'unitxt/catalog/cards/global_mmlu/zh/formal_logic.json' 2026-01-13T10:37:35,401 adding 'unitxt/catalog/cards/global_mmlu/zh/global_facts.json' 2026-01-13T10:37:35,402 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json' 2026-01-13T10:37:35,404 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json' 2026-01-13T10:37:35,405 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json' 2026-01-13T10:37:35,406 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json' 2026-01-13T10:37:35,408 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json' 2026-01-13T10:37:35,409 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json' 2026-01-13T10:37:35,410 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json' 2026-01-13T10:37:35,411 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json' 2026-01-13T10:37:35,413 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json' 2026-01-13T10:37:35,414 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json' 2026-01-13T10:37:35,415 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json' 2026-01-13T10:37:35,416 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json' 2026-01-13T10:37:35,418 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json' 2026-01-13T10:37:35,419 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json' 2026-01-13T10:37:35,420 adding 'unitxt/catalog/cards/global_mmlu/zh/human_aging.json' 2026-01-13T10:37:35,422 adding 'unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json' 2026-01-13T10:37:35,423 adding 'unitxt/catalog/cards/global_mmlu/zh/international_law.json' 2026-01-13T10:37:35,424 adding 'unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json' 2026-01-13T10:37:35,426 adding 'unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json' 2026-01-13T10:37:35,427 adding 'unitxt/catalog/cards/global_mmlu/zh/machine_learning.json' 2026-01-13T10:37:35,428 adding 'unitxt/catalog/cards/global_mmlu/zh/management.json' 2026-01-13T10:37:35,430 adding 'unitxt/catalog/cards/global_mmlu/zh/marketing.json' 2026-01-13T10:37:35,431 adding 'unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json' 2026-01-13T10:37:35,432 adding 'unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json' 2026-01-13T10:37:35,434 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json' 2026-01-13T10:37:35,435 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json' 2026-01-13T10:37:35,436 adding 'unitxt/catalog/cards/global_mmlu/zh/nutrition.json' 2026-01-13T10:37:35,438 adding 'unitxt/catalog/cards/global_mmlu/zh/philosophy.json' 2026-01-13T10:37:35,439 adding 'unitxt/catalog/cards/global_mmlu/zh/prehistory.json' 2026-01-13T10:37:35,440 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json' 2026-01-13T10:37:35,442 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_law.json' 2026-01-13T10:37:35,443 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json' 2026-01-13T10:37:35,444 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json' 2026-01-13T10:37:35,446 adding 'unitxt/catalog/cards/global_mmlu/zh/public_relations.json' 2026-01-13T10:37:35,447 adding 'unitxt/catalog/cards/global_mmlu/zh/security_studies.json' 2026-01-13T10:37:35,449 adding 'unitxt/catalog/cards/global_mmlu/zh/sociology.json' 2026-01-13T10:37:35,450 adding 'unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json' 2026-01-13T10:37:35,451 adding 'unitxt/catalog/cards/global_mmlu/zh/virology.json' 2026-01-13T10:37:35,453 adding 'unitxt/catalog/cards/global_mmlu/zh/world_religions.json' 2026-01-13T10:37:35,455 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ar.json' 2026-01-13T10:37:35,456 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/bn.json' 2026-01-13T10:37:35,458 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/de.json' 2026-01-13T10:37:35,460 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/es.json' 2026-01-13T10:37:35,461 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/fr.json' 2026-01-13T10:37:35,463 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/hi.json' 2026-01-13T10:37:35,464 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/id.json' 2026-01-13T10:37:35,466 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/it.json' 2026-01-13T10:37:35,468 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ja.json' 2026-01-13T10:37:35,469 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ko.json' 2026-01-13T10:37:35,471 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/pt.json' 2026-01-13T10:37:35,472 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/sw.json' 2026-01-13T10:37:35,474 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/yo.json' 2026-01-13T10:37:35,475 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/zh.json' 2026-01-13T10:37:35,478 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ar.json' 2026-01-13T10:37:35,479 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/bn.json' 2026-01-13T10:37:35,481 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/de.json' 2026-01-13T10:37:35,482 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/es.json' 2026-01-13T10:37:35,484 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/fr.json' 2026-01-13T10:37:35,485 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/hi.json' 2026-01-13T10:37:35,487 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/id.json' 2026-01-13T10:37:35,489 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/it.json' 2026-01-13T10:37:35,490 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ja.json' 2026-01-13T10:37:35,492 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ko.json' 2026-01-13T10:37:35,493 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/pt.json' 2026-01-13T10:37:35,495 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/sw.json' 2026-01-13T10:37:35,496 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/yo.json' 2026-01-13T10:37:35,498 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/zh.json' 2026-01-13T10:37:35,500 adding 'unitxt/catalog/cards/go_emotions/simplified.json' 2026-01-13T10:37:35,502 adding 'unitxt/catalog/cards/gpqa/diamond.json' 2026-01-13T10:37:35,503 adding 'unitxt/catalog/cards/gpqa/extended.json' 2026-01-13T10:37:35,504 adding 'unitxt/catalog/cards/gpqa/main.json' 2026-01-13T10:37:35,506 adding 'unitxt/catalog/cards/head_qa/en.json' 2026-01-13T10:37:35,507 adding 'unitxt/catalog/cards/head_qa/es.json' 2026-01-13T10:37:35,509 adding 'unitxt/catalog/cards/head_qa/gl.json' 2026-01-13T10:37:35,510 adding 'unitxt/catalog/cards/head_qa/it.json' 2026-01-13T10:37:35,511 adding 'unitxt/catalog/cards/head_qa/ru.json' 2026-01-13T10:37:35,513 adding 'unitxt/catalog/cards/judge_bench/cola/grammaticality.json' 2026-01-13T10:37:35,515 adding 'unitxt/catalog/cards/judge_bench/dices/safety.json' 2026-01-13T10:37:35,517 adding 'unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json' 2026-01-13T10:37:35,519 adding 'unitxt/catalog/cards/judge_bench/newswoom/coherence.json' 2026-01-13T10:37:35,520 adding 'unitxt/catalog/cards/judge_bench/newswoom/fluency.json' 2026-01-13T10:37:35,521 adding 'unitxt/catalog/cards/judge_bench/newswoom/informativeness.json' 2026-01-13T10:37:35,523 adding 'unitxt/catalog/cards/judge_bench/newswoom/relevance.json' 2026-01-13T10:37:35,525 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json' 2026-01-13T10:37:35,527 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json' 2026-01-13T10:37:35,528 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json' 2026-01-13T10:37:35,529 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json' 2026-01-13T10:37:35,531 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json' 2026-01-13T10:37:35,532 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json' 2026-01-13T10:37:35,533 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json' 2026-01-13T10:37:35,534 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json' 2026-01-13T10:37:35,536 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json' 2026-01-13T10:37:35,537 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json' 2026-01-13T10:37:35,539 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json' 2026-01-13T10:37:35,540 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json' 2026-01-13T10:37:35,543 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json' 2026-01-13T10:37:35,544 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json' 2026-01-13T10:37:35,545 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json' 2026-01-13T10:37:35,546 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json' 2026-01-13T10:37:35,548 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json' 2026-01-13T10:37:35,549 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json' 2026-01-13T10:37:35,551 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json' 2026-01-13T10:37:35,552 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json' 2026-01-13T10:37:35,553 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json' 2026-01-13T10:37:35,555 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json' 2026-01-13T10:37:35,557 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json' 2026-01-13T10:37:35,558 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json' 2026-01-13T10:37:35,559 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json' 2026-01-13T10:37:35,561 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json' 2026-01-13T10:37:35,562 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json' 2026-01-13T10:37:35,563 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json' 2026-01-13T10:37:35,565 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json' 2026-01-13T10:37:35,566 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json' 2026-01-13T10:37:35,568 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json' 2026-01-13T10:37:35,570 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json' 2026-01-13T10:37:35,571 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json' 2026-01-13T10:37:35,572 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json' 2026-01-13T10:37:35,574 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json' 2026-01-13T10:37:35,575 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json' 2026-01-13T10:37:35,576 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json' 2026-01-13T10:37:35,578 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json' 2026-01-13T10:37:35,579 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json' 2026-01-13T10:37:35,581 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json' 2026-01-13T10:37:35,582 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json' 2026-01-13T10:37:35,584 adding 'unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json' 2026-01-13T10:37:35,586 adding 'unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json' 2026-01-13T10:37:35,588 adding 'unitxt/catalog/cards/legalbench/abercrombie.json' 2026-01-13T10:37:35,589 adding 'unitxt/catalog/cards/legalbench/corporate_lobbying.json' 2026-01-13T10:37:35,590 adding 'unitxt/catalog/cards/legalbench/function_of_decision_section.json' 2026-01-13T10:37:35,591 adding 'unitxt/catalog/cards/legalbench/international_citizenship_questions.json' 2026-01-13T10:37:35,593 adding 'unitxt/catalog/cards/legalbench/proa.json' 2026-01-13T10:37:35,595 adding 'unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json' 2026-01-13T10:37:35,597 adding 'unitxt/catalog/cards/milu/Bengali/Business_Studies.json' 2026-01-13T10:37:35,598 adding 'unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json' 2026-01-13T10:37:35,599 adding 'unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json' 2026-01-13T10:37:35,601 adding 'unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json' 2026-01-13T10:37:35,602 adding 'unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json' 2026-01-13T10:37:35,603 adding 'unitxt/catalog/cards/milu/Bengali/Science.json' 2026-01-13T10:37:35,604 adding 'unitxt/catalog/cards/milu/Bengali/Social_Sciences.json' 2026-01-13T10:37:35,606 adding 'unitxt/catalog/cards/milu/English/Arts_and_Humanities.json' 2026-01-13T10:37:35,608 adding 'unitxt/catalog/cards/milu/English/Business_Studies.json' 2026-01-13T10:37:35,609 adding 'unitxt/catalog/cards/milu/English/Engineering_and_Tech.json' 2026-01-13T10:37:35,610 adding 'unitxt/catalog/cards/milu/English/Environmental_Sciences.json' 2026-01-13T10:37:35,612 adding 'unitxt/catalog/cards/milu/English/Health_and_Medicine.json' 2026-01-13T10:37:35,613 adding 'unitxt/catalog/cards/milu/English/Law_and_Governance.json' 2026-01-13T10:37:35,614 adding 'unitxt/catalog/cards/milu/English/Science.json' 2026-01-13T10:37:35,616 adding 'unitxt/catalog/cards/milu/English/Social_Sciences.json' 2026-01-13T10:37:35,618 adding 'unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json' 2026-01-13T10:37:35,619 adding 'unitxt/catalog/cards/milu/Gujarati/Business_Studies.json' 2026-01-13T10:37:35,620 adding 'unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json' 2026-01-13T10:37:35,622 adding 'unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json' 2026-01-13T10:37:35,623 adding 'unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json' 2026-01-13T10:37:35,624 adding 'unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json' 2026-01-13T10:37:35,626 adding 'unitxt/catalog/cards/milu/Gujarati/Science.json' 2026-01-13T10:37:35,627 adding 'unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json' 2026-01-13T10:37:35,629 adding 'unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json' 2026-01-13T10:37:35,630 adding 'unitxt/catalog/cards/milu/Hindi/Business_Studies.json' 2026-01-13T10:37:35,632 adding 'unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json' 2026-01-13T10:37:35,633 adding 'unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json' 2026-01-13T10:37:35,634 adding 'unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json' 2026-01-13T10:37:35,636 adding 'unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json' 2026-01-13T10:37:35,637 adding 'unitxt/catalog/cards/milu/Hindi/Science.json' 2026-01-13T10:37:35,639 adding 'unitxt/catalog/cards/milu/Hindi/Social_Sciences.json' 2026-01-13T10:37:35,641 adding 'unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json' 2026-01-13T10:37:35,642 adding 'unitxt/catalog/cards/milu/Kannada/Business_Studies.json' 2026-01-13T10:37:35,643 adding 'unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json' 2026-01-13T10:37:35,645 adding 'unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json' 2026-01-13T10:37:35,646 adding 'unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json' 2026-01-13T10:37:35,647 adding 'unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json' 2026-01-13T10:37:35,649 adding 'unitxt/catalog/cards/milu/Kannada/Science.json' 2026-01-13T10:37:35,650 adding 'unitxt/catalog/cards/milu/Kannada/Social_Sciences.json' 2026-01-13T10:37:35,652 adding 'unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json' 2026-01-13T10:37:35,653 adding 'unitxt/catalog/cards/milu/Malayalam/Business_Studies.json' 2026-01-13T10:37:35,654 adding 'unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json' 2026-01-13T10:37:35,656 adding 'unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json' 2026-01-13T10:37:35,657 adding 'unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json' 2026-01-13T10:37:35,658 adding 'unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json' 2026-01-13T10:37:35,660 adding 'unitxt/catalog/cards/milu/Malayalam/Science.json' 2026-01-13T10:37:35,661 adding 'unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json' 2026-01-13T10:37:35,663 adding 'unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json' 2026-01-13T10:37:35,664 adding 'unitxt/catalog/cards/milu/Marathi/Business_Studies.json' 2026-01-13T10:37:35,665 adding 'unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json' 2026-01-13T10:37:35,666 adding 'unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json' 2026-01-13T10:37:35,668 adding 'unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json' 2026-01-13T10:37:35,669 adding 'unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json' 2026-01-13T10:37:35,670 adding 'unitxt/catalog/cards/milu/Marathi/Science.json' 2026-01-13T10:37:35,672 adding 'unitxt/catalog/cards/milu/Marathi/Social_Sciences.json' 2026-01-13T10:37:35,674 adding 'unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json' 2026-01-13T10:37:35,675 adding 'unitxt/catalog/cards/milu/Odia/Business_Studies.json' 2026-01-13T10:37:35,676 adding 'unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json' 2026-01-13T10:37:35,678 adding 'unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json' 2026-01-13T10:37:35,679 adding 'unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json' 2026-01-13T10:37:35,680 adding 'unitxt/catalog/cards/milu/Odia/Law_and_Governance.json' 2026-01-13T10:37:35,682 adding 'unitxt/catalog/cards/milu/Odia/Science.json' 2026-01-13T10:37:35,683 adding 'unitxt/catalog/cards/milu/Odia/Social_Sciences.json' 2026-01-13T10:37:35,685 adding 'unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json' 2026-01-13T10:37:35,687 adding 'unitxt/catalog/cards/milu/Punjabi/Business_Studies.json' 2026-01-13T10:37:35,688 adding 'unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json' 2026-01-13T10:37:35,690 adding 'unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json' 2026-01-13T10:37:35,691 adding 'unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json' 2026-01-13T10:37:35,693 adding 'unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json' 2026-01-13T10:37:35,694 adding 'unitxt/catalog/cards/milu/Punjabi/Science.json' 2026-01-13T10:37:35,695 adding 'unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json' 2026-01-13T10:37:35,697 adding 'unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json' 2026-01-13T10:37:35,698 adding 'unitxt/catalog/cards/milu/Tamil/Business_Studies.json' 2026-01-13T10:37:35,700 adding 'unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json' 2026-01-13T10:37:35,701 adding 'unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json' 2026-01-13T10:37:35,703 adding 'unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json' 2026-01-13T10:37:35,704 adding 'unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json' 2026-01-13T10:37:35,706 adding 'unitxt/catalog/cards/milu/Tamil/Science.json' 2026-01-13T10:37:35,707 adding 'unitxt/catalog/cards/milu/Tamil/Social_Sciences.json' 2026-01-13T10:37:35,709 adding 'unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json' 2026-01-13T10:37:35,710 adding 'unitxt/catalog/cards/milu/Telugu/Business_Studies.json' 2026-01-13T10:37:35,712 adding 'unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json' 2026-01-13T10:37:35,713 adding 'unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json' 2026-01-13T10:37:35,714 adding 'unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json' 2026-01-13T10:37:35,715 adding 'unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json' 2026-01-13T10:37:35,717 adding 'unitxt/catalog/cards/milu/Telugu/Science.json' 2026-01-13T10:37:35,718 adding 'unitxt/catalog/cards/milu/Telugu/Social_Sciences.json' 2026-01-13T10:37:35,719 adding 'unitxt/catalog/cards/mlsum/de.json' 2026-01-13T10:37:35,721 adding 'unitxt/catalog/cards/mlsum/es.json' 2026-01-13T10:37:35,722 adding 'unitxt/catalog/cards/mlsum/fr.json' 2026-01-13T10:37:35,723 adding 'unitxt/catalog/cards/mlsum/ru.json' 2026-01-13T10:37:35,725 adding 'unitxt/catalog/cards/mlsum/tu.json' 2026-01-13T10:37:35,727 adding 'unitxt/catalog/cards/mmlu/abstract_algebra.json' 2026-01-13T10:37:35,728 adding 'unitxt/catalog/cards/mmlu/anatomy.json' 2026-01-13T10:37:35,730 adding 'unitxt/catalog/cards/mmlu/astronomy.json' 2026-01-13T10:37:35,731 adding 'unitxt/catalog/cards/mmlu/business_ethics.json' 2026-01-13T10:37:35,732 adding 'unitxt/catalog/cards/mmlu/clinical_knowledge.json' 2026-01-13T10:37:35,733 adding 'unitxt/catalog/cards/mmlu/college_biology.json' 2026-01-13T10:37:35,734 adding 'unitxt/catalog/cards/mmlu/college_chemistry.json' 2026-01-13T10:37:35,736 adding 'unitxt/catalog/cards/mmlu/college_computer_science.json' 2026-01-13T10:37:35,737 adding 'unitxt/catalog/cards/mmlu/college_mathematics.json' 2026-01-13T10:37:35,738 adding 'unitxt/catalog/cards/mmlu/college_medicine.json' 2026-01-13T10:37:35,740 adding 'unitxt/catalog/cards/mmlu/college_physics.json' 2026-01-13T10:37:35,741 adding 'unitxt/catalog/cards/mmlu/computer_security.json' 2026-01-13T10:37:35,742 adding 'unitxt/catalog/cards/mmlu/conceptual_physics.json' 2026-01-13T10:37:35,744 adding 'unitxt/catalog/cards/mmlu/econometrics.json' 2026-01-13T10:37:35,745 adding 'unitxt/catalog/cards/mmlu/electrical_engineering.json' 2026-01-13T10:37:35,746 adding 'unitxt/catalog/cards/mmlu/elementary_mathematics.json' 2026-01-13T10:37:35,748 adding 'unitxt/catalog/cards/mmlu/formal_logic.json' 2026-01-13T10:37:35,749 adding 'unitxt/catalog/cards/mmlu/global_facts.json' 2026-01-13T10:37:35,750 adding 'unitxt/catalog/cards/mmlu/high_school_biology.json' 2026-01-13T10:37:35,751 adding 'unitxt/catalog/cards/mmlu/high_school_chemistry.json' 2026-01-13T10:37:35,753 adding 'unitxt/catalog/cards/mmlu/high_school_computer_science.json' 2026-01-13T10:37:35,754 adding 'unitxt/catalog/cards/mmlu/high_school_european_history.json' 2026-01-13T10:37:35,756 adding 'unitxt/catalog/cards/mmlu/high_school_geography.json' 2026-01-13T10:37:35,757 adding 'unitxt/catalog/cards/mmlu/high_school_government_and_politics.json' 2026-01-13T10:37:35,759 adding 'unitxt/catalog/cards/mmlu/high_school_macroeconomics.json' 2026-01-13T10:37:35,760 adding 'unitxt/catalog/cards/mmlu/high_school_mathematics.json' 2026-01-13T10:37:35,761 adding 'unitxt/catalog/cards/mmlu/high_school_microeconomics.json' 2026-01-13T10:37:35,763 adding 'unitxt/catalog/cards/mmlu/high_school_physics.json' 2026-01-13T10:37:35,764 adding 'unitxt/catalog/cards/mmlu/high_school_psychology.json' 2026-01-13T10:37:35,766 adding 'unitxt/catalog/cards/mmlu/high_school_statistics.json' 2026-01-13T10:37:35,768 adding 'unitxt/catalog/cards/mmlu/high_school_us_history.json' 2026-01-13T10:37:35,769 adding 'unitxt/catalog/cards/mmlu/high_school_world_history.json' 2026-01-13T10:37:35,770 adding 'unitxt/catalog/cards/mmlu/human_aging.json' 2026-01-13T10:37:35,772 adding 'unitxt/catalog/cards/mmlu/human_sexuality.json' 2026-01-13T10:37:35,773 adding 'unitxt/catalog/cards/mmlu/international_law.json' 2026-01-13T10:37:35,774 adding 'unitxt/catalog/cards/mmlu/jurisprudence.json' 2026-01-13T10:37:35,775 adding 'unitxt/catalog/cards/mmlu/logical_fallacies.json' 2026-01-13T10:37:35,776 adding 'unitxt/catalog/cards/mmlu/machine_learning.json' 2026-01-13T10:37:35,778 adding 'unitxt/catalog/cards/mmlu/management.json' 2026-01-13T10:37:35,779 adding 'unitxt/catalog/cards/mmlu/marketing.json' 2026-01-13T10:37:35,780 adding 'unitxt/catalog/cards/mmlu/medical_genetics.json' 2026-01-13T10:37:35,781 adding 'unitxt/catalog/cards/mmlu/miscellaneous.json' 2026-01-13T10:37:35,783 adding 'unitxt/catalog/cards/mmlu/moral_disputes.json' 2026-01-13T10:37:35,784 adding 'unitxt/catalog/cards/mmlu/moral_scenarios.json' 2026-01-13T10:37:35,785 adding 'unitxt/catalog/cards/mmlu/nutrition.json' 2026-01-13T10:37:35,786 adding 'unitxt/catalog/cards/mmlu/philosophy.json' 2026-01-13T10:37:35,788 adding 'unitxt/catalog/cards/mmlu/prehistory.json' 2026-01-13T10:37:35,789 adding 'unitxt/catalog/cards/mmlu/professional_accounting.json' 2026-01-13T10:37:35,790 adding 'unitxt/catalog/cards/mmlu/professional_law.json' 2026-01-13T10:37:35,792 adding 'unitxt/catalog/cards/mmlu/professional_medicine.json' 2026-01-13T10:37:35,793 adding 'unitxt/catalog/cards/mmlu/professional_psychology.json' 2026-01-13T10:37:35,794 adding 'unitxt/catalog/cards/mmlu/public_relations.json' 2026-01-13T10:37:35,796 adding 'unitxt/catalog/cards/mmlu/security_studies.json' 2026-01-13T10:37:35,797 adding 'unitxt/catalog/cards/mmlu/sociology.json' 2026-01-13T10:37:35,798 adding 'unitxt/catalog/cards/mmlu/us_foreign_policy.json' 2026-01-13T10:37:35,799 adding 'unitxt/catalog/cards/mmlu/virology.json' 2026-01-13T10:37:35,801 adding 'unitxt/catalog/cards/mmlu/world_religions.json' 2026-01-13T10:37:35,803 adding 'unitxt/catalog/cards/mmlu_pro/biology.json' 2026-01-13T10:37:35,804 adding 'unitxt/catalog/cards/mmlu_pro/business.json' 2026-01-13T10:37:35,805 adding 'unitxt/catalog/cards/mmlu_pro/chemistry.json' 2026-01-13T10:37:35,806 adding 'unitxt/catalog/cards/mmlu_pro/computer_science.json' 2026-01-13T10:37:35,808 adding 'unitxt/catalog/cards/mmlu_pro/economics.json' 2026-01-13T10:37:35,809 adding 'unitxt/catalog/cards/mmlu_pro/engineering.json' 2026-01-13T10:37:35,811 adding 'unitxt/catalog/cards/mmlu_pro/health.json' 2026-01-13T10:37:35,812 adding 'unitxt/catalog/cards/mmlu_pro/history.json' 2026-01-13T10:37:35,813 adding 'unitxt/catalog/cards/mmlu_pro/law.json' 2026-01-13T10:37:35,814 adding 'unitxt/catalog/cards/mmlu_pro/math.json' 2026-01-13T10:37:35,816 adding 'unitxt/catalog/cards/mmlu_pro/other.json' 2026-01-13T10:37:35,817 adding 'unitxt/catalog/cards/mmlu_pro/philosophy.json' 2026-01-13T10:37:35,818 adding 'unitxt/catalog/cards/mmlu_pro/physics.json' 2026-01-13T10:37:35,819 adding 'unitxt/catalog/cards/mmlu_pro/psychology.json' 2026-01-13T10:37:35,822 adding 'unitxt/catalog/cards/mmmu/accounting.json' 2026-01-13T10:37:35,823 adding 'unitxt/catalog/cards/mmmu/agriculture.json' 2026-01-13T10:37:35,825 adding 'unitxt/catalog/cards/mmmu/architecture_and_engineering.json' 2026-01-13T10:37:35,826 adding 'unitxt/catalog/cards/mmmu/art.json' 2026-01-13T10:37:35,827 adding 'unitxt/catalog/cards/mmmu/art_theory.json' 2026-01-13T10:37:35,829 adding 'unitxt/catalog/cards/mmmu/basic_medical_science.json' 2026-01-13T10:37:35,830 adding 'unitxt/catalog/cards/mmmu/biology.json' 2026-01-13T10:37:35,831 adding 'unitxt/catalog/cards/mmmu/chemistry.json' 2026-01-13T10:37:35,833 adding 'unitxt/catalog/cards/mmmu/clinical_medicine.json' 2026-01-13T10:37:35,834 adding 'unitxt/catalog/cards/mmmu/computer_science.json' 2026-01-13T10:37:35,835 adding 'unitxt/catalog/cards/mmmu/design.json' 2026-01-13T10:37:35,837 adding 'unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json' 2026-01-13T10:37:35,838 adding 'unitxt/catalog/cards/mmmu/economics.json' 2026-01-13T10:37:35,839 adding 'unitxt/catalog/cards/mmmu/electronics.json' 2026-01-13T10:37:35,841 adding 'unitxt/catalog/cards/mmmu/energy_and_power.json' 2026-01-13T10:37:35,842 adding 'unitxt/catalog/cards/mmmu/finance.json' 2026-01-13T10:37:35,843 adding 'unitxt/catalog/cards/mmmu/geography.json' 2026-01-13T10:37:35,845 adding 'unitxt/catalog/cards/mmmu/history.json' 2026-01-13T10:37:35,846 adding 'unitxt/catalog/cards/mmmu/literature.json' 2026-01-13T10:37:35,847 adding 'unitxt/catalog/cards/mmmu/manage.json' 2026-01-13T10:37:35,849 adding 'unitxt/catalog/cards/mmmu/marketing.json' 2026-01-13T10:37:35,850 adding 'unitxt/catalog/cards/mmmu/materials.json' 2026-01-13T10:37:35,851 adding 'unitxt/catalog/cards/mmmu/math.json' 2026-01-13T10:37:35,852 adding 'unitxt/catalog/cards/mmmu/mechanical_engineering.json' 2026-01-13T10:37:35,854 adding 'unitxt/catalog/cards/mmmu/music.json' 2026-01-13T10:37:35,855 adding 'unitxt/catalog/cards/mmmu/pharmacy.json' 2026-01-13T10:37:35,856 adding 'unitxt/catalog/cards/mmmu/physics.json' 2026-01-13T10:37:35,857 adding 'unitxt/catalog/cards/mmmu/psychology.json' 2026-01-13T10:37:35,859 adding 'unitxt/catalog/cards/mmmu/public_health.json' 2026-01-13T10:37:35,860 adding 'unitxt/catalog/cards/mmmu/sociology.json' 2026-01-13T10:37:35,862 adding 'unitxt/catalog/cards/mt/flores_101/ara_eng.json' 2026-01-13T10:37:35,863 adding 'unitxt/catalog/cards/mt/flores_101/deu_eng.json' 2026-01-13T10:37:35,865 adding 'unitxt/catalog/cards/mt/flores_101/eng_ara.json' 2026-01-13T10:37:35,866 adding 'unitxt/catalog/cards/mt/flores_101/eng_deu.json' 2026-01-13T10:37:35,867 adding 'unitxt/catalog/cards/mt/flores_101/eng_fra.json' 2026-01-13T10:37:35,868 adding 'unitxt/catalog/cards/mt/flores_101/eng_jpn.json' 2026-01-13T10:37:35,869 adding 'unitxt/catalog/cards/mt/flores_101/eng_kor.json' 2026-01-13T10:37:35,871 adding 'unitxt/catalog/cards/mt/flores_101/eng_por.json' 2026-01-13T10:37:35,872 adding 'unitxt/catalog/cards/mt/flores_101/eng_ron.json' 2026-01-13T10:37:35,873 adding 'unitxt/catalog/cards/mt/flores_101/eng_spa.json' 2026-01-13T10:37:35,874 adding 'unitxt/catalog/cards/mt/flores_101/fra_eng.json' 2026-01-13T10:37:35,875 adding 'unitxt/catalog/cards/mt/flores_101/jpn_eng.json' 2026-01-13T10:37:35,877 adding 'unitxt/catalog/cards/mt/flores_101/kor_eng.json' 2026-01-13T10:37:35,878 adding 'unitxt/catalog/cards/mt/flores_101/por_eng.json' 2026-01-13T10:37:35,879 adding 'unitxt/catalog/cards/mt/flores_101/ron_eng.json' 2026-01-13T10:37:35,880 adding 'unitxt/catalog/cards/mt/flores_101/spa_eng.json' 2026-01-13T10:37:35,882 adding 'unitxt/catalog/cards/mt_bench/generation/english_single_turn.json' 2026-01-13T10:37:35,884 adding 'unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json' 2026-01-13T10:37:35,886 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json' 2026-01-13T10:37:35,887 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json' 2026-01-13T10:37:35,888 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json' 2026-01-13T10:37:35,890 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json' 2026-01-13T10:37:35,892 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json' 2026-01-13T10:37:35,893 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json' 2026-01-13T10:37:35,894 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json' 2026-01-13T10:37:35,895 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json' 2026-01-13T10:37:35,897 adding 'unitxt/catalog/cards/multidoc2dial/abstractive.json' 2026-01-13T10:37:35,898 adding 'unitxt/catalog/cards/multidoc2dial/extractive.json' 2026-01-13T10:37:35,900 adding 'unitxt/catalog/cards/rag/mtrag.json' 2026-01-13T10:37:35,903 adding 'unitxt/catalog/cards/rag/benchmark/bioasq/en.json' 2026-01-13T10:37:35,905 adding 'unitxt/catalog/cards/rag/benchmark/clap_nq/en.json' 2026-01-13T10:37:35,906 adding 'unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json' 2026-01-13T10:37:35,908 adding 'unitxt/catalog/cards/rag/benchmark/miniwiki/en.json' 2026-01-13T10:37:35,910 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json' 2026-01-13T10:37:35,911 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json' 2026-01-13T10:37:35,913 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json' 2026-01-13T10:37:35,915 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json' 2026-01-13T10:37:35,917 adding 'unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json' 2026-01-13T10:37:35,919 adding 'unitxt/catalog/cards/rag/documents/bioasq/en.json' 2026-01-13T10:37:35,920 adding 'unitxt/catalog/cards/rag/documents/clap_nq/en.json' 2026-01-13T10:37:35,922 adding 'unitxt/catalog/cards/rag/documents/hotpotqa/en.json' 2026-01-13T10:37:35,924 adding 'unitxt/catalog/cards/rag/documents/miniwiki/en.json' 2026-01-13T10:37:35,925 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json' 2026-01-13T10:37:35,927 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json' 2026-01-13T10:37:35,929 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json' 2026-01-13T10:37:35,931 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json' 2026-01-13T10:37:35,932 adding 'unitxt/catalog/cards/rag/documents/watsonxqa/en.json' 2026-01-13T10:37:35,934 adding 'unitxt/catalog/cards/rag/mtrag/documents/clapnq.json' 2026-01-13T10:37:35,935 adding 'unitxt/catalog/cards/rag/mtrag/documents/cloud.json' 2026-01-13T10:37:35,937 adding 'unitxt/catalog/cards/rag/mtrag/documents/fiqa.json' 2026-01-13T10:37:35,938 adding 'unitxt/catalog/cards/rag/mtrag/documents/govt.json' 2026-01-13T10:37:35,940 adding 'unitxt/catalog/cards/rag/response_generation/clapnq.json' 2026-01-13T10:37:35,942 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json' 2026-01-13T10:37:35,944 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json' 2026-01-13T10:37:35,945 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json' 2026-01-13T10:37:35,946 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json' 2026-01-13T10:37:35,948 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json' 2026-01-13T10:37:35,950 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json' 2026-01-13T10:37:35,951 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json' 2026-01-13T10:37:35,952 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json' 2026-01-13T10:37:35,954 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json' 2026-01-13T10:37:35,955 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json' 2026-01-13T10:37:35,957 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json' 2026-01-13T10:37:35,958 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json' 2026-01-13T10:37:35,959 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json' 2026-01-13T10:37:35,961 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json' 2026-01-13T10:37:35,962 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json' 2026-01-13T10:37:35,963 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json' 2026-01-13T10:37:35,964 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json' 2026-01-13T10:37:35,965 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json' 2026-01-13T10:37:35,967 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json' 2026-01-13T10:37:35,968 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json' 2026-01-13T10:37:35,969 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json' 2026-01-13T10:37:35,970 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json' 2026-01-13T10:37:35,972 adding 'unitxt/catalog/cards/rag/response_generation/train/clapnq.json' 2026-01-13T10:37:35,973 adding 'unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json' 2026-01-13T10:37:35,975 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json' 2026-01-13T10:37:35,976 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json' 2026-01-13T10:37:35,978 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json' 2026-01-13T10:37:35,979 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json' 2026-01-13T10:37:35,980 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json' 2026-01-13T10:37:35,981 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json' 2026-01-13T10:37:35,982 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json' 2026-01-13T10:37:35,983 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json' 2026-01-13T10:37:35,985 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json' 2026-01-13T10:37:35,986 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json' 2026-01-13T10:37:35,987 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json' 2026-01-13T10:37:35,988 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json' 2026-01-13T10:37:35,990 adding 'unitxt/catalog/cards/ragbench/covidqa.json' 2026-01-13T10:37:35,992 adding 'unitxt/catalog/cards/ragbench/cuad.json' 2026-01-13T10:37:35,993 adding 'unitxt/catalog/cards/ragbench/delucionqa.json' 2026-01-13T10:37:35,994 adding 'unitxt/catalog/cards/ragbench/emanual.json' 2026-01-13T10:37:35,995 adding 'unitxt/catalog/cards/ragbench/expertqa.json' 2026-01-13T10:37:35,996 adding 'unitxt/catalog/cards/ragbench/finqa.json' 2026-01-13T10:37:35,998 adding 'unitxt/catalog/cards/ragbench/hagrid.json' 2026-01-13T10:37:35,999 adding 'unitxt/catalog/cards/ragbench/hotpotqa.json' 2026-01-13T10:37:36,000 adding 'unitxt/catalog/cards/ragbench/msmarco.json' 2026-01-13T10:37:36,001 adding 'unitxt/catalog/cards/ragbench/pubmedqa.json' 2026-01-13T10:37:36,002 adding 'unitxt/catalog/cards/ragbench/tatqa.json' 2026-01-13T10:37:36,004 adding 'unitxt/catalog/cards/ragbench/techqa.json' 2026-01-13T10:37:36,006 adding 'unitxt/catalog/cards/reuters21578/ModApte.json' 2026-01-13T10:37:36,007 adding 'unitxt/catalog/cards/reuters21578/ModHayes.json' 2026-01-13T10:37:36,008 adding 'unitxt/catalog/cards/reuters21578/ModLewis.json' 2026-01-13T10:37:36,010 adding 'unitxt/catalog/cards/reward_bench/chat.json' 2026-01-13T10:37:36,012 adding 'unitxt/catalog/cards/reward_bench/chat_hard.json' 2026-01-13T10:37:36,013 adding 'unitxt/catalog/cards/reward_bench/reasoning.json' 2026-01-13T10:37:36,014 adding 'unitxt/catalog/cards/reward_bench/safety.json' 2026-01-13T10:37:36,016 adding 'unitxt/catalog/cards/safety/airbench2024.json' 2026-01-13T10:37:36,018 adding 'unitxt/catalog/cards/safety/mlcommons_ailuminate.json' 2026-01-13T10:37:36,019 adding 'unitxt/catalog/cards/safety/provoq.json' 2026-01-13T10:37:36,020 adding 'unitxt/catalog/cards/safety/simple_safety_tests.json' 2026-01-13T10:37:36,022 adding 'unitxt/catalog/cards/safety/truthful_qa.json' 2026-01-13T10:37:36,023 adding 'unitxt/catalog/cards/safety/xstest.json' 2026-01-13T10:37:36,025 adding 'unitxt/catalog/cards/safety/bbq/Age.json' 2026-01-13T10:37:36,029 adding 'unitxt/catalog/cards/safety/bbq/Disability_status.json' 2026-01-13T10:37:36,031 adding 'unitxt/catalog/cards/safety/bbq/Gender_identity.json' 2026-01-13T10:37:36,032 adding 'unitxt/catalog/cards/safety/bbq/Nationality.json' 2026-01-13T10:37:36,033 adding 'unitxt/catalog/cards/safety/bbq/Physical_appearance.json' 2026-01-13T10:37:36,034 adding 'unitxt/catalog/cards/safety/bbq/Race_ethnicity.json' 2026-01-13T10:37:36,035 adding 'unitxt/catalog/cards/safety/bbq/Race_x_SES.json' 2026-01-13T10:37:36,036 adding 'unitxt/catalog/cards/safety/bbq/Race_x_gender.json' 2026-01-13T10:37:36,038 adding 'unitxt/catalog/cards/safety/bbq/Religion.json' 2026-01-13T10:37:36,039 adding 'unitxt/catalog/cards/safety/bbq/SES.json' 2026-01-13T10:37:36,040 adding 'unitxt/catalog/cards/safety/bbq/Sexual_orientation.json' 2026-01-13T10:37:36,042 adding 'unitxt/catalog/cards/safety/discrim_eval/explicit.json' 2026-01-13T10:37:36,043 adding 'unitxt/catalog/cards/safety/discrim_eval/implicit.json' 2026-01-13T10:37:36,045 adding 'unitxt/catalog/cards/tablebench_data_analysis/legacy.json' 2026-01-13T10:37:36,047 adding 'unitxt/catalog/cards/tablebench_fact_checking/legacy.json' 2026-01-13T10:37:36,048 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json' 2026-01-13T10:37:36,050 adding 'unitxt/catalog/cards/text2sql/bird.json' 2026-01-13T10:37:36,052 adding 'unitxt/catalog/cards/tot/arithmetic.json' 2026-01-13T10:37:36,053 adding 'unitxt/catalog/cards/tot/semantic.json' 2026-01-13T10:37:36,055 adding 'unitxt/catalog/cards/universal_ner/ceb/gja.json' 2026-01-13T10:37:36,057 adding 'unitxt/catalog/cards/universal_ner/da/ddt.json' 2026-01-13T10:37:36,059 adding 'unitxt/catalog/cards/universal_ner/de/pud.json' 2026-01-13T10:37:36,061 adding 'unitxt/catalog/cards/universal_ner/en/ewt.json' 2026-01-13T10:37:36,062 adding 'unitxt/catalog/cards/universal_ner/en/pud.json' 2026-01-13T10:37:36,064 adding 'unitxt/catalog/cards/universal_ner/hr/set.json' 2026-01-13T10:37:36,066 adding 'unitxt/catalog/cards/universal_ner/pt/bosque.json' 2026-01-13T10:37:36,068 adding 'unitxt/catalog/cards/universal_ner/pt/pud.json' 2026-01-13T10:37:36,069 adding 'unitxt/catalog/cards/universal_ner/ru/pud.json' 2026-01-13T10:37:36,071 adding 'unitxt/catalog/cards/universal_ner/sk/snk.json' 2026-01-13T10:37:36,073 adding 'unitxt/catalog/cards/universal_ner/sr/set.json' 2026-01-13T10:37:36,075 adding 'unitxt/catalog/cards/universal_ner/sv/pud.json' 2026-01-13T10:37:36,076 adding 'unitxt/catalog/cards/universal_ner/sv/talbanken.json' 2026-01-13T10:37:36,078 adding 'unitxt/catalog/cards/universal_ner/tl/trg.json' 2026-01-13T10:37:36,079 adding 'unitxt/catalog/cards/universal_ner/tl/ugnayan.json' 2026-01-13T10:37:36,081 adding 'unitxt/catalog/cards/universal_ner/zh/gsd.json' 2026-01-13T10:37:36,083 adding 'unitxt/catalog/cards/universal_ner/zh/gsdsimp.json' 2026-01-13T10:37:36,084 adding 'unitxt/catalog/cards/universal_ner/zh/pud.json' 2026-01-13T10:37:36,086 adding 'unitxt/catalog/cards/winogrande/debiased.json' 2026-01-13T10:37:36,087 adding 'unitxt/catalog/cards/winogrande/l.json' 2026-01-13T10:37:36,088 adding 'unitxt/catalog/cards/winogrande/m.json' 2026-01-13T10:37:36,090 adding 'unitxt/catalog/cards/winogrande/s.json' 2026-01-13T10:37:36,091 adding 'unitxt/catalog/cards/winogrande/xl.json' 2026-01-13T10:37:36,092 adding 'unitxt/catalog/cards/winogrande/xs.json' 2026-01-13T10:37:36,094 adding 'unitxt/catalog/cards/wmt/en_de.json' 2026-01-13T10:37:36,095 adding 'unitxt/catalog/cards/wmt/en_fr.json' 2026-01-13T10:37:36,096 adding 'unitxt/catalog/cards/wmt/en_ro.json' 2026-01-13T10:37:36,098 adding 'unitxt/catalog/cards/wnli/truthfulness.json' 2026-01-13T10:37:36,101 adding 'unitxt/catalog/cards/xlsum/amharic.json' 2026-01-13T10:37:36,102 adding 'unitxt/catalog/cards/xlsum/arabic.json' 2026-01-13T10:37:36,103 adding 'unitxt/catalog/cards/xlsum/azerbaijani.json' 2026-01-13T10:37:36,104 adding 'unitxt/catalog/cards/xlsum/bengali.json' 2026-01-13T10:37:36,106 adding 'unitxt/catalog/cards/xlsum/burmese.json' 2026-01-13T10:37:36,107 adding 'unitxt/catalog/cards/xlsum/chinese_simplified.json' 2026-01-13T10:37:36,108 adding 'unitxt/catalog/cards/xlsum/chinese_traditional.json' 2026-01-13T10:37:36,109 adding 'unitxt/catalog/cards/xlsum/english.json' 2026-01-13T10:37:36,111 adding 'unitxt/catalog/cards/xlsum/french.json' 2026-01-13T10:37:36,112 adding 'unitxt/catalog/cards/xlsum/gujarati.json' 2026-01-13T10:37:36,113 adding 'unitxt/catalog/cards/xlsum/hausa.json' 2026-01-13T10:37:36,114 adding 'unitxt/catalog/cards/xlsum/hindi.json' 2026-01-13T10:37:36,116 adding 'unitxt/catalog/cards/xlsum/igbo.json' 2026-01-13T10:37:36,117 adding 'unitxt/catalog/cards/xlsum/indonesian.json' 2026-01-13T10:37:36,118 adding 'unitxt/catalog/cards/xlsum/japanese.json' 2026-01-13T10:37:36,119 adding 'unitxt/catalog/cards/xlsum/kirundi.json' 2026-01-13T10:37:36,120 adding 'unitxt/catalog/cards/xlsum/korean.json' 2026-01-13T10:37:36,122 adding 'unitxt/catalog/cards/xlsum/kyrgyz.json' 2026-01-13T10:37:36,123 adding 'unitxt/catalog/cards/xlsum/marathi.json' 2026-01-13T10:37:36,124 adding 'unitxt/catalog/cards/xlsum/nepali.json' 2026-01-13T10:37:36,125 adding 'unitxt/catalog/cards/xlsum/oromo.json' 2026-01-13T10:37:36,127 adding 'unitxt/catalog/cards/xlsum/pashto.json' 2026-01-13T10:37:36,128 adding 'unitxt/catalog/cards/xlsum/persian.json' 2026-01-13T10:37:36,129 adding 'unitxt/catalog/cards/xlsum/pidgin.json' 2026-01-13T10:37:36,130 adding 'unitxt/catalog/cards/xlsum/portuguese.json' 2026-01-13T10:37:36,131 adding 'unitxt/catalog/cards/xlsum/punjabi.json' 2026-01-13T10:37:36,133 adding 'unitxt/catalog/cards/xlsum/russian.json' 2026-01-13T10:37:36,134 adding 'unitxt/catalog/cards/xlsum/scottish_gaelic.json' 2026-01-13T10:37:36,135 adding 'unitxt/catalog/cards/xlsum/serbian_cyrillic.json' 2026-01-13T10:37:36,136 adding 'unitxt/catalog/cards/xlsum/serbian_latin.json' 2026-01-13T10:37:36,138 adding 'unitxt/catalog/cards/xlsum/sinhala.json' 2026-01-13T10:37:36,139 adding 'unitxt/catalog/cards/xlsum/somali.json' 2026-01-13T10:37:36,140 adding 'unitxt/catalog/cards/xlsum/spanish.json' 2026-01-13T10:37:36,142 adding 'unitxt/catalog/cards/xlsum/swahili.json' 2026-01-13T10:37:36,143 adding 'unitxt/catalog/cards/xlsum/tamil.json' 2026-01-13T10:37:36,144 adding 'unitxt/catalog/cards/xlsum/telugu.json' 2026-01-13T10:37:36,145 adding 'unitxt/catalog/cards/xlsum/thai.json' 2026-01-13T10:37:36,147 adding 'unitxt/catalog/cards/xlsum/tigrinya.json' 2026-01-13T10:37:36,148 adding 'unitxt/catalog/cards/xlsum/turkish.json' 2026-01-13T10:37:36,150 adding 'unitxt/catalog/cards/xlsum/ukrainian.json' 2026-01-13T10:37:36,151 adding 'unitxt/catalog/cards/xlsum/urdu.json' 2026-01-13T10:37:36,152 adding 'unitxt/catalog/cards/xlsum/uzbek.json' 2026-01-13T10:37:36,154 adding 'unitxt/catalog/cards/xlsum/vietnamese.json' 2026-01-13T10:37:36,155 adding 'unitxt/catalog/cards/xlsum/welsh.json' 2026-01-13T10:37:36,156 adding 'unitxt/catalog/cards/xlsum/yoruba.json' 2026-01-13T10:37:36,158 adding 'unitxt/catalog/cards/xnli/ar.json' 2026-01-13T10:37:36,160 adding 'unitxt/catalog/cards/xnli/bg.json' 2026-01-13T10:37:36,161 adding 'unitxt/catalog/cards/xnli/de.json' 2026-01-13T10:37:36,162 adding 'unitxt/catalog/cards/xnli/el.json' 2026-01-13T10:37:36,164 adding 'unitxt/catalog/cards/xnli/en.json' 2026-01-13T10:37:36,165 adding 'unitxt/catalog/cards/xnli/es.json' 2026-01-13T10:37:36,166 adding 'unitxt/catalog/cards/xnli/fr.json' 2026-01-13T10:37:36,168 adding 'unitxt/catalog/cards/xnli/hi.json' 2026-01-13T10:37:36,169 adding 'unitxt/catalog/cards/xnli/ru.json' 2026-01-13T10:37:36,170 adding 'unitxt/catalog/cards/xnli/sw.json' 2026-01-13T10:37:36,171 adding 'unitxt/catalog/cards/xnli/th.json' 2026-01-13T10:37:36,173 adding 'unitxt/catalog/cards/xnli/tr.json' 2026-01-13T10:37:36,174 adding 'unitxt/catalog/cards/xnli/ur.json' 2026-01-13T10:37:36,175 adding 'unitxt/catalog/cards/xnli/vi.json' 2026-01-13T10:37:36,177 adding 'unitxt/catalog/cards/xnli/zh.json' 2026-01-13T10:37:36,178 adding 'unitxt/catalog/cards/xwinogrande/en.json' 2026-01-13T10:37:36,180 adding 'unitxt/catalog/cards/xwinogrande/jp.json' 2026-01-13T10:37:36,181 adding 'unitxt/catalog/cards/xwinogrande/pt.json' 2026-01-13T10:37:36,182 adding 'unitxt/catalog/cards/xwinogrande/ru.json' 2026-01-13T10:37:36,183 adding 'unitxt/catalog/cards/xwinogrande/zh.json' 2026-01-13T10:37:36,185 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json' 2026-01-13T10:37:36,186 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json' 2026-01-13T10:37:36,188 adding 'unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json' 2026-01-13T10:37:36,189 adding 'unitxt/catalog/engines/classification/gpt_4o_open_ai.json' 2026-01-13T10:37:36,190 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_rits.json' 2026-01-13T10:37:36,191 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json' 2026-01-13T10:37:36,192 adding 'unitxt/catalog/engines/classification/llama3_3_ollama.json' 2026-01-13T10:37:36,193 adding 'unitxt/catalog/engines/classification/llama3_8b_ollama.json' 2026-01-13T10:37:36,195 adding 'unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json' 2026-01-13T10:37:36,196 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json' 2026-01-13T10:37:36,197 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json' 2026-01-13T10:37:36,198 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json' 2026-01-13T10:37:36,199 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json' 2026-01-13T10:37:36,200 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json' 2026-01-13T10:37:36,201 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json' 2026-01-13T10:37:36,202 adding 'unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json' 2026-01-13T10:37:36,204 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json' 2026-01-13T10:37:36,205 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json' 2026-01-13T10:37:36,206 adding 'unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json' 2026-01-13T10:37:36,207 adding 'unitxt/catalog/engines/classification/mistral_large_watsonx.json' 2026-01-13T10:37:36,208 adding 'unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json' 2026-01-13T10:37:36,209 adding 'unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json' 2026-01-13T10:37:36,211 adding 'unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json' 2026-01-13T10:37:36,212 adding 'unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json' 2026-01-13T10:37:36,214 adding 'unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json' 2026-01-13T10:37:36,216 adding 'unitxt/catalog/engines/model/llama_3_8b_instruct.json' 2026-01-13T10:37:36,218 adding 'unitxt/catalog/engines/model/flan/t5_small/hf.json' 2026-01-13T10:37:36,219 adding 'unitxt/catalog/engines/ollama/llama2.json' 2026-01-13T10:37:36,221 adding 'unitxt/catalog/engines/openai/gpt_4o.json' 2026-01-13T10:37:36,223 adding 'unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json' 2026-01-13T10:37:36,224 adding 'unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json' 2026-01-13T10:37:36,225 adding 'unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json' 2026-01-13T10:37:36,227 adding 'unitxt/catalog/formats/chat_api.json' 2026-01-13T10:37:36,228 adding 'unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json' 2026-01-13T10:37:36,229 adding 'unitxt/catalog/formats/deepseek_coder.json' 2026-01-13T10:37:36,231 adding 'unitxt/catalog/formats/empty.json' 2026-01-13T10:37:36,232 adding 'unitxt/catalog/formats/empty_input_output_separator.json' 2026-01-13T10:37:36,233 adding 'unitxt/catalog/formats/human_assistant.json' 2026-01-13T10:37:36,234 adding 'unitxt/catalog/formats/llama.json' 2026-01-13T10:37:36,235 adding 'unitxt/catalog/formats/llama2.json' 2026-01-13T10:37:36,236 adding 'unitxt/catalog/formats/llama3_instruct.json' 2026-01-13T10:37:36,237 adding 'unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json' 2026-01-13T10:37:36,238 adding 'unitxt/catalog/formats/llamaguard2.json' 2026-01-13T10:37:36,239 adding 'unitxt/catalog/formats/textual_assistant.json' 2026-01-13T10:37:36,240 adding 'unitxt/catalog/formats/user_agent.json' 2026-01-13T10:37:36,241 adding 'unitxt/catalog/formats/user_assistant.json' 2026-01-13T10:37:36,243 adding 'unitxt/catalog/formats/models/alpaca_instruct.json' 2026-01-13T10:37:36,244 adding 'unitxt/catalog/formats/models/granite_3_1_documents.json' 2026-01-13T10:37:36,245 adding 'unitxt/catalog/formats/models/llava.json' 2026-01-13T10:37:36,246 adding 'unitxt/catalog/formats/models/llava_interleave.json' 2026-01-13T10:37:36,248 adding 'unitxt/catalog/formats/models/phi_3.json' 2026-01-13T10:37:36,249 adding 'unitxt/catalog/formats/models/starling.json' 2026-01-13T10:37:36,251 adding 'unitxt/catalog/formats/models/flan/exq_exa.json' 2026-01-13T10:37:36,252 adding 'unitxt/catalog/formats/models/flan/few_shot.json' 2026-01-13T10:37:36,254 adding 'unitxt/catalog/formats/models/labradorite/few_shot.json' 2026-01-13T10:37:36,255 adding 'unitxt/catalog/formats/models/labradorite/zero_shot.json' 2026-01-13T10:37:36,256 adding 'unitxt/catalog/formats/models/mistral/instruction.json' 2026-01-13T10:37:36,258 adding 'unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json' 2026-01-13T10:37:36,261 adding 'unitxt/catalog/metrics/accuracy.json' 2026-01-13T10:37:36,262 adding 'unitxt/catalog/metrics/accuracy_binary.json' 2026-01-13T10:37:36,264 adding 'unitxt/catalog/metrics/anls.json' 2026-01-13T10:37:36,265 adding 'unitxt/catalog/metrics/bleu.json' 2026-01-13T10:37:36,266 adding 'unitxt/catalog/metrics/char_edit_dist_accuracy.json' 2026-01-13T10:37:36,267 adding 'unitxt/catalog/metrics/char_edit_distance.json' 2026-01-13T10:37:36,268 adding 'unitxt/catalog/metrics/exact_match_mm.json' 2026-01-13T10:37:36,269 adding 'unitxt/catalog/metrics/f1_binary.json' 2026-01-13T10:37:36,270 adding 'unitxt/catalog/metrics/f1_macro.json' 2026-01-13T10:37:36,272 adding 'unitxt/catalog/metrics/f1_macro_multi_label.json' 2026-01-13T10:37:36,273 adding 'unitxt/catalog/metrics/f1_micro.json' 2026-01-13T10:37:36,274 adding 'unitxt/catalog/metrics/f1_micro_multi_label.json' 2026-01-13T10:37:36,275 adding 'unitxt/catalog/metrics/f1_strings.json' 2026-01-13T10:37:36,276 adding 'unitxt/catalog/metrics/f1_weighted.json' 2026-01-13T10:37:36,277 adding 'unitxt/catalog/metrics/fin_qa_metric.json' 2026-01-13T10:37:36,278 adding 'unitxt/catalog/metrics/fuzzyner.json' 2026-01-13T10:37:36,279 adding 'unitxt/catalog/metrics/is_code_mixed.json' 2026-01-13T10:37:36,281 adding 'unitxt/catalog/metrics/jaccard_index.json' 2026-01-13T10:37:36,282 adding 'unitxt/catalog/metrics/jaccard_index_words.json' 2026-01-13T10:37:36,283 adding 'unitxt/catalog/metrics/kendalltau_b.json' 2026-01-13T10:37:36,284 adding 'unitxt/catalog/metrics/kpa.json' 2026-01-13T10:37:36,285 adding 'unitxt/catalog/metrics/map.json' 2026-01-13T10:37:36,287 adding 'unitxt/catalog/metrics/matthews_correlation.json' 2026-01-13T10:37:36,288 adding 'unitxt/catalog/metrics/max_accuracy_binary.json' 2026-01-13T10:37:36,289 adding 'unitxt/catalog/metrics/max_f1_binary.json' 2026-01-13T10:37:36,290 adding 'unitxt/catalog/metrics/mean_squared_error.json' 2026-01-13T10:37:36,291 adding 'unitxt/catalog/metrics/meteor.json' 2026-01-13T10:37:36,293 adding 'unitxt/catalog/metrics/meteor_hf.json' 2026-01-13T10:37:36,294 adding 'unitxt/catalog/metrics/metric_based_ner.json' 2026-01-13T10:37:36,295 adding 'unitxt/catalog/metrics/mrr.json' 2026-01-13T10:37:36,296 adding 'unitxt/catalog/metrics/ndcg.json' 2026-01-13T10:37:36,297 adding 'unitxt/catalog/metrics/ner.json' 2026-01-13T10:37:36,298 adding 'unitxt/catalog/metrics/normalized_sacrebleu.json' 2026-01-13T10:37:36,299 adding 'unitxt/catalog/metrics/pearson.json' 2026-01-13T10:37:36,300 adding 'unitxt/catalog/metrics/precision_binary.json' 2026-01-13T10:37:36,301 adding 'unitxt/catalog/metrics/precision_macro_multi_label.json' 2026-01-13T10:37:36,302 adding 'unitxt/catalog/metrics/precision_micro_multi_label.json' 2026-01-13T10:37:36,303 adding 'unitxt/catalog/metrics/prediction_length.json' 2026-01-13T10:37:36,304 adding 'unitxt/catalog/metrics/recall_binary.json' 2026-01-13T10:37:36,305 adding 'unitxt/catalog/metrics/recall_macro_multi_label.json' 2026-01-13T10:37:36,306 adding 'unitxt/catalog/metrics/recall_micro_multi_label.json' 2026-01-13T10:37:36,307 adding 'unitxt/catalog/metrics/regard_metric.json' 2026-01-13T10:37:36,308 adding 'unitxt/catalog/metrics/relaxed_correctness.json' 2026-01-13T10:37:36,310 adding 'unitxt/catalog/metrics/rerank_recall.json' 2026-01-13T10:37:36,311 adding 'unitxt/catalog/metrics/retrieval_at_k.json' 2026-01-13T10:37:36,312 adding 'unitxt/catalog/metrics/roc_auc.json' 2026-01-13T10:37:36,313 adding 'unitxt/catalog/metrics/root_mean_squared_error.json' 2026-01-13T10:37:36,314 adding 'unitxt/catalog/metrics/rouge.json' 2026-01-13T10:37:36,315 adding 'unitxt/catalog/metrics/rouge_with_confidence_intervals.json' 2026-01-13T10:37:36,316 adding 'unitxt/catalog/metrics/sacrebleu.json' 2026-01-13T10:37:36,318 adding 'unitxt/catalog/metrics/safety_metric.json' 2026-01-13T10:37:36,319 adding 'unitxt/catalog/metrics/spearman.json' 2026-01-13T10:37:36,320 adding 'unitxt/catalog/metrics/squad.json' 2026-01-13T10:37:36,321 adding 'unitxt/catalog/metrics/string_containment.json' 2026-01-13T10:37:36,322 adding 'unitxt/catalog/metrics/string_containment_ratio.json' 2026-01-13T10:37:36,323 adding 'unitxt/catalog/metrics/token_overlap.json' 2026-01-13T10:37:36,325 adding 'unitxt/catalog/metrics/token_overlap_with_context.json' 2026-01-13T10:37:36,326 adding 'unitxt/catalog/metrics/tool_calling.json' 2026-01-13T10:37:36,327 adding 'unitxt/catalog/metrics/unsorted_list_exact_match.json' 2026-01-13T10:37:36,328 adding 'unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json' 2026-01-13T10:37:36,329 adding 'unitxt/catalog/metrics/websrc_squad_f1.json' 2026-01-13T10:37:36,330 adding 'unitxt/catalog/metrics/weighted_win_rate_correlation.json' 2026-01-13T10:37:36,331 adding 'unitxt/catalog/metrics/wer.json' 2026-01-13T10:37:36,333 adding 'unitxt/catalog/metrics/bert_score/bert_base_uncased.json' 2026-01-13T10:37:36,334 adding 'unitxt/catalog/metrics/bert_score/deberta_base_mnli.json' 2026-01-13T10:37:36,336 adding 'unitxt/catalog/metrics/bert_score/deberta_large_mnli.json' 2026-01-13T10:37:36,337 adding 'unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-01-13T10:37:36,339 adding 'unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json' 2026-01-13T10:37:36,340 adding 'unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json' 2026-01-13T10:37:36,343 adding 'unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json' 2026-01-13T10:37:36,345 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json' 2026-01-13T10:37:36,346 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json' 2026-01-13T10:37:36,348 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json' 2026-01-13T10:37:36,349 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json' 2026-01-13T10:37:36,351 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json' 2026-01-13T10:37:36,353 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json' 2026-01-13T10:37:36,354 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json' 2026-01-13T10:37:36,356 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json' 2026-01-13T10:37:36,358 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/harm.json' 2026-01-13T10:37:36,359 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json' 2026-01-13T10:37:36,361 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json' 2026-01-13T10:37:36,362 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json' 2026-01-13T10:37:36,364 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json' 2026-01-13T10:37:36,365 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/violence.json' 2026-01-13T10:37:36,367 adding 'unitxt/catalog/metrics/key_value_extraction/accuracy.json' 2026-01-13T10:37:36,368 adding 'unitxt/catalog/metrics/key_value_extraction/token_overlap.json' 2026-01-13T10:37:36,371 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json' 2026-01-13T10:37:36,373 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json' 2026-01-13T10:37:36,374 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json' 2026-01-13T10:37:36,376 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json' 2026-01-13T10:37:36,377 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json' 2026-01-13T10:37:36,379 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json' 2026-01-13T10:37:36,380 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json' 2026-01-13T10:37:36,382 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json' 2026-01-13T10:37:36,383 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json' 2026-01-13T10:37:36,385 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json' 2026-01-13T10:37:36,386 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json' 2026-01-13T10:37:36,387 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json' 2026-01-13T10:37:36,389 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json' 2026-01-13T10:37:36,390 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json' 2026-01-13T10:37:36,392 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json' 2026-01-13T10:37:36,393 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json' 2026-01-13T10:37:36,395 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json' 2026-01-13T10:37:36,396 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json' 2026-01-13T10:37:36,400 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json' 2026-01-13T10:37:36,402 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json' 2026-01-13T10:37:36,403 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json' 2026-01-13T10:37:36,405 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json' 2026-01-13T10:37:36,406 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json' 2026-01-13T10:37:36,408 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json' 2026-01-13T10:37:36,410 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json' 2026-01-13T10:37:36,412 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json' 2026-01-13T10:37:36,413 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json' 2026-01-13T10:37:36,415 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json' 2026-01-13T10:37:36,416 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json' 2026-01-13T10:37:36,418 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json' 2026-01-13T10:37:36,419 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json' 2026-01-13T10:37:36,421 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json' 2026-01-13T10:37:36,422 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json' 2026-01-13T10:37:36,426 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json' 2026-01-13T10:37:36,428 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json' 2026-01-13T10:37:36,429 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json' 2026-01-13T10:37:36,431 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json' 2026-01-13T10:37:36,432 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json' 2026-01-13T10:37:36,434 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json' 2026-01-13T10:37:36,435 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json' 2026-01-13T10:37:36,436 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json' 2026-01-13T10:37:36,438 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json' 2026-01-13T10:37:36,439 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json' 2026-01-13T10:37:36,440 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json' 2026-01-13T10:37:36,441 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json' 2026-01-13T10:37:36,443 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json' 2026-01-13T10:37:36,444 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json' 2026-01-13T10:37:36,445 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json' 2026-01-13T10:37:36,446 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json' 2026-01-13T10:37:36,448 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json' 2026-01-13T10:37:36,449 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json' 2026-01-13T10:37:36,450 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json' 2026-01-13T10:37:36,452 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json' 2026-01-13T10:37:36,453 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json' 2026-01-13T10:37:36,454 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json' 2026-01-13T10:37:36,455 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json' 2026-01-13T10:37:36,456 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json' 2026-01-13T10:37:36,458 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json' 2026-01-13T10:37:36,459 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json' 2026-01-13T10:37:36,460 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json' 2026-01-13T10:37:36,461 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json' 2026-01-13T10:37:36,462 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json' 2026-01-13T10:37:36,464 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json' 2026-01-13T10:37:36,465 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json' 2026-01-13T10:37:36,466 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json' 2026-01-13T10:37:36,467 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json' 2026-01-13T10:37:36,468 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json' 2026-01-13T10:37:36,469 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json' 2026-01-13T10:37:36,470 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json' 2026-01-13T10:37:36,472 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json' 2026-01-13T10:37:36,473 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json' 2026-01-13T10:37:36,474 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json' 2026-01-13T10:37:36,475 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json' 2026-01-13T10:37:36,476 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json' 2026-01-13T10:37:36,478 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json' 2026-01-13T10:37:36,479 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json' 2026-01-13T10:37:36,480 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json' 2026-01-13T10:37:36,481 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json' 2026-01-13T10:37:36,482 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json' 2026-01-13T10:37:36,483 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json' 2026-01-13T10:37:36,485 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json' 2026-01-13T10:37:36,486 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json' 2026-01-13T10:37:36,487 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json' 2026-01-13T10:37:36,488 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json' 2026-01-13T10:37:36,490 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json' 2026-01-13T10:37:36,491 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json' 2026-01-13T10:37:36,492 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json' 2026-01-13T10:37:36,494 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json' 2026-01-13T10:37:36,495 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-01-13T10:37:36,496 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json' 2026-01-13T10:37:36,497 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json' 2026-01-13T10:37:36,499 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json' 2026-01-13T10:37:36,500 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json' 2026-01-13T10:37:36,501 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json' 2026-01-13T10:37:36,502 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json' 2026-01-13T10:37:36,504 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json' 2026-01-13T10:37:36,505 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json' 2026-01-13T10:37:36,506 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json' 2026-01-13T10:37:36,507 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json' 2026-01-13T10:37:36,509 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json' 2026-01-13T10:37:36,510 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json' 2026-01-13T10:37:36,511 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json' 2026-01-13T10:37:36,512 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json' 2026-01-13T10:37:36,513 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json' 2026-01-13T10:37:36,515 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json' 2026-01-13T10:37:36,516 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json' 2026-01-13T10:37:36,517 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json' 2026-01-13T10:37:36,518 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json' 2026-01-13T10:37:36,519 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json' 2026-01-13T10:37:36,521 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json' 2026-01-13T10:37:36,522 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json' 2026-01-13T10:37:36,523 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json' 2026-01-13T10:37:36,524 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json' 2026-01-13T10:37:36,526 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json' 2026-01-13T10:37:36,527 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json' 2026-01-13T10:37:36,529 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json' 2026-01-13T10:37:36,530 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json' 2026-01-13T10:37:36,531 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json' 2026-01-13T10:37:36,532 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json' 2026-01-13T10:37:36,533 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json' 2026-01-13T10:37:36,535 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json' 2026-01-13T10:37:36,536 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json' 2026-01-13T10:37:36,537 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json' 2026-01-13T10:37:36,538 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json' 2026-01-13T10:37:36,539 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json' 2026-01-13T10:37:36,541 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json' 2026-01-13T10:37:36,542 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json' 2026-01-13T10:37:36,544 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json' 2026-01-13T10:37:36,545 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json' 2026-01-13T10:37:36,546 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json' 2026-01-13T10:37:36,547 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json' 2026-01-13T10:37:36,549 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json' 2026-01-13T10:37:36,550 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json' 2026-01-13T10:37:36,551 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json' 2026-01-13T10:37:36,553 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json' 2026-01-13T10:37:36,555 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json' 2026-01-13T10:37:36,556 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json' 2026-01-13T10:37:36,557 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json' 2026-01-13T10:37:36,558 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json' 2026-01-13T10:37:36,559 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json' 2026-01-13T10:37:36,560 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json' 2026-01-13T10:37:36,561 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json' 2026-01-13T10:37:36,562 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json' 2026-01-13T10:37:36,564 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json' 2026-01-13T10:37:36,566 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json' 2026-01-13T10:37:36,567 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json' 2026-01-13T10:37:36,568 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json' 2026-01-13T10:37:36,569 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json' 2026-01-13T10:37:36,570 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json' 2026-01-13T10:37:36,572 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json' 2026-01-13T10:37:36,573 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json' 2026-01-13T10:37:36,574 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json' 2026-01-13T10:37:36,576 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json' 2026-01-13T10:37:36,577 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json' 2026-01-13T10:37:36,578 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json' 2026-01-13T10:37:36,579 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json' 2026-01-13T10:37:36,581 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json' 2026-01-13T10:37:36,582 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json' 2026-01-13T10:37:36,584 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json' 2026-01-13T10:37:36,585 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json' 2026-01-13T10:37:36,586 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json' 2026-01-13T10:37:36,587 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json' 2026-01-13T10:37:36,588 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json' 2026-01-13T10:37:36,590 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json' 2026-01-13T10:37:36,591 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-01-13T10:37:36,592 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json' 2026-01-13T10:37:36,594 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json' 2026-01-13T10:37:36,595 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json' 2026-01-13T10:37:36,596 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json' 2026-01-13T10:37:36,597 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json' 2026-01-13T10:37:36,599 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json' 2026-01-13T10:37:36,600 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json' 2026-01-13T10:37:36,601 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json' 2026-01-13T10:37:36,602 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json' 2026-01-13T10:37:36,604 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json' 2026-01-13T10:37:36,605 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json' 2026-01-13T10:37:36,606 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json' 2026-01-13T10:37:36,608 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json' 2026-01-13T10:37:36,609 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json' 2026-01-13T10:37:36,610 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json' 2026-01-13T10:37:36,611 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json' 2026-01-13T10:37:36,612 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json' 2026-01-13T10:37:36,614 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json' 2026-01-13T10:37:36,615 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json' 2026-01-13T10:37:36,616 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json' 2026-01-13T10:37:36,617 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json' 2026-01-13T10:37:36,619 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json' 2026-01-13T10:37:36,620 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json' 2026-01-13T10:37:36,621 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json' 2026-01-13T10:37:36,622 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json' 2026-01-13T10:37:36,623 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json' 2026-01-13T10:37:36,625 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json' 2026-01-13T10:37:36,626 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json' 2026-01-13T10:37:36,628 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json' 2026-01-13T10:37:36,629 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json' 2026-01-13T10:37:36,630 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json' 2026-01-13T10:37:36,631 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json' 2026-01-13T10:37:36,632 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json' 2026-01-13T10:37:36,634 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json' 2026-01-13T10:37:36,635 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json' 2026-01-13T10:37:36,637 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json' 2026-01-13T10:37:36,638 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json' 2026-01-13T10:37:36,640 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json' 2026-01-13T10:37:36,641 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json' 2026-01-13T10:37:36,642 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json' 2026-01-13T10:37:36,643 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json' 2026-01-13T10:37:36,645 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json' 2026-01-13T10:37:36,646 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json' 2026-01-13T10:37:36,647 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json' 2026-01-13T10:37:36,649 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json' 2026-01-13T10:37:36,650 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-01-13T10:37:36,651 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json' 2026-01-13T10:37:36,653 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json' 2026-01-13T10:37:36,654 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json' 2026-01-13T10:37:36,655 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-01-13T10:37:36,656 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json' 2026-01-13T10:37:36,658 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json' 2026-01-13T10:37:36,660 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json' 2026-01-13T10:37:36,662 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json' 2026-01-13T10:37:36,663 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json' 2026-01-13T10:37:36,665 adding 'unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json' 2026-01-13T10:37:36,666 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json' 2026-01-13T10:37:36,668 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json' 2026-01-13T10:37:36,669 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json' 2026-01-13T10:37:36,670 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json' 2026-01-13T10:37:36,672 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json' 2026-01-13T10:37:36,673 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json' 2026-01-13T10:37:36,675 adding 'unitxt/catalog/metrics/multi_turn/accuracy.json' 2026-01-13T10:37:36,676 adding 'unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json' 2026-01-13T10:37:36,678 adding 'unitxt/catalog/metrics/perplexity/flan_t5_small.json' 2026-01-13T10:37:36,679 adding 'unitxt/catalog/metrics/perplexity_a/flan_t5_small.json' 2026-01-13T10:37:36,681 adding 'unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json' 2026-01-13T10:37:36,682 adding 'unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json' 2026-01-13T10:37:36,684 adding 'unitxt/catalog/metrics/perplexity_q/flan_t5_small.json' 2026-01-13T10:37:36,686 adding 'unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json' 2026-01-13T10:37:36,687 adding 'unitxt/catalog/metrics/qa/open/recommended_local_gpu.json' 2026-01-13T10:37:36,688 adding 'unitxt/catalog/metrics/qa/open/recommended_no_gpu.json' 2026-01-13T10:37:36,690 adding 'unitxt/catalog/metrics/rag/answer_correctness.json' 2026-01-13T10:37:36,692 adding 'unitxt/catalog/metrics/rag/answer_inference.json' 2026-01-13T10:37:36,693 adding 'unitxt/catalog/metrics/rag/answer_reward.json' 2026-01-13T10:37:36,694 adding 'unitxt/catalog/metrics/rag/context_correctness.json' 2026-01-13T10:37:36,695 adding 'unitxt/catalog/metrics/rag/context_perplexity.json' 2026-01-13T10:37:36,696 adding 'unitxt/catalog/metrics/rag/context_relevance.json' 2026-01-13T10:37:36,698 adding 'unitxt/catalog/metrics/rag/faithfulness.json' 2026-01-13T10:37:36,699 adding 'unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json' 2026-01-13T10:37:36,700 adding 'unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json' 2026-01-13T10:37:36,701 adding 'unitxt/catalog/metrics/rag/granite_guardian_groundedness.json' 2026-01-13T10:37:36,703 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json' 2026-01-13T10:37:36,705 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json' 2026-01-13T10:37:36,706 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json' 2026-01-13T10:37:36,707 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json' 2026-01-13T10:37:36,708 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json' 2026-01-13T10:37:36,710 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json' 2026-01-13T10:37:36,711 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json' 2026-01-13T10:37:36,712 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json' 2026-01-13T10:37:36,713 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,714 adding 'unitxt/catalog/metrics/rag/answer_correctness/token_recall.json' 2026-01-13T10:37:36,716 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json' 2026-01-13T10:37:36,717 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json' 2026-01-13T10:37:36,718 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json' 2026-01-13T10:37:36,719 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json' 2026-01-13T10:37:36,720 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json' 2026-01-13T10:37:36,721 adding 'unitxt/catalog/metrics/rag/answer_relevance/token_recall.json' 2026-01-13T10:37:36,723 adding 'unitxt/catalog/metrics/rag/context_correctness/map.json' 2026-01-13T10:37:36,724 adding 'unitxt/catalog/metrics/rag/context_correctness/mrr.json' 2026-01-13T10:37:36,725 adding 'unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json' 2026-01-13T10:37:36,727 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json' 2026-01-13T10:37:36,728 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json' 2026-01-13T10:37:36,730 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json' 2026-01-13T10:37:36,731 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json' 2026-01-13T10:37:36,732 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json' 2026-01-13T10:37:36,733 adding 'unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json' 2026-01-13T10:37:36,735 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json' 2026-01-13T10:37:36,736 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,737 adding 'unitxt/catalog/metrics/rag/context_relevance/token_precision.json' 2026-01-13T10:37:36,739 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json' 2026-01-13T10:37:36,740 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json' 2026-01-13T10:37:36,742 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json' 2026-01-13T10:37:36,743 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json' 2026-01-13T10:37:36,744 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-01-13T10:37:36,745 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-01-13T10:37:36,747 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json' 2026-01-13T10:37:36,749 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json' 2026-01-13T10:37:36,750 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json' 2026-01-13T10:37:36,751 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_reward.json' 2026-01-13T10:37:36,753 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness.json' 2026-01-13T10:37:36,754 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance.json' 2026-01-13T10:37:36,755 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json' 2026-01-13T10:37:36,756 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json' 2026-01-13T10:37:36,758 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json' 2026-01-13T10:37:36,759 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,760 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,761 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,762 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,763 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,765 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,766 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,767 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,768 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,769 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,770 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json' 2026-01-13T10:37:36,772 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,773 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json' 2026-01-13T10:37:36,774 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json' 2026-01-13T10:37:36,776 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json' 2026-01-13T10:37:36,777 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,779 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,780 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,781 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,782 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,783 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,785 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,786 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,787 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,788 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,790 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json' 2026-01-13T10:37:36,792 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json' 2026-01-13T10:37:36,793 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json' 2026-01-13T10:37:36,795 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json' 2026-01-13T10:37:36,796 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json' 2026-01-13T10:37:36,798 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,799 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,800 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,801 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,802 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,803 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,805 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,806 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,807 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,809 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,810 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json' 2026-01-13T10:37:36,811 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json' 2026-01-13T10:37:36,813 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,814 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json' 2026-01-13T10:37:36,816 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json' 2026-01-13T10:37:36,817 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json' 2026-01-13T10:37:36,818 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json' 2026-01-13T10:37:36,820 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,821 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,822 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,823 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,824 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,826 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,827 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,828 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,830 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,831 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,832 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json' 2026-01-13T10:37:36,833 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,834 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json' 2026-01-13T10:37:36,836 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json' 2026-01-13T10:37:36,838 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json' 2026-01-13T10:37:36,840 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json' 2026-01-13T10:37:36,841 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json' 2026-01-13T10:37:36,843 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json' 2026-01-13T10:37:36,845 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json' 2026-01-13T10:37:36,847 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness.json' 2026-01-13T10:37:36,848 adding 'unitxt/catalog/metrics/rag/external_rag/answer_reward.json' 2026-01-13T10:37:36,849 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness.json' 2026-01-13T10:37:36,850 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance.json' 2026-01-13T10:37:36,851 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness.json' 2026-01-13T10:37:36,853 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json' 2026-01-13T10:37:36,854 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json' 2026-01-13T10:37:36,856 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json' 2026-01-13T10:37:36,857 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,858 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,859 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,860 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,862 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,863 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,864 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,865 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,866 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,868 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,869 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json' 2026-01-13T10:37:36,870 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,871 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json' 2026-01-13T10:37:36,873 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json' 2026-01-13T10:37:36,874 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json' 2026-01-13T10:37:36,875 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,876 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,878 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,879 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,880 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,882 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,883 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,884 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,885 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,886 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,888 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json' 2026-01-13T10:37:36,890 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json' 2026-01-13T10:37:36,891 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json' 2026-01-13T10:37:36,892 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json' 2026-01-13T10:37:36,894 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json' 2026-01-13T10:37:36,895 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,896 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,898 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,899 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,901 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,902 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,903 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,905 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,906 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,907 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,908 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json' 2026-01-13T10:37:36,909 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json' 2026-01-13T10:37:36,911 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,912 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json' 2026-01-13T10:37:36,914 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json' 2026-01-13T10:37:36,915 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json' 2026-01-13T10:37:36,916 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json' 2026-01-13T10:37:36,918 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,919 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,920 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,921 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,922 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,924 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,925 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,926 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,927 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,929 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,930 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json' 2026-01-13T10:37:36,931 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,932 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json' 2026-01-13T10:37:36,933 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json' 2026-01-13T10:37:36,936 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json' 2026-01-13T10:37:36,938 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json' 2026-01-13T10:37:36,940 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json' 2026-01-13T10:37:36,941 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json' 2026-01-13T10:37:36,943 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json' 2026-01-13T10:37:36,945 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json' 2026-01-13T10:37:36,946 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json' 2026-01-13T10:37:36,947 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json' 2026-01-13T10:37:36,948 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json' 2026-01-13T10:37:36,949 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json' 2026-01-13T10:37:36,950 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json' 2026-01-13T10:37:36,952 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json' 2026-01-13T10:37:36,953 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json' 2026-01-13T10:37:36,954 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json' 2026-01-13T10:37:36,955 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-01-13T10:37:36,956 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-01-13T10:37:36,958 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json' 2026-01-13T10:37:36,959 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json' 2026-01-13T10:37:36,960 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json' 2026-01-13T10:37:36,961 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json' 2026-01-13T10:37:36,963 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,964 adding 'unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json' 2026-01-13T10:37:36,965 adding 'unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json' 2026-01-13T10:37:36,967 adding 'unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json' 2026-01-13T10:37:36,969 adding 'unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json' 2026-01-13T10:37:36,971 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json' 2026-01-13T10:37:36,972 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json' 2026-01-13T10:37:36,973 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json' 2026-01-13T10:37:36,974 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,976 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,977 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,979 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,980 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,981 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:36,982 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:36,983 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:36,984 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:36,985 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:36,986 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json' 2026-01-13T10:37:36,988 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json' 2026-01-13T10:37:36,989 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json' 2026-01-13T10:37:36,990 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json' 2026-01-13T10:37:36,992 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json' 2026-01-13T10:37:36,993 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json' 2026-01-13T10:37:36,994 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:36,995 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:36,996 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:36,998 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:36,999 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:37,000 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:37,001 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:37,002 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:37,004 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:37,005 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json' 2026-01-13T10:37:37,007 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json' 2026-01-13T10:37:37,009 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json' 2026-01-13T10:37:37,010 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-01-13T10:37:37,012 adding 'unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json' 2026-01-13T10:37:37,014 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json' 2026-01-13T10:37:37,015 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json' 2026-01-13T10:37:37,016 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json' 2026-01-13T10:37:37,017 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json' 2026-01-13T10:37:37,018 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-13T10:37:37,020 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-13T10:37:37,021 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-13T10:37:37,022 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-13T10:37:37,023 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-13T10:37:37,024 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-13T10:37:37,025 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-13T10:37:37,026 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-13T10:37:37,027 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-13T10:37:37,029 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json' 2026-01-13T10:37:37,030 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json' 2026-01-13T10:37:37,031 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json' 2026-01-13T10:37:37,032 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json' 2026-01-13T10:37:37,034 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json' 2026-01-13T10:37:37,036 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json' 2026-01-13T10:37:37,037 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json' 2026-01-13T10:37:37,039 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json' 2026-01-13T10:37:37,040 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json' 2026-01-13T10:37:37,042 adding 'unitxt/catalog/metrics/reward/deberta_v3_large_v2.json' 2026-01-13T10:37:37,044 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json' 2026-01-13T10:37:37,045 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json' 2026-01-13T10:37:37,046 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json' 2026-01-13T10:37:37,047 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json' 2026-01-13T10:37:37,048 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json' 2026-01-13T10:37:37,050 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json' 2026-01-13T10:37:37,051 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json' 2026-01-13T10:37:37,052 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json' 2026-01-13T10:37:37,053 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json' 2026-01-13T10:37:37,054 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json' 2026-01-13T10:37:37,055 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json' 2026-01-13T10:37:37,057 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json' 2026-01-13T10:37:37,058 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json' 2026-01-13T10:37:37,059 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json' 2026-01-13T10:37:37,060 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json' 2026-01-13T10:37:37,061 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json' 2026-01-13T10:37:37,062 adding 'unitxt/catalog/metrics/robustness/group_mean_accuracy.json' 2026-01-13T10:37:37,063 adding 'unitxt/catalog/metrics/robustness/group_mean_string_containment.json' 2026-01-13T10:37:37,064 adding 'unitxt/catalog/metrics/robustness/group_mean_token_overlap.json' 2026-01-13T10:37:37,066 adding 'unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json' 2026-01-13T10:37:37,067 adding 'unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json' 2026-01-13T10:37:37,068 adding 'unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json' 2026-01-13T10:37:37,070 adding 'unitxt/catalog/metrics/text2sql/execution_accuracy.json' 2026-01-13T10:37:37,071 adding 'unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json' 2026-01-13T10:37:37,072 adding 'unitxt/catalog/metrics/text2sql/non_execution_accuracy.json' 2026-01-13T10:37:37,074 adding 'unitxt/catalog/metrics/tool_calling/reflection.json' 2026-01-13T10:37:37,076 adding 'unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json' 2026-01-13T10:37:37,078 adding 'unitxt/catalog/metrics/tool_calling/key_value/accuracy.json' 2026-01-13T10:37:37,079 adding 'unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json' 2026-01-13T10:37:37,081 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/validity.json' 2026-01-13T10:37:37,083 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json' 2026-01-13T10:37:37,085 adding 'unitxt/catalog/metrics/tool_calling/reflection/syntactic.json' 2026-01-13T10:37:37,088 adding 'unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json' 2026-01-13T10:37:37,090 adding 'unitxt/catalog/operators/capitalize.json' 2026-01-13T10:37:37,091 adding 'unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json' 2026-01-13T10:37:37,092 adding 'unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json' 2026-01-13T10:37:37,093 adding 'unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json' 2026-01-13T10:37:37,094 adding 'unitxt/catalog/operators/convert_to_boolean.json' 2026-01-13T10:37:37,096 adding 'unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json' 2026-01-13T10:37:37,097 adding 'unitxt/catalog/operators/extract_from_double_brackets.json' 2026-01-13T10:37:37,098 adding 'unitxt/catalog/operators/extract_harm_rating_judgment.json' 2026-01-13T10:37:37,099 adding 'unitxt/catalog/operators/extract_mt_bench_label_judgment.json' 2026-01-13T10:37:37,101 adding 'unitxt/catalog/operators/extract_mt_bench_rating_judgment.json' 2026-01-13T10:37:37,102 adding 'unitxt/catalog/operators/extract_verbal_judgement.json' 2026-01-13T10:37:37,103 adding 'unitxt/catalog/operators/extract_verbal_judgement_bad_good.json' 2026-01-13T10:37:37,105 adding 'unitxt/catalog/operators/first_character.json' 2026-01-13T10:37:37,106 adding 'unitxt/catalog/operators/fix_json_schema.json' 2026-01-13T10:37:37,107 adding 'unitxt/catalog/operators/fix_whitespace.json' 2026-01-13T10:37:37,109 adding 'unitxt/catalog/operators/get_string_after_colon.json' 2026-01-13T10:37:37,110 adding 'unitxt/catalog/operators/hate_speech_or_not_hate_speech.json' 2026-01-13T10:37:37,111 adding 'unitxt/catalog/operators/literal_eval.json' 2026-01-13T10:37:37,112 adding 'unitxt/catalog/operators/lower_case.json' 2026-01-13T10:37:37,113 adding 'unitxt/catalog/operators/lower_case_till_punc.json' 2026-01-13T10:37:37,114 adding 'unitxt/catalog/operators/match_closest_option.json' 2026-01-13T10:37:37,116 adding 'unitxt/catalog/operators/predictions_yes_1_else_0.json' 2026-01-13T10:37:37,117 adding 'unitxt/catalog/operators/regex_parser.json' 2026-01-13T10:37:37,118 adding 'unitxt/catalog/operators/remove_articles.json' 2026-01-13T10:37:37,119 adding 'unitxt/catalog/operators/remove_none_from_list.json' 2026-01-13T10:37:37,120 adding 'unitxt/catalog/operators/remove_punctuations.json' 2026-01-13T10:37:37,121 adding 'unitxt/catalog/operators/scale_0_10_to_0_1.json' 2026-01-13T10:37:37,122 adding 'unitxt/catalog/operators/stance_to_pro_con.json' 2026-01-13T10:37:37,123 adding 'unitxt/catalog/operators/str_to_float_format.json' 2026-01-13T10:37:37,124 adding 'unitxt/catalog/operators/substring.json' 2026-01-13T10:37:37,125 adding 'unitxt/catalog/operators/take_first_non_empty_line.json' 2026-01-13T10:37:37,126 adding 'unitxt/catalog/operators/take_first_word.json' 2026-01-13T10:37:37,127 adding 'unitxt/catalog/operators/take_last_non_empty_line.json' 2026-01-13T10:37:37,128 adding 'unitxt/catalog/operators/to_yes_or_none.json' 2026-01-13T10:37:37,129 adding 'unitxt/catalog/operators/toxic_or_not_toxic.json' 2026-01-13T10:37:37,130 adding 'unitxt/catalog/operators/upper_case.json' 2026-01-13T10:37:37,131 adding 'unitxt/catalog/operators/yes_no_to_int.json' 2026-01-13T10:37:37,133 adding 'unitxt/catalog/operators/balancers/classification/by_label.json' 2026-01-13T10:37:37,134 adding 'unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json' 2026-01-13T10:37:37,136 adding 'unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json' 2026-01-13T10:37:37,137 adding 'unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json' 2026-01-13T10:37:37,139 adding 'unitxt/catalog/operators/balancers/qa/by_answer.json' 2026-01-13T10:37:37,141 adding 'unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json' 2026-01-13T10:37:37,142 adding 'unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json' 2026-01-13T10:37:37,145 adding 'unitxt/catalog/processors/capitalize.json' 2026-01-13T10:37:37,146 adding 'unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json' 2026-01-13T10:37:37,148 adding 'unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json' 2026-01-13T10:37:37,149 adding 'unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json' 2026-01-13T10:37:37,150 adding 'unitxt/catalog/processors/convert_to_boolean.json' 2026-01-13T10:37:37,151 adding 'unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json' 2026-01-13T10:37:37,152 adding 'unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json' 2026-01-13T10:37:37,153 adding 'unitxt/catalog/processors/extract_from_double_brackets.json' 2026-01-13T10:37:37,155 adding 'unitxt/catalog/processors/extract_harm_rating_judgment.json' 2026-01-13T10:37:37,156 adding 'unitxt/catalog/processors/extract_mt_bench_label_judgment.json' 2026-01-13T10:37:37,157 adding 'unitxt/catalog/processors/extract_mt_bench_rating_judgment.json' 2026-01-13T10:37:37,158 adding 'unitxt/catalog/processors/extract_verbal_judgement.json' 2026-01-13T10:37:37,160 adding 'unitxt/catalog/processors/extract_verbal_judgement_bad_good.json' 2026-01-13T10:37:37,161 adding 'unitxt/catalog/processors/first_character.json' 2026-01-13T10:37:37,163 adding 'unitxt/catalog/processors/fix_whitespace.json' 2026-01-13T10:37:37,164 adding 'unitxt/catalog/processors/get_string_after_colon.json' 2026-01-13T10:37:37,166 adding 'unitxt/catalog/processors/hate_speech_or_not_hate_speech.json' 2026-01-13T10:37:37,167 adding 'unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json' 2026-01-13T10:37:37,169 adding 'unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json' 2026-01-13T10:37:37,170 adding 'unitxt/catalog/processors/list_to_empty_entity_tuples.json' 2026-01-13T10:37:37,171 adding 'unitxt/catalog/processors/literal_eval.json' 2026-01-13T10:37:37,173 adding 'unitxt/catalog/processors/load_json.json' 2026-01-13T10:37:37,174 adding 'unitxt/catalog/processors/load_json_from_predictions.json' 2026-01-13T10:37:37,175 adding 'unitxt/catalog/processors/load_json_or_empty_tool_call.json' 2026-01-13T10:37:37,176 adding 'unitxt/catalog/processors/load_json_predictions.json' 2026-01-13T10:37:37,177 adding 'unitxt/catalog/processors/lower_case.json' 2026-01-13T10:37:37,178 adding 'unitxt/catalog/processors/lower_case_till_punc.json' 2026-01-13T10:37:37,179 adding 'unitxt/catalog/processors/match_closest_option.json' 2026-01-13T10:37:37,180 adding 'unitxt/catalog/processors/multi_tool_call.json' 2026-01-13T10:37:37,181 adding 'unitxt/catalog/processors/predictions_yes_1_else_0.json' 2026-01-13T10:37:37,182 adding 'unitxt/catalog/processors/regex_parser_from_prediction.json' 2026-01-13T10:37:37,183 adding 'unitxt/catalog/processors/remove_articles.json' 2026-01-13T10:37:37,184 adding 'unitxt/catalog/processors/remove_none_from_list.json' 2026-01-13T10:37:37,185 adding 'unitxt/catalog/processors/remove_punctuations.json' 2026-01-13T10:37:37,186 adding 'unitxt/catalog/processors/safe_unsafe.json' 2026-01-13T10:37:37,188 adding 'unitxt/catalog/processors/scale_0_10_to_0_1.json' 2026-01-13T10:37:37,189 adding 'unitxt/catalog/processors/stance_to_pro_con.json' 2026-01-13T10:37:37,190 adding 'unitxt/catalog/processors/str_to_float_format.json' 2026-01-13T10:37:37,191 adding 'unitxt/catalog/processors/substring.json' 2026-01-13T10:37:37,192 adding 'unitxt/catalog/processors/take_first_non_empty_line.json' 2026-01-13T10:37:37,193 adding 'unitxt/catalog/processors/take_first_word.json' 2026-01-13T10:37:37,194 adding 'unitxt/catalog/processors/take_last_non_empty_line.json' 2026-01-13T10:37:37,195 adding 'unitxt/catalog/processors/to_list_by_comma.json' 2026-01-13T10:37:37,196 adding 'unitxt/catalog/processors/to_list_by_comma_from_references.json' 2026-01-13T10:37:37,197 adding 'unitxt/catalog/processors/to_list_by_comma_space.json' 2026-01-13T10:37:37,199 adding 'unitxt/catalog/processors/to_list_by_hyphen_space.json' 2026-01-13T10:37:37,200 adding 'unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json' 2026-01-13T10:37:37,201 adding 'unitxt/catalog/processors/to_span_label_pairs.json' 2026-01-13T10:37:37,202 adding 'unitxt/catalog/processors/to_span_label_pairs_surface_only.json' 2026-01-13T10:37:37,203 adding 'unitxt/catalog/processors/to_string.json' 2026-01-13T10:37:37,204 adding 'unitxt/catalog/processors/to_string_stripped.json' 2026-01-13T10:37:37,205 adding 'unitxt/catalog/processors/to_yes_or_none.json' 2026-01-13T10:37:37,207 adding 'unitxt/catalog/processors/toxic_or_not_toxic.json' 2026-01-13T10:37:37,208 adding 'unitxt/catalog/processors/upper_case.json' 2026-01-13T10:37:37,209 adding 'unitxt/catalog/processors/yes_no_to_int.json' 2026-01-13T10:37:37,211 adding 'unitxt/catalog/processors/text2sql/get_sql.json' 2026-01-13T10:37:37,214 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json' 2026-01-13T10:37:37,215 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json' 2026-01-13T10:37:37,216 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json' 2026-01-13T10:37:37,218 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json' 2026-01-13T10:37:37,219 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json' 2026-01-13T10:37:37,220 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json' 2026-01-13T10:37:37,221 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json' 2026-01-13T10:37:37,222 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json' 2026-01-13T10:37:37,223 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json' 2026-01-13T10:37:37,225 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json' 2026-01-13T10:37:37,226 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json' 2026-01-13T10:37:37,228 adding 'unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json' 2026-01-13T10:37:37,230 adding 'unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json' 2026-01-13T10:37:37,232 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json' 2026-01-13T10:37:37,233 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json' 2026-01-13T10:37:37,234 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json' 2026-01-13T10:37:37,235 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json' 2026-01-13T10:37:37,236 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json' 2026-01-13T10:37:37,237 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json' 2026-01-13T10:37:37,238 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json' 2026-01-13T10:37:37,239 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json' 2026-01-13T10:37:37,240 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json' 2026-01-13T10:37:37,241 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json' 2026-01-13T10:37:37,242 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json' 2026-01-13T10:37:37,243 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json' 2026-01-13T10:37:37,245 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json' 2026-01-13T10:37:37,246 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json' 2026-01-13T10:37:37,248 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json' 2026-01-13T10:37:37,249 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json' 2026-01-13T10:37:37,250 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json' 2026-01-13T10:37:37,251 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json' 2026-01-13T10:37:37,252 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json' 2026-01-13T10:37:37,254 adding 'unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json' 2026-01-13T10:37:37,255 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json' 2026-01-13T10:37:37,257 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json' 2026-01-13T10:37:37,259 adding 'unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json' 2026-01-13T10:37:37,261 adding 'unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json' 2026-01-13T10:37:37,263 adding 'unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json' 2026-01-13T10:37:37,264 adding 'unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json' 2026-01-13T10:37:37,266 adding 'unitxt/catalog/recipes/bluebench/safety/attaq_500.json' 2026-01-13T10:37:37,267 adding 'unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json' 2026-01-13T10:37:37,269 adding 'unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json' 2026-01-13T10:37:37,271 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json' 2026-01-13T10:37:37,272 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json' 2026-01-13T10:37:37,273 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json' 2026-01-13T10:37:37,274 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json' 2026-01-13T10:37:37,275 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json' 2026-01-13T10:37:37,276 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json' 2026-01-13T10:37:37,278 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json' 2026-01-13T10:37:37,279 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json' 2026-01-13T10:37:37,280 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json' 2026-01-13T10:37:37,281 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json' 2026-01-13T10:37:37,282 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json' 2026-01-13T10:37:37,283 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json' 2026-01-13T10:37:37,284 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json' 2026-01-13T10:37:37,285 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json' 2026-01-13T10:37:37,287 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json' 2026-01-13T10:37:37,289 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,290 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,291 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,292 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,294 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,295 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,296 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,298 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,299 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,300 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,302 adding 'unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,303 adding 'unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,305 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,306 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,308 adding 'unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,310 adding 'unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,311 adding 'unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,312 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,313 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,314 adding 'unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,316 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,317 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,319 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,320 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,321 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,323 adding 'unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,324 adding 'unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,325 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,326 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,327 adding 'unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,329 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,330 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,331 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,332 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,333 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,336 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,337 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,338 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,339 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,340 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,342 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,343 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,344 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,345 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,346 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,348 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,349 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,350 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,352 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,353 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,355 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,356 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,357 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,358 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,359 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,361 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,362 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,363 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,365 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,366 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,368 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,369 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,370 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,371 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,372 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,374 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,375 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,376 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,378 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,379 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,381 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,382 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,383 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,384 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,385 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,387 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,388 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,389 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,390 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,391 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,393 adding 'unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,394 adding 'unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,395 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,397 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,398 adding 'unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,400 adding 'unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,401 adding 'unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,402 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,403 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,404 adding 'unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,406 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,407 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,408 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,410 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,411 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,412 adding 'unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,414 adding 'unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,415 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,416 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,417 adding 'unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,419 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,420 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,421 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,422 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,423 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,426 adding 'unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,427 adding 'unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,428 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,429 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,430 adding 'unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,432 adding 'unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,433 adding 'unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,434 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,435 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,436 adding 'unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,438 adding 'unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,439 adding 'unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,440 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,441 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,443 adding 'unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,444 adding 'unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,446 adding 'unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,447 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,448 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,449 adding 'unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,451 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,452 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,453 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,454 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,455 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,458 adding 'unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,459 adding 'unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,460 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,461 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,462 adding 'unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,464 adding 'unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,465 adding 'unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,466 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,468 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,469 adding 'unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,471 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,472 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,473 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,474 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,475 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,477 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,478 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,479 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,480 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,481 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,483 adding 'unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,484 adding 'unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,485 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,486 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,488 adding 'unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,489 adding 'unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,490 adding 'unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,492 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,493 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,494 adding 'unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,496 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,497 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,498 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,499 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,501 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,502 adding 'unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,504 adding 'unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,505 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,506 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,507 adding 'unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,509 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,510 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,511 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,512 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,513 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,515 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,517 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,518 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,519 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,520 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,521 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,523 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,524 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,525 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,526 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,528 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,529 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,530 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,531 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,532 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,534 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,535 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,537 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,538 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,539 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,541 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,542 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,543 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,544 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,546 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,547 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,549 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,550 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,551 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,552 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,554 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,555 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,556 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,557 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,558 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,560 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,561 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,562 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,563 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,564 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,566 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,568 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,569 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,570 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,571 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,573 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,574 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,575 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,576 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,578 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,579 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,581 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,582 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,583 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,584 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,586 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,587 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,588 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,589 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,591 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,592 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,594 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,595 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,596 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,597 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,599 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,600 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,601 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,602 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,603 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,606 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,607 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,608 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,609 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,610 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,612 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,613 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,615 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,616 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,617 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,619 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,620 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,621 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,622 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,624 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,625 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,626 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,628 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,629 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,630 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,632 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,633 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,635 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,636 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,637 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,639 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,640 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,641 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,643 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,644 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,646 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,647 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,648 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,649 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,651 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,653 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,654 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json' 2026-01-13T10:37:37,655 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,656 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,658 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,659 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,661 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json' 2026-01-13T10:37:37,662 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,663 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,664 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,667 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,668 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json' 2026-01-13T10:37:37,669 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,670 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,672 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,674 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,675 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json' 2026-01-13T10:37:37,676 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,678 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,679 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,681 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,682 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json' 2026-01-13T10:37:37,684 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,685 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,686 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,688 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,689 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json' 2026-01-13T10:37:37,690 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,691 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,692 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,694 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,695 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json' 2026-01-13T10:37:37,696 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-13T10:37:37,698 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-13T10:37:37,699 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json' 2026-01-13T10:37:37,701 adding 'unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,702 adding 'unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json' 2026-01-13T10:37:37,703 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,704 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,706 adding 'unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,707 adding 'unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,709 adding 'unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json' 2026-01-13T10:37:37,710 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,711 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,713 adding 'unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,714 adding 'unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,716 adding 'unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json' 2026-01-13T10:37:37,717 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,719 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,720 adding 'unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,722 adding 'unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,723 adding 'unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json' 2026-01-13T10:37:37,725 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,726 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,727 adding 'unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,729 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,730 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json' 2026-01-13T10:37:37,731 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,732 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,733 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,735 adding 'unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,736 adding 'unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json' 2026-01-13T10:37:37,737 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,738 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,740 adding 'unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,741 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,742 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json' 2026-01-13T10:37:37,744 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json' 2026-01-13T10:37:37,745 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json' 2026-01-13T10:37:37,746 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json' 2026-01-13T10:37:37,748 adding 'unitxt/catalog/serializers/table/concat.json' 2026-01-13T10:37:37,749 adding 'unitxt/catalog/serializers/table/df.json' 2026-01-13T10:37:37,750 adding 'unitxt/catalog/serializers/table/html.json' 2026-01-13T10:37:37,751 adding 'unitxt/catalog/serializers/table/image.json' 2026-01-13T10:37:37,753 adding 'unitxt/catalog/serializers/table/indexed_row_major.json' 2026-01-13T10:37:37,754 adding 'unitxt/catalog/serializers/table/json.json' 2026-01-13T10:37:37,755 adding 'unitxt/catalog/serializers/table/markdown.json' 2026-01-13T10:37:37,756 adding 'unitxt/catalog/serializers/text2sql/schema.json' 2026-01-13T10:37:37,758 adding 'unitxt/catalog/splitters/diverse_labels_sampler.json' 2026-01-13T10:37:37,759 adding 'unitxt/catalog/splitters/large_no_dev.json' 2026-01-13T10:37:37,760 adding 'unitxt/catalog/splitters/large_no_test.json' 2026-01-13T10:37:37,762 adding 'unitxt/catalog/splitters/small_no_dev.json' 2026-01-13T10:37:37,763 adding 'unitxt/catalog/splitters/small_no_test.json' 2026-01-13T10:37:37,764 adding 'unitxt/catalog/splitters/test_only.json' 2026-01-13T10:37:37,766 adding 'unitxt/catalog/system_prompts/boolqa.json' 2026-01-13T10:37:37,767 adding 'unitxt/catalog/system_prompts/empty.json' 2026-01-13T10:37:37,768 adding 'unitxt/catalog/system_prompts/general/be_concise.json' 2026-01-13T10:37:37,770 adding 'unitxt/catalog/system_prompts/model/granite.json' 2026-01-13T10:37:37,772 adding 'unitxt/catalog/system_prompts/models/alpaca.json' 2026-01-13T10:37:37,773 adding 'unitxt/catalog/system_prompts/models/deepseek_coder.json' 2026-01-13T10:37:37,774 adding 'unitxt/catalog/system_prompts/models/japanese_llama.json' 2026-01-13T10:37:37,775 adding 'unitxt/catalog/system_prompts/models/labradorite.json' 2026-01-13T10:37:37,777 adding 'unitxt/catalog/system_prompts/models/llama.json' 2026-01-13T10:37:37,778 adding 'unitxt/catalog/system_prompts/models/llama2.json' 2026-01-13T10:37:37,779 adding 'unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json' 2026-01-13T10:37:37,781 adding 'unitxt/catalog/tasks/generation.json' 2026-01-13T10:37:37,782 adding 'unitxt/catalog/tasks/grammatical_error_correction.json' 2026-01-13T10:37:37,783 adding 'unitxt/catalog/tasks/key_value_extraction.json' 2026-01-13T10:37:37,784 adding 'unitxt/catalog/tasks/language_identification.json' 2026-01-13T10:37:37,785 adding 'unitxt/catalog/tasks/schema_linking.json' 2026-01-13T10:37:37,786 adding 'unitxt/catalog/tasks/text2sql.json' 2026-01-13T10:37:37,787 adding 'unitxt/catalog/tasks/text2sql_logic.json' 2026-01-13T10:37:37,789 adding 'unitxt/catalog/tasks/classification/binary.json' 2026-01-13T10:37:37,790 adding 'unitxt/catalog/tasks/classification/multi_class.json' 2026-01-13T10:37:37,791 adding 'unitxt/catalog/tasks/classification/multi_label.json' 2026-01-13T10:37:37,793 adding 'unitxt/catalog/tasks/classification/binary/zero_or_one.json' 2026-01-13T10:37:37,795 adding 'unitxt/catalog/tasks/classification/multi_class/relation.json' 2026-01-13T10:37:37,796 adding 'unitxt/catalog/tasks/classification/multi_class/topic_classification.json' 2026-01-13T10:37:37,797 adding 'unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json' 2026-01-13T10:37:37,799 adding 'unitxt/catalog/tasks/completion/abstractive.json' 2026-01-13T10:37:37,800 adding 'unitxt/catalog/tasks/completion/extractive.json' 2026-01-13T10:37:37,801 adding 'unitxt/catalog/tasks/completion/multiple_choice.json' 2026-01-13T10:37:37,803 adding 'unitxt/catalog/tasks/evaluation/preference.json' 2026-01-13T10:37:37,804 adding 'unitxt/catalog/tasks/generation/from_pair.json' 2026-01-13T10:37:37,806 adding 'unitxt/catalog/tasks/ner/all_entity_types.json' 2026-01-13T10:37:37,808 adding 'unitxt/catalog/tasks/ner/single_entity_type.json' 2026-01-13T10:37:37,810 adding 'unitxt/catalog/tasks/qa/extractive.json' 2026-01-13T10:37:37,811 adding 'unitxt/catalog/tasks/qa/open.json' 2026-01-13T10:37:37,812 adding 'unitxt/catalog/tasks/qa/with_context.json' 2026-01-13T10:37:37,814 adding 'unitxt/catalog/tasks/qa/extractive/multi_turn.json' 2026-01-13T10:37:37,816 adding 'unitxt/catalog/tasks/qa/multiple_choice/open.json' 2026-01-13T10:37:37,817 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context.json' 2026-01-13T10:37:37,818 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_topic.json' 2026-01-13T10:37:37,820 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json' 2026-01-13T10:37:37,822 adding 'unitxt/catalog/tasks/qa/with_context/abstractive.json' 2026-01-13T10:37:37,823 adding 'unitxt/catalog/tasks/qa/with_context/extractive.json' 2026-01-13T10:37:37,824 adding 'unitxt/catalog/tasks/qa/with_context/with_domain.json' 2026-01-13T10:37:37,825 adding 'unitxt/catalog/tasks/qa/with_context/with_type.json' 2026-01-13T10:37:37,827 adding 'unitxt/catalog/tasks/rag/corpora.json' 2026-01-13T10:37:37,828 adding 'unitxt/catalog/tasks/rag/end_to_end.json' 2026-01-13T10:37:37,829 adding 'unitxt/catalog/tasks/rag/response_generation.json' 2026-01-13T10:37:37,832 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json' 2026-01-13T10:37:37,833 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json' 2026-01-13T10:37:37,835 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json' 2026-01-13T10:37:37,836 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json' 2026-01-13T10:37:37,838 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/binary.json' 2026-01-13T10:37:37,839 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json' 2026-01-13T10:37:37,841 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json' 2026-01-13T10:37:37,842 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json' 2026-01-13T10:37:37,844 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/binary.json' 2026-01-13T10:37:37,845 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json' 2026-01-13T10:37:37,846 adding 'unitxt/catalog/tasks/regression/single_text.json' 2026-01-13T10:37:37,847 adding 'unitxt/catalog/tasks/regression/two_texts.json' 2026-01-13T10:37:37,849 adding 'unitxt/catalog/tasks/regression/two_texts/similarity.json' 2026-01-13T10:37:37,851 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json' 2026-01-13T10:37:37,853 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json' 2026-01-13T10:37:37,854 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json' 2026-01-13T10:37:37,855 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json' 2026-01-13T10:37:37,857 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json' 2026-01-13T10:37:37,858 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn.json' 2026-01-13T10:37:37,859 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json' 2026-01-13T10:37:37,860 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn.json' 2026-01-13T10:37:37,861 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json' 2026-01-13T10:37:37,863 adding 'unitxt/catalog/tasks/rewriting/by_attribute.json' 2026-01-13T10:37:37,864 adding 'unitxt/catalog/tasks/rewriting/paraphrase.json' 2026-01-13T10:37:37,866 adding 'unitxt/catalog/tasks/selection/by_attribute.json' 2026-01-13T10:37:37,868 adding 'unitxt/catalog/tasks/span_labeling/extraction.json' 2026-01-13T10:37:37,869 adding 'unitxt/catalog/tasks/summarization/abstractive.json' 2026-01-13T10:37:37,871 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json' 2026-01-13T10:37:37,872 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json' 2026-01-13T10:37:37,874 adding 'unitxt/catalog/tasks/tool_calling/multi_turn.json' 2026-01-13T10:37:37,875 adding 'unitxt/catalog/tasks/tool_calling/supervised.json' 2026-01-13T10:37:37,877 adding 'unitxt/catalog/tasks/translation/directed.json' 2026-01-13T10:37:37,878 adding 'unitxt/catalog/templates/empty.json' 2026-01-13T10:37:37,880 adding 'unitxt/catalog/templates/key_val.json' 2026-01-13T10:37:37,881 adding 'unitxt/catalog/templates/key_val_with_new_lines.json' 2026-01-13T10:37:37,883 adding 'unitxt/catalog/templates/classification/multi_class/all.json' 2026-01-13T10:37:37,884 adding 'unitxt/catalog/templates/classification/multi_class/bluebench.json' 2026-01-13T10:37:37,885 adding 'unitxt/catalog/templates/classification/multi_class/default.json' 2026-01-13T10:37:37,886 adding 'unitxt/catalog/templates/classification/multi_class/empty.json' 2026-01-13T10:37:37,887 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json' 2026-01-13T10:37:37,889 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json' 2026-01-13T10:37:37,890 adding 'unitxt/catalog/templates/classification/multi_class/instruct_select_question.json' 2026-01-13T10:37:37,891 adding 'unitxt/catalog/templates/classification/multi_class/instruction.json' 2026-01-13T10:37:37,892 adding 'unitxt/catalog/templates/classification/multi_class/title.json' 2026-01-13T10:37:37,894 adding 'unitxt/catalog/templates/classification/multi_class/relation/all.json' 2026-01-13T10:37:37,895 adding 'unitxt/catalog/templates/classification/multi_class/relation/default.json' 2026-01-13T10:37:37,896 adding 'unitxt/catalog/templates/classification/multi_class/relation/simple.json' 2026-01-13T10:37:37,899 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json' 2026-01-13T10:37:37,900 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json' 2026-01-13T10:37:37,902 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json' 2026-01-13T10:37:37,903 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json' 2026-01-13T10:37:37,904 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json' 2026-01-13T10:37:37,905 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json' 2026-01-13T10:37:37,906 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json' 2026-01-13T10:37:37,907 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json' 2026-01-13T10:37:37,909 adding 'unitxt/catalog/templates/classification/multi_label/all.json' 2026-01-13T10:37:37,910 adding 'unitxt/catalog/templates/classification/multi_label/default.json' 2026-01-13T10:37:37,911 adding 'unitxt/catalog/templates/classification/multi_label/empty.json' 2026-01-13T10:37:37,912 adding 'unitxt/catalog/templates/classification/multi_label/instruction.json' 2026-01-13T10:37:37,913 adding 'unitxt/catalog/templates/classification/multi_label/title.json' 2026-01-13T10:37:37,915 adding 'unitxt/catalog/templates/completion/abstractive/all.json' 2026-01-13T10:37:37,916 adding 'unitxt/catalog/templates/completion/abstractive/empty.json' 2026-01-13T10:37:37,917 adding 'unitxt/catalog/templates/completion/abstractive/standard.json' 2026-01-13T10:37:37,919 adding 'unitxt/catalog/templates/completion/multiple_choice/all.json' 2026-01-13T10:37:37,920 adding 'unitxt/catalog/templates/completion/multiple_choice/bluebench.json' 2026-01-13T10:37:37,921 adding 'unitxt/catalog/templates/completion/multiple_choice/enumerated.json' 2026-01-13T10:37:37,923 adding 'unitxt/catalog/templates/completion/multiple_choice/simple.json' 2026-01-13T10:37:37,924 adding 'unitxt/catalog/templates/completion/multiple_choice/standard.json' 2026-01-13T10:37:37,925 adding 'unitxt/catalog/templates/completion/multiple_choice/title.json' 2026-01-13T10:37:37,927 adding 'unitxt/catalog/templates/evaluation/preference/all.json' 2026-01-13T10:37:37,928 adding 'unitxt/catalog/templates/evaluation/preference/default.json' 2026-01-13T10:37:37,930 adding 'unitxt/catalog/templates/generation/all.json' 2026-01-13T10:37:37,931 adding 'unitxt/catalog/templates/generation/default.json' 2026-01-13T10:37:37,932 adding 'unitxt/catalog/templates/generation/empty.json' 2026-01-13T10:37:37,934 adding 'unitxt/catalog/templates/generation/from_pair/all.json' 2026-01-13T10:37:37,935 adding 'unitxt/catalog/templates/generation/from_pair/default.json' 2026-01-13T10:37:37,937 adding 'unitxt/catalog/templates/grammatical_error_correction/all.json' 2026-01-13T10:37:37,938 adding 'unitxt/catalog/templates/grammatical_error_correction/simple.json' 2026-01-13T10:37:37,940 adding 'unitxt/catalog/templates/grammatical_error_detection/all.json' 2026-01-13T10:37:37,941 adding 'unitxt/catalog/templates/grammatical_error_detection/yes_no.json' 2026-01-13T10:37:37,943 adding 'unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json' 2026-01-13T10:37:37,945 adding 'unitxt/catalog/templates/language_identification/all.json' 2026-01-13T10:37:37,946 adding 'unitxt/catalog/templates/language_identification/simple.json' 2026-01-13T10:37:37,948 adding 'unitxt/catalog/templates/qa/extractive.json' 2026-01-13T10:37:37,949 adding 'unitxt/catalog/templates/qa/open.json' 2026-01-13T10:37:37,950 adding 'unitxt/catalog/templates/qa/with_context.json' 2026-01-13T10:37:37,952 adding 'unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json' 2026-01-13T10:37:37,954 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json' 2026-01-13T10:37:37,955 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json' 2026-01-13T10:37:37,956 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json' 2026-01-13T10:37:37,959 adding 'unitxt/catalog/templates/qa/multi_turn/with_context/simple.json' 2026-01-13T10:37:37,960 adding 'unitxt/catalog/templates/qa/multiple_choice/helm.json' 2026-01-13T10:37:37,961 adding 'unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json' 2026-01-13T10:37:37,962 adding 'unitxt/catalog/templates/qa/multiple_choice/match.json' 2026-01-13T10:37:37,963 adding 'unitxt/catalog/templates/qa/multiple_choice/title.json' 2026-01-13T10:37:37,965 adding 'unitxt/catalog/templates/qa/multiple_choice/open/all.json' 2026-01-13T10:37:37,966 adding 'unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json' 2026-01-13T10:37:37,967 adding 'unitxt/catalog/templates/qa/multiple_choice/open/helm.json' 2026-01-13T10:37:37,968 adding 'unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json' 2026-01-13T10:37:37,969 adding 'unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json' 2026-01-13T10:37:37,971 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/all.json' 2026-01-13T10:37:37,972 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json' 2026-01-13T10:37:37,973 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json' 2026-01-13T10:37:37,974 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json' 2026-01-13T10:37:37,976 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/all.json' 2026-01-13T10:37:37,977 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json' 2026-01-13T10:37:37,978 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json' 2026-01-13T10:37:37,979 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json' 2026-01-13T10:37:37,981 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json' 2026-01-13T10:37:37,982 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json' 2026-01-13T10:37:37,983 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json' 2026-01-13T10:37:37,984 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json' 2026-01-13T10:37:37,986 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json' 2026-01-13T10:37:37,988 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json' 2026-01-13T10:37:37,989 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json' 2026-01-13T10:37:37,990 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json' 2026-01-13T10:37:37,992 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json' 2026-01-13T10:37:37,993 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json' 2026-01-13T10:37:37,994 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json' 2026-01-13T10:37:37,995 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json' 2026-01-13T10:37:37,997 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json' 2026-01-13T10:37:37,998 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/all.json' 2026-01-13T10:37:37,999 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json' 2026-01-13T10:37:38,001 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json' 2026-01-13T10:37:38,002 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json' 2026-01-13T10:37:38,003 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json' 2026-01-13T10:37:38,004 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/match.json' 2026-01-13T10:37:38,006 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/title.json' 2026-01-13T10:37:38,008 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json' 2026-01-13T10:37:38,009 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json' 2026-01-13T10:37:38,010 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json' 2026-01-13T10:37:38,011 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json' 2026-01-13T10:37:38,013 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json' 2026-01-13T10:37:38,014 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json' 2026-01-13T10:37:38,015 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json' 2026-01-13T10:37:38,016 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json' 2026-01-13T10:37:38,017 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json' 2026-01-13T10:37:38,018 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json' 2026-01-13T10:37:38,020 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json' 2026-01-13T10:37:38,021 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json' 2026-01-13T10:37:38,022 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json' 2026-01-13T10:37:38,024 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json' 2026-01-13T10:37:38,025 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json' 2026-01-13T10:37:38,026 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json' 2026-01-13T10:37:38,028 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json' 2026-01-13T10:37:38,029 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json' 2026-01-13T10:37:38,030 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json' 2026-01-13T10:37:38,031 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json' 2026-01-13T10:37:38,033 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json' 2026-01-13T10:37:38,034 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json' 2026-01-13T10:37:38,035 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json' 2026-01-13T10:37:38,036 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json' 2026-01-13T10:37:38,038 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json' 2026-01-13T10:37:38,039 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json' 2026-01-13T10:37:38,041 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json' 2026-01-13T10:37:38,042 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json' 2026-01-13T10:37:38,043 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json' 2026-01-13T10:37:38,044 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json' 2026-01-13T10:37:38,046 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json' 2026-01-13T10:37:38,048 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json' 2026-01-13T10:37:38,049 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json' 2026-01-13T10:37:38,050 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json' 2026-01-13T10:37:38,051 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json' 2026-01-13T10:37:38,053 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json' 2026-01-13T10:37:38,054 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json' 2026-01-13T10:37:38,055 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json' 2026-01-13T10:37:38,057 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json' 2026-01-13T10:37:38,058 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json' 2026-01-13T10:37:38,059 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json' 2026-01-13T10:37:38,060 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json' 2026-01-13T10:37:38,061 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json' 2026-01-13T10:37:38,063 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json' 2026-01-13T10:37:38,064 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json' 2026-01-13T10:37:38,065 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json' 2026-01-13T10:37:38,066 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json' 2026-01-13T10:37:38,068 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json' 2026-01-13T10:37:38,069 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json' 2026-01-13T10:37:38,070 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json' 2026-01-13T10:37:38,071 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json' 2026-01-13T10:37:38,073 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json' 2026-01-13T10:37:38,074 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json' 2026-01-13T10:37:38,075 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json' 2026-01-13T10:37:38,077 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json' 2026-01-13T10:37:38,078 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json' 2026-01-13T10:37:38,079 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json' 2026-01-13T10:37:38,080 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json' 2026-01-13T10:37:38,082 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json' 2026-01-13T10:37:38,083 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json' 2026-01-13T10:37:38,085 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json' 2026-01-13T10:37:38,086 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json' 2026-01-13T10:37:38,087 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json' 2026-01-13T10:37:38,089 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json' 2026-01-13T10:37:38,090 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json' 2026-01-13T10:37:38,092 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json' 2026-01-13T10:37:38,093 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json' 2026-01-13T10:37:38,095 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json' 2026-01-13T10:37:38,096 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json' 2026-01-13T10:37:38,097 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json' 2026-01-13T10:37:38,099 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json' 2026-01-13T10:37:38,100 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json' 2026-01-13T10:37:38,101 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json' 2026-01-13T10:37:38,103 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json' 2026-01-13T10:37:38,104 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json' 2026-01-13T10:37:38,106 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json' 2026-01-13T10:37:38,107 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json' 2026-01-13T10:37:38,108 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json' 2026-01-13T10:37:38,109 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json' 2026-01-13T10:37:38,111 adding 'unitxt/catalog/templates/qa/open/all.json' 2026-01-13T10:37:38,112 adding 'unitxt/catalog/templates/qa/open/empty.json' 2026-01-13T10:37:38,113 adding 'unitxt/catalog/templates/qa/open/simple.json' 2026-01-13T10:37:38,114 adding 'unitxt/catalog/templates/qa/open/simple2.json' 2026-01-13T10:37:38,115 adding 'unitxt/catalog/templates/qa/open/title.json' 2026-01-13T10:37:38,116 adding 'unitxt/catalog/templates/qa/with_context/all.json' 2026-01-13T10:37:38,118 adding 'unitxt/catalog/templates/qa/with_context/chart_qa.json' 2026-01-13T10:37:38,119 adding 'unitxt/catalog/templates/qa/with_context/doc_vqa.json' 2026-01-13T10:37:38,120 adding 'unitxt/catalog/templates/qa/with_context/ffqa.json' 2026-01-13T10:37:38,121 adding 'unitxt/catalog/templates/qa/with_context/info_vqa.json' 2026-01-13T10:37:38,122 adding 'unitxt/catalog/templates/qa/with_context/lmms_eval.json' 2026-01-13T10:37:38,123 adding 'unitxt/catalog/templates/qa/with_context/qtsumm.json' 2026-01-13T10:37:38,124 adding 'unitxt/catalog/templates/qa/with_context/question_first.json' 2026-01-13T10:37:38,125 adding 'unitxt/catalog/templates/qa/with_context/simple.json' 2026-01-13T10:37:38,127 adding 'unitxt/catalog/templates/qa/with_context/simple2.json' 2026-01-13T10:37:38,128 adding 'unitxt/catalog/templates/qa/with_context/title.json' 2026-01-13T10:37:38,129 adding 'unitxt/catalog/templates/qa/with_context/websrc.json' 2026-01-13T10:37:38,130 adding 'unitxt/catalog/templates/qa/with_context/with_type.json' 2026-01-13T10:37:38,132 adding 'unitxt/catalog/templates/rag/end_to_end/json_predictions.json' 2026-01-13T10:37:38,134 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json' 2026-01-13T10:37:38,135 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json' 2026-01-13T10:37:38,136 adding 'unitxt/catalog/templates/rag/response_generation/bluebench.json' 2026-01-13T10:37:38,137 adding 'unitxt/catalog/templates/rag/response_generation/please_respond.json' 2026-01-13T10:37:38,139 adding 'unitxt/catalog/templates/rag/response_generation/please_respond_chat.json' 2026-01-13T10:37:38,141 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/all.json' 2026-01-13T10:37:38,142 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json' 2026-01-13T10:37:38,143 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json' 2026-01-13T10:37:38,145 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json' 2026-01-13T10:37:38,146 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json' 2026-01-13T10:37:38,147 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json' 2026-01-13T10:37:38,149 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json' 2026-01-13T10:37:38,150 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json' 2026-01-13T10:37:38,151 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json' 2026-01-13T10:37:38,152 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json' 2026-01-13T10:37:38,154 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json' 2026-01-13T10:37:38,155 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json' 2026-01-13T10:37:38,156 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json' 2026-01-13T10:37:38,157 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json' 2026-01-13T10:37:38,158 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json' 2026-01-13T10:37:38,160 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/all.json' 2026-01-13T10:37:38,161 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json' 2026-01-13T10:37:38,162 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json' 2026-01-13T10:37:38,164 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json' 2026-01-13T10:37:38,165 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json' 2026-01-13T10:37:38,166 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json' 2026-01-13T10:37:38,168 adding 'unitxt/catalog/templates/rag_eval/context_relevance/all.json' 2026-01-13T10:37:38,169 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json' 2026-01-13T10:37:38,170 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json' 2026-01-13T10:37:38,171 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json' 2026-01-13T10:37:38,172 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json' 2026-01-13T10:37:38,174 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json' 2026-01-13T10:37:38,175 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json' 2026-01-13T10:37:38,176 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json' 2026-01-13T10:37:38,177 adding 'unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json' 2026-01-13T10:37:38,179 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/all.json' 2026-01-13T10:37:38,180 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json' 2026-01-13T10:37:38,182 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json' 2026-01-13T10:37:38,183 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json' 2026-01-13T10:37:38,184 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json' 2026-01-13T10:37:38,185 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json' 2026-01-13T10:37:38,186 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json' 2026-01-13T10:37:38,188 adding 'unitxt/catalog/templates/rag_eval/faithfulness/all.json' 2026-01-13T10:37:38,190 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json' 2026-01-13T10:37:38,191 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json' 2026-01-13T10:37:38,192 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json' 2026-01-13T10:37:38,193 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json' 2026-01-13T10:37:38,195 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json' 2026-01-13T10:37:38,196 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json' 2026-01-13T10:37:38,197 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json' 2026-01-13T10:37:38,199 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json' 2026-01-13T10:37:38,200 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json' 2026-01-13T10:37:38,201 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json' 2026-01-13T10:37:38,202 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json' 2026-01-13T10:37:38,203 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json' 2026-01-13T10:37:38,204 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json' 2026-01-13T10:37:38,206 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json' 2026-01-13T10:37:38,207 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json' 2026-01-13T10:37:38,208 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json' 2026-01-13T10:37:38,209 adding 'unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json' 2026-01-13T10:37:38,212 adding 'unitxt/catalog/templates/regression/single_text/all.json' 2026-01-13T10:37:38,213 adding 'unitxt/catalog/templates/regression/single_text/simple.json' 2026-01-13T10:37:38,214 adding 'unitxt/catalog/templates/regression/single_text/title.json' 2026-01-13T10:37:38,216 adding 'unitxt/catalog/templates/regression/two_texts/all.json' 2026-01-13T10:37:38,217 adding 'unitxt/catalog/templates/regression/two_texts/simple.json' 2026-01-13T10:37:38,218 adding 'unitxt/catalog/templates/regression/two_texts/title.json' 2026-01-13T10:37:38,220 adding 'unitxt/catalog/templates/regression/two_texts/similarity/flan.json' 2026-01-13T10:37:38,222 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json' 2026-01-13T10:37:38,224 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json' 2026-01-13T10:37:38,225 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json' 2026-01-13T10:37:38,226 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json' 2026-01-13T10:37:38,228 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json' 2026-01-13T10:37:38,230 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json' 2026-01-13T10:37:38,231 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json' 2026-01-13T10:37:38,232 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json' 2026-01-13T10:37:38,234 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json' 2026-01-13T10:37:38,235 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json' 2026-01-13T10:37:38,236 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json' 2026-01-13T10:37:38,238 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json' 2026-01-13T10:37:38,240 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json' 2026-01-13T10:37:38,241 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json' 2026-01-13T10:37:38,242 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json' 2026-01-13T10:37:38,243 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json' 2026-01-13T10:37:38,245 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json' 2026-01-13T10:37:38,246 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json' 2026-01-13T10:37:38,248 adding 'unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json' 2026-01-13T10:37:38,251 adding 'unitxt/catalog/templates/rewriting/by_attribute/all.json' 2026-01-13T10:37:38,252 adding 'unitxt/catalog/templates/rewriting/by_attribute/default.json' 2026-01-13T10:37:38,253 adding 'unitxt/catalog/templates/rewriting/paraphrase/all.json' 2026-01-13T10:37:38,254 adding 'unitxt/catalog/templates/rewriting/paraphrase/default.json' 2026-01-13T10:37:38,256 adding 'unitxt/catalog/templates/safety/harm_rating.json' 2026-01-13T10:37:38,258 adding 'unitxt/catalog/templates/safety/llamaguard.json' 2026-01-13T10:37:38,259 adding 'unitxt/catalog/templates/schema_linking/all.json' 2026-01-13T10:37:38,260 adding 'unitxt/catalog/templates/schema_linking/default.json' 2026-01-13T10:37:38,261 adding 'unitxt/catalog/templates/schema_linking/with_hint.json' 2026-01-13T10:37:38,263 adding 'unitxt/catalog/templates/selection/by_attribute/all.json' 2026-01-13T10:37:38,265 adding 'unitxt/catalog/templates/selection/by_attribute/default.json' 2026-01-13T10:37:38,267 adding 'unitxt/catalog/templates/span_labeling/extraction/all.json' 2026-01-13T10:37:38,268 adding 'unitxt/catalog/templates/span_labeling/extraction/carry.json' 2026-01-13T10:37:38,269 adding 'unitxt/catalog/templates/span_labeling/extraction/detailed.json' 2026-01-13T10:37:38,270 adding 'unitxt/catalog/templates/span_labeling/extraction/empty.json' 2026-01-13T10:37:38,271 adding 'unitxt/catalog/templates/span_labeling/extraction/extract.json' 2026-01-13T10:37:38,272 adding 'unitxt/catalog/templates/span_labeling/extraction/having.json' 2026-01-13T10:37:38,274 adding 'unitxt/catalog/templates/span_labeling/extraction/identify.json' 2026-01-13T10:37:38,275 adding 'unitxt/catalog/templates/span_labeling/extraction/title.json' 2026-01-13T10:37:38,277 adding 'unitxt/catalog/templates/summarization/abstractive/all.json' 2026-01-13T10:37:38,278 adding 'unitxt/catalog/templates/summarization/abstractive/bluebench.json' 2026-01-13T10:37:38,279 adding 'unitxt/catalog/templates/summarization/abstractive/casual.json' 2026-01-13T10:37:38,281 adding 'unitxt/catalog/templates/summarization/abstractive/formal.json' 2026-01-13T10:37:38,282 adding 'unitxt/catalog/templates/summarization/abstractive/formal_without_label.json' 2026-01-13T10:37:38,283 adding 'unitxt/catalog/templates/summarization/abstractive/full.json' 2026-01-13T10:37:38,284 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_full.json' 2026-01-13T10:37:38,285 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json' 2026-01-13T10:37:38,286 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_passive.json' 2026-01-13T10:37:38,288 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json' 2026-01-13T10:37:38,289 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json' 2026-01-13T10:37:38,290 adding 'unitxt/catalog/templates/summarization/abstractive/instructive.json' 2026-01-13T10:37:38,291 adding 'unitxt/catalog/templates/summarization/abstractive/one_sentence.json' 2026-01-13T10:37:38,292 adding 'unitxt/catalog/templates/summarization/abstractive/passive.json' 2026-01-13T10:37:38,294 adding 'unitxt/catalog/templates/summarization/abstractive/professional.json' 2026-01-13T10:37:38,295 adding 'unitxt/catalog/templates/summarization/abstractive/title.json' 2026-01-13T10:37:38,296 adding 'unitxt/catalog/templates/summarization/abstractive/write_succinct.json' 2026-01-13T10:37:38,299 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/all.json' 2026-01-13T10:37:38,300 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json' 2026-01-13T10:37:38,301 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/empty.json' 2026-01-13T10:37:38,303 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json' 2026-01-13T10:37:38,304 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json' 2026-01-13T10:37:38,305 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json' 2026-01-13T10:37:38,307 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json' 2026-01-13T10:37:38,309 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json' 2026-01-13T10:37:38,310 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json' 2026-01-13T10:37:38,312 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json' 2026-01-13T10:37:38,313 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json' 2026-01-13T10:37:38,314 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json' 2026-01-13T10:37:38,316 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json' 2026-01-13T10:37:38,317 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json' 2026-01-13T10:37:38,319 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json' 2026-01-13T10:37:38,320 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json' 2026-01-13T10:37:38,321 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json' 2026-01-13T10:37:38,323 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json' 2026-01-13T10:37:38,324 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json' 2026-01-13T10:37:38,325 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json' 2026-01-13T10:37:38,326 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json' 2026-01-13T10:37:38,328 adding 'unitxt/catalog/templates/text2sql/all.json' 2026-01-13T10:37:38,329 adding 'unitxt/catalog/templates/text2sql/empty.json' 2026-01-13T10:37:38,330 adding 'unitxt/catalog/templates/text2sql/you_are_given.json' 2026-01-13T10:37:38,332 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system.json' 2026-01-13T10:37:38,333 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json' 2026-01-13T10:37:38,334 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint.json' 2026-01-13T10:37:38,335 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json' 2026-01-13T10:37:38,336 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json' 2026-01-13T10:37:38,338 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json' 2026-01-13T10:37:38,339 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json' 2026-01-13T10:37:38,341 adding 'unitxt/catalog/templates/tool_calling/base.json' 2026-01-13T10:37:38,342 adding 'unitxt/catalog/templates/tool_calling/multi_turn.json' 2026-01-13T10:37:38,344 adding 'unitxt/catalog/templates/translation/directed/all.json' 2026-01-13T10:37:38,345 adding 'unitxt/catalog/templates/translation/directed/bluebench.json' 2026-01-13T10:37:38,347 adding 'unitxt/catalog/templates/translation/directed/casual.json' 2026-01-13T10:37:38,348 adding 'unitxt/catalog/templates/translation/directed/formal.json' 2026-01-13T10:37:38,349 adding 'unitxt/catalog/templates/translation/directed/instructional.json' 2026-01-13T10:37:38,350 adding 'unitxt/catalog/templates/translation/directed/playful.json' 2026-01-13T10:37:38,351 adding 'unitxt/catalog/templates/translation/directed/simple.json' 2026-01-13T10:37:38,352 adding 'unitxt/catalog/templates/translation/directed/title.json' 2026-01-13T10:37:38,354 adding 'unitxt/service/__init__.py' 2026-01-13T10:37:38,356 adding 'unitxt/service/metrics/__init__.py' 2026-01-13T10:37:38,357 adding 'unitxt/service/metrics/main.py' 2026-01-13T10:37:38,359 adding 'unitxt/service/metrics/tokens.py' 2026-01-13T10:37:38,360 adding 'unitxt/test_utils/__init__.py' 2026-01-13T10:37:38,361 adding 'unitxt/test_utils/artifact.py' 2026-01-13T10:37:38,363 adding 'unitxt/test_utils/card.py' 2026-01-13T10:37:38,364 adding 'unitxt/test_utils/catalog.py' 2026-01-13T10:37:38,366 adding 'unitxt/test_utils/metrics.py' 2026-01-13T10:37:38,367 adding 'unitxt/test_utils/operators.py' 2026-01-13T10:37:38,368 adding 'unitxt/test_utils/storage.py' 2026-01-13T10:37:38,370 adding 'unitxt/ui/__init__.py' 2026-01-13T10:37:38,382 adding 'unitxt/ui/banner.png' 2026-01-13T10:37:38,384 adding 'unitxt/ui/gradio_utils.py' 2026-01-13T10:37:38,385 adding 'unitxt/ui/load_catalog_data.py' 2026-01-13T10:37:38,387 adding 'unitxt/ui/run.py' 2026-01-13T10:37:38,389 adding 'unitxt/ui/settings.py' 2026-01-13T10:37:38,390 adding 'unitxt/ui/ui_tester.py' 2026-01-13T10:37:38,392 adding 'unitxt/ui/ui_utils.py' 2026-01-13T10:37:38,395 adding 'unitxt-1.26.9.dist-info/licenses/LICENSE' 2026-01-13T10:37:38,398 adding 'unitxt-1.26.9.dist-info/METADATA' 2026-01-13T10:37:38,399 adding 'unitxt-1.26.9.dist-info/WHEEL' 2026-01-13T10:37:38,400 adding 'unitxt-1.26.9.dist-info/entry_points.txt' 2026-01-13T10:37:38,401 adding 'unitxt-1.26.9.dist-info/top_level.txt' 2026-01-13T10:37:38,489 adding 'unitxt-1.26.9.dist-info/RECORD' 2026-01-13T10:37:38,969 removing build/bdist.linux-armv7l/wheel 2026-01-13T10:37:40,378 Building wheel for unitxt (pyproject.toml): finished with status 'done' 2026-01-13T10:37:41,055 Created wheel for unitxt: filename=unitxt-1.26.9-py3-none-any.whl size=32886162 sha256=5fe92873dfcbcd84bd82e870085e9f280d68b7de9948a1d2e1e75a4ab07ba5c4 2026-01-13T10:37:41,056 Stored in directory: /tmp/pip-ephem-wheel-cache-dsy5wdfp/wheels/7a/df/2d/7b79be7e7196b8bea05dda2f50838e06283cc290c7d2b8cc2d 2026-01-13T10:37:41,240 Successfully built unitxt 2026-01-13T10:37:42,121 Removed build tracker: '/tmp/pip-build-tracker-d082n51i'