书生开源大模型训练营-第2讲笔记
1 大模型及 InternLM 模型简介
1.1 什么是大模型?
大模型=大语料+大算力+大模型参数
大模型的优势在于其能够捕捉和理解数据中更为复杂、抽象的特征和关系。书读三遍,其义自见
大模型的应用和发展也需要在性能、成本和道德等多个方面进行权衡和考量。
1.2 InternLM 模型全链条开源
InternLM:
开源的轻量级训练框架。
InternLM-7B
和 InternLM-20B:
基于 InternLM
训练框架,上海人工智能实验室已经发布的两个开源的预训练模型。
Lagent:轻量级、开源的基于大语言模型的智能体(agent)框架。
浦语·灵笔:基于书生·浦语大语言模型研发的视觉-语言大模型,能够实现图像到文本、文本到图像的双向转换。
2 InternLM-Chat-7B 智能对话 Demo
2.1 环境准备
进入 conda
环境之后,使用以下命令从本地克隆一个已有的 pytorch 2.0.1
的环境
bash # 请每次使用 jupyter lab 打开终端时务必先执行 bash 命令进入 bash 中 bash /root/share/install_conda_env_internlm_base.sh internlm-demo # 执行该脚本文件来安装项目实验环境
屏幕输出:
./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11 ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11 ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11 ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11.7.4.75 ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11 ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11 ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11 ./pkgs/libnpp-11.7.4.75-0/info/ ./pkgs/libnpp-11.7.4.75-0/info/files ./pkgs/libnpp-11.7.4.75-0/info/paths.json ./pkgs/libnpp-11.7.4.75-0/info/index.json ./pkgs/libnpp-11.7.4.75-0/info/git ./pkgs/libnpp-11.7.4.75-0/info/repodata_record.json ./pkgs/libnpp-11.7.4.75-0/info/about.json ---------- start create the new conda env: internlm-demo Source: /share/conda_envs/internlm-base Destination: /root/.conda/envs/internlm-demo Packages: 96 Files: 0 Downloading and Extracting Packages: Downloading and Extracting Packages: Preparing transaction: done Verifying transaction: done Executing transaction: done # # To activate this environment, use # # $ conda activate internlm-demo # # To deactivate an active environment, use # # $ conda deactivate Finised! Now you can use your environment by typing: conda activate internlm-demo (base) root@intern-studio-069640:~#
然后使用以下命令激活环境
conda activate internlm-demo
屏幕输出:
(base) root@intern-studio-069640:~# conda activate internlm-demo (internlm-demo) root@intern-studio-069640:~#
并在环境中安装运行 demo 所需要的依赖。
# 升级pip python -m pip install --upgrade pip pip install modelscope==1.9.5 pip install transformers==4.35.2 pip install streamlit==1.24.0 pip install sentencepiece==0.1.99 pip install accelerate==0.24.1
屏幕输出:
(internlm-demo) root@intern-studio-069640:~# # 升级pip (internlm-demo) root@intern-studio-069640:~# python -m pip install --upgrade pip Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Requirement already satisfied: pip in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (23.3.1) Collecting pip Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8a/6a/19e9fe04fca059ccf770861c7d5721ab4c2aebc539889e97c7977528a53b/pip-24.0-py3-none-any.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 5.8 MB/s eta 0:00:00 Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 23.3.1 Uninstalling pip-23.3.1: Successfully uninstalled pip-23.3.1 Successfully installed pip-24.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~# (internlm-demo) root@intern-studio-069640:~# pip install modelscope==1.9.5 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting modelscope==1.9.5 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ac/05/75b5d750608d7354dc3dd023dca7101e5f3b4645cb3e5b816536d472a058/modelscope-1.9.5-py3-none-any.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 10.9 MB/s eta 0:00:00 Collecting addict (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/00/b08f23b7d7e1e14ce01419a467b583edbb93c6cdb8654e54a9cc579cd61f/addict-2.4.0-py3-none-any.whl (3.8 kB) Collecting attrs (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/44/827b2a91a5816512fcaf3cc4ebc465ccd5d598c45cefa6703fcf4a79018f/attrs-23.2.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 875.6 kB/s eta 0:00:00 Collecting datasets<=2.13.0,>=2.8.0 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/17/d8/f808e32ed7fa86617b9ac7a37b7dcff894c839108c4871cc33ffc4e65b7d/datasets-2.13.0-py3-none-any.whl (485 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 485.6/485.6 kB 4.9 MB/s eta 0:00:00 Collecting einops (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/29/0b/2d1c0ebfd092e25935b86509a9a817159212d82aa43d7fb07eca4eeff2c2/einops-0.7.0-py3-none-any.whl (44 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 kB 3.4 MB/s eta 0:00:00 Requirement already satisfied: filelock>=3.3.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (3.13.1) Collecting gast>=0.2.2 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fa/39/5aae571e5a5f4de9c3445dae08a530498e5c53b0e74410eeeb0991c79047/gast-0.5.4-py3-none-any.whl (19 kB) Requirement already satisfied: numpy in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (1.26.2) Collecting oss2 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d5/63/b6c355af7f04a8a1d5759fa6fc47539e25ef8e6f2745372a242fdadcac65/oss2-2.18.4.tar.gz (278 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.1/278.1 kB 1.7 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting pandas (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b3/b3/3102c3a4abca1093e50cfec2213102a1c65c0b318a4431395d0121e6e690/pandas-2.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.0/13.0 MB 6.7 MB/s eta 0:00:00 Requirement already satisfied: Pillow>=6.2.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (10.0.1) Collecting pyarrow!=9.0.0,>=6.0.0 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d4/ca/ef67abb77f9dd51a0d3ff7fcebff58296068a046d7da352b9548070005ed/pyarrow-15.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (38.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38.3/38.3 MB 13.2 MB/s eta 0:00:00 Collecting python-dateutil>=2.1 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 4.0 MB/s eta 0:00:00 Collecting pyyaml (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/29/61/bf33c6c85c55bc45a29eee3195848ff2d518d84735eb0e2d8cb42e0d285e/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 3.0 MB/s eta 0:00:00 Requirement already satisfied: requests>=2.25 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (2.31.0) Collecting scipy (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f5/aa/8e6071a5e4dca4ec68b5b22e4991ee74c59c5d372112b9c236ec1faff57d/scipy-1.12.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38.4/38.4 MB 7.4 MB/s eta 0:00:00 Requirement already satisfied: setuptools in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (68.0.0) Collecting simplejson>=3.3.0 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/cb/b6/ed513a0adc3e2c9654864ffb68266dcab5720d5653428d690e7e4fb32a6c/simplejson-3.19.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (137 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 137.9/137.9 kB 2.6 MB/s eta 0:00:00 Collecting sortedcontainers>=1.5.9 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/32/46/9cb0e58b2deb7f82b84065f37f3bffeb12413f947f9388e4cac22c4621ce/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting tqdm>=4.64.0 (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2a/14/e75e52d521442e2fcc9f1df3c5e456aead034203d4797867980de558ab34/tqdm-4.66.2-py3-none-any.whl (78 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.3/78.3 kB 838.7 kB/s eta 0:00:00 Requirement already satisfied: urllib3>=1.26 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from modelscope==1.9.5) (1.26.18) Collecting yapf (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/66/c9/d4b03b2490107f13ebd68fe9496d41ae41a7de6275ead56d0d4621b11ffd/yapf-0.40.2-py3-none-any.whl (254 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 254.7/254.7 kB 374.4 kB/s eta 0:00:00 Collecting dill<0.3.7,>=0.3.0 (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/be/e3/a84bf2e561beed15813080d693b4b27573262433fced9c1d1fea59e60553/dill-0.3.6-py3-none-any.whl (110 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 110.5/110.5 kB 744.8 kB/s eta 0:00:00 Collecting xxhash (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/80/8a/1dd41557883b6196f8f092011a5c1f72d4d44cf36d7b67d4a5efe3127949/xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 194.1/194.1 kB 743.6 kB/s eta 0:00:00 Collecting multiprocess (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bc/f7/7ec7fddc92e50714ea3745631f79bd9c96424cb2702632521028e57d3a36/multiprocess-0.70.16-py310-none-any.whl (134 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.8/134.8 kB 552.0 kB/s eta 0:00:00 Collecting fsspec>=2021.11.1 (from fsspec[http]>=2021.11.1->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ad/30/2281c062222dc39328843bd1ddd30ff3005ef8e30b2fd09c4d2792766061/fsspec-2024.2.0-py3-none-any.whl (170 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 170.9/170.9 kB 744.5 kB/s eta 0:00:00 Collecting aiohttp (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/93/40/d3decda219ebd5410eba627601d537ec3782efbcadba308e9ce381cc0b71/aiohttp-3.9.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 1.3 MB/s eta 0:00:00 Collecting huggingface-hub<1.0.0,>=0.11.0 (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/28/03/7d3c7153113ec59cfb31e3b8ee773f5f420a0dd7d26d40442542b96675c3/huggingface_hub-0.20.3-py3-none-any.whl (330 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 330.1/330.1 kB 1.1 MB/s eta 0:00:00 Collecting packaging (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl (53 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 616.8 kB/s eta 0:00:00 Collecting six>=1.5 (from python-dateutil>=2.1->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl (11 kB) Requirement already satisfied: charset-normalizer<4,>=2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (3.4) Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (2023.11.17) Collecting crcmod>=1.7 (from oss2->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6b/b0/e595ce2a2527e169c3bcd6c33d2473c1918e0b7f6826a043ca1245dd4e5b/crcmod-1.7.tar.gz (89 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.7/89.7 kB 213.4 kB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting pycryptodome>=3.4.7 (from oss2->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/af/20/5f29ec45462360e7f61e8688af9fe4a0afae057edfabdada662e11bf97e7/pycryptodome-3.20.0-cp35-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 2.5 MB/s eta 0:00:00 Collecting aliyun-python-sdk-kms>=2.4.1 (from oss2->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3d/ea/d88e08bfc4a0aee0111f1f24c98b19107bc6783441e7e944907c77b2243d/aliyun_python_sdk_kms-2.16.2-py2.py3-none-any.whl (94 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94.0/94.0 kB 1.1 MB/s eta 0:00:00 Collecting aliyun-python-sdk-core>=2.13.12 (from oss2->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1e/e3/8623c0305022610466ded2b0010a7221e9585046116263dd27cb2e56df36/aliyun-python-sdk-core-2.14.0.tar.gz (443 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 443.0/443.0 kB 3.1 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting pytz>=2020.1 (from pandas->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9c/3d/a121f284241f08268b21359bd425f7d4825cffc5ac5cd0e1b3d82ffd2b10/pytz-2024.1-py2.py3-none-any.whl (505 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 505.5/505.5 kB 2.2 MB/s eta 0:00:00 Collecting tzdata>=2022.7 (from pandas->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/58/f9c9e6be752e9fcb8b6a0ee9fb87e6e7a1f6bcab2cdc73f02bb7ba91ada0/tzdata-2024.1-py2.py3-none-any.whl (345 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 345.4/345.4 kB 2.6 MB/s eta 0:00:00 Collecting importlib-metadata>=6.6.0 (from yapf->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c0/8b/d8427f023c081a8303e6ac7209c16e6878f2765d5b59667f3903fbcfd365/importlib_metadata-7.0.1-py3-none-any.whl (23 kB) Collecting platformdirs>=3.5.1 (from yapf->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/55/72/4898c44ee9ea6f43396fbc23d9bfaf3d06e01b83698bdf2e4c919deceb7c/platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting tomli>=2.0.1 (from yapf->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/75/10a9ebee3fd790d20926a90a2547f0bf78f371b2f13aa822c759680ca7b9/tomli-2.0.1-py3-none-any.whl (12 kB) Collecting jmespath<1.0.0,>=0.9.3 (from aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/07/cb/5f001272b6faeb23c1c9e0acc04d48eaaf5c862c17709d20e3469c6e0139/jmespath-0.10.0-py2.py3-none-any.whl (24 kB) Requirement already satisfied: cryptography>=2.6.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (41.0.3) Collecting aiosignal>=1.1.2 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/76/ac/a7305707cb852b7e16ff80eaf5692309bde30e2b1100a1fcacdc8f731d97/aiosignal-1.3.1-py3-none-any.whl (7.6 kB) Collecting frozenlist>=1.1.1 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ec/25/0c87df2e53c0c5d90f7517ca0ff7aca78d050a8ec4d32c4278e8c0e52e51/frozenlist-1.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (239 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 239.5/239.5 kB 302.6 kB/s eta 0:00:00 Collecting multidict<7.0,>=4.5 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/33/62/2c9085e571318d51212a6914566fe41dd0e33d7f268f7e2f23dcd3f06c56/multidict-6.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (124 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 124.3/124.3 kB 848.2 kB/s eta 0:00:00 Collecting yarl<2.0,>=1.0 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c3/a0/0ade1409d184cbc9e85acd403a386a7c0563b92ff0f26d138ff9e86e48b4/yarl-1.9.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 301.6/301.6 kB 826.0 kB/s eta 0:00:00 Collecting async-timeout<5.0,>=4.0 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a7/fa/e01228c2938de91d47b307831c62ab9e4001e747789d0b05baf779a6488c/async_timeout-4.0.3-py3-none-any.whl (5.7 kB) Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub<1.0.0,>=0.11.0->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) (4.7.1) Collecting zipp>=0.5 (from importlib-metadata>=6.6.0->yapf->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d9/66/48866fc6b158c81cc2bfecc04c480f105c6040e8b077bc54c634b4a67926/zipp-3.17.0-py3-none-any.whl (7.4 kB) INFO: pip is looking at multiple versions of multiprocess to determine which version is compatible with other requirements. This could take a while. Collecting multiprocess (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/35/a8/36d8d7b3e46b377800d8dec47891cdf05842d1a2366909ae4a0c89fbc5e6/multiprocess-0.70.15-py310-none-any.whl (134 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.8/134.8 kB 293.1 kB/s eta 0:00:00 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b8/0c/c26b346b41bb1f81ac921fa10074a9595c22e5f99cc89c0410fc4efd5df3/multiprocess-0.70.14-py310-none-any.whl (134 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.3/134.3 kB 1.0 MB/s eta 0:00:00 Requirement already satisfied: cffi>=1.12 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (1.16.0) Requirement already satisfied: pycparser in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from cffi>=1.12->cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (2.21) Building wheels for collected packages: oss2, aliyun-python-sdk-core, crcmod Building wheel for oss2 (setup.py) ... done Created wheel for oss2: filename=oss2-2.18.4-py3-none-any.whl size=115939 sha256=b4982e513a03f639608305229f2b722293b6d9c53f1c6bb93c94fb1387f55a99 Stored in directory: /root/.cache/pip/wheels/29/5a/f0/41e21c49b5f9e6623f3da79959757c3815e14cfde87d1f4d3f Building wheel for aliyun-python-sdk-core (setup.py) ... done Created wheel for aliyun-python-sdk-core: filename=aliyun_python_sdk_core-2.14.0-py3-none-any.whl size=535290 sha256=58da75f8b5251fcbf78544e98b8823afb216a481970f53be7c91bd91740d0ba9 Stored in directory: /root/.cache/pip/wheels/5d/a2/13/75ca6264763fad6d7615dcbc0bb71c62059357be6a20147e8e Building wheel for crcmod (setup.py) ... done Created wheel for crcmod: filename=crcmod-1.7-cp310-cp310-linux_x86_64.whl size=23536 sha256=ca6c4ba47d632fac7285ca0fd7a18fdd05b57924f9b3c8dc5a0e217a65f4b7c9 Stored in directory: /root/.cache/pip/wheels/78/30/21/160bc71114a7959e68ea098676241291515e71377d8db6ceea Successfully built oss2 aliyun-python-sdk-core crcmod Installing collected packages: sortedcontainers, pytz, crcmod, addict, zipp, xxhash, tzdata, tqdm, tomli, six, simplejson, scipy, pyyaml, pycryptodome, pyarrow, platformdirs, packaging, multidict, jmespath, gast, fsspec, frozenlist, einops, dill, attrs, async-timeout, yarl, python-dateutil, multiprocess, importlib-metadata, huggingface-hub, aiosignal, yapf, pandas, aliyun-python-sdk-core, aiohttp, aliyun-python-sdk-kms, oss2, datasets, modelscope Successfully installed addict-2.4.0 aiohttp-3.9.3 aiosignal-1.3.1 aliyun-python-sdk-core-2.14.0 aliyun-python-sdk-kms-2.16.2 async-timeout-4.0.3 attrs-23.2.0 crcmod-1.7 datasets-2.13.0 dill-0.3.6 einops-0.7.0 frozenlist-1.4.1 fsspec-2024.2.0 gast-0.5.4 huggingface-hub-0.20.3 importlib-metadata-7.0.1 jmespath-0.10.0 modelscope-1.9.5 multidict-6.0.5 multiprocess-0.70.14 oss2-2.18.4 packaging-23.2 pandas-2.2.0 platformdirs-4.2.0 pyarrow-15.0.0 pycryptodome-3.20.0 python-dateutil-2.8.2 pytz-2024.1 pyyaml-6.0.1 scipy-1.12.0 simplejson-3.19.2 six-1.16.0 sortedcontainers-2.4.0 tomli-2.0.1 tqdm-4.66.2 tzdata-2024.1 xxhash-3.4.1 yapf-0.40.2 yarl-1.9.4 zipp-3.17.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~# pip install transformers==4.35.2 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting transformers==4.35.2 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/12/dd/f17b11a93a9ca27728e12512d167eb1281c151c4c6881d3ab59eb58f4127/transformers-4.35.2-py3-none-any.whl (7.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.9/7.9 MB 21.9 MB/s eta 0:00:00 Requirement already satisfied: filelock in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (3.13.1) Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (0.20.3) Requirement already satisfied: numpy>=1.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (1.26.2) Requirement already satisfied: packaging>=20.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (23.2) Requirement already satisfied: pyyaml>=5.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (6.0.1) Collecting regex!=2019.12.17 (from transformers==4.35.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/81/8a/96a62ce98e8ff1b16db56fde3debc8a571f6b7ea42ee137eb0d995cdfa26/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 774.0/774.0 kB 36.1 MB/s eta 0:00:00 Requirement already satisfied: requests in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (2.31.0) Collecting tokenizers<0.19,>=0.14 (from transformers==4.35.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1c/5d/cf5e122ce4f1a29f165b2a69dc33d1ff30bce303343d58a54775ddba5d51/tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 87.8 MB/s eta 0:00:00 Collecting safetensors>=0.3.1 (from transformers==4.35.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d0/ba/b2254fafc7f5fdc98a2fa4d5a5eeb029fbf9589ec87f2c230c3ac0a1dd53/safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 29.7 MB/s eta 0:00:00 Requirement already satisfied: tqdm>=4.27 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from transformers==4.35.2) (4.66.2) Requirement already satisfied: fsspec>=2023.5.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.16.4->transformers==4.35.2) (2024.2.0) Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.16.4->transformers==4.35.2) (4.7.1) Requirement already satisfied: charset-normalizer<4,>=2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->transformers==4.35.2) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->transformers==4.35.2) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->transformers==4.35.2) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->transformers==4.35.2) (2023.11.17) Installing collected packages: safetensors, regex, tokenizers, transformers Successfully installed regex-2023.12.25 safetensors-0.4.2 tokenizers-0.15.2 transformers-4.35.2 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~# pip install streamlit==1.24.0 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting streamlit==1.24.0 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3d/5f/1716c66c58a8b080f9673e7ca569044b1b8ac6a5cd8519fe4b1afa89abf8/streamlit-1.24.0-py2.py3-none-any.whl (8.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 18.4 MB/s eta 0:00:00 Collecting altair<6,>=4.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c5/e4/7fcceef127badbb0d644d730d992410e4f3799b295c9964a172f92a469c7/altair-5.2.0-py3-none-any.whl (996 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 996.9/996.9 kB 29.2 MB/s eta 0:00:00 Collecting blinker<2,>=1.0.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fa/2a/7f3714cbc6356a0efec525ce7a0613d581072ed6eb53eb7b9754f33db807/blinker-1.7.0-py3-none-any.whl (13 kB) Collecting cachetools<6,>=4.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a2/91/2d843adb9fbd911e0da45fbf6f18ca89d07a087c3daa23e955584f90ebf4/cachetools-5.3.2-py3-none-any.whl (9.3 kB) Collecting click<9,>=7.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 8.0 MB/s eta 0:00:00 Collecting importlib-metadata<7,>=1.4 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/59/9b/ecce94952ab5ea74c31dcf9ccf78ccd484eebebef06019bf8cb579ab4519/importlib_metadata-6.11.0-py3-none-any.whl (23 kB) Requirement already satisfied: numpy<2,>=1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (1.26.2) Requirement already satisfied: packaging<24,>=14.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (23.2) Requirement already satisfied: pandas<3,>=0.25 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (2.2.0) Collecting pillow<10,>=6.2.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/25/6b/d3c35d207c9c0b6c2f855420f62e64ef43d348e8c797ad1c32b9f2106a19/Pillow-9.5.0-cp310-cp310-manylinux_2_28_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 64.3 MB/s eta 0:00:00 Collecting protobuf<5,>=3.20 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/81/9e/63501b8d5b4e40c7260049836bd15ec3270c936e83bc57b85e4603cc212c/protobuf-4.25.2-cp37-abi3-manylinux2014_x86_64.whl (294 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 7.7 MB/s eta 0:00:00 Requirement already satisfied: pyarrow>=4.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (15.0.0) Collecting pympler<2,>=0.9 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2c/42/41e1469ed0b37b9c8532cb8074bea179f7d85ee7e82a59b5b6c289ed6045/Pympler-1.0.1-py3-none-any.whl (164 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 164.8/164.8 kB 19.6 MB/s eta 0:00:00 Requirement already satisfied: python-dateutil<3,>=2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (2.8.2) Requirement already satisfied: requests<3,>=2.4 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (2.31.0) Collecting rich<14,>=10.11.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/be/be/1520178fa01eabe014b16e72a952b9f900631142ccd03dc36cf93e30c1ce/rich-13.7.0-py3-none-any.whl (240 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 26.1 MB/s eta 0:00:00 Collecting tenacity<9,>=8.0.0 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl (24 kB) Collecting toml<2 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl (16 kB) Requirement already satisfied: typing-extensions<5,>=4.0.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from streamlit==1.24.0) (4.7.1) Collecting tzlocal<5,>=1.1 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/55/a6/a75af44665e5e77e52f6789eef4f8bc056c8e039d96c804b975806942580/tzlocal-4.3.1-py3-none-any.whl (20 kB) Collecting validators<1,>=0.2 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3a/0c/785d317eea99c3739821718f118c70537639aa43f96bfa1d83a71f68eaf6/validators-0.22.0-py3-none-any.whl (26 kB) Collecting gitpython!=3.1.19,<4,>=3 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/45/c6/a637a7a11d4619957cb95ca195168759a4502991b1b91c13d3203ffc3748/GitPython-3.1.41-py3-none-any.whl (196 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 196.4/196.4 kB 23.3 MB/s eta 0:00:00 Collecting pydeck<1,>=0.1.dev5 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/10/4b/2fc80540e2d3903452245bb657c7f758ec7342420507d1e4091b0161856e/pydeck-0.8.1b0-py2.py3-none-any.whl (4.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.8/4.8 MB 73.2 MB/s eta 0:00:00 Collecting tornado<7,>=6.0.3 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9f/12/11d0a757bb67278d3380d41955ae98527d5ad18330b2edbdc8de222b569b/tornado-6.4-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (435 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 435.4/435.4 kB 37.4 MB/s eta 0:00:00 Collecting watchdog (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/91/7b/26d2f43aa9fe428416be21ee1cb9ac75638cf302466b7e706c14eeaea42c/watchdog-4.0.0-py3-none-manylinux2014_x86_64.whl (82 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.0/83.0 kB 10.7 MB/s eta 0:00:00 Requirement already satisfied: jinja2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from altair<6,>=4.0->streamlit==1.24.0) (3.1.2) Collecting jsonschema>=3.0 (from altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/39/9d/b035d024c62c85f2e2d4806a59ca7b8520307f34e0932fbc8cc75fe7b2d9/jsonschema-4.21.1-py3-none-any.whl (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.5/85.5 kB 5.6 MB/s eta 0:00:00 Collecting toolz (from altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b7/8a/d82202c9f89eab30f9fc05380daae87d617e2ad11571ab23d7c13a29bb54/toolz-0.12.1-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.1/56.1 kB 7.0 MB/s eta 0:00:00 Collecting gitdb<5,>=4.0.1 (from gitpython!=3.1.19,<4,>=3->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fd/5b/8f0c4a5bb9fd491c277c21eff7ccae71b47d43c4446c9d0c6cff2fe8c2c4/gitdb-4.0.11-py3-none-any.whl (62 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.7/62.7 kB 123.5 kB/s eta 0:00:00 Requirement already satisfied: zipp>=0.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from importlib-metadata<7,>=1.4->streamlit==1.24.0) (3.17.0) Requirement already satisfied: pytz>=2020.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from pandas<3,>=0.25->streamlit==1.24.0) (2024.1) Requirement already satisfied: tzdata>=2022.7 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from pandas<3,>=0.25->streamlit==1.24.0) (2024.1) Requirement already satisfied: six>=1.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from python-dateutil<3,>=2->streamlit==1.24.0) (1.16.0) Requirement already satisfied: charset-normalizer<4,>=2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (2023.11.17) Collecting markdown-it-py>=2.2.0 (from rich<14,>=10.11.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/42/d7/1ec15b46af6af88f19b8e5ffea08fa375d433c998b8a7639e76935c14f1f/markdown_it_py-3.0.0-py3-none-any.whl (87 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 264.0 kB/s eta 0:00:00 Collecting pygments<3.0.0,>=2.13.0 (from rich<14,>=10.11.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/9c/372fef8377a6e340b1704768d20daaded98bf13282b5327beb2e2fe2c7ef/pygments-2.17.2-py3-none-any.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 1.1 MB/s eta 0:00:00 Collecting pytz-deprecation-shim (from tzlocal<5,>=1.1->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/eb/73/3eaab547ca809754e67e06871cff0fc962bafd4b604e15f31896a0f94431/pytz_deprecation_shim-0.1.0.post0-py2.py3-none-any.whl (15 kB) Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->gitpython!=3.1.19,<4,>=3->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a7/a5/10f97f73544edcdef54409f1d839f6049a0d79df68adbc1ceb24d1aaca42/smmap-5.0.1-py3-none-any.whl (24 kB) Requirement already satisfied: MarkupSafe>=2.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from jinja2->altair<6,>=4.0->streamlit==1.24.0) (2.1.1) Requirement already satisfied: attrs>=22.2.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) (23.2.0) Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ee/07/44bd408781594c4d0a027666ef27fab1e441b109dc3b76b4f836f8fd04fe/jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB) Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/90/10/1c92edb0a0a14b67ff825bc338e74bc49ab27d3f3bae3f9a02838cba546f/referencing-0.33.0-py3-none-any.whl (26 kB) Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8c/f1/09bee4d70305e79ecad4f3ccee583f0185c06a5f58befdc3544cf8b18536/rpds_py-0.17.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 2.1 MB/s eta 0:00:00 Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich<14,>=10.11.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b3/38/89ba8ad64ae25be8de66a6d463314cf1eb366222074cfda9ee839c56a4b4/mdurl-0.1.2-py3-none-any.whl (10.0 kB) Installing collected packages: watchdog, validators, tornado, toolz, toml, tenacity, smmap, rpds-py, pytz-deprecation-shim, pympler, pygments, protobuf, pillow, mdurl, importlib-metadata, click, cachetools, blinker, tzlocal, referencing, pydeck, markdown-it-py, gitdb, rich, jsonschema-specifications, gitpython, jsonschema, altair, streamlit Attempting uninstall: pillow Found existing installation: Pillow 10.0.1 Uninstalling Pillow-10.0.1: Successfully uninstalled Pillow-10.0.1 Attempting uninstall: importlib-metadata Found existing installation: importlib-metadata 7.0.1 Uninstalling importlib-metadata-7.0.1: Successfully uninstalled importlib-metadata-7.0.1 Successfully installed altair-5.2.0 blinker-1.7.0 cachetools-5.3.2 click-8.1.7 gitdb-4.0.11 gitpython-3.1.41 importlib-metadata-6.11.0 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 markdown-it-py-3.0.0 mdurl-0.1.2 pillow-9.5.0 protobuf-4.25.2 pydeck-0.8.1b0 pygments-2.17.2 pympler-1.0.1 pytz-deprecation-shim-0.1.0.post0 referencing-0.33.0 rich-13.7.0 rpds-py-0.17.1 smmap-5.0.1 streamlit-1.24.0 tenacity-8.2.3 toml-0.10.2 toolz-0.12.1 tornado-6.4 tzlocal-4.3.1 validators-0.22.0 watchdog-4.0.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~# pip install sentencepiece==0.1.99 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting sentencepiece==0.1.99 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7f/e5/323dc813b3e1339305f888d035e2f3725084fc4dcf051995b366dd26cc90/sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 3.6 MB/s eta 0:00:00 Installing collected packages: sentencepiece Successfully installed sentencepiece-0.1.99 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~# pip install accelerate==0.24.1 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting accelerate==0.24.1 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/13/9e/ee987874058f2d93006961f6ff49e0bcb60ab9c26709ebe06bfa8707a4d8/accelerate-0.24.1-py3-none-any.whl (261 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 261.4/261.4 kB 1.8 MB/s eta 0:00:00 Requirement already satisfied: numpy>=1.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from accelerate==0.24.1) (1.26.2) Requirement already satisfied: packaging>=20.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from accelerate==0.24.1) (23.2) Collecting psutil (from accelerate==0.24.1) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c5/4f/0e22aaa246f96d6ac87fe5ebb9c5a693fbe8877f537a1022527c47ca43c5/psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 288.2/288.2 kB 5.2 MB/s eta 0:00:00 Requirement already satisfied: pyyaml in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from accelerate==0.24.1) (6.0.1) Requirement already satisfied: torch>=1.10.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from accelerate==0.24.1) (2.0.1) Requirement already satisfied: huggingface-hub in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from accelerate==0.24.1) (0.20.3) Requirement already satisfied: filelock in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.13.1) Requirement already satisfied: typing-extensions in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (4.7.1) Requirement already satisfied: sympy in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (1.11.1) Requirement already satisfied: networkx in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.1) Requirement already satisfied: jinja2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.1.2) Requirement already satisfied: fsspec>=2023.5.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (2024.2.0) Requirement already satisfied: requests in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (2.31.0) Requirement already satisfied: tqdm>=4.42.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (4.66.2) Requirement already satisfied: MarkupSafe>=2.0 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from jinja2->torch>=1.10.0->accelerate==0.24.1) (2.1.1) Requirement already satisfied: charset-normalizer<4,>=2 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (2023.11.17) Requirement already satisfied: mpmath>=0.19 in ./.conda/envs/internlm-demo/lib/python3.10/site-packages (from sympy->torch>=1.10.0->accelerate==0.24.1) (1.3.0) Installing collected packages: psutil, accelerate Successfully installed accelerate-0.24.1 psutil-5.9.8 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~#
2.2 模型下载
share
目录下已经为我们准备了全系列的 InternLM
模型,所以我们可以直接复制即可。使用如下命令复制:
mkdir -p /root/model/Shanghai_AI_Laboratory cp -r /root/share/temp/model_repos/internlm-chat-7b /root/model/Shanghai_AI_Laboratory
屏幕输出:
(internlm-demo) root@intern-studio-069640:~# mkdir -p /root/model/Shanghai_AI_Laboratory (internlm-demo) root@intern-studio-069640:~# cp -r /root/share/temp/model_repos/internlm-chat-7b /root/model/Shanghai_AI_Laboratory
2.3 代码准备
首先 clone
代码,在 /root
路径下新建 code
目录,然后切换路径, clone 代码.
mkdir code
cd /root/code git clone https://gitee.com/internlm/InternLM.git
屏幕输出:
(internlm-demo) root@intern-studio-069640:~# mkdir code (internlm-demo) root@intern-studio-069640:~# cd /root/code (internlm-demo) root@intern-studio-069640:~/code# git clone https://gitee.com/internlm/InternLM.git Cloning into 'InternLM'... remote: Enumerating objects: 2604, done. remote: Counting objects: 100% (592/592), done. remote: Compressing objects: 100% (264/264), done. remote: Total 2604 (delta 323), reused 581 (delta 318), pack-reused 2012 Receiving objects: 100% (2604/2604), 4.87 MiB | 1.08 MiB/s, done. Resolving deltas: 100% (1607/1607), done. (internlm-demo) root@intern-studio-069640:~/code#
切换 commit 版本,与教程 commit 版本保持一致:
cd InternLM
git checkout 3028f07cb79e5b1d7342f4ad8d11efad3fd13d17
屏幕输出:
(internlm-demo) root@intern-studio-069640:~/code# cd InternLM (internlm-demo) root@intern-studio-069640:~/code/InternLM# git checkout 3028f07cb79e5b1d7342f4ad8d11efad3fd13d17 Note: switching to '3028f07cb79e5b1d7342f4ad8d11efad3fd13d17'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c <new-branch-name> Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 3028f07 fix(readme): update README with original weight download link (#460) (internlm-demo) root@intern-studio-069640:~/code/InternLM#
将 /root/code/InternLM/web_demo.py
中 29 行和 33 行的模型更换为本地的 /root/model/Shanghai_AI_Laboratory/internlm-chat-7b
。
2.4 终端运行
在 /root/code/InternLM
目录下新建一个 cli_demo.py
文件,将以下代码填入其中:
import torch from transformers import AutoTokenizer, AutoModelForCausalLM model_name_or_path = "/root/model/Shanghai_AI_Laboratory/internlm-chat-7b" tokenizer = AutoTokenizer.from_pretrained(model_name_or_path, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained(model_name_or_path, trust_remote_code=True, torch_dtype=torch.bfloat16, device_map='auto') model = model.eval() system_prompt = """You are an AI assistant whose name is InternLM (书生·浦语). - InternLM (书生·浦语) is a conversational language model that is developed by Shanghai AI Laboratory (上海人工智能实验室). It is designed to be helpful, honest, and harmless. - InternLM (书生·浦语) can understand and communicate fluently in the language chosen by the user such as English and 中文. """ messages = [(system_prompt, '')] print("=============Welcome to InternLM chatbot, type 'exit' to exit.=============") while True: input_text = input("User >>> ") input_text = input_text.replace(' ', '') if input_text == "exit": break response, history = model.chat(tokenizer, input_text, history=messages) messages.append((input_text, response)) print(f"robot >>> {response}")
然后在终端运行以下命令开始体验:
python /root/code/InternLM/cli_demo.py
屏幕输出:
(internlm-demo) root@intern-studio-069640:~/code/InternLM# vim cli_demo.py (internlm-demo) root@intern-studio-069640:~/code/InternLM# python /root/code/InternLM/cli_demo.py Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:42<00:00, 5.36s/it] =============Welcome to InternLM chatbot, type 'exit' to exit.============= User >>> robot >>> 您好!我能帮助您处理任何问题。请问您有什么需要我帮忙的? User >>> robot >>> 您好!请问您需要了解什么方面的知识呢?我将尽我所能为您提供帮助。
随便问几个问题:
2.5 web demo 运行
配置本地端口映射:在我的macbook上运行:
ssh-keygen -t rsa
一路回车,屏幕输出:
(base) gongshaocheng@192 ~ % ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/Users/gongshaocheng/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /Users/gongshaocheng/.ssh/id_rsa Your public key has been saved in /Users/gongshaocheng/.ssh/id_rsa.pub The key fingerprint is: SHA256:nv8v0hJuhIrLKaN2FLx80Gno89cSuxAjy0f4CX77pnI gongshaocheng@192.168.0.102 The key's randomart image is: +---[RSA 3072]----+ | | | | | . o . | | =.+ | | o+=+ S. | | o**.+o..o | | .++B .*o o | | .o++E+= o= o | |o..o*+=oo..+.o. | +----[SHA256]-----+ (base) gongshaocheng@192 ~ %
确认:
cat ~/.ssh/id_rsa.pub
截屏:
将公钥复制到剪贴板中,然后回到 InternStudio
控制台,点击配置 SSH Key:
在本地macbook终端输入以下指令 .6006
是在服务器中打开的端口,而 36739
是根据开发机的端口进行更改。如下所示:
ssh -CNg -L 6006:127.0.0.1:6006 root@ssh.intern-ai.org.cn -p 36739
截屏:
切换到 VScode
中,运行 /root/code/InternLM
目录下的 web_demo.py
文件,输入以下命令:
bash conda activate internlm-demo # 首次进入 vscode 会默认是 base 环境,所以首先切换环境 cd /root/code/InternLM streamlit run web_demo.py --server.address 127.0.0.1 --server.port 6006
截屏:
在本地macbook的浏览器上输入在本地浏览器输入 http://127.0.0.1:6006
即可。
3 Lagent 智能体工具调用 Demo
3.1 环境准备
不需要。在第2节中已经完成。
3.2 模型下载
不需要。在第2节中已经完成。
3.3 Lagent 安装
首先切换路径到 /root/code
克隆 lagent
仓库,并通过 pip install -e .
源码安装 Lagent。
cd /root/code git clone https://gitee.com/internlm/lagent.git cd /root/code/lagent git checkout 511b03889010c4811b1701abb153e02b8e94fb5e # 尽量保证和教程commit版本一致 pip install -e . # 源码安装
屏幕输出:
(internlm-demo) root@intern-studio-069640:~# cd /root/code (internlm-demo) root@intern-studio-069640:~/code# git clone https://gitee.com/internlm/lagent.git fatal: destination path 'lagent' already exists and is not an empty directory. (internlm-demo) root@intern-studio-069640:~/code# rm -rf lagent (internlm-demo) root@intern-studio-069640:~/code# git clone https://gitee.com/internlm/lagent.git Cloning into 'lagent'... remote: Enumerating objects: 414, done. remote: Total 414 (delta 0), reused 0 (delta 0), pack-reused 414 Receiving objects: 100% (414/414), 214.97 KiB | 643.00 KiB/s, done. Resolving deltas: 100% (197/197), done. (internlm-demo) root@intern-studio-069640:~/code# cd /root/code/lagent �commit版本一致 root@intern-studio-069640:~/code/lagent# git checkout 511b03889010c4811b1701abb153e02b8e94fb5e # 尽量保证和教程 Note: switching to '511b03889010c4811b1701abb153e02b8e94fb5e'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c <new-branch-name> Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 511b038 update header-logo (#72) (internlm-demo) root@intern-studio-069640:~/code/lagent# pip install -e . # 源码安装 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Obtaining file:///root/code/lagent Preparing metadata (setup.py) ... done Collecting distro (from lagent==0.1.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/12/b3/231ffd4ab1fc9d679809f356cebee130ac7daa00d6d6f3206dd4fd137e9e/distro-1.9.0-py3-none-any.whl (20 kB) Collecting func_timeout (from lagent==0.1.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b3/0d/bf0567477f7281d9a3926c582bfef21bff7498fc0ffd3e9de21811896a0b/func_timeout-4.3.5.tar.gz (44 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.3/44.3 kB 1.2 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Requirement already satisfied: jsonschema in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from lagent==0.1.2) (4.21.1) Requirement already satisfied: requests in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from lagent==0.1.2) (2.31.0) Collecting tiktoken (from lagent==0.1.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/16/05/5efbd91252ffb1301ea393d88ef736b33d41e75d4bcf0bd31d660050e400/tiktoken-0.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 8.5 MB/s eta 0:00:00 Requirement already satisfied: attrs>=22.2.0 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from jsonschema->lagent==0.1.2) (23.2.0) Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from jsonschema->lagent==0.1.2) (2023.12.1) Requirement already satisfied: referencing>=0.28.4 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from jsonschema->lagent==0.1.2) (0.33.0) Requirement already satisfied: rpds-py>=0.7.1 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from jsonschema->lagent==0.1.2) (0.17.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->lagent==0.1.2) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->lagent==0.1.2) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->lagent==0.1.2) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from requests->lagent==0.1.2) (2023.11.17) Requirement already satisfied: regex>=2022.1.18 in /root/.conda/envs/internlm-demo/lib/python3.10/site-packages (from tiktoken->lagent==0.1.2) (2023.12.25) Building wheels for collected packages: func_timeout Building wheel for func_timeout (setup.py) ... done Created wheel for func_timeout: filename=func_timeout-4.3.5-py3-none-any.whl size=15080 sha256=05e378e0a08b63144553c30c3c070d01e5c7902014fc16184571a1e89d806fcd Stored in directory: /root/.cache/pip/wheels/b6/7d/e1/481b414548217ccfed53434596f173efbb32fe82fe28ae2f2d Successfully built func_timeout Installing collected packages: func_timeout, distro, tiktoken, lagent Running setup.py develop for lagent Successfully installed distro-1.9.0 func_timeout-4.3.5 lagent-0.1.2 tiktoken-0.6.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (internlm-demo) root@intern-studio-069640:~/code/lagent#
3.4 修改代码
将/root/code/lagent/examples/react_web_demo.py文件的内容替换为下面的代码:
import copy import os import streamlit as st from streamlit.logger import get_logger from lagent.actions import ActionExecutor, GoogleSearch, PythonInterpreter from lagent.agents.react import ReAct from lagent.llms import GPTAPI from lagent.llms.huggingface import HFTransformerCasualLM class SessionState: def init_state(self): """Initialize session state variables.""" st.session_state['assistant'] = [] st.session_state['user'] = [] #action_list = [PythonInterpreter(), GoogleSearch()] action_list = [PythonInterpreter()] st.session_state['plugin_map'] = { action.name: action for action in action_list } st.session_state['model_map'] = {} st.session_state['model_selected'] = None st.session_state['plugin_actions'] = set() def clear_state(self): """Clear the existing session state.""" st.session_state['assistant'] = [] st.session_state['user'] = [] st.session_state['model_selected'] = None if 'chatbot' in st.session_state: st.session_state['chatbot']._session_history = [] class StreamlitUI: def __init__(self, session_state: SessionState): self.init_streamlit() self.session_state = session_state def init_streamlit(self): """Initialize Streamlit's UI settings.""" st.set_page_config( layout='wide', page_title='lagent-web', page_icon='./docs/imgs/lagent_icon.png') # st.header(':robot_face: :blue[Lagent] Web Demo ', divider='rainbow') st.sidebar.title('模型控制') def setup_sidebar(self): """Setup the sidebar for model and plugin selection.""" model_name = st.sidebar.selectbox( '模型选择:', options=['gpt-3.5-turbo','internlm']) if model_name != st.session_state['model_selected']: model = self.init_model(model_name) self.session_state.clear_state() st.session_state['model_selected'] = model_name if 'chatbot' in st.session_state: del st.session_state['chatbot'] else: model = st.session_state['model_map'][model_name] plugin_name = st.sidebar.multiselect( '插件选择', options=list(st.session_state['plugin_map'].keys()), default=[list(st.session_state['plugin_map'].keys())[0]], ) plugin_action = [ st.session_state['plugin_map'][name] for name in plugin_name ] if 'chatbot' in st.session_state: st.session_state['chatbot']._action_executor = ActionExecutor( actions=plugin_action) if st.sidebar.button('清空对话', key='clear'): self.session_state.clear_state() uploaded_file = st.sidebar.file_uploader( '上传文件', type=['png', 'jpg', 'jpeg', 'mp4', 'mp3', 'wav']) return model_name, model, plugin_action, uploaded_file def init_model(self, option): """Initialize the model based on the selected option.""" if option not in st.session_state['model_map']: if option.startswith('gpt'): st.session_state['model_map'][option] = GPTAPI( model_type=option) else: st.session_state['model_map'][option] = HFTransformerCasualLM( '/root/model/Shanghai_AI_Laboratory/internlm-chat-7b') return st.session_state['model_map'][option] def initialize_chatbot(self, model, plugin_action): """Initialize the chatbot with the given model and plugin actions.""" return ReAct( llm=model, action_executor=ActionExecutor(actions=plugin_action)) def render_user(self, prompt: str): with st.chat_message('user'): st.markdown(prompt) def render_assistant(self, agent_return): with st.chat_message('assistant'): for action in agent_return.actions: if (action): self.render_action(action) st.markdown(agent_return.response) def render_action(self, action): with st.expander(action.type, expanded=True): st.markdown( "<p style='text-align: left;display:flex;'> <span style='font-size:14px;font-weight:600;width:70px;text-align-last: justify;'>插 件</span><span style='width:14px;text-align:left;display:block;'>:</span><span style='flex:1;'>" # noqa E501 + action.type + '</span></p>', unsafe_allow_html=True) st.markdown( "<p style='text-align: left;display:flex;'> <span style='font-size:14px;font-weight:600;width:70px;text-align-last: justify;'>思考步骤</span><span style='width:14px;text-align:left;display:block;'>:</span><span style='flex:1;'>" # noqa E501 + action.thought + '</span></p>', unsafe_allow_html=True) if (isinstance(action.args, dict) and 'text' in action.args): st.markdown( "<p style='text-align: left;display:flex;'><span style='font-size:14px;font-weight:600;width:70px;text-align-last: justify;'> 执行内容</span><span style='width:14px;text-align:left;display:block;'>:</span></p>", # noqa E501 unsafe_allow_html=True) st.markdown(action.args['text']) self.render_action_results(action) def render_action_results(self, action): """Render the results of action, including text, images, videos, and audios.""" if (isinstance(action.result, dict)): st.markdown( "<p style='text-align: left;display:flex;'><span style='font-size:14px;font-weight:600;width:70px;text-align-last: justify;'> 执行结果</span><span style='width:14px;text-align:left;display:block;'>:</span></p>", # noqa E501 unsafe_allow_html=True) if 'text' in action.result: st.markdown( "<p style='text-align: left;'>" + action.result['text'] + '</p>', unsafe_allow_html=True) if 'image' in action.result: image_path = action.result['image'] image_data = open(image_path, 'rb').read() st.image(image_data, caption='Generated Image') if 'video' in action.result: video_data = action.result['video'] video_data = open(video_data, 'rb').read() st.video(video_data) if 'audio' in action.result: audio_data = action.result['audio'] audio_data = open(audio_data, 'rb').read() st.audio(audio_data) def main(): logger = get_logger(__name__) # Initialize Streamlit UI and setup sidebar if 'ui' not in st.session_state: session_state = SessionState() session_state.init_state() st.session_state['ui'] = StreamlitUI(session_state) else: st.set_page_config( layout='wide', page_title='lagent-web', page_icon='./docs/imgs/lagent_icon.png') # st.header(':robot_face: :blue[Lagent] Web Demo ', divider='rainbow') model_name, model, plugin_action, uploaded_file = st.session_state[ 'ui'].setup_sidebar() # Initialize chatbot if it is not already initialized # or if the model has changed if 'chatbot' not in st.session_state or model != st.session_state[ 'chatbot']._llm: st.session_state['chatbot'] = st.session_state[ 'ui'].initialize_chatbot(model, plugin_action) for prompt, agent_return in zip(st.session_state['user'], st.session_state['assistant']): st.session_state['ui'].render_user(prompt) st.session_state['ui'].render_assistant(agent_return) # User input form at the bottom (this part will be at the bottom) # with st.form(key='my_form', clear_on_submit=True): if user_input := st.chat_input(''): st.session_state['ui'].render_user(user_input) st.session_state['user'].append(user_input) # Add file uploader to sidebar if uploaded_file: file_bytes = uploaded_file.read() file_type = uploaded_file.type if 'image' in file_type: st.image(file_bytes, caption='Uploaded Image') elif 'video' in file_type: st.video(file_bytes, caption='Uploaded Video') elif 'audio' in file_type: st.audio(file_bytes, caption='Uploaded Audio') # Save the file to a temporary location and get the path file_path = os.path.join(root_dir, uploaded_file.name) with open(file_path, 'wb') as tmpfile: tmpfile.write(file_bytes) st.write(f'File saved at: {file_path}') user_input = '我上传了一个图像,路径为: {file_path}. {user_input}'.format( file_path=file_path, user_input=user_input) agent_return = st.session_state['chatbot'].chat(user_input) st.session_state['assistant'].append(copy.deepcopy(agent_return)) logger.info(agent_return.inner_steps) st.session_state['ui'].render_assistant(agent_return) if __name__ == '__main__': root_dir = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) root_dir = os.path.join(root_dir, 'tmp_dir') os.makedirs(root_dir, exist_ok=True) main()
3.5 Demo 运行
切换到开发机上的terminal,运行如下命令:
streamlit run /root/code/lagent/examples/react_web_demo.py --server.address 127.0.0.1 --server.port 6006
屏幕输出:
(internlm-demo) root@intern-studio-069640:~/code/lagent# streamlit run /root/code/lagent/examples/react_web_demo.py --server.address 127.0.0.1 --server.port 6006 Collecting usage statistics. To deactivate, set browser.gatherUsageStats to False. You can now view your Streamlit app in your browser. URL: http://127.0.0.1:6006
在浏览器上输入http://127.0.0.1:6006,即可进入界面。需要等待一些时间,待模型加载。
模型选择Internlm-7b,出现CUDA outofmemory错误,先停掉开发机,升级开发机配置到1/2 A100,重试。
4. 浦语·灵笔图文理解创作 Demo
4.1 环境准备
由于在第3节中,我们已经将开发机升级到A100 1/2了,所以不用在升级开发机了。这里要记得从internlm-demo虚拟环境中推迟,执行如下命令:
conda deactivate
进入 conda
环境之后,使用以下命令从本地克隆一个已有的pytorch 2.0.1
的环境.
/root/share/install_conda_env_internlm_base.sh xcomposer-demo
屏幕输出:
tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bujumbura: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/El_Aaiun tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/El_Aaiun: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Blantyre tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Blantyre: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bissau tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bissau: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ceuta tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ceuta: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bangui tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bangui: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Harare tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Harare: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Cairo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Cairo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dar_es_Salaam tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dar_es_Salaam: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Brazzaville tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Brazzaville: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Freetown tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Freetown: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Abidjan tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Abidjan: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Addis_Ababa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Addis_Ababa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Casablanca tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Casablanca: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmara tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmara: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Douala tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Douala: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dakar tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dakar: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Gaborone tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Gaborone: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kampala tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kampala: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Accra tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Accra: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maputo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maputo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lusaka tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lusaka: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Djibouti tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Djibouti: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lubumbashi tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lubumbashi: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Timbuktu tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Timbuktu: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmera tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmera: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mbabane tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mbabane: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Juba tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Juba: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tripoli tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tripoli: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lagos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lagos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nairobi tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nairobi: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ndjamena tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ndjamena: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tunis tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tunis: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Kwajalein tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Kwajalein: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MST7MDT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MST7MDT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/West tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/West: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/DeNoronha tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/DeNoronha: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/East tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/East: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/Acre tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/Acre: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB-Eire tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB-Eire: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/Longyearbyen tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/Longyearbyen: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/ROK tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/ROK: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone.tab tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone.tab: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Turkey tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Turkey: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/UCT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/UCT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Cuba tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Cuba: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/PST8PDT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/PST8PDT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Libya tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Libya: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/EET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/EET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Poland tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Poland: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Reunion tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Reunion: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mahe tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mahe: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Christmas tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Christmas: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mayotte tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mayotte: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mauritius tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mauritius: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Chagos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Chagos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Kerguelen tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Kerguelen: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Antananarivo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Antananarivo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Cocos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Cocos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Maldives tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Maldives: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Comoro tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Comoro: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/localtime tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/localtime: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/WET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/WET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Michigan tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Michigan: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Mountain tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Mountain: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Central tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Central: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Arizona tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Arizona: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Samoa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Samoa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Eastern tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Eastern: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Pacific tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Pacific: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Hawaii tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Hawaii: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Indiana-Starke tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Indiana-Starke: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/East-Indiana tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/East-Indiana: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Alaska tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Alaska: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Aleutian tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Aleutian: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Israel tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Israel: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/W-SU tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/W-SU: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/General tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/General: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaNorte tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaNorte: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaSur tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaSur: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/DumontDUrville tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/DumontDUrville: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Vostok tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Vostok: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Macquarie tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Macquarie: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Mawson tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Mawson: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/McMurdo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/McMurdo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Syowa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Syowa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Casey tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Casey: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/South_Pole tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/South_Pole: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Troll tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Troll: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Davis tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Davis: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Rothera tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Rothera: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Palmer tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Palmer: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/files tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/files: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/build.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/build.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/conda_build_config.yaml tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml.template tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/run_test.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/run_test.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/link.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/link.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/paths.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/paths.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/hash_input.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/hash_input.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/index.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/index.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/test/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/test: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/test/run_test.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/test/run_test.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/LICENSE tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/LICENSE: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/git tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/git: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/repodata_record.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/repodata_record.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/about.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/about.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsondiff tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsondiff: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsonpatch tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsonpatch: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch.py tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch.py: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/METADATA tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/METADATA: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/direct_url.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/direct_url.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/REQUESTED tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/REQUESTED: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/AUTHORS tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/AUTHORS: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/INSTALLER tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/INSTALLER: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/RECORD tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/RECORD: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/COPYING tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/COPYING: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/top_level.txt tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/top_level.txt: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/WHEEL tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/WHEEL: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/files tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/files: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/conda_build_config.yaml tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml.template tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/link.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/link.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/has_prefix tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/has_prefix: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/paths.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/paths.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/hash_input.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/hash_input.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/index.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/index.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/run_test.py tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/run_test.py: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/COPYING tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/COPYING: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/git tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/git: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/repodata_record.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/repodata_record.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/about.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/about.json: skipping existing file ./pkgs/giflib-5.2.1-h5eee18b_3.conda tar: ./pkgs/giflib-5.2.1-h5eee18b_3.conda: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/url.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/url.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/transmute.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/transmute.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__init__.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__init__.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/package_streaming.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/package_streaming.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/extract.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/extract.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/exceptions.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/exceptions.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/s3.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/s3.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/lazy_wheel.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/lazy_wheel.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/s3.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/s3.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/package_streaming.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/package_streaming.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/url.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/url.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/exceptions.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/exceptions.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/transmute.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/transmute.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/lazy_wheel.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/lazy_wheel.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/extract.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/extract.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/METADATA tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/METADATA: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/LICENSE tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/LICENSE: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/direct_url.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/direct_url.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/REQUESTED tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/REQUESTED: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/INSTALLER tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/INSTALLER: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/RECORD tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/RECORD: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/WHEEL tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/WHEEL: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/files tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/files: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/conda_build_config.yaml tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml.template tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/paths.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/paths.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/hash_input.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/hash_input.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/index.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/index.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/test_time_dependencies.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.sh tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.sh: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/LICENSE tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/LICENSE: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/git tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/git: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/repodata_record.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/repodata_record.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/about.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/about.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0.conda tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0.conda: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/tqdm tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/tqdm: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/METADATA tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/METADATA: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/direct_url.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/direct_url.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/LICENCE tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/LICENCE: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/REQUESTED tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/REQUESTED: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/INSTALLER tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/INSTALLER: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/RECORD tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/RECORD: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/top_level.txt tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/top_level.txt: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/WHEEL tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/WHEEL: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/entry_points.txt tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/entry_points.txt: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tk.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tk.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/autonotebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/autonotebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tqdm.1 tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tqdm.1: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_utils.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_utils.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/dask.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/dask.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/cli.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/cli.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_pandas.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_pandas.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/asyncio.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/asyncio.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/itertools.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/itertools.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/utils_worker.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/utils_worker.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/logging.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/logging.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/concurrent.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/concurrent.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/telegram.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/telegram.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/slack.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/slack.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/discord.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/discord.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/concurrent.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/concurrent.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/utils_worker.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/utils_worker.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/discord.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/discord.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/slack.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/slack.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/telegram.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/telegram.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/bells.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/bells.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/itertools.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/itertools.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/logging.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/logging.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/bells.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/bells.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/rich.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/rich.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/auto.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/auto.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_main.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_main.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/utils.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/utils.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/std.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/std.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_monitor.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_monitor.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/version.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/version.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__main__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__main__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/keras.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/keras.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/cli.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/cli.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/version.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/version.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/tk.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/tk.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/dask.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/dask.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/gui.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/gui.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/asyncio.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/asyncio.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_main.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_main.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/rich.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/rich.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_monitor.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_monitor.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/auto.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/auto.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_notebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_notebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__main__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__main__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/keras.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/keras.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_gui.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_gui.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_utils.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_utils.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_pandas.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_pandas.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/std.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/std.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_dist_ver.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_dist_ver.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/utils.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/utils.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/autonotebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/autonotebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/notebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/notebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_dist_ver.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_dist_ver.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/completion.sh tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/completion.sh: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/files tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/files: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/conda_build_config.yaml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml.template tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/has_prefix tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/has_prefix: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/paths.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/paths.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/hash_input.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/hash_input.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/index.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/index.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_pandas.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_pandas.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tqdm.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tqdm.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_concurrent.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_concurrent.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/conftest.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/conftest.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_itertools.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_itertools.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_synchronisation.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_synchronisation.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tk.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tk.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_perf.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_perf.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib_logging.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib_logging.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_version.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_version.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_rich.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_rich.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_keras.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_keras.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_asyncio.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_asyncio.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_dask.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_dask.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_main.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_main.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/test_time_dependencies.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/setup.cfg tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/setup.cfg: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/pyproject.toml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/pyproject.toml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.sh tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.sh: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/LICENCE tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/LICENCE: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/git tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/git: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/repodata_record.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/repodata_record.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/about.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/about.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/ tar: ./pkgs/libev-4.33-h7f8727e_1: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ tar: ./pkgs/libev-4.33-h7f8727e_1/include: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ev.h tar: ./pkgs/libev-4.33-h7f8727e_1/include/ev.h: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ev++.h tar: ./pkgs/libev-4.33-h7f8727e_1/include/ev++.h: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/ tar: ./pkgs/libev-4.33-h7f8727e_1/lib: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4.0.0 tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4.0.0: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4 tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/ tar: ./pkgs/libev-4.33-h7f8727e_1/share: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/ tar: ./pkgs/libev-4.33-h7f8727e_1/share/man: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ tar: ./pkgs/libev-4.33-h7f8727e_1/share/man/man3: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ev.3 tar: ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ev.3: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/ tar: ./pkgs/libev-4.33-h7f8727e_1/info: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/files tar: ./pkgs/libev-4.33-h7f8727e_1/info/files: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/run_exports.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/run_exports.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/ tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/recipe_log.txt tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/recipe_log.txt: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/build.sh tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/build.sh: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/conda_build_config.yaml tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml.template tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml.template: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/install.sh tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/install.sh: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/paths.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/paths.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/hash_input.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/hash_input.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/index.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/index.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/licenses/ tar: ./pkgs/libev-4.33-h7f8727e_1/info/licenses: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/licenses/LICENSE tar: ./pkgs/libev-4.33-h7f8727e_1/info/licenses/LICENSE: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/git tar: ./pkgs/libev-4.33-h7f8727e_1/info/git: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/repodata_record.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/repodata_record.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/about.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/about.json: skipping existing file ./pkgs/numpy-1.26.2-py310h5f9d8c6_0.conda tar: ./pkgs/numpy-1.26.2-py310h5f9d8c6_0.conda: skipping existing file ./pkgs/idna-3.4-py310h06a4308_0.conda tar: ./pkgs/idna-3.4-py310h06a4308_0.conda: skipping existing file ./pkgs/libcufile-1.8.1.2-0/ tar: ./pkgs/libcufile-1.8.1.2-0: skipping existing file ./pkgs/libcufile-1.8.1.2-0/etc/ tar: ./pkgs/libcufile-1.8.1.2-0/etc: skipping existing file ./pkgs/libcufile-1.8.1.2-0/etc/cufile.json tar: ./pkgs/libcufile-1.8.1.2-0/etc/cufile.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/ tar: ./pkgs/libcufile-1.8.1.2-0/lib: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.1.8.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.1.8.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1.8.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1.8.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.0 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.0: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/ tar: ./pkgs/libcufile-1.8.1.2-0/info: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/files tar: ./pkgs/libcufile-1.8.1.2-0/info/files: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/paths.json tar: ./pkgs/libcufile-1.8.1.2-0/info/paths.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/index.json tar: ./pkgs/libcufile-1.8.1.2-0/info/index.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/git tar: ./pkgs/libcufile-1.8.1.2-0/info/git: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/repodata_record.json tar: ./pkgs/libcufile-1.8.1.2-0/info/repodata_record.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/about.json tar: ./pkgs/libcufile-1.8.1.2-0/info/about.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/cacert.pem tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/cacert.pem: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/py.typed tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/py.typed: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__init__.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__init__.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/core.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/core.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__main__.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__main__.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/core.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/core.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__main__.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__main__.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/METADATA tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/METADATA: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/LICENSE tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/LICENSE: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/direct_url.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/direct_url.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/REQUESTED tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/REQUESTED: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/INSTALLER tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/INSTALLER: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/RECORD tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/RECORD: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/top_level.txt tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/top_level.txt: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/WHEEL tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/WHEEL: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/files tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/files: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/build.sh tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/build.sh: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/run_test.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/run_test.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/conda_build_config.yaml tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml.template tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/bld.bat tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/bld.bat: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/paths.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/paths.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/hash_input.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/hash_input.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/index.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/index.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/test_time_dependencies.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.sh tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.sh: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/LICENSE tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/LICENSE: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/git tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/git: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/repodata_record.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/repodata_record.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/about.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/about.json: skipping existing file ./pkgs/networkx-3.1-py310h06a4308_0.conda tar: ./pkgs/networkx-3.1-py310h06a4308_0.conda: skipping existing file ./pkgs/libnpp-11.7.4.75-0/ tar: ./pkgs/libnpp-11.7.4.75-0: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/ tar: ./pkgs/libnpp-11.7.4.75-0/lib: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/ tar: ./pkgs/libnpp-11.7.4.75-0/info: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/files tar: ./pkgs/libnpp-11.7.4.75-0/info/files: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/paths.json tar: ./pkgs/libnpp-11.7.4.75-0/info/paths.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/index.json tar: ./pkgs/libnpp-11.7.4.75-0/info/index.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/git tar: ./pkgs/libnpp-11.7.4.75-0/info/git: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/repodata_record.json tar: ./pkgs/libnpp-11.7.4.75-0/info/repodata_record.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/about.json tar: ./pkgs/libnpp-11.7.4.75-0/info/about.json: skipping existing file ---------- start create the new conda env: xcomposer-demo Source: /share/conda_envs/internlm-base Destination: /root/.conda/envs/xcomposer-demo Packages: 96 Files: 0 Downloading and Extracting Packages: Downloading and Extracting Packages: Preparing transaction: done Verifying transaction: done Executing transaction: done # # To activate this environment, use # # $ conda activate xcomposer-demo # # To deactivate an active environment, use # # $ conda deactivate Finised! Now you can use your environment by typing: conda activate xcomposer-demo (base) root@intern-studio-069640:~#
激活虚拟环境xcomposer-demo:
conda activate xcomposer-demo
接下来运行以下命令,安装 transformers
、gradio
等依赖包。
pip install transformers==4.33.1 timm==0.4.12 sentencepiece==0.1.99 gradio==3.44.4 markdown2==2.4.10 xlsxwriter==3.1.2 einops accelerate
屏幕输出:
(base) root@intern-studio-069640:~# pip install transformers==4.33.1 timm==0.4.12 sentencepiece==0.1.99 gradio==3.44.4 markdown2==2.4.10 xlsxwriter==3.1.2 einops accelerate^C (base) root@intern-studio-069640:~# conda activate xcomposer-demo (xcomposer-demo) root@intern-studio-069640:~# pip install transformers==4.33.1 timm==0.4.12 sentencepiece==0.1.99 gradio==3.44.4 markdown2==2.4.10 xlsxwriter==3.1.2 einops accelerate Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting transformers==4.33.1 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/13/30/54b59e73400df3de506ad8630284e9fd63f4b94f735423d55fc342181037/transformers-4.33.1-py3-none-any.whl (7.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.6/7.6 MB 22.4 MB/s eta 0:00:00 Collecting timm==0.4.12 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/90/fc/606bc5cf46acac3aa9bd179b3954433c026aaf88ea98d6b19f5d14c336da/timm-0.4.12-py3-none-any.whl (376 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 377.0/377.0 kB 14.7 MB/s eta 0:00:00 Collecting sentencepiece==0.1.99 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/7f/e5/323dc813b3e1339305f888d035e2f3725084fc4dcf051995b366dd26cc90/sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Collecting gradio==3.44.4 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/02/69/ddbc35cf374744a36934455281934966d980988ee5556611a21470752014/gradio-3.44.4-py3-none-any.whl (20.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.2/20.2 MB 63.7 MB/s eta 0:00:00 Collecting markdown2==2.4.10 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f1/98/61276a753f078dd2f3171c9a69fd3f451d220e806b2b1cdca41b8e368b0f/markdown2-2.4.10-py2.py3-none-any.whl (39 kB) Collecting xlsxwriter==3.1.2 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/37/94/25d3ec8587974de7ebd790232aa3155abfe44ed23df7ccaa4645977a1cbe/XlsxWriter-3.1.2-py3-none-any.whl (153 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.0/153.0 kB 18.5 MB/s eta 0:00:00 Collecting einops Using cached https://pypi.tuna.tsinghua.edu.cn/packages/29/0b/2d1c0ebfd092e25935b86509a9a817159212d82aa43d7fb07eca4eeff2c2/einops-0.7.0-py3-none-any.whl (44 kB) Collecting accelerate Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c8/14/73c3d62e709c2ace755c826997b12f883f3cb6b138dec63ac1e2a68cd910/accelerate-0.27.0-py3-none-any.whl (279 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 279.7/279.7 kB 12.0 MB/s eta 0:00:00 Requirement already satisfied: filelock in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from transformers==4.33.1) (3.13.1) Collecting huggingface-hub<1.0,>=0.15.1 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/28/03/7d3c7153113ec59cfb31e3b8ee773f5f420a0dd7d26d40442542b96675c3/huggingface_hub-0.20.3-py3-none-any.whl (330 kB) Requirement already satisfied: numpy>=1.17 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from transformers==4.33.1) (1.26.2) Collecting packaging>=20.0 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl (53 kB) Collecting pyyaml>=5.1 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/29/61/bf33c6c85c55bc45a29eee3195848ff2d518d84735eb0e2d8cb42e0d285e/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB) Collecting regex!=2019.12.17 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/81/8a/96a62ce98e8ff1b16db56fde3debc8a571f6b7ea42ee137eb0d995cdfa26/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) Requirement already satisfied: requests in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from transformers==4.33.1) (2.31.0) Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers==4.33.1) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/94/60/ff26cce378023624ffcad91edaa4871f561d6ba7295185c45037ddba80e2/tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 50.0 MB/s eta 0:00:00 Collecting safetensors>=0.3.1 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d0/ba/b2254fafc7f5fdc98a2fa4d5a5eeb029fbf9589ec87f2c230c3ac0a1dd53/safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Collecting tqdm>=4.27 (from transformers==4.33.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2a/14/e75e52d521442e2fcc9f1df3c5e456aead034203d4797867980de558ab34/tqdm-4.66.2-py3-none-any.whl (78 kB) Requirement already satisfied: torch>=1.4 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from timm==0.4.12) (2.0.1) Requirement already satisfied: torchvision in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from timm==0.4.12) (0.15.2) Collecting aiofiles<24.0,>=22.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c5/19/5af6804c4cc0fed83f47bff6e413a98a36618e7d40185cd36e69737f3b0e/aiofiles-23.2.1-py3-none-any.whl (15 kB) Collecting altair<6.0,>=4.2.0 (from gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/e4/7fcceef127badbb0d644d730d992410e4f3799b295c9964a172f92a469c7/altair-5.2.0-py3-none-any.whl (996 kB) Collecting fastapi (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bf/97/60351307ab4502908d29f64f2801a36709a3f1888447bb328bc373d6ca0e/fastapi-0.109.2-py3-none-any.whl (92 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92.1/92.1 kB 5.6 MB/s eta 0:00:00 Collecting ffmpy (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1d/70/07914754979f5dd80bda947a0ffd181c08bfcb137b01c3c0cef45254d271/ffmpy-0.3.2.tar.gz (5.5 kB) Preparing metadata (setup.py) ... done Collecting gradio-client==0.5.1 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4e/41/b01f772e23dd7ac36f42958e36ed59322ead30cf4037790cc3139dfa6796/gradio_client-0.5.1-py3-none-any.whl (298 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 298.2/298.2 kB 5.1 MB/s eta 0:00:00 Collecting httpx (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/39/9b/4937d841aee9c2c8102d9a4eeb800c7dad25386caabb4a1bf5010df81a57/httpx-0.26.0-py3-none-any.whl (75 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.9/75.9 kB 7.6 MB/s eta 0:00:00 Collecting importlib-resources<7.0,>=1.3 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/93/e8/facde510585869b5ec694e8e0363ffe4eba067cb357a8398a55f6a1f8023/importlib_resources-6.1.1-py3-none-any.whl (33 kB) Requirement already satisfied: jinja2<4.0 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from gradio==3.44.4) (3.1.2) Requirement already satisfied: markupsafe~=2.0 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from gradio==3.44.4) (2.1.1) Collecting matplotlib~=3.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/19/e5/a4ea514515f270224435c69359abb7a3d152ed31b9ee3ba5e63017461945/matplotlib-3.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 64.6 MB/s eta 0:00:00 Collecting orjson~=3.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/00/a6/144bfa40294a4401076f64b00834adda56a9c995280081e41f081ac5d909/orjson-3.9.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 138.7/138.7 kB 12.6 MB/s eta 0:00:00 Collecting pandas<3.0,>=1.0 (from gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b3/b3/3102c3a4abca1093e50cfec2213102a1c65c0b318a4431395d0121e6e690/pandas-2.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.0 MB) Requirement already satisfied: pillow<11.0,>=8.0 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from gradio==3.44.4) (10.0.1) Collecting pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/db/dc/afecbd9650f486889181c6d1a0d675b580c06253ea7e304588e4c7485bdb/pydantic-2.6.1-py3-none-any.whl (394 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 394.8/394.8 kB 8.6 MB/s eta 0:00:00 Collecting pydub (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/53/d78dc063216e62fc55f6b2eebb447f6a4b0a59f55c8406376f76bf959b08/pydub-0.25.1-py2.py3-none-any.whl (32 kB) Collecting python-multipart (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3d/47/444768600d9e0ebc82f8e347775d24aef8f6348cf00e9fa0e81910814e6d/python_multipart-0.0.9-py3-none-any.whl (22 kB) Collecting semantic-version~=2.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/23/8146aad7d88f4fcb3a6218f41a60f6c2d4e3a72de72da1825dc7c8f7877c/semantic_version-2.10.0-py2.py3-none-any.whl (15 kB) Requirement already satisfied: typing-extensions~=4.0 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from gradio==3.44.4) (4.7.1) Collecting uvicorn>=0.14.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d9/fd/bac111726b6c651f1fa5563145ecba5ff70d36fb140a55e0d79b60b9d65e/uvicorn-0.27.1-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 5.8 MB/s eta 0:00:00 Collecting websockets<12.0,>=10.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/58/0a/7570e15661a0a546c3a1152d95fe8c05480459bab36247f0acbf41f01a41/websockets-11.0.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 129.9/129.9 kB 9.5 MB/s eta 0:00:00 Collecting fsspec (from gradio-client==0.5.1->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ad/30/2281c062222dc39328843bd1ddd30ff3005ef8e30b2fd09c4d2792766061/fsspec-2024.2.0-py3-none-any.whl (170 kB) Collecting psutil (from accelerate) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/4f/0e22aaa246f96d6ac87fe5ebb9c5a693fbe8877f537a1022527c47ca43c5/psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) Collecting jsonschema>=3.0 (from altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/9d/b035d024c62c85f2e2d4806a59ca7b8520307f34e0932fbc8cc75fe7b2d9/jsonschema-4.21.1-py3-none-any.whl (85 kB) Collecting toolz (from altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b7/8a/d82202c9f89eab30f9fc05380daae87d617e2ad11571ab23d7c13a29bb54/toolz-0.12.1-py3-none-any.whl (56 kB) Collecting contourpy>=1.0.1 (from matplotlib~=3.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/58/56/e2c43dcfa1f9c7db4d5e3d6f5134b24ed953f4e2133a4b12f0062148db58/contourpy-1.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (310 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 310.7/310.7 kB 7.2 MB/s eta 0:00:00 Collecting cycler>=0.10 (from matplotlib~=3.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e7/05/c19819d5e3d95294a6f5947fb9b9629efb316b96de511b418c53d245aae6/cycler-0.12.1-py3-none-any.whl (8.3 kB) Collecting fonttools>=4.22.0 (from matplotlib~=3.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a8/33/536e7d7c57248fa2cce8352ae536ed0223800e9c47d5ec40a413fea81808/fonttools-4.48.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 35.6 MB/s eta 0:00:00 Collecting kiwisolver>=1.3.1 (from matplotlib~=3.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/40/4ab1fdb57fced80ce5903f04ae1aed7c1d5939dda4fd0c0aa526c12fe28a/kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 36.8 MB/s eta 0:00:00 Collecting pyparsing>=2.3.1 (from matplotlib~=3.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/39/92/8486ede85fcc088f1b3dba4ce92dd29d126fd96b0008ea213167940a2475/pyparsing-3.1.1-py3-none-any.whl (103 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.1/103.1 kB 13.3 MB/s eta 0:00:00 Collecting python-dateutil>=2.7 (from matplotlib~=3.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pytz>=2020.1 (from pandas<3.0,>=1.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/9c/3d/a121f284241f08268b21359bd425f7d4825cffc5ac5cd0e1b3d82ffd2b10/pytz-2024.1-py2.py3-none-any.whl (505 kB) Collecting tzdata>=2022.7 (from pandas<3.0,>=1.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/65/58/f9c9e6be752e9fcb8b6a0ee9fb87e6e7a1f6bcab2cdc73f02bb7ba91ada0/tzdata-2024.1-py2.py3-none-any.whl (345 kB) Collecting annotated-types>=0.4.0 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/28/78/d31230046e58c207284c6b2c4e8d96e6d3cb4e52354721b944d3e1ee4aa5/annotated_types-0.6.0-py3-none-any.whl (12 kB) Collecting pydantic-core==2.16.2 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/50/5e/2978d9f0e8d0cfd78e22115c028a41e0599e3d684e5aef7ed9bd18fcbd0c/pydantic_core-2.16.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.2/2.2 MB 45.4 MB/s eta 0:00:00 Requirement already satisfied: charset-normalizer<4,>=2 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from requests->transformers==4.33.1) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from requests->transformers==4.33.1) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from requests->transformers==4.33.1) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from requests->transformers==4.33.1) (2023.11.17) Requirement already satisfied: sympy in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from torch>=1.4->timm==0.4.12) (1.11.1) Requirement already satisfied: networkx in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from torch>=1.4->timm==0.4.12) (3.1) Collecting click>=7.0 (from uvicorn>=0.14.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl (97 kB) Collecting h11>=0.8 (from uvicorn>=0.14.0->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/95/04/ff642e65ad6b90db43e668d70ffb6736436c7ce41fcc549f4e9472234127/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 6.8 MB/s eta 0:00:00 Collecting starlette<0.37.0,>=0.36.3 (from fastapi->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/eb/f7/372e3953b6e6fbfe0b70a1bb52612eae16e943f4288516480860fcd4ac41/starlette-0.36.3-py3-none-any.whl (71 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.5/71.5 kB 9.0 MB/s eta 0:00:00 Collecting typing-extensions~=4.0 (from gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b7/f4/6a90020cd2d93349b442bfcb657d0dc91eee65491600b2cb1d388bc98e6b/typing_extensions-4.9.0-py3-none-any.whl (32 kB) Collecting anyio (from httpx->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bf/cd/d6d9bb1dadf73e7af02d18225cbd2c93f8552e13130484f1c8dcfece292b/anyio-4.2.0-py3-none-any.whl (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.5/85.5 kB 11.3 MB/s eta 0:00:00 Collecting httpcore==1.* (from httpx->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/56/ba/78b0a99c4da0ff8b0f59defa2f13ca4668189b134bd9840b6202a93d9a0f/httpcore-1.0.2-py3-none-any.whl (76 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.9/76.9 kB 10.5 MB/s eta 0:00:00 Collecting sniffio (from httpx->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c3/a0/5dba8ed157b0136607c7f2151db695885606968d1fae123dc3391e0cfdbf/sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting attrs>=22.2.0 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/e0/44/827b2a91a5816512fcaf3cc4ebc465ccd5d598c45cefa6703fcf4a79018f/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ee/07/44bd408781594c4d0a027666ef27fab1e441b109dc3b76b4f836f8fd04fe/jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB) Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/90/10/1c92edb0a0a14b67ff825bc338e74bc49ab27d3f3bae3f9a02838cba546f/referencing-0.33.0-py3-none-any.whl (26 kB) Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/8c/f1/09bee4d70305e79ecad4f3ccee583f0185c06a5f58befdc3544cf8b18536/rpds_py-0.17.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB) Collecting six>=1.5 (from python-dateutil>=2.7->matplotlib~=3.0->gradio==3.44.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting exceptiongroup>=1.0.2 (from anyio->httpx->gradio==3.44.4) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b8/9a/5028fd52db10e600f1c4674441b968cf2ea4959085bfb5b99fb1250e5f68/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) Requirement already satisfied: mpmath>=0.19 in ./.conda/envs/xcomposer-demo/lib/python3.10/site-packages (from sympy->torch>=1.4->timm==0.4.12) (1.3.0) Building wheels for collected packages: ffmpy Building wheel for ffmpy (setup.py) ... done Created wheel for ffmpy: filename=ffmpy-0.3.2-py3-none-any.whl size=5582 sha256=32075e53a6e00dbe0e556840cb83d2e05b41c3480bb7dfeae3bf483af7509d17 Stored in directory: /root/.cache/pip/wheels/ab/22/26/fe2be2a2a84ab0ed59fc0c532fe416f6b4ff1180afe1d4f8a9 Successfully built ffmpy Installing collected packages: tokenizers, sentencepiece, pytz, pydub, ffmpy, xlsxwriter, websockets, tzdata, typing-extensions, tqdm, toolz, sniffio, six, semantic-version, safetensors, rpds-py, regex, pyyaml, python-multipart, pyparsing, psutil, packaging, orjson, markdown2, kiwisolver, importlib-resources, h11, fsspec, fonttools, exceptiongroup, einops, cycler, contourpy, click, attrs, annotated-types, aiofiles, uvicorn, referencing, python-dateutil, pydantic-core, huggingface-hub, httpcore, anyio, transformers, starlette, pydantic, pandas, matplotlib, jsonschema-specifications, httpx, accelerate, timm, jsonschema, gradio-client, fastapi, altair, gradio Attempting uninstall: typing-extensions Found existing installation: typing_extensions 4.7.1 Uninstalling typing_extensions-4.7.1: Successfully uninstalled typing_extensions-4.7.1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. triton 2.0.0 requires cmake, which is not installed. triton 2.0.0 requires lit, which is not installed. Successfully installed accelerate-0.27.0 aiofiles-23.2.1 altair-5.2.0 annotated-types-0.6.0 anyio-4.2.0 attrs-23.2.0 click-8.1.7 contourpy-1.2.0 cycler-0.12.1 einops-0.7.0 exceptiongroup-1.2.0 fastapi-0.109.2 ffmpy-0.3.2 fonttools-4.48.1 fsspec-2024.2.0 gradio-3.44.4 gradio-client-0.5.1 h11-0.14.0 httpcore-1.0.2 httpx-0.26.0 huggingface-hub-0.20.3 importlib-resources-6.1.1 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 kiwisolver-1.4.5 markdown2-2.4.10 matplotlib-3.8.2 orjson-3.9.13 packaging-23.2 pandas-2.2.0 psutil-5.9.8 pydantic-2.6.1 pydantic-core-2.16.2 pydub-0.25.1 pyparsing-3.1.1 python-dateutil-2.8.2 python-multipart-0.0.9 pytz-2024.1 pyyaml-6.0.1 referencing-0.33.0 regex-2023.12.25 rpds-py-0.17.1 safetensors-0.4.2 semantic-version-2.10.0 sentencepiece-0.1.99 six-1.16.0 sniffio-1.3.0 starlette-0.36.3 timm-0.4.12 tokenizers-0.13.3 toolz-0.12.1 tqdm-4.66.2 transformers-4.33.1 typing-extensions-4.9.0 tzdata-2024.1 uvicorn-0.27.1 websockets-11.0.3 xlsxwriter-3.1.2 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (xcomposer-demo) root@intern-studio-069640:~#
其中有个出错,按照视频教学内容,可以忽略:
4.2 模型下载
InternStudio平台的 share
目录下已经为我们准备了全系列的 InternLM
模型,所以我们可以直接复制即可。使用如下命令复制:
mkdir -p /root/model/Shanghai_AI_Laboratory cp -r /root/share/temp/model_repos/internlm-xcomposer-7b /root/model/Shanghai_AI_Laboratory
屏幕输出:
(xcomposer-demo) root@intern-studio-069640:~# mkdir -p /root/model/Shanghai_AI_Laboratory /root/share/temp/model_repos/internlm-xcomposer-7b(xcomposer-demo) root@intern-studio-069640:~# cp -r /root/share/temp/model_repoboratorylm-xcomposer-7b /root/model/Shanghai_AI_Lab (xcomposer-demo) root@intern-studio-069640:~#
4.3 代码准备
在 /root/code
git clone InternLM-XComposer
仓库的代码:
cd /root/code git clone https://gitee.com/internlm/InternLM-XComposer.git cd /root/code/InternLM-XComposer git checkout 3e8c79051a1356b9c388a6447867355c0634932d # 最好保证和教程的 commit 版本一致
屏幕输出:
(xcomposer-demo) root@intern-studio-069640:~# cd /root/code (xcomposer-demo) root@intern-studio-069640:~/code# git clone https://gitee.com/internlm/InternLM-XComposer.git mposer git checkout 3e8c79051a1356b9c388a644786735Cloning into 'InternLM-XComposer'... 5c0634932d # 最好保证和教程的 commit 版本一致 remote: Enumerating objects: 680, done. remote: Counting objects: 100% (680/680), done. remote: Compressing objects: 100% (273/273), done. remote: Total 680 (delta 361), reused 680 (delta 361), pack-reused 0 Receiving objects: 100% (680/680), 10.74 MiB | 1.81 MiB/s, done. Resolving deltas: 100% (361/361), done. (xcomposer-demo) root@intern-studio-069640:~/code# cd /root/code/InternLM-XComposer �好保证和教程的 commit 版本一致udio-069640:~/code/InternLM-XComposer# git checkout 3e8c79051a1356b9c388a6447867355c0634932d # 最 Note: switching to '3e8c79051a1356b9c388a6447867355c0634932d'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c <new-branch-name> Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 3e8c790 add polar in readme (xcomposer-demo) root@intern-studio-069640:~/code/InternLM-XComposer#
4.4 Demo 运行
在终端运行以下代码:
cd /root/code/InternLM-XComposer python examples/web_demo.py \ --folder /root/model/Shanghai_AI_Laboratory/internlm-xcomposer-7b \ --num_gpus 1 \ --port 6006
屏幕输出:
(xcomposer-demo) root@intern-studio-069640:~/code/InternLM-XComposer# python examples/web_demo.py --folder /root/model/Shanghai_AI_Laboratory/internlm-xcomposer-7b --num_gpus 1 --port 6006 Init VIT ... Done Init Perceive Sampler ... Done Init InternLM ... Done Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████| 4/4 [00:22<00:00, 5.61s/it] load model done: <class 'transformers_modules.internlm-xcomposer-7b.modeling_InternLM_XComposer.InternLMXComposerForCausalLM'> /root/code/InternLM-XComposer/examples/web_demo.py:1068: GradioDeprecationWarning: The `style` method is deprecated. Please set these arguments in the constructor instead. chat_textbox = gr.Textbox( Running on local URL: http://0.0.0.0:6006 Could not create share link. Missing file: /root/.conda/envs/xcomposer-demo/lib/python3.10/site-packages/gradio/frpc_linux_amd64_v0.2. Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps: 1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.2/frpc_linux_amd64 2. Rename the downloaded file to: frpc_linux_amd64_v0.2 3. Move the file to this location: /root/.conda/envs/xcomposer-demo/lib/python3.10/site-packages/gradio
在浏览器上输入:http://127.0.0.1:6006/
posted on 2024-02-13 17:55 littlesuccess 阅读(55) 评论(0) 编辑 收藏 举报