书生开源大模型训练营-第3讲-作业
提交方式：在各个班级对应的 GitHub Discussion 帖子中进行提交。
基础作业：
复现课程知识库助手搭建过程 (截图)
1 环境配置
1.1 InternLM 模型部署
创建一个InternLM的虚拟环境，方法是从已有的internlm-base中克隆：
输入命令：
bash /root/share/install_conda_env_internlm_base.sh InternLM
屏幕输出：
tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Cordoba: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Santo_Domingo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Santo_Domingo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Guatemala tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Guatemala: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/La_Paz tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/La_Paz: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Coral_Harbour tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Coral_Harbour: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Blanc-Sablon tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Blanc-Sablon: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Phoenix tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Phoenix: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Cayman tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Cayman: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Grand_Turk tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Grand_Turk: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Chihuahua tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Chihuahua: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Montreal tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Montreal: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Vincent tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Vincent: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Campo_Grande tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Campo_Grande: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Kitts tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Kitts: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Nome tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Nome: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Caracas tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Caracas: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Knox tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Knox: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Winamac tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Winamac: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Marengo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Marengo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Petersburg tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Petersburg: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Indianapolis tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Indianapolis: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Tell_City tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Tell_City: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Vincennes tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Vincennes: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Vevay tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Indiana/Vevay: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Thunder_Bay tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Thunder_Bay: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Johns tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Johns: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Lucia tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/St_Lucia: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Vancouver tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Vancouver: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Costa_Rica tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/America/Costa_Rica: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Factory tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Factory: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Zulu tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Zulu: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CST6CDT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CST6CDT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GMT-0 tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GMT-0: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone1970.tab tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone1970.tab: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Monrovia tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Monrovia: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ouagadougou tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ouagadougou: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nouakchott tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nouakchott: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Khartoum tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Khartoum: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Malabo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Malabo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Algiers tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Algiers: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kigali tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kigali: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Conakry tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Conakry: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Luanda tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Luanda: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Libreville tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Libreville: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Banjul tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Banjul: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kinshasa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kinshasa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lome tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lome: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Niamey tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Niamey: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Johannesburg tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Johannesburg: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Porto-Novo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Porto-Novo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Windhoek tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Windhoek: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Sao_Tome tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Sao_Tome: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maseru tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maseru: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mogadishu tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mogadishu: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bamako tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bamako: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bujumbura tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bujumbura: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/El_Aaiun tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/El_Aaiun: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Blantyre tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Blantyre: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bissau tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bissau: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ceuta tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ceuta: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bangui tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Bangui: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Harare tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Harare: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Cairo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Cairo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dar_es_Salaam tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dar_es_Salaam: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Brazzaville tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Brazzaville: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Freetown tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Freetown: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Abidjan tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Abidjan: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Addis_Ababa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Addis_Ababa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Casablanca tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Casablanca: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmara tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmara: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Douala tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Douala: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dakar tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Dakar: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Gaborone tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Gaborone: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kampala tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Kampala: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Accra tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Accra: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maputo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Maputo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lusaka tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lusaka: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Djibouti tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Djibouti: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lubumbashi tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lubumbashi: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Timbuktu tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Timbuktu: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmera tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Asmera: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mbabane tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Mbabane: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Juba tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Juba: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tripoli tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tripoli: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lagos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Lagos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nairobi tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Nairobi: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ndjamena tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Ndjamena: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tunis tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Africa/Tunis: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Kwajalein tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Kwajalein: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MST7MDT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MST7MDT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/West tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/West: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/DeNoronha tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/DeNoronha: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/East tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/East: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/Acre tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Brazil/Acre: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB-Eire tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/GB-Eire: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/CET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/Longyearbyen tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Arctic/Longyearbyen: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/ROK tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/ROK: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone.tab tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/zone.tab: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Turkey tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Turkey: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/MET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/UCT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/UCT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Cuba tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Cuba: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/PST8PDT tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/PST8PDT: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Libya tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Libya: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/EET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/EET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Poland tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Poland: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Reunion tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Reunion: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mahe tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mahe: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Christmas tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Christmas: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mayotte tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mayotte: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mauritius tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Mauritius: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Chagos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Chagos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Kerguelen tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Kerguelen: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Antananarivo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Antananarivo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Cocos tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Cocos: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Maldives tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Maldives: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Comoro tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Indian/Comoro: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/localtime tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/build/etc/localtime: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/WET tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/WET: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Michigan tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Michigan: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Mountain tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Mountain: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Central tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Central: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Arizona tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Arizona: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Samoa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Samoa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Eastern tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Eastern: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Pacific tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Pacific: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Hawaii tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Hawaii: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Indiana-Starke tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Indiana-Starke: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/East-Indiana tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/East-Indiana: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Alaska tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Alaska: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Aleutian tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/US/Aleutian: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Israel tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Israel: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/W-SU tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/W-SU: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/General tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/General: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaNorte tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaNorte: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaSur tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Mexico/BajaSur: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/DumontDUrville tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/DumontDUrville: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Vostok tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Vostok: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Macquarie tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Macquarie: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Mawson tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Mawson: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/McMurdo tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/McMurdo: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Syowa tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Syowa: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Casey tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Casey: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/South_Pole tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/South_Pole: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Troll tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Troll: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Davis tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Davis: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Rothera tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Rothera: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Palmer tar: ./pkgs/tzdata-2023c-h04d1e81_0/share/zoneinfo/Antarctica/Palmer: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/files tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/files: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/build.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/build.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/conda_build_config.yaml tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml.template tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/meta.yaml: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/run_test.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/recipe/run_test.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/link.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/link.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/paths.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/paths.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/hash_input.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/hash_input.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/index.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/index.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/test/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/test: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/test/run_test.sh tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/test/run_test.sh: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/ tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/LICENSE tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/licenses/LICENSE: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/git tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/git: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/repodata_record.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/repodata_record.json: skipping existing file ./pkgs/tzdata-2023c-h04d1e81_0/info/about.json tar: ./pkgs/tzdata-2023c-h04d1e81_0/info/about.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsondiff tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsondiff: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsonpatch tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/python-scripts/jsonpatch: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch.py tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch.py: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/METADATA tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/METADATA: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/direct_url.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/direct_url.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/REQUESTED tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/REQUESTED: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/AUTHORS tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/AUTHORS: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/INSTALLER tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/INSTALLER: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/RECORD tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/RECORD: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/COPYING tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/COPYING: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/top_level.txt tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/top_level.txt: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/WHEEL tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/site-packages/jsonpatch-1.32.dist-info/WHEEL: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/files tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/files: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/conda_build_config.yaml tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml.template tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/recipe/meta.yaml: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/link.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/link.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/has_prefix tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/has_prefix: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/paths.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/paths.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/hash_input.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/hash_input.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/index.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/index.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/run_test.py tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/test/run_test.py: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/ tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/COPYING tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/licenses/COPYING: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/git tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/git: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/repodata_record.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/repodata_record.json: skipping existing file ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/about.json tar: ./pkgs/jsonpatch-1.32-pyhd3eb1b0_0/info/about.json: skipping existing file ./pkgs/giflib-5.2.1-h5eee18b_3.conda tar: ./pkgs/giflib-5.2.1-h5eee18b_3.conda: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/url.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/url.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/transmute.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/transmute.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__init__.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__init__.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/package_streaming.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/package_streaming.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/extract.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/extract.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/exceptions.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/exceptions.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/s3.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/s3.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/lazy_wheel.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/lazy_wheel.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/s3.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/s3.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/package_streaming.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/package_streaming.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/url.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/url.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/exceptions.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/exceptions.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/transmute.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/transmute.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/lazy_wheel.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/lazy_wheel.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/extract.cpython-311.pyc tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming/__pycache__/extract.cpython-311.pyc: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/METADATA tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/METADATA: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/LICENSE tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/LICENSE: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/direct_url.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/direct_url.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/REQUESTED tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/REQUESTED: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/INSTALLER tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/INSTALLER: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/RECORD tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/RECORD: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/WHEEL tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/lib/python3.11/site-packages/conda_package_streaming-0.9.0.dist-info/WHEEL: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/files tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/files: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/conda_build_config.yaml tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml.template tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/recipe/meta.yaml: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/paths.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/paths.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/hash_input.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/hash_input.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/index.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/index.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.py tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.py: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/test_time_dependencies.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.sh tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/test/run_test.sh: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/ tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/LICENSE tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/licenses/LICENSE: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/git tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/git: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/repodata_record.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/repodata_record.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/about.json tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0/info/about.json: skipping existing file ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0.conda tar: ./pkgs/conda-package-streaming-0.9.0-py311h06a4308_0.conda: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/tqdm tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/bin/tqdm: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/METADATA tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/METADATA: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/direct_url.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/direct_url.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/LICENCE tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/LICENCE: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/REQUESTED tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/REQUESTED: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/INSTALLER tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/INSTALLER: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/RECORD tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/RECORD: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/top_level.txt tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/top_level.txt: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/WHEEL tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/WHEEL: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/entry_points.txt tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm-4.65.0.dist-info/entry_points.txt: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tk.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tk.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/autonotebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/autonotebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tqdm.1 tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/tqdm.1: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_utils.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_utils.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/dask.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/dask.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/cli.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/cli.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_pandas.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_pandas.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/asyncio.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/asyncio.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/itertools.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/itertools.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/utils_worker.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/utils_worker.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/logging.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/logging.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/concurrent.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/concurrent.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/telegram.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/telegram.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/slack.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/slack.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/discord.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/discord.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/concurrent.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/concurrent.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/utils_worker.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/utils_worker.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/discord.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/discord.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/slack.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/slack.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/telegram.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/telegram.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/bells.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/bells.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/itertools.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/itertools.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/logging.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/__pycache__/logging.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/bells.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/contrib/bells.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/rich.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/rich.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/auto.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/auto.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_main.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_main.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/utils.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/utils.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/std.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/std.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_monitor.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_monitor.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_tqdm_notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/version.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/version.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__main__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__main__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/keras.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/keras.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/cli.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/cli.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/version.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/version.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/tk.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/tk.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/dask.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/dask.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/gui.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/gui.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/asyncio.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/asyncio.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_main.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_main.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/rich.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/rich.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_monitor.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_monitor.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/auto.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/auto.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_notebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_notebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__main__.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/__main__.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/keras.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/keras.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_gui.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_gui.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_utils.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_utils.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_pandas.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_tqdm_pandas.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/std.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/std.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_dist_ver.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/_dist_ver.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/utils.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/utils.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/autonotebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/autonotebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/notebook.cpython-311.pyc tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/__pycache__/notebook.cpython-311.pyc: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_dist_ver.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/_dist_ver.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/completion.sh tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/lib/python3.11/site-packages/tqdm/completion.sh: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/files tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/files: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/conda_build_config.yaml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml.template tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/recipe/meta.yaml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/has_prefix tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/has_prefix: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/paths.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/paths.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/hash_input.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/hash_input.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/index.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/index.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_pandas.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_pandas.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_gui.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_gui.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tqdm.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tqdm.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_concurrent.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_concurrent.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/__init__.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/__init__.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_notebook.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_notebook.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/conftest.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/conftest.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_itertools.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_itertools.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_synchronisation.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_synchronisation.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tk.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_tk.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_perf.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_perf.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib_logging.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib_logging.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_contrib.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_version.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_version.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_rich.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_rich.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_keras.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_keras.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_asyncio.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_asyncio.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_dask.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_dask.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_main.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/tests/tests_main.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.py tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.py: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/test_time_dependencies.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/setup.cfg tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/setup.cfg: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/pyproject.toml tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/pyproject.toml: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.sh tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/test/run_test.sh: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/ tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/LICENCE tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/licenses/LICENCE: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/git tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/git: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/repodata_record.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/repodata_record.json: skipping existing file ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/about.json tar: ./pkgs/tqdm-4.65.0-py311h92b7b1e_0/info/about.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/ tar: ./pkgs/libev-4.33-h7f8727e_1: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ tar: ./pkgs/libev-4.33-h7f8727e_1/include: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ev.h tar: ./pkgs/libev-4.33-h7f8727e_1/include/ev.h: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/include/ev++.h tar: ./pkgs/libev-4.33-h7f8727e_1/include/ev++.h: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/ tar: ./pkgs/libev-4.33-h7f8727e_1/lib: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4.0.0 tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4.0.0: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4 tar: ./pkgs/libev-4.33-h7f8727e_1/lib/libev.so.4: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/ tar: ./pkgs/libev-4.33-h7f8727e_1/share: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/ tar: ./pkgs/libev-4.33-h7f8727e_1/share/man: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ tar: ./pkgs/libev-4.33-h7f8727e_1/share/man/man3: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ev.3 tar: ./pkgs/libev-4.33-h7f8727e_1/share/man/man3/ev.3: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/ tar: ./pkgs/libev-4.33-h7f8727e_1/info: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/files tar: ./pkgs/libev-4.33-h7f8727e_1/info/files: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/run_exports.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/run_exports.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/ tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/recipe_log.txt tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/recipe_log.txt: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/build.sh tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/build.sh: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/conda_build_config.yaml tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml.template tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml.template: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/meta.yaml: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/recipe/install.sh tar: ./pkgs/libev-4.33-h7f8727e_1/info/recipe/install.sh: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/paths.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/paths.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/hash_input.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/hash_input.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/index.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/index.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/licenses/ tar: ./pkgs/libev-4.33-h7f8727e_1/info/licenses: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/licenses/LICENSE tar: ./pkgs/libev-4.33-h7f8727e_1/info/licenses/LICENSE: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/git tar: ./pkgs/libev-4.33-h7f8727e_1/info/git: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/repodata_record.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/repodata_record.json: skipping existing file ./pkgs/libev-4.33-h7f8727e_1/info/about.json tar: ./pkgs/libev-4.33-h7f8727e_1/info/about.json: skipping existing file ./pkgs/numpy-1.26.2-py310h5f9d8c6_0.conda tar: ./pkgs/numpy-1.26.2-py310h5f9d8c6_0.conda: skipping existing file ./pkgs/idna-3.4-py310h06a4308_0.conda tar: ./pkgs/idna-3.4-py310h06a4308_0.conda: skipping existing file ./pkgs/libcufile-1.8.1.2-0/ tar: ./pkgs/libcufile-1.8.1.2-0: skipping existing file ./pkgs/libcufile-1.8.1.2-0/etc/ tar: ./pkgs/libcufile-1.8.1.2-0/etc: skipping existing file ./pkgs/libcufile-1.8.1.2-0/etc/cufile.json tar: ./pkgs/libcufile-1.8.1.2-0/etc/cufile.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/ tar: ./pkgs/libcufile-1.8.1.2-0/lib: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.1.8.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.1.8.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1.8.1 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile_rdma.so.1.8.1: skipping existing file ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.0 tar: ./pkgs/libcufile-1.8.1.2-0/lib/libcufile.so.0: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/ tar: ./pkgs/libcufile-1.8.1.2-0/info: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/files tar: ./pkgs/libcufile-1.8.1.2-0/info/files: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/paths.json tar: ./pkgs/libcufile-1.8.1.2-0/info/paths.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/index.json tar: ./pkgs/libcufile-1.8.1.2-0/info/index.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/git tar: ./pkgs/libcufile-1.8.1.2-0/info/git: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/repodata_record.json tar: ./pkgs/libcufile-1.8.1.2-0/info/repodata_record.json: skipping existing file ./pkgs/libcufile-1.8.1.2-0/info/about.json tar: ./pkgs/libcufile-1.8.1.2-0/info/about.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/cacert.pem tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/cacert.pem: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/py.typed tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/py.typed: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__init__.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__init__.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/core.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/core.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__main__.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__main__.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/core.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/core.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__init__.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__init__.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__main__.cpython-311.pyc tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi/__pycache__/__main__.cpython-311.pyc: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/METADATA tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/METADATA: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/LICENSE tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/LICENSE: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/direct_url.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/direct_url.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/REQUESTED tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/REQUESTED: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/INSTALLER tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/INSTALLER: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/RECORD tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/RECORD: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/top_level.txt tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/top_level.txt: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/WHEEL tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/lib/python3.11/site-packages/certifi-2023.7.22.dist-info/WHEEL: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/files tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/files: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/build.sh tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/build.sh: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/run_test.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/run_test.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/conda_build_config.yaml tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/conda_build_config.yaml: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml.template tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml.template: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/bld.bat tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/bld.bat: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/recipe/meta.yaml: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/paths.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/paths.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/hash_input.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/hash_input.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/index.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/index.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.py tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.py: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/test_time_dependencies.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/test_time_dependencies.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.sh tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/test/run_test.sh: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/ tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/LICENSE tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/licenses/certifi/LICENSE: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/git tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/git: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/repodata_record.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/repodata_record.json: skipping existing file ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/about.json tar: ./pkgs/certifi-2023.7.22-py311h06a4308_0/info/about.json: skipping existing file ./pkgs/networkx-3.1-py310h06a4308_0.conda tar: ./pkgs/networkx-3.1-py310h06a4308_0.conda: skipping existing file ./pkgs/libnpp-11.7.4.75-0/ tar: ./pkgs/libnpp-11.7.4.75-0: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/ tar: ./pkgs/libnpp-11.7.4.75-0/lib: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppidei.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppicc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppitc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnpps.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppial.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppist.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppisu.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11.7.4.75 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppim.so.11.7.4.75: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppig.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppc.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11 tar: ./pkgs/libnpp-11.7.4.75-0/lib/libnppif.so.11: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/ tar: ./pkgs/libnpp-11.7.4.75-0/info: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/files tar: ./pkgs/libnpp-11.7.4.75-0/info/files: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/paths.json tar: ./pkgs/libnpp-11.7.4.75-0/info/paths.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/index.json tar: ./pkgs/libnpp-11.7.4.75-0/info/index.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/git tar: ./pkgs/libnpp-11.7.4.75-0/info/git: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/repodata_record.json tar: ./pkgs/libnpp-11.7.4.75-0/info/repodata_record.json: skipping existing file ./pkgs/libnpp-11.7.4.75-0/info/about.json tar: ./pkgs/libnpp-11.7.4.75-0/info/about.json: skipping existing file ---------- start create the new conda env: InternLM Retrieving notices: ...working... done Source: /share/conda_envs/internlm-base Destination: /root/.conda/envs/InternLM Packages: 96 Files: 0 Downloading and Extracting Packages: Downloading and Extracting Packages: Preparing transaction: done Verifying transaction: done Executing transaction: done # # To activate this environment, use # # $ conda activate InternLM # # To deactivate an active environment, use # # $ conda deactivate Finised! Now you can use your environment by typing: conda activate InternLM (base) root@intern-studio-069640:/opt/jupyterlab#
激活刚刚创建的InternLM虚拟环境：
conda activate InternLM
代表已经激活虚拟环境InternLM。
接下来在环境中安装运行 demo 所需要的依赖。
# 升级pip python -m pip install --upgrade pip pip install modelscope==1.9.5 pip install transformers==4.35.2 pip install streamlit==1.24.0 pip install sentencepiece==0.1.99 pip install accelerate==0.24.1
屏幕输出：
(InternLM) root@intern-studio-069640:/opt/jupyterlab# # 升级pip (InternLM) root@intern-studio-069640:/opt/jupyterlab# python -m pip install --upgrade pip Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Requirement already satisfied: pip in /root/.conda/envs/InternLM/lib/python3.10/site-packages (23.3.1) Collecting pip Using cached https://pypi.tuna.tsinghua.edu.cn/packages/8a/6a/19e9fe04fca059ccf770861c7d5721ab4c2aebc539889e97c7977528a53b/pip-24.0-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 23.3.1 Uninstalling pip-23.3.1: Successfully uninstalled pip-23.3.1 Successfully installed pip-24.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install modelscope==1.9.5 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting modelscope==1.9.5 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ac/05/75b5d750608d7354dc3dd023dca7101e5f3b4645cb3e5b816536d472a058/modelscope-1.9.5-py3-none-any.whl (5.4 MB) Collecting addict (from modelscope==1.9.5) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/00/b08f23b7d7e1e14ce01419a467b583edbb93c6cdb8654e54a9cc579cd61f/addict-2.4.0-py3-none-any.whl (3.8 kB) Collecting attrs (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/e0/44/827b2a91a5816512fcaf3cc4ebc465ccd5d598c45cefa6703fcf4a79018f/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting datasets<=2.13.0,>=2.8.0 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/17/d8/f808e32ed7fa86617b9ac7a37b7dcff894c839108c4871cc33ffc4e65b7d/datasets-2.13.0-py3-none-any.whl (485 kB) Collecting einops (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/29/0b/2d1c0ebfd092e25935b86509a9a817159212d82aa43d7fb07eca4eeff2c2/einops-0.7.0-py3-none-any.whl (44 kB) Requirement already satisfied: filelock>=3.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (3.13.1) Collecting gast>=0.2.2 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fa/39/5aae571e5a5f4de9c3445dae08a530498e5c53b0e74410eeeb0991c79047/gast-0.5.4-py3-none-any.whl (19 kB) Requirement already satisfied: numpy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (1.26.2) Collecting oss2 (from modelscope==1.9.5) Using cached oss2-2.18.4-py3-none-any.whl Collecting pandas (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b3/b3/3102c3a4abca1093e50cfec2213102a1c65c0b318a4431395d0121e6e690/pandas-2.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.0 MB) Requirement already satisfied: Pillow>=6.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (10.0.1) Collecting pyarrow!=9.0.0,>=6.0.0 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d4/ca/ef67abb77f9dd51a0d3ff7fcebff58296068a046d7da352b9548070005ed/pyarrow-15.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (38.3 MB) Collecting python-dateutil>=2.1 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pyyaml (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/29/61/bf33c6c85c55bc45a29eee3195848ff2d518d84735eb0e2d8cb42e0d285e/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB) Requirement already satisfied: requests>=2.25 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (2.31.0) Collecting scipy (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/f5/aa/8e6071a5e4dca4ec68b5b22e4991ee74c59c5d372112b9c236ec1faff57d/scipy-1.12.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.4 MB) Requirement already satisfied: setuptools in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (68.0.0) Collecting simplejson>=3.3.0 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/cb/b6/ed513a0adc3e2c9654864ffb68266dcab5720d5653428d690e7e4fb32a6c/simplejson-3.19.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (137 kB) Collecting sortedcontainers>=1.5.9 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/32/46/9cb0e58b2deb7f82b84065f37f3bffeb12413f947f9388e4cac22c4621ce/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting tqdm>=4.64.0 (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2a/14/e75e52d521442e2fcc9f1df3c5e456aead034203d4797867980de558ab34/tqdm-4.66.2-py3-none-any.whl (78 kB) Requirement already satisfied: urllib3>=1.26 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from modelscope==1.9.5) (1.26.18) Collecting yapf (from modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/66/c9/d4b03b2490107f13ebd68fe9496d41ae41a7de6275ead56d0d4621b11ffd/yapf-0.40.2-py3-none-any.whl (254 kB) Collecting dill<0.3.7,>=0.3.0 (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/be/e3/a84bf2e561beed15813080d693b4b27573262433fced9c1d1fea59e60553/dill-0.3.6-py3-none-any.whl (110 kB) Collecting xxhash (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/80/8a/1dd41557883b6196f8f092011a5c1f72d4d44cf36d7b67d4a5efe3127949/xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB) Collecting multiprocess (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/bc/f7/7ec7fddc92e50714ea3745631f79bd9c96424cb2702632521028e57d3a36/multiprocess-0.70.16-py310-none-any.whl (134 kB) Collecting fsspec>=2021.11.1 (from fsspec[http]>=2021.11.1->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ad/30/2281c062222dc39328843bd1ddd30ff3005ef8e30b2fd09c4d2792766061/fsspec-2024.2.0-py3-none-any.whl (170 kB) Collecting aiohttp (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/93/40/d3decda219ebd5410eba627601d537ec3782efbcadba308e9ce381cc0b71/aiohttp-3.9.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB) Collecting huggingface-hub<1.0.0,>=0.11.0 (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/28/03/7d3c7153113ec59cfb31e3b8ee773f5f420a0dd7d26d40442542b96675c3/huggingface_hub-0.20.3-py3-none-any.whl (330 kB) Collecting packaging (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl (53 kB) Collecting six>=1.5 (from python-dateutil>=2.1->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl (11 kB) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (3.4) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.25->modelscope==1.9.5) (2023.11.17) Collecting crcmod>=1.7 (from oss2->modelscope==1.9.5) Using cached crcmod-1.7-cp310-cp310-linux_x86_64.whl Collecting pycryptodome>=3.4.7 (from oss2->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/af/20/5f29ec45462360e7f61e8688af9fe4a0afae057edfabdada662e11bf97e7/pycryptodome-3.20.0-cp35-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB) Collecting aliyun-python-sdk-kms>=2.4.1 (from oss2->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3d/ea/d88e08bfc4a0aee0111f1f24c98b19107bc6783441e7e944907c77b2243d/aliyun_python_sdk_kms-2.16.2-py2.py3-none-any.whl (94 kB) Collecting aliyun-python-sdk-core>=2.13.12 (from oss2->modelscope==1.9.5) Using cached aliyun_python_sdk_core-2.14.0-py3-none-any.whl Collecting pytz>=2020.1 (from pandas->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/9c/3d/a121f284241f08268b21359bd425f7d4825cffc5ac5cd0e1b3d82ffd2b10/pytz-2024.1-py2.py3-none-any.whl (505 kB) Collecting tzdata>=2022.7 (from pandas->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/65/58/f9c9e6be752e9fcb8b6a0ee9fb87e6e7a1f6bcab2cdc73f02bb7ba91ada0/tzdata-2024.1-py2.py3-none-any.whl (345 kB) Collecting importlib-metadata>=6.6.0 (from yapf->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c0/8b/d8427f023c081a8303e6ac7209c16e6878f2765d5b59667f3903fbcfd365/importlib_metadata-7.0.1-py3-none-any.whl (23 kB) Collecting platformdirs>=3.5.1 (from yapf->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/55/72/4898c44ee9ea6f43396fbc23d9bfaf3d06e01b83698bdf2e4c919deceb7c/platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting tomli>=2.0.1 (from yapf->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/97/75/10a9ebee3fd790d20926a90a2547f0bf78f371b2f13aa822c759680ca7b9/tomli-2.0.1-py3-none-any.whl (12 kB) Collecting jmespath<1.0.0,>=0.9.3 (from aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/07/cb/5f001272b6faeb23c1c9e0acc04d48eaaf5c862c17709d20e3469c6e0139/jmespath-0.10.0-py2.py3-none-any.whl (24 kB) Requirement already satisfied: cryptography>=2.6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (41.0.3) Collecting aiosignal>=1.1.2 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/76/ac/a7305707cb852b7e16ff80eaf5692309bde30e2b1100a1fcacdc8f731d97/aiosignal-1.3.1-py3-none-any.whl (7.6 kB) Collecting frozenlist>=1.1.1 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ec/25/0c87df2e53c0c5d90f7517ca0ff7aca78d050a8ec4d32c4278e8c0e52e51/frozenlist-1.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (239 kB) Collecting multidict<7.0,>=4.5 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/33/62/2c9085e571318d51212a6914566fe41dd0e33d7f268f7e2f23dcd3f06c56/multidict-6.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (124 kB) Collecting yarl<2.0,>=1.0 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c3/a0/0ade1409d184cbc9e85acd403a386a7c0563b92ff0f26d138ff9e86e48b4/yarl-1.9.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB) Collecting async-timeout<5.0,>=4.0 (from aiohttp->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/a7/fa/e01228c2938de91d47b307831c62ab9e4001e747789d0b05baf779a6488c/async_timeout-4.0.3-py3-none-any.whl (5.7 kB) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub<1.0.0,>=0.11.0->datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) (4.7.1) Collecting zipp>=0.5 (from importlib-metadata>=6.6.0->yapf->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/66/48866fc6b158c81cc2bfecc04c480f105c6040e8b077bc54c634b4a67926/zipp-3.17.0-py3-none-any.whl (7.4 kB) INFO: pip is looking at multiple versions of multiprocess to determine which version is compatible with other requirements. This could take a while. Collecting multiprocess (from datasets<=2.13.0,>=2.8.0->modelscope==1.9.5) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/35/a8/36d8d7b3e46b377800d8dec47891cdf05842d1a2366909ae4a0c89fbc5e6/multiprocess-0.70.15-py310-none-any.whl (134 kB) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b8/0c/c26b346b41bb1f81ac921fa10074a9595c22e5f99cc89c0410fc4efd5df3/multiprocess-0.70.14-py310-none-any.whl (134 kB) Requirement already satisfied: cffi>=1.12 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (1.16.0) Requirement already satisfied: pycparser in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from cffi>=1.12->cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2->modelscope==1.9.5) (2.21) Installing collected packages: sortedcontainers, pytz, crcmod, addict, zipp, xxhash, tzdata, tqdm, tomli, six, simplejson, scipy, pyyaml, pycryptodome, pyarrow, platformdirs, packaging, multidict, jmespath, gast, fsspec, frozenlist, einops, dill, attrs, async-timeout, yarl, python-dateutil, multiprocess, importlib-metadata, huggingface-hub, aiosignal, yapf, pandas, aliyun-python-sdk-core, aiohttp, aliyun-python-sdk-kms, oss2, datasets, modelscope Successfully installed addict-2.4.0 aiohttp-3.9.3 aiosignal-1.3.1 aliyun-python-sdk-core-2.14.0 aliyun-python-sdk-kms-2.16.2 async-timeout-4.0.3 attrs-23.2.0 crcmod-1.7 datasets-2.13.0 dill-0.3.6 einops-0.7.0 frozenlist-1.4.1 fsspec-2024.2.0 gast-0.5.4 huggingface-hub-0.20.3 importlib-metadata-7.0.1 jmespath-0.10.0 modelscope-1.9.5 multidict-6.0.5 multiprocess-0.70.14 oss2-2.18.4 packaging-23.2 pandas-2.2.0 platformdirs-4.2.0 pyarrow-15.0.0 pycryptodome-3.20.0 python-dateutil-2.8.2 pytz-2024.1 pyyaml-6.0.1 scipy-1.12.0 simplejson-3.19.2 six-1.16.0 sortedcontainers-2.4.0 tomli-2.0.1 tqdm-4.66.2 tzdata-2024.1 xxhash-3.4.1 yapf-0.40.2 yarl-1.9.4 zipp-3.17.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install transformers==4.35.2 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting transformers==4.35.2 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/12/dd/f17b11a93a9ca27728e12512d167eb1281c151c4c6881d3ab59eb58f4127/transformers-4.35.2-py3-none-any.whl (7.9 MB) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (3.13.1) Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (0.20.3) Requirement already satisfied: numpy>=1.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (1.26.2) Requirement already satisfied: packaging>=20.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (23.2) Requirement already satisfied: pyyaml>=5.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (6.0.1) Collecting regex!=2019.12.17 (from transformers==4.35.2) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/81/8a/96a62ce98e8ff1b16db56fde3debc8a571f6b7ea42ee137eb0d995cdfa26/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (2.31.0) Collecting tokenizers<0.19,>=0.14 (from transformers==4.35.2) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/1c/5d/cf5e122ce4f1a29f165b2a69dc33d1ff30bce303343d58a54775ddba5d51/tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB) Collecting safetensors>=0.3.1 (from transformers==4.35.2) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d0/ba/b2254fafc7f5fdc98a2fa4d5a5eeb029fbf9589ec87f2c230c3ac0a1dd53/safetensors-0.4.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Requirement already satisfied: tqdm>=4.27 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers==4.35.2) (4.66.2) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.16.4->transformers==4.35.2) (2024.2.0) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.16.4->transformers==4.35.2) (4.7.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->transformers==4.35.2) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->transformers==4.35.2) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->transformers==4.35.2) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->transformers==4.35.2) (2023.11.17) Installing collected packages: safetensors, regex, tokenizers, transformers Successfully installed regex-2023.12.25 safetensors-0.4.2 tokenizers-0.15.2 transformers-4.35.2 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install streamlit==1.24.0 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting streamlit==1.24.0 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3d/5f/1716c66c58a8b080f9673e7ca569044b1b8ac6a5cd8519fe4b1afa89abf8/streamlit-1.24.0-py2.py3-none-any.whl (8.9 MB) Collecting altair<6,>=4.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/e4/7fcceef127badbb0d644d730d992410e4f3799b295c9964a172f92a469c7/altair-5.2.0-py3-none-any.whl (996 kB) Collecting blinker<2,>=1.0.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fa/2a/7f3714cbc6356a0efec525ce7a0613d581072ed6eb53eb7b9754f33db807/blinker-1.7.0-py3-none-any.whl (13 kB) Collecting cachetools<6,>=4.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/a2/91/2d843adb9fbd911e0da45fbf6f18ca89d07a087c3daa23e955584f90ebf4/cachetools-5.3.2-py3-none-any.whl (9.3 kB) Collecting click<9,>=7.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl (97 kB) Collecting importlib-metadata<7,>=1.4 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/59/9b/ecce94952ab5ea74c31dcf9ccf78ccd484eebebef06019bf8cb579ab4519/importlib_metadata-6.11.0-py3-none-any.whl (23 kB) Requirement already satisfied: numpy<2,>=1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (1.26.2) Requirement already satisfied: packaging<24,>=14.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (23.2) Requirement already satisfied: pandas<3,>=0.25 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (2.2.0) Collecting pillow<10,>=6.2.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/25/6b/d3c35d207c9c0b6c2f855420f62e64ef43d348e8c797ad1c32b9f2106a19/Pillow-9.5.0-cp310-cp310-manylinux_2_28_x86_64.whl (3.4 MB) Collecting protobuf<5,>=3.20 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/15/db/7f731524fe0e56c6b2eb57d05b55d3badd80ef7d1f1ed59db191b2fdd8ab/protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl (294 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 7.6 MB/s eta 0:00:00 Requirement already satisfied: pyarrow>=4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (15.0.0) Collecting pympler<2,>=0.9 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2c/42/41e1469ed0b37b9c8532cb8074bea179f7d85ee7e82a59b5b6c289ed6045/Pympler-1.0.1-py3-none-any.whl (164 kB) Requirement already satisfied: python-dateutil<3,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (2.8.2) Requirement already satisfied: requests<3,>=2.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (2.31.0) Collecting rich<14,>=10.11.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/be/be/1520178fa01eabe014b16e72a952b9f900631142ccd03dc36cf93e30c1ce/rich-13.7.0-py3-none-any.whl (240 kB) Collecting tenacity<9,>=8.0.0 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl (24 kB) Collecting toml<2 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl (16 kB) Requirement already satisfied: typing-extensions<5,>=4.0.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from streamlit==1.24.0) (4.7.1) Collecting tzlocal<5,>=1.1 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/55/a6/a75af44665e5e77e52f6789eef4f8bc056c8e039d96c804b975806942580/tzlocal-4.3.1-py3-none-any.whl (20 kB) Collecting validators<1,>=0.2 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3a/0c/785d317eea99c3739821718f118c70537639aa43f96bfa1d83a71f68eaf6/validators-0.22.0-py3-none-any.whl (26 kB) Collecting gitpython!=3.1.19,<4,>=3 (from streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/67/c7/995360c87dd74e27539ccbfecddfb58e08f140d849fcd7f35d2ed1a5f80f/GitPython-3.1.42-py3-none-any.whl (195 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 195.4/195.4 kB 8.7 MB/s eta 0:00:00 Collecting pydeck<1,>=0.1.dev5 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/10/4b/2fc80540e2d3903452245bb657c7f758ec7342420507d1e4091b0161856e/pydeck-0.8.1b0-py2.py3-none-any.whl (4.8 MB) Collecting tornado<7,>=6.0.3 (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/9f/12/11d0a757bb67278d3380d41955ae98527d5ad18330b2edbdc8de222b569b/tornado-6.4-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (435 kB) Collecting watchdog (from streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/91/7b/26d2f43aa9fe428416be21ee1cb9ac75638cf302466b7e706c14eeaea42c/watchdog-4.0.0-py3-none-manylinux2014_x86_64.whl (82 kB) Requirement already satisfied: jinja2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from altair<6,>=4.0->streamlit==1.24.0) (3.1.2) Collecting jsonschema>=3.0 (from altair<6,>=4.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/9d/b035d024c62c85f2e2d4806a59ca7b8520307f34e0932fbc8cc75fe7b2d9/jsonschema-4.21.1-py3-none-any.whl (85 kB) Collecting toolz (from altair<6,>=4.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b7/8a/d82202c9f89eab30f9fc05380daae87d617e2ad11571ab23d7c13a29bb54/toolz-0.12.1-py3-none-any.whl (56 kB) Collecting gitdb<5,>=4.0.1 (from gitpython!=3.1.19,<4,>=3->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fd/5b/8f0c4a5bb9fd491c277c21eff7ccae71b47d43c4446c9d0c6cff2fe8c2c4/gitdb-4.0.11-py3-none-any.whl (62 kB) Requirement already satisfied: zipp>=0.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from importlib-metadata<7,>=1.4->streamlit==1.24.0) (3.17.0) Requirement already satisfied: pytz>=2020.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3,>=0.25->streamlit==1.24.0) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3,>=0.25->streamlit==1.24.0) (2024.1) Requirement already satisfied: six>=1.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from python-dateutil<3,>=2->streamlit==1.24.0) (1.16.0) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2.4->streamlit==1.24.0) (2023.11.17) Collecting markdown-it-py>=2.2.0 (from rich<14,>=10.11.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/42/d7/1ec15b46af6af88f19b8e5ffea08fa375d433c998b8a7639e76935c14f1f/markdown_it_py-3.0.0-py3-none-any.whl (87 kB) Collecting pygments<3.0.0,>=2.13.0 (from rich<14,>=10.11.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/97/9c/372fef8377a6e340b1704768d20daaded98bf13282b5327beb2e2fe2c7ef/pygments-2.17.2-py3-none-any.whl (1.2 MB) Collecting pytz-deprecation-shim (from tzlocal<5,>=1.1->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/eb/73/3eaab547ca809754e67e06871cff0fc962bafd4b604e15f31896a0f94431/pytz_deprecation_shim-0.1.0.post0-py2.py3-none-any.whl (15 kB) Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->gitpython!=3.1.19,<4,>=3->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/a7/a5/10f97f73544edcdef54409f1d839f6049a0d79df68adbc1ceb24d1aaca42/smmap-5.0.1-py3-none-any.whl (24 kB) Requirement already satisfied: MarkupSafe>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jinja2->altair<6,>=4.0->streamlit==1.24.0) (2.1.1) Requirement already satisfied: attrs>=22.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) (23.2.0) Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ee/07/44bd408781594c4d0a027666ef27fab1e441b109dc3b76b4f836f8fd04fe/jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB) Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/90/10/1c92edb0a0a14b67ff825bc338e74bc49ab27d3f3bae3f9a02838cba546f/referencing-0.33.0-py3-none-any.whl (26 kB) Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6,>=4.0->streamlit==1.24.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/15/f5/769fc90b3af55e6288ce683539ffd68b93dbdf1a5d86050f063828e5911e/rpds_py-0.18.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 9.1 MB/s eta 0:00:00 Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich<14,>=10.11.0->streamlit==1.24.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b3/38/89ba8ad64ae25be8de66a6d463314cf1eb366222074cfda9ee839c56a4b4/mdurl-0.1.2-py3-none-any.whl (10.0 kB) Installing collected packages: watchdog, validators, tornado, toolz, toml, tenacity, smmap, rpds-py, pytz-deprecation-shim, pympler, pygments, protobuf, pillow, mdurl, importlib-metadata, click, cachetools, blinker, tzlocal, referencing, pydeck, markdown-it-py, gitdb, rich, jsonschema-specifications, gitpython, jsonschema, altair, streamlit Attempting uninstall: pillow Found existing installation: Pillow 10.0.1 Uninstalling Pillow-10.0.1: Successfully uninstalled Pillow-10.0.1 Attempting uninstall: importlib-metadata Found existing installation: importlib-metadata 7.0.1 Uninstalling importlib-metadata-7.0.1: Successfully uninstalled importlib-metadata-7.0.1 Successfully installed altair-5.2.0 blinker-1.7.0 cachetools-5.3.2 click-8.1.7 gitdb-4.0.11 gitpython-3.1.42 importlib-metadata-6.11.0 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 markdown-it-py-3.0.0 mdurl-0.1.2 pillow-9.5.0 protobuf-4.25.3 pydeck-0.8.1b0 pygments-2.17.2 pympler-1.0.1 pytz-deprecation-shim-0.1.0.post0 referencing-0.33.0 rich-13.7.0 rpds-py-0.18.0 smmap-5.0.1 streamlit-1.24.0 tenacity-8.2.3 toml-0.10.2 toolz-0.12.1 tornado-6.4 tzlocal-4.3.1 validators-0.22.0 watchdog-4.0.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install sentencepiece==0.1.99 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting sentencepiece==0.1.99 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/7f/e5/323dc813b3e1339305f888d035e2f3725084fc4dcf051995b366dd26cc90/sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Installing collected packages: sentencepiece Successfully installed sentencepiece-0.1.99 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install accelerate==0.24.1 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting accelerate==0.24.1 Using cached https://pypi.tuna.tsinghua.edu.cn/packages/13/9e/ee987874058f2d93006961f6ff49e0bcb60ab9c26709ebe06bfa8707a4d8/accelerate-0.24.1-py3-none-any.whl (261 kB) Requirement already satisfied: numpy>=1.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from accelerate==0.24.1) (1.26.2) Requirement already satisfied: packaging>=20.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from accelerate==0.24.1) (23.2) Collecting psutil (from accelerate==0.24.1) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/4f/0e22aaa246f96d6ac87fe5ebb9c5a693fbe8877f537a1022527c47ca43c5/psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) Requirement already satisfied: pyyaml in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from accelerate==0.24.1) (6.0.1) Requirement already satisfied: torch>=1.10.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from accelerate==0.24.1) (2.0.1) Requirement already satisfied: huggingface-hub in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from accelerate==0.24.1) (0.20.3) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.13.1) Requirement already satisfied: typing-extensions in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (4.7.1) Requirement already satisfied: sympy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (1.11.1) Requirement already satisfied: networkx in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.1) Requirement already satisfied: jinja2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.24.1) (3.1.2) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (2024.2.0) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (2.31.0) Requirement already satisfied: tqdm>=4.42.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub->accelerate==0.24.1) (4.66.2) Requirement already satisfied: MarkupSafe>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jinja2->torch>=1.10.0->accelerate==0.24.1) (2.1.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub->accelerate==0.24.1) (2023.11.17) Requirement already satisfied: mpmath>=0.19 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sympy->torch>=1.10.0->accelerate==0.24.1) (1.3.0) Installing collected packages: psutil, accelerate Successfully installed accelerate-0.24.1 psutil-5.9.8 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab#
1.2 模型下载
在本地的 /root/share/temp/model_repos/internlm-chat-7b 目录下已存储有所需的模型文件参数，可以直接拷贝到个人目录的模型保存地址：
mkdir -p /root/data/model/Shanghai_AI_Laboratory cp -r /root/share/temp/model_repos/internlm-chat-7b /root/data/model/Shanghai_AI_Laboratory/internlm-chat-7b
屏幕输出：
(InternLM) root@intern-studio-069640:/opt/jupyterlab# mkdir -p /root/data/model/Shanghai_AI_Laboratory (InternLM) root@intern-studio-069640:/opt/jupyterlab# cp -r /root/share/temp/model_repos/internlm-chat-7b /root/data/model/Shanghai_AI_Laboratory/internlm-chat-7b (InternLM) root@intern-studio-069640:/opt/jupyterlab#
确认文件已经拷贝好：
1.3 LangChain 相关环境配置
在已完成 InternLM 的部署基础上，还需要安装以下依赖包：
pip install langchain==0.0.292 pip install gradio==4.4.0 pip install chromadb==0.4.15 pip install sentence-transformers==2.2.2 pip install unstructured==0.10.30 pip install markdown==3.3.7
屏幕输出：
(InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install langchain==0.0.292 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting langchain==0.0.292 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/86/dc/e2c7599b03455ea675107472b60e836f693ac8453e7c1119b61e6e60f574/langchain-0.0.292-py3-none-any.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 8.3 MB/s eta 0:00:00 Requirement already satisfied: PyYAML>=5.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (6.0.1) Collecting SQLAlchemy<3,>=1.4 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/52/35/07882bf478515af007b7c3809fae9dbfa38f5bdd089efd31ce6abdbe66a5/SQLAlchemy-2.0.27-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 33.2 MB/s eta 0:00:00 Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (3.9.3) Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (4.0.3) Collecting dataclasses-json<0.6.0,>=0.5.7 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/5f/e7cc90f36152810cab08b6c9c1125e8bcb9d76f8b3018d101b5f877b386c/dataclasses_json-0.5.14-py3-none-any.whl (26 kB) Collecting langsmith<0.1.0,>=0.0.21 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/cd/1c618f89d3fcbb375c99a3ea950bffba8a01862cc0f0ab5032dfb95e8d1e/langsmith-0.0.92-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.5/56.5 kB 2.2 MB/s eta 0:00:00 Collecting numexpr<3.0.0,>=2.8.4 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4a/39/cc88cdade7fb8e409efb63b79c22cfbea7c9c15249e375dfbaf86984dece/numexpr-2.9.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (375 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 375.2/375.2 kB 16.1 MB/s eta 0:00:00 Requirement already satisfied: numpy<2,>=1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (1.26.2) Collecting pydantic<3,>=1 (from langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/db/dc/afecbd9650f486889181c6d1a0d675b580c06253ea7e304588e4c7485bdb/pydantic-2.6.1-py3-none-any.whl (394 kB) Requirement already satisfied: requests<3,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (2.31.0) Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (8.2.3) Requirement already satisfied: aiosignal>=1.1.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (23.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.9.4) Collecting marshmallow<4.0.0,>=3.18.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/57/e9/4368d49d3b462da16a3bac976487764a84dd85cef97232c7bd61f5bdedf3/marshmallow-3.20.2-py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.4/49.4 kB 1.8 MB/s eta 0:00:00 Collecting typing-inspect<1,>=0.4.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/f3/107a22063bf27bdccf2024833d3445f4eea42b2e598abfbd46f6a63b6cb0/typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) Collecting annotated-types>=0.4.0 (from pydantic<3,>=1->langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/28/78/d31230046e58c207284c6b2c4e8d96e6d3cb4e52354721b944d3e1ee4aa5/annotated_types-0.6.0-py3-none-any.whl (12 kB) Collecting pydantic-core==2.16.2 (from pydantic<3,>=1->langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/50/5e/2978d9f0e8d0cfd78e22115c028a41e0599e3d684e5aef7ed9bd18fcbd0c/pydantic_core-2.16.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) Requirement already satisfied: typing-extensions>=4.6.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic<3,>=1->langchain==0.0.292) (4.7.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (2023.11.17) Collecting greenlet!=0.4.17 (from SQLAlchemy<3,>=1.4->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/24/35/945d5b10648fec9b20bcc6df8952d20bb3bba76413cd71c1fdbee98f5616/greenlet-3.0.3-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (616 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 616.0/616.0 kB 11.1 MB/s eta 0:00:00 Requirement already satisfied: packaging>=17.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) (23.2) Collecting mypy-extensions>=0.3.0 (from typing-inspect<1,>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2a/e2/5d3f6ada4297caebe1a2add3b126fe800c96f56dbe5d1988a2cbe0b267aa/mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) Installing collected packages: pydantic-core, numexpr, mypy-extensions, marshmallow, greenlet, annotated-types, typing-inspect, SQLAlchemy, pydantic, langsmith, dataclasses-json, langchain Successfully installed SQLAlchemy-2.0.27 annotated-types-0.6.0 dataclasses-json-0.5.14 greenlet-3.0.3 langchain-0.0.292 langsmith-0.0.92 marshmallow-3.20.2 mypy-extensions-1.0.0 numexpr-2.9.0 pydantic-2.6.1 pydantic-core-2.16.2 typing-inspect-0.9.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install gradio==4.4.0 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting gradio==4.4.0 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bc/d7/265f368048d5c6d87901db82a470cd9ca3b95320f2c5bbb548336c1c72a6/gradio-4.4.0-py3-none-any.whl (15.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.4/15.4 MB 63.1 MB/s eta 0:00:00 Collecting aiofiles<24.0,>=22.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/19/5af6804c4cc0fed83f47bff6e413a98a36618e7d40185cd36e69737f3b0e/aiofiles-23.2.1-py3-none-any.whl (15 kB) Requirement already satisfied: altair<6.0,>=4.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (5.2.0) Collecting fastapi (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/bf/97/60351307ab4502908d29f64f2801a36709a3f1888447bb328bc373d6ca0e/fastapi-0.109.2-py3-none-any.whl (92 kB) Collecting ffmpy (from gradio==4.4.0) Using cached ffmpy-0.3.2-py3-none-any.whl Collecting gradio-client==0.7.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/34/0d/94ef1fe636519984b50a1a8dc1339601e45af32b9cf7e78c67e595a75c73/gradio_client-0.7.0-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.7/302.7 kB 5.4 MB/s eta 0:00:00 Collecting httpx (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/9b/4937d841aee9c2c8102d9a4eeb800c7dad25386caabb4a1bf5010df81a57/httpx-0.26.0-py3-none-any.whl (75 kB) Requirement already satisfied: huggingface-hub>=0.14.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (0.20.3) Collecting importlib-resources<7.0,>=1.3 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/93/e8/facde510585869b5ec694e8e0363ffe4eba067cb357a8398a55f6a1f8023/importlib_resources-6.1.1-py3-none-any.whl (33 kB) Requirement already satisfied: jinja2<4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (3.1.2) Requirement already satisfied: markupsafe~=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.1.1) Collecting matplotlib~=3.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c1/f2/325897d6c498278b0f8b460d44b516f5db865ddb4ba9018e9fe58a3e4633/matplotlib-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 85.9 MB/s eta 0:00:00 Requirement already satisfied: numpy~=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (1.26.2) Collecting orjson~=3.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/41/41/302b51345b61afb68ce166e4be2ebeef0b86d7aa9f28ca4fcf7c3d612d45/orjson-3.9.14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.0/139.0 kB 6.8 MB/s eta 0:00:00 Requirement already satisfied: packaging in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (23.2) Requirement already satisfied: pandas<3.0,>=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.2.0) Requirement already satisfied: pillow<11.0,>=8.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (9.5.0) Requirement already satisfied: pydantic>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.6.1) Collecting pydub (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/a6/53/d78dc063216e62fc55f6b2eebb447f6a4b0a59f55c8406376f76bf959b08/pydub-0.25.1-py2.py3-none-any.whl (32 kB) Collecting python-multipart (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3d/47/444768600d9e0ebc82f8e347775d24aef8f6348cf00e9fa0e81910814e6d/python_multipart-0.0.9-py3-none-any.whl (22 kB) Requirement already satisfied: pyyaml<7.0,>=5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (6.0.1) Requirement already satisfied: requests~=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.31.0) Collecting semantic-version~=2.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6a/23/8146aad7d88f4fcb3a6218f41a60f6c2d4e3a72de72da1825dc7c8f7877c/semantic_version-2.10.0-py2.py3-none-any.whl (15 kB) Collecting tomlkit==0.12.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/68/4f/12207897848a653d03ebbf6775a29d949408ded5f99b2d87198bc5c93508/tomlkit-0.12.0-py3-none-any.whl (37 kB) Collecting typer<1.0,>=0.9 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bf/0e/c68adf10adda05f28a6ed7b9f4cd7b8e07f641b44af88ba72d9c89e4de7a/typer-0.9.0-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.9/45.9 kB 2.3 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions~=4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (4.7.1) Collecting uvicorn>=0.14.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/fd/bac111726b6c651f1fa5563145ecba5ff70d36fb140a55e0d79b60b9d65e/uvicorn-0.27.1-py3-none-any.whl (60 kB) Requirement already satisfied: fsspec in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio-client==0.7.0->gradio==4.4.0) (2024.2.0) Collecting websockets<12.0,>=10.0 (from gradio-client==0.7.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/58/0a/7570e15661a0a546c3a1152d95fe8c05480459bab36247f0acbf41f01a41/websockets-11.0.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB) Requirement already satisfied: jsonschema>=3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==4.4.0) (4.21.1) Requirement already satisfied: toolz in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==4.4.0) (0.12.1) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==4.4.0) (3.13.1) Requirement already satisfied: tqdm>=4.42.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==4.4.0) (4.66.2) Collecting contourpy>=1.0.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/58/56/e2c43dcfa1f9c7db4d5e3d6f5134b24ed953f4e2133a4b12f0062148db58/contourpy-1.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (310 kB) Collecting cycler>=0.10 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/e7/05/c19819d5e3d95294a6f5947fb9b9629efb316b96de511b418c53d245aae6/cycler-0.12.1-py3-none-any.whl (8.3 kB) Collecting fonttools>=4.22.0 (from matplotlib~=3.0->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/ba/5eac3e9c9bbc2dea3606e46de08bcef0908d74e7ccf89a71701b95a16747/fonttools-4.49.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 53.2 MB/s eta 0:00:00 Collecting kiwisolver>=1.3.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6f/40/4ab1fdb57fced80ce5903f04ae1aed7c1d5939dda4fd0c0aa526c12fe28a/kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) Collecting pyparsing>=2.3.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/92/8486ede85fcc088f1b3dba4ce92dd29d126fd96b0008ea213167940a2475/pyparsing-3.1.1-py3-none-any.whl (103 kB) Requirement already satisfied: python-dateutil>=2.7 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==4.4.0) (2.8.2) Requirement already satisfied: pytz>=2020.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==4.4.0) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==4.4.0) (2024.1) Requirement already satisfied: annotated-types>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=2.0->gradio==4.4.0) (0.6.0) Requirement already satisfied: pydantic-core==2.16.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=2.0->gradio==4.4.0) (2.16.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (2023.11.17) Requirement already satisfied: click<9.0.0,>=7.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer<1.0,>=0.9->typer[all]<1.0,>=0.9->gradio==4.4.0) (8.1.7) Collecting colorama<0.5.0,>=0.4.3 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d1/d6/3965ed04c63042e047cb6a3e6ed1a63a35087b6a609aa3a15ed8ac56c221/colorama-0.4.6-py2.py3-none-any.whl (25 kB) Collecting shellingham<2.0.0,>=1.3.0 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/f9/0595336914c5619e5f28a1fb793285925a8cd4b432c9da0a987836c7f822/shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Requirement already satisfied: rich<14.0.0,>=10.11.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer[all]<1.0,>=0.9->gradio==4.4.0) (13.7.0) Collecting h11>=0.8 (from uvicorn>=0.14.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/95/04/ff642e65ad6b90db43e668d70ffb6736436c7ce41fcc549f4e9472234127/h11-0.14.0-py3-none-any.whl (58 kB) Collecting starlette<0.37.0,>=0.36.3 (from fastapi->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/eb/f7/372e3953b6e6fbfe0b70a1bb52612eae16e943f4288516480860fcd4ac41/starlette-0.36.3-py3-none-any.whl (71 kB) Collecting typing-extensions~=4.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b7/f4/6a90020cd2d93349b442bfcb657d0dc91eee65491600b2cb1d388bc98e6b/typing_extensions-4.9.0-py3-none-any.whl (32 kB) Collecting anyio (from httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/bf/cd/d6d9bb1dadf73e7af02d18225cbd2c93f8552e13130484f1c8dcfece292b/anyio-4.2.0-py3-none-any.whl (85 kB) Collecting httpcore==1.* (from httpx->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/11/a6/24139fa27831cf2127fcf578d6d0a852a611f10cefecd800b1c557333d7a/httpcore-1.0.3-py3-none-any.whl (77 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.0/77.0 kB 3.8 MB/s eta 0:00:00 Collecting sniffio (from httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c3/a0/5dba8ed157b0136607c7f2151db695885606968d1fae123dc3391e0cfdbf/sniffio-1.3.0-py3-none-any.whl (10 kB) Requirement already satisfied: attrs>=22.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (23.2.0) Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (2023.12.1) Requirement already satisfied: referencing>=0.28.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (0.33.0) Requirement already satisfied: rpds-py>=0.7.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (0.18.0) Requirement already satisfied: six>=1.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib~=3.0->gradio==4.4.0) (1.16.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (2.17.2) Collecting exceptiongroup>=1.0.2 (from anyio->httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b8/9a/5028fd52db10e600f1c4674441b968cf2ea4959085bfb5b99fb1250e5f68/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) Requirement already satisfied: mdurl~=0.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (0.1.2) Installing collected packages: pydub, ffmpy, websockets, typing-extensions, tomlkit, sniffio, shellingham, semantic-version, python-multipart, pyparsing, orjson, kiwisolver, importlib-resources, h11, fonttools, exceptiongroup, cycler, contourpy, colorama, aiofiles, uvicorn, typer, matplotlib, httpcore, anyio, starlette, httpx, gradio-client, fastapi, gradio Attempting uninstall: typing-extensions Found existing installation: typing_extensions 4.7.1 Uninstalling typing_extensions-4.7.1: Successfully uninstalled typing_extensions-4.7.1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. triton 2.0.0 requires cmake, which is not installed. triton 2.0.0 requires lit, which is not installed. Successfully installed aiofiles-23.2.1 anyio-4.2.0 colorama-0.4.6 contourpy-1.2.0 cycler-0.12.1 exceptiongroup-1.2.0 fastapi-0.109.2 ffmpy-0.3.2 fonttools-4.49.0 gradio-4.4.0 gradio-client-0.7.0 h11-0.14.0 httpcore-1.0.3 httpx-0.26.0 importlib-resources-6.1.1 kiwisolver-1.4.5 matplotlib-3.8.3 orjson-3.9.14 pydub-0.25.1 pyparsing-3.1.1 python-multipart-0.0.9 semantic-version-2.10.0 shellingham-1.5.4 sniffio-1.3.0 starlette-0.36.3 tomlkit-0.12.0 typer-0.9.0 typing-extensions-4.9.0 uvicorn-0.27.1 websockets-11.0.3 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install chromadb==0.4.15 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting chromadb==0.4.15 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f1/2a/549be867b5ab45112aacd9d113af788768a015e9e6d0ade831b45c1df877/chromadb-0.4.15-py3-none-any.whl (479 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 479.8/479.8 kB 2.8 MB/s eta 0:00:00 Requirement already satisfied: requests>=2.28 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (2.31.0) Requirement already satisfied: pydantic>=1.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (2.6.1) Collecting chroma-hnswlib==0.7.3 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2f/48/f7609a3cb15a24c5d8ec18911ce10ac94144e9a89584f0a86bf9871b024c/chroma_hnswlib-0.7.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 15.7 MB/s eta 0:00:00 Requirement already satisfied: fastapi>=0.95.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.109.2) Requirement already satisfied: uvicorn>=0.18.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) (0.27.1) Collecting posthog>=2.4.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/55/05/81ace5be5e4026c09fb2dfde6ff7862b9133535a471fcec4c2232727160f/posthog-3.4.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.1/41.1 kB 1.4 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions>=4.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (4.9.0) Collecting pulsar-client>=3.1.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/5d/d0/5d9ae2c1732eacbbd679e700027888da14aa4bc491874363450458edcb7e/pulsar_client-3.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 49.9 MB/s eta 0:00:00 Collecting onnxruntime>=1.14.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7c/c8/9131986ad60c900af8790dad66d7422b169daa578d6e047798ff02434c48/onnxruntime-1.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 56.7 MB/s eta 0:00:00 Collecting opentelemetry-api>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fc/2e/a8509051aa446783e24ee03d74bd268c07d5d25a8d48686cfcf3429d5d32/opentelemetry_api-1.22.0-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.9/57.9 kB 3.7 MB/s eta 0:00:00 Collecting opentelemetry-exporter-otlp-proto-grpc>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/88/76/9057dce1afb24204cbe7f1c04629980f7b0f9aa5f5114c39d2e25f24209a/opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl (18 kB) Collecting opentelemetry-sdk>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ff/94/588f49e0dd9a62ec46102736d2378330032a55e19c79ff7e4febea7ebed1/opentelemetry_sdk-1.22.0-py3-none-any.whl (105 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 105.6/105.6 kB 7.9 MB/s eta 0:00:00 Requirement already satisfied: tokenizers>=0.13.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.15.2) Collecting pypika>=0.48.9 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c7/2c/94ed7b91db81d61d7096ac8f2d325ec562fc75e35f3baea8749c85b28784/PyPika-0.48.9.tar.gz (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.3/67.3 kB 4.3 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Installing backend dependencies ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: tqdm>=4.65.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (4.66.2) Collecting overrides>=7.3.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2c/ab/fc8290c6a4c722e5514d80f62b2dc4c4df1a68a41d1364e625c35990fcf3/overrides-7.7.0-py3-none-any.whl (17 kB) Requirement already satisfied: importlib-resources in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (6.1.1) Collecting grpcio>=1.58.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/db/d4/8643b32c1ca0efa31b0a75b33e5750fe1597724bff684128096670eea13d/grpcio-1.60.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 50.3 MB/s eta 0:00:00 Collecting bcrypt>=4.0.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/42/9d/a88027b5a8752f4b1831d957470f48e23cebc112aaf762880f3adbfba9cf/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 10.5 MB/s eta 0:00:00 Requirement already satisfied: typer>=0.9.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.9.0) Collecting kubernetes>=28.1.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/34/164e57fec8a9693d7e6ae2d1a345482020ea9e9b32eab95a90bb3eaea83d/kubernetes-29.0.0-py2.py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 27.9 MB/s eta 0:00:00 Requirement already satisfied: tenacity>=8.2.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (8.2.3) Requirement already satisfied: numpy>=1.22.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (1.26.2) Requirement already satisfied: starlette<0.37.0,>=0.36.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from fastapi>=0.95.2->chromadb==0.4.15) (0.36.3) Requirement already satisfied: certifi>=14.05.14 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (2023.11.17) Requirement already satisfied: six>=1.9.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (1.16.0) Requirement already satisfied: python-dateutil>=2.5.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (2.8.2) Requirement already satisfied: pyyaml>=5.4.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (6.0.1) Collecting google-auth>=1.0.1 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ff/ce/1b4dc8b5ecdc9a99202b093729192b69301c33064d0e312fb8d9e384dbe0/google_auth-2.28.0-py2.py3-none-any.whl (186 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 186.9/186.9 kB 8.5 MB/s eta 0:00:00 Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1e/70/1e88138a9afbed1d37093b85f0bebc3011623c4f47c166431599fe9d6c93/websocket_client-1.7.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.5/58.5 kB 2.9 MB/s eta 0:00:00 Collecting requests-oauthlib (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/bb/5deac77a9af870143c684ab46a7934038a53eb4aa975bc0687ed6ca2c610/requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting oauthlib>=3.2.2 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7e/80/cab10959dc1faead58dc8384a781dfbf93cb4d33d50988f7a69f1b7c9bbe/oauthlib-3.2.2-py3-none-any.whl (151 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 6.2 MB/s eta 0:00:00 Requirement already satisfied: urllib3>=1.24.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (1.26.18) Collecting coloredlogs (from onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a7/06/3d6badcf13db419e25b07041d9c7b4a2c331d3f4e7134445ec5df57714cd/coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 2.0 MB/s eta 0:00:00 Collecting flatbuffers (from onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/12/d5c79ee252793ffe845d58a913197bfa02ae9a0b5c9bc3dc4b58d477b9e7/flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) Requirement already satisfied: packaging in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (23.2) Requirement already satisfied: protobuf in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (4.25.3) Requirement already satisfied: sympy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (1.11.1) Collecting deprecated>=1.2.6 (from opentelemetry-api>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/20/8d/778b7d51b981a96554f29136cd59ca7880bf58094338085bcf2a979a0e6a/Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB) Requirement already satisfied: importlib-metadata<7.0,>=6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from opentelemetry-api>=1.2.0->chromadb==0.4.15) (6.11.0) Collecting backoff<3.0.0,>=1.10.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/df/73/b6e24bd22e6720ca8ee9a85a0c4a2971af8497d8f3193fa05390cbd46e09/backoff-2.2.1-py3-none-any.whl (15 kB) Collecting googleapis-common-protos~=1.52 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f0/43/c9d8f75ddf08e2a0a27db243c13a700c3cc7ec615b545b697cf6f715ad92/googleapis_common_protos-1.62.0-py2.py3-none-any.whl (228 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.7/228.7 kB 8.0 MB/s eta 0:00:00 Collecting opentelemetry-exporter-otlp-proto-common==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ee/75/0972205c139695ff3b21a58063e0e0440a81eaa2c5dd6ef4c1f22f58fdd5/opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl (17 kB) Collecting opentelemetry-proto==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c7/0d/579c664af2f1faca957c3d8c9159ae9fc7a1fe8de7b40a2d2e4fa1832574/opentelemetry_proto-1.22.0-py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.8/50.8 kB 2.3 MB/s eta 0:00:00 Collecting opentelemetry-semantic-conventions==0.43b0 (from opentelemetry-sdk>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/26/69be0f1a56a362c68fa0c7632d841b1b8f29d809bc6b1b897387c9f46973/opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl (36 kB) Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9a/67/7e8406a29b6c45be7af7740456f7f37025f0506ae2e05fb9009a53946860/monotonic-1.6-py2.py3-none-any.whl (8.2 kB) Requirement already satisfied: annotated-types>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=1.9->chromadb==0.4.15) (0.6.0) Requirement already satisfied: pydantic-core==2.16.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=1.9->chromadb==0.4.15) (2.16.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.28->chromadb==0.4.15) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.28->chromadb==0.4.15) (3.4) Requirement already satisfied: huggingface_hub<1.0,>=0.16.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from tokenizers>=0.13.2->chromadb==0.4.15) (0.20.3) Requirement already satisfied: click<9.0.0,>=7.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer>=0.9.0->chromadb==0.4.15) (8.1.7) Requirement already satisfied: h11>=0.8 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn>=0.18.3->uvicorn[standard]>=0.18.3->chromadb==0.4.15) (0.14.0) Collecting httptools>=0.5.0 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/e7/dd5ba95c84047118a363f0755ad78e639e0529be92424bb020496578aa3b/httptools-0.6.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (341 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 341.4/341.4 kB 9.4 MB/s eta 0:00:00 Collecting python-dotenv>=0.13 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/3e/b68c118422ec867fa7ab88444e1274aa40681c606d59ac27de5a5588f082/python_dotenv-1.0.1-py3-none-any.whl (19 kB) Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ab/ed/12729fba5e3b7e02ee70b3ea230b88e60a50375cf63300db22607694d2f0/uvloop-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 59.2 MB/s eta 0:00:00 Collecting watchfiles>=0.13 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f7/4b/b90dcdc3bbaf3bb2db733e1beea2d01566b601c15fcf8e71dfcc8686c097/watchfiles-0.21.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 42.3 MB/s eta 0:00:00 Requirement already satisfied: websockets>=10.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) (11.0.3) Collecting wrapt<2,>=1.10 (from deprecated>=1.2.6->opentelemetry-api>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/49/83/b40bc1ad04a868b5b5bcec86349f06c1ee1ea7afe51dc3e46131e4f39308/wrapt-1.16.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (80 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.3/80.3 kB 5.3 MB/s eta 0:00:00 Requirement already satisfied: cachetools<6.0,>=2.0.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) (5.3.2) Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/cd/8e/bea464350e1b8c6ed0da3a312659cb648804a08af6cacc6435867f74f8bd/pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 10.4 MB/s eta 0:00:00 Collecting rsa<5,>=3.1.4 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/49/97/fa78e3d2f65c02c8e1268b9aba606569fe97f6c8f7c2d74394553347c145/rsa-4.9-py3-none-any.whl (34 kB) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb==0.4.15) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb==0.4.15) (2024.2.0) Requirement already satisfied: zipp>=0.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from importlib-metadata<7.0,>=6.0->opentelemetry-api>=1.2.0->chromadb==0.4.15) (3.17.0) Requirement already satisfied: anyio<5,>=3.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (4.2.0) Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f0/0f/310fb31e39e2d734ccaa2c0fb981ee41f7bd5056ce9bc29b2248bd569169/humanfriendly-10.0-py2.py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 5.2 MB/s eta 0:00:00 Requirement already satisfied: mpmath>=0.19 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sympy->onnxruntime>=1.14.1->chromadb==0.4.15) (1.3.0) Requirement already satisfied: sniffio>=1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from anyio<5,>=3.4.0->starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (1.3.0) Requirement already satisfied: exceptiongroup>=1.0.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from anyio<5,>=3.4.0->starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (1.2.0) Collecting pyasn1<0.6.0,>=0.4.6 (from pyasn1-modules>=0.2.1->google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d1/75/4686d2872bf2fc0b37917cbc8bbf0dd3a5cdb0990799be1b9cbf1e1eb733/pyasn1-0.5.1-py2.py3-none-any.whl (84 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.9/84.9 kB 5.4 MB/s eta 0:00:00 Building wheels for collected packages: pypika Building wheel for pypika (pyproject.toml) ... done Created wheel for pypika: filename=PyPika-0.48.9-py2.py3-none-any.whl size=53723 sha256=9e820bd826f21c74e3dc851ce1794c67a87f7959a2b6beaec86acef05bd55771 Stored in directory: /root/.cache/pip/wheels/06/08/01/e1ce9a2b2e9e51d8540e77461c4cc395c902b9020c296aae50 Successfully built pypika Installing collected packages: pypika, monotonic, flatbuffers, wrapt, websocket-client, uvloop, python-dotenv, pyasn1, pulsar-client, overrides, opentelemetry-semantic-conventions, opentelemetry-proto, oauthlib, humanfriendly, httptools, grpcio, googleapis-common-protos, chroma-hnswlib, bcrypt, backoff, watchfiles, rsa, requests-oauthlib, pyasn1-modules, posthog, opentelemetry-exporter-otlp-proto-common, deprecated, coloredlogs, opentelemetry-api, onnxruntime, google-auth, opentelemetry-sdk, kubernetes, opentelemetry-exporter-otlp-proto-grpc, chromadb Successfully installed backoff-2.2.1 bcrypt-4.1.2 chroma-hnswlib-0.7.3 chromadb-0.4.15 coloredlogs-15.0.1 deprecated-1.2.14 flatbuffers-23.5.26 google-auth-2.28.0 googleapis-common-protos-1.62.0 grpcio-1.60.1 httptools-0.6.1 humanfriendly-10.0 kubernetes-29.0.0 monotonic-1.6 oauthlib-3.2.2 onnxruntime-1.17.0 opentelemetry-api-1.22.0 opentelemetry-exporter-otlp-proto-common-1.22.0 opentelemetry-exporter-otlp-proto-grpc-1.22.0 opentelemetry-proto-1.22.0 opentelemetry-sdk-1.22.0 opentelemetry-semantic-conventions-0.43b0 overrides-7.7.0 posthog-3.4.1 pulsar-client-3.4.0 pyasn1-0.5.1 pyasn1-modules-0.3.0 pypika-0.48.9 python-dotenv-1.0.1 requests-oauthlib-1.3.1 rsa-4.9 uvloop-0.19.0 watchfiles-0.21.0 websocket-client-1.7.0 wrapt-1.16.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install sentence-transformers==2.2.2 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting sentence-transformers==2.2.2 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/20/9c/f07bd70d128fdb107bc02a0c702b9058b4fe147d0ba67b5a0f4c3cf15a54/sentence-transformers-2.2.2.tar.gz (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.0/86.0 kB 968.6 kB/s eta 0:00:00 Preparing metadata (setup.py) ... done Requirement already satisfied: transformers<5.0.0,>=4.6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (4.35.2) Requirement already satisfied: tqdm in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (4.66.2) Requirement already satisfied: torch>=1.6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (2.0.1) Requirement already satisfied: torchvision in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.15.2) Requirement already satisfied: numpy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (1.26.2) Collecting scikit-learn (from sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bc/b9/6a637668d69de04b7f8b917e837aff282950601f09998a5f6c9f23f6642d/scikit_learn-1.4.1.post1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.1/12.1 MB 63.4 MB/s eta 0:00:00 Requirement already satisfied: scipy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (1.12.0) Collecting nltk (from sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/0a/0d20d2c0f16be91b9fa32a77b76c60f9baf6eba419e5ef5deca17af9c582/nltk-3.8.1-py3-none-any.whl (1.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 40.9 MB/s eta 0:00:00 Requirement already satisfied: sentencepiece in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.1.99) Requirement already satisfied: huggingface-hub>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.20.3) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2024.2.0) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2.31.0) Requirement already satisfied: pyyaml>=5.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (6.0.1) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (4.9.0) Requirement already satisfied: packaging>=20.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (23.2) Requirement already satisfied: sympy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (1.11.1) Requirement already satisfied: networkx in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (3.1) Requirement already satisfied: jinja2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (3.1.2) Requirement already satisfied: regex!=2019.12.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (2023.12.25) Requirement already satisfied: tokenizers<0.19,>=0.14 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (0.15.2) Requirement already satisfied: safetensors>=0.3.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (0.4.2) Requirement already satisfied: click in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->sentence-transformers==2.2.2) (8.1.7) Collecting joblib (from nltk->sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/10/40/d551139c85db202f1f384ba8bcf96aca2f329440a844f924c8a0040b6d02/joblib-1.3.2-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 9.2 MB/s eta 0:00:00 Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b1/2c/f504e55d98418f2fcf756a56877e6d9a45dd5ed28b3d7c267b300e85ad5b/threadpoolctl-3.3.0-py3-none-any.whl (17 kB) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torchvision->sentence-transformers==2.2.2) (9.5.0) Requirement already satisfied: MarkupSafe>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jinja2->torch>=1.6.0->sentence-transformers==2.2.2) (2.1.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2023.11.17) Requirement already satisfied: mpmath>=0.19 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers==2.2.2) (1.3.0) Building wheels for collected packages: sentence-transformers Building wheel for sentence-transformers (setup.py) ... done Created wheel for sentence-transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=6b3b9561ed651ab64c69d352e7f04f0f724ba58ccce3d3295852c7ab41a8b982 Stored in directory: /root/.cache/pip/wheels/66/0c/99/a3942d61ac4446e2d615ed4634a1f3ed69a37728e5ac184cf3 Successfully built sentence-transformers Installing collected packages: threadpoolctl, joblib, scikit-learn, nltk, sentence-transformers Successfully installed joblib-1.3.2 nltk-3.8.1 scikit-learn-1.4.1.post1 sentence-transformers-2.2.2 threadpoolctl-3.3.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install unstructured==0.10.30 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting unstructured==0.10.30 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e3/95/28c08bbdd98a9bdbb7f52c07c0e81090ea5f89af5b6cac7c7c6d86ce2a5e/unstructured-0.10.30-py3-none-any.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 7.8 MB/s eta 0:00:00 Collecting chardet (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/38/6f/f5fbc992a329ee4e0f288c1fe0e2ad9485ed064cac731ed2fe47dcc38cbf/chardet-5.2.0-py3-none-any.whl (199 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 11.4 MB/s eta 0:00:00 Collecting filetype (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/18/79/1b8fa1bb3568781e84c9200f951c735f3f157429f44be0495da55894d620/filetype-1.2.0-py2.py3-none-any.whl (19 kB) Collecting python-magic (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6c/73/9f872cb81fc5c3bb48f7227872c28975f998f3e7c2b1c16e95e6432bbb90/python_magic-0.4.27-py2.py3-none-any.whl (13 kB) Collecting lxml (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/25/5c/979167df4ca5a1c308105bb1590412c54bd1b0baa1883212f39cb42d4fcd/lxml-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.0/8.0 MB 62.5 MB/s eta 0:00:00 Requirement already satisfied: nltk in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (3.8.1) Collecting tabulate (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/40/44/4a5f08c96eb108af5cb50b41f76142f0afa346dfa99d5296fe7202a11854/tabulate-0.9.0-py3-none-any.whl (35 kB) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (2.31.0) Collecting beautifulsoup4 (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b1/fe/e8c672695b37eecc5cbf43e1d0638d88d66ba3a44c4d321c796f4e59167f/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.9/147.9 kB 6.8 MB/s eta 0:00:00 Collecting emoji (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/98/00/00d56e704d69cee4a92b1d517676579b4af5f2f8bc72946c464a504705b2/emoji-2.10.1-py2.py3-none-any.whl (421 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 421.5/421.5 kB 11.8 MB/s eta 0:00:00 Requirement already satisfied: dataclasses-json in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (0.5.14) Collecting python-iso639 (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/01/62/2fed44ba10fe805345fb0e9c46c7f8dcdaf1bffd642f051fcc3db9bf55d8/python_iso639-2024.2.7-py3-none-any.whl (274 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 274.7/274.7 kB 6.5 MB/s eta 0:00:00 Collecting langdetect (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/0e/72/a3add0e4eec4eb9e2569554f7c70f4a3c27712f40e3284d483e88094cc0e/langdetect-1.0.9.tar.gz (981 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 981.5/981.5 kB 27.2 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Requirement already satisfied: numpy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (1.26.2) Collecting rapidfuzz (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/02/39/3f94121e21b78e0a2699b272a8906ee5eb6f9d70082d90784464b0a4fcc8/rapidfuzz-3.6.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 54.0 MB/s eta 0:00:00 Requirement already satisfied: backoff in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (2.2.1) Requirement already satisfied: typing-extensions in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (4.9.0) Collecting soupsieve>1.2 (from beautifulsoup4->unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl (36 kB) Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from dataclasses-json->unstructured==0.10.30) (3.20.2) Requirement already satisfied: typing-inspect<1,>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from dataclasses-json->unstructured==0.10.30) (0.9.0) Requirement already satisfied: six in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langdetect->unstructured==0.10.30) (1.16.0) Requirement already satisfied: click in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (8.1.7) Requirement already satisfied: joblib in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (1.3.2) Requirement already satisfied: regex>=2021.8.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (2023.12.25) Requirement already satisfied: tqdm in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (4.66.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (2023.11.17) Requirement already satisfied: packaging>=17.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->unstructured==0.10.30) (23.2) Requirement already satisfied: mypy-extensions>=0.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typing-inspect<1,>=0.4.0->dataclasses-json->unstructured==0.10.30) (1.0.0) Building wheels for collected packages: langdetect Building wheel for langdetect (setup.py) ... done Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993224 sha256=76cfd25e44e53b8b0e53f438122aa9c4351991aa70793d77eaeb7f3e659d29a2 Stored in directory: /root/.cache/pip/wheels/ee/e9/63/fe12d571f8675325c5e131236f64a52b7ed05da124bd628a74 Successfully built langdetect Installing collected packages: filetype, tabulate, soupsieve, rapidfuzz, python-magic, python-iso639, lxml, langdetect, emoji, chardet, beautifulsoup4, unstructured Successfully installed beautifulsoup4-4.12.3 chardet-5.2.0 emoji-2.10.1 filetype-1.2.0 langdetect-1.0.9 lxml-5.1.0 python-iso639-2024.2.7 python-magic-0.4.27 rapidfuzz-3.6.1 soupsieve-2.5 tabulate-0.9.0 unstructured-0.10.30 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install markdown==3.3.7
(InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install markdown==3.3.7
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting markdown==3.3.7
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f3/df/ca72f352e15b6f8ce32b74af029f1189abffb906f7c137501ffe69c98a65/Markdown-3.3.7-py3-none-any.whl (97 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.8/97.8 kB 938.8 kB/s eta 0:00:00
Installing collected packages: markdown
Successfully installed markdown-3.3.7
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
(InternLM) root@intern-studio-069640:/opt/jupyterlab#
接下来安装开源向量模型。首先需要使用 huggingface 官方提供的 huggingface-cli 命令行工具。安装依赖:
pip install -U huggingface_hub
屏幕输出：
(InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install -U huggingface_hub Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Requirement already satisfied: huggingface_hub in /root/.conda/envs/InternLM/lib/python3.10/site-packages (0.20.3) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (2024.2.0) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (2.31.0) Requirement already satisfied: tqdm>=4.42.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (4.66.2) Requirement already satisfied: pyyaml>=5.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (6.0.1) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (4.9.0) Requirement already satisfied: packaging>=20.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (23.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (2023.11.17) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab#
在/root/data/目录下建立download_hf.py文件，其代码如下：
import os # 下载模型 os.system('huggingface-cli download --resume-download sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 --local-dir /root/data/model/sentence-transformer')
切换到/root/data目录，执行上述python脚本：
屏幕输出：
(InternLM) root@intern-studio-069640:~/data# python download_hf.py Consider using `hf_transfer` for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 14 files: 0%| | 0/14 [00:00<?, ?it/s]downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/.gitattributes to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/ef4a55971246c7825073cfa3690eeda3d967f376.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/1_Pooling/config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/d1514c3162bbe87b343f565fadc62e6c06f04f03.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/config_sentence_transformers.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/b974b349cb2d419ada11181750a733ff82f291ad.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/README.md to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/065b011b76fe98894d8975acfa28f028085fa35b.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/sentence_bert_config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/5fd10429389515d3e5cccdeda08cae5fea1ae82e.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/modules.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/f7640f94e81bb7f4f04daf1668850b38763a13d9.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/c06d5b49495f044e6380e68a60538be17a6bd5d1.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/pytorch_model.bin to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/16cc9e54df6e083272378abec2d75dc34d7a48b5276db3ccc050d18de672ac59.incomplete .gitattributes: 968B [00:00, 2.24MB/s] 1_Pooling/config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 190/190 [00:00<00:00, 1.02MB/s] config_sentence_transformers.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 122/122 [00:00<00:00, 1.35MB/s] README.md: 4.12kB [00:00, 14.5MB/s] sentence_bert_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 53.0/53.0 [00:00<00:00, 387kB/s] modules.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 229/229 [00:00<00:00, 2.64MB/s] config.json: 645B [00:00, 6.97MB/s] Fetching 14 files: 29%|███████████████████████████████████████████████▍ | 4/14 [00:01<00:02, 4.62it/s]downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/sentencepiece.bpe.model to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/cfc8146abe2a0488e9e2a0c56de7952f7c11ab059eca145a0a727afce0db2865.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/special_tokens_map.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tokenizer.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/2c3387be76557bd40970cec13153b3bbf80407865484b209e655e5e4729076b8.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tf_model.h5 to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/22150b6ba00e477c7f816f1988d028fff924e2b52e14540889690c72c5add40e.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tokenizer_config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/0da3507018a1a1c625ff93179ff60bdb9202cc6c.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/unigram.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/71b44701d7efd054205115acfa6ef126c5d2f84bd3affe0c59e48163674d19a6.incomplete special_tokens_map.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 239/239 [00:00<00:00, 2.12MB/s] tokenizer_config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 480/480 [00:00<00:00, 4.65MB/s] unigram.json: 14.8MB [00:02, 5.12MB/s] | 0.00/480 [00:00<?, ?B/s] sentencepiece.bpe.model: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5.07M/5.07M [00:02<00:00, 2.03MB/s] tokenizer.json: 9.08MB [00:02, 3.37MB/s] | 0.00/471M [00:00<?, ?B/s] pytorch_model.bin: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [01:02<00:00, 7.52MB/s] Fetching 14 files: 50%|███████████████████████████████████████████████████████████████████████████████████ | 7/14 [01:05<01:21, 11.61s/it] tf_model.h5: 49%|██████████████████████████████████████████████████████████████████████████████████▎ | 231M/471M [00:57<01:50, 2.17MB/s] tf_model.h5: 71%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▍ | 336M/471M [09:07<08:57, 252kB/s] pytorch_model.bin: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [01:02<00:00, 7.67MB/s] c tf_model.h5: 73%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ | 346M/471M [10:12<10:19, 202kB/s] tf_model.h5: 78%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▋ | 367M/471M [10:32<05:00, 346kB/s Downloading https://pypi.tuna.tsinghua.edu.cn/packages/86/dc/e2c7599b03455ea675107472b60e836f693ac8453e7c1119b61e6e60f574/langchain-0.0.292-py3-none-any.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 8.3 MB/s eta 0:00:00 Requirement already satisfied: PyYAML>=5.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (6.0.1) Collecting SQLAlchemy<3,>=1.4 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/52/35/07882bf478515af007b7c3809fae9dbfa38f5bdd089efd31ce6abdbe66a5/SQLAlchemy-2.0.27-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 33.2 MB/s eta 0:00:00 Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (3.9.3) Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (4.0.3) Collecting dataclasses-json<0.6.0,>=0.5.7 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/5f/e7cc90f36152810cab08b6c9c1125e8bcb9d76f8b3018d101b5f877b386c/dataclasses_json-0.5.14-py3-none-any.whl (26 kB) Collecting langsmith<0.1.0,>=0.0.21 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/97/cd/1c618f89d3fcbb375c99a3ea950bffba8a01862cc0f0ab5032dfb95e8d1e/langsmith-0.0.92-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.5/56.5 kB 2.2 MB/s eta 0:00:00 Collecting numexpr<3.0.0,>=2.8.4 (from langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4a/39/cc88cdade7fb8e409efb63b79c22cfbea7c9c15249e375dfbaf86984dece/numexpr-2.9.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (375 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 375.2/375.2 kB 16.1 MB/s eta 0:00:00 Requirement already satisfied: numpy<2,>=1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (1.26.2) Collecting pydantic<3,>=1 (from langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/db/dc/afecbd9650f486889181c6d1a0d675b580c06253ea7e304588e4c7485bdb/pydantic-2.6.1-py3-none-any.whl (394 kB) Requirement already satisfied: requests<3,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (2.31.0) Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langchain==0.0.292) (8.2.3) Requirement already satisfied: aiosignal>=1.1.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (23.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain==0.0.292) (1.9.4) Collecting marshmallow<4.0.0,>=3.18.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/57/e9/4368d49d3b462da16a3bac976487764a84dd85cef97232c7bd61f5bdedf3/marshmallow-3.20.2-py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.4/49.4 kB 1.8 MB/s eta 0:00:00 Collecting typing-inspect<1,>=0.4.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/f3/107a22063bf27bdccf2024833d3445f4eea42b2e598abfbd46f6a63b6cb0/typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) Collecting annotated-types>=0.4.0 (from pydantic<3,>=1->langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/28/78/d31230046e58c207284c6b2c4e8d96e6d3cb4e52354721b944d3e1ee4aa5/annotated_types-0.6.0-py3-none-any.whl (12 kB) Collecting pydantic-core==2.16.2 (from pydantic<3,>=1->langchain==0.0.292) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/50/5e/2978d9f0e8d0cfd78e22115c028a41e0599e3d684e5aef7ed9bd18fcbd0c/pydantic_core-2.16.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) Requirement already satisfied: typing-extensions>=4.6.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic<3,>=1->langchain==0.0.292) (4.7.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests<3,>=2->langchain==0.0.292) (2023.11.17) Collecting greenlet!=0.4.17 (from SQLAlchemy<3,>=1.4->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/24/35/945d5b10648fec9b20bcc6df8952d20bb3bba76413cd71c1fdbee98f5616/greenlet-3.0.3-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (616 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 616.0/616.0 kB 11.1 MB/s eta 0:00:00 Requirement already satisfied: packaging>=17.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) (23.2) Collecting mypy-extensions>=0.3.0 (from typing-inspect<1,>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain==0.0.292) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2a/e2/5d3f6ada4297caebe1a2add3b126fe800c96f56dbe5d1988a2cbe0b267aa/mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) Installing collected packages: pydantic-core, numexpr, mypy-extensions, marshmallow, greenlet, annotated-types, typing-inspect, SQLAlchemy, pydantic, langsmith, dataclasses-json, langchain Successfully installed SQLAlchemy-2.0.27 annotated-types-0.6.0 dataclasses-json-0.5.14 greenlet-3.0.3 langchain-0.0.292 langsmith-0.0.92 marshmallow-3.20.2 mypy-extensions-1.0.0 numexpr-2.9.0 pydantic-2.6.1 pydantic-core-2.16.2 typing-inspect-0.9.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install gradio==4.4.0 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting gradio==4.4.0 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bc/d7/265f368048d5c6d87901db82a470cd9ca3b95320f2c5bbb548336c1c72a6/gradio-4.4.0-py3-none-any.whl (15.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.4/15.4 MB 63.1 MB/s eta 0:00:00 Collecting aiofiles<24.0,>=22.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c5/19/5af6804c4cc0fed83f47bff6e413a98a36618e7d40185cd36e69737f3b0e/aiofiles-23.2.1-py3-none-any.whl (15 kB) Requirement already satisfied: altair<6.0,>=4.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (5.2.0) Collecting fastapi (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/bf/97/60351307ab4502908d29f64f2801a36709a3f1888447bb328bc373d6ca0e/fastapi-0.109.2-py3-none-any.whl (92 kB) Collecting ffmpy (from gradio==4.4.0) Using cached ffmpy-0.3.2-py3-none-any.whl Collecting gradio-client==0.7.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/34/0d/94ef1fe636519984b50a1a8dc1339601e45af32b9cf7e78c67e595a75c73/gradio_client-0.7.0-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.7/302.7 kB 5.4 MB/s eta 0:00:00 Collecting httpx (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/9b/4937d841aee9c2c8102d9a4eeb800c7dad25386caabb4a1bf5010df81a57/httpx-0.26.0-py3-none-any.whl (75 kB) Requirement already satisfied: huggingface-hub>=0.14.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (0.20.3) Collecting importlib-resources<7.0,>=1.3 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/93/e8/facde510585869b5ec694e8e0363ffe4eba067cb357a8398a55f6a1f8023/importlib_resources-6.1.1-py3-none-any.whl (33 kB) Requirement already satisfied: jinja2<4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (3.1.2) Requirement already satisfied: markupsafe~=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.1.1) Collecting matplotlib~=3.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c1/f2/325897d6c498278b0f8b460d44b516f5db865ddb4ba9018e9fe58a3e4633/matplotlib-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 85.9 MB/s eta 0:00:00 Requirement already satisfied: numpy~=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (1.26.2) Collecting orjson~=3.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/41/41/302b51345b61afb68ce166e4be2ebeef0b86d7aa9f28ca4fcf7c3d612d45/orjson-3.9.14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.0/139.0 kB 6.8 MB/s eta 0:00:00 Requirement already satisfied: packaging in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (23.2) Requirement already satisfied: pandas<3.0,>=1.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.2.0) Requirement already satisfied: pillow<11.0,>=8.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (9.5.0) Requirement already satisfied: pydantic>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.6.1) Collecting pydub (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/a6/53/d78dc063216e62fc55f6b2eebb447f6a4b0a59f55c8406376f76bf959b08/pydub-0.25.1-py2.py3-none-any.whl (32 kB) Collecting python-multipart (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3d/47/444768600d9e0ebc82f8e347775d24aef8f6348cf00e9fa0e81910814e6d/python_multipart-0.0.9-py3-none-any.whl (22 kB) Requirement already satisfied: pyyaml<7.0,>=5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (6.0.1) Requirement already satisfied: requests~=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (2.31.0) Collecting semantic-version~=2.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6a/23/8146aad7d88f4fcb3a6218f41a60f6c2d4e3a72de72da1825dc7c8f7877c/semantic_version-2.10.0-py2.py3-none-any.whl (15 kB) Collecting tomlkit==0.12.0 (from gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/68/4f/12207897848a653d03ebbf6775a29d949408ded5f99b2d87198bc5c93508/tomlkit-0.12.0-py3-none-any.whl (37 kB) Collecting typer<1.0,>=0.9 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bf/0e/c68adf10adda05f28a6ed7b9f4cd7b8e07f641b44af88ba72d9c89e4de7a/typer-0.9.0-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.9/45.9 kB 2.3 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions~=4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio==4.4.0) (4.7.1) Collecting uvicorn>=0.14.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/fd/bac111726b6c651f1fa5563145ecba5ff70d36fb140a55e0d79b60b9d65e/uvicorn-0.27.1-py3-none-any.whl (60 kB) Requirement already satisfied: fsspec in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from gradio-client==0.7.0->gradio==4.4.0) (2024.2.0) Collecting websockets<12.0,>=10.0 (from gradio-client==0.7.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/58/0a/7570e15661a0a546c3a1152d95fe8c05480459bab36247f0acbf41f01a41/websockets-11.0.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB) Requirement already satisfied: jsonschema>=3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==4.4.0) (4.21.1) Requirement already satisfied: toolz in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==4.4.0) (0.12.1) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==4.4.0) (3.13.1) Requirement already satisfied: tqdm>=4.42.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==4.4.0) (4.66.2) Collecting contourpy>=1.0.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/58/56/e2c43dcfa1f9c7db4d5e3d6f5134b24ed953f4e2133a4b12f0062148db58/contourpy-1.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (310 kB) Collecting cycler>=0.10 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/e7/05/c19819d5e3d95294a6f5947fb9b9629efb316b96de511b418c53d245aae6/cycler-0.12.1-py3-none-any.whl (8.3 kB) Collecting fonttools>=4.22.0 (from matplotlib~=3.0->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/ba/5eac3e9c9bbc2dea3606e46de08bcef0908d74e7ccf89a71701b95a16747/fonttools-4.49.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 53.2 MB/s eta 0:00:00 Collecting kiwisolver>=1.3.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6f/40/4ab1fdb57fced80ce5903f04ae1aed7c1d5939dda4fd0c0aa526c12fe28a/kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) Collecting pyparsing>=2.3.1 (from matplotlib~=3.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/92/8486ede85fcc088f1b3dba4ce92dd29d126fd96b0008ea213167940a2475/pyparsing-3.1.1-py3-none-any.whl (103 kB) Requirement already satisfied: python-dateutil>=2.7 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==4.4.0) (2.8.2) Requirement already satisfied: pytz>=2020.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==4.4.0) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==4.4.0) (2024.1) Requirement already satisfied: annotated-types>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=2.0->gradio==4.4.0) (0.6.0) Requirement already satisfied: pydantic-core==2.16.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=2.0->gradio==4.4.0) (2.16.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests~=2.0->gradio==4.4.0) (2023.11.17) Requirement already satisfied: click<9.0.0,>=7.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer<1.0,>=0.9->typer[all]<1.0,>=0.9->gradio==4.4.0) (8.1.7) Collecting colorama<0.5.0,>=0.4.3 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d1/d6/3965ed04c63042e047cb6a3e6ed1a63a35087b6a609aa3a15ed8ac56c221/colorama-0.4.6-py2.py3-none-any.whl (25 kB) Collecting shellingham<2.0.0,>=1.3.0 (from typer[all]<1.0,>=0.9->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/f9/0595336914c5619e5f28a1fb793285925a8cd4b432c9da0a987836c7f822/shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Requirement already satisfied: rich<14.0.0,>=10.11.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer[all]<1.0,>=0.9->gradio==4.4.0) (13.7.0) Collecting h11>=0.8 (from uvicorn>=0.14.0->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/95/04/ff642e65ad6b90db43e668d70ffb6736436c7ce41fcc549f4e9472234127/h11-0.14.0-py3-none-any.whl (58 kB) Collecting starlette<0.37.0,>=0.36.3 (from fastapi->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/eb/f7/372e3953b6e6fbfe0b70a1bb52612eae16e943f4288516480860fcd4ac41/starlette-0.36.3-py3-none-any.whl (71 kB) Collecting typing-extensions~=4.0 (from gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b7/f4/6a90020cd2d93349b442bfcb657d0dc91eee65491600b2cb1d388bc98e6b/typing_extensions-4.9.0-py3-none-any.whl (32 kB) Collecting anyio (from httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/bf/cd/d6d9bb1dadf73e7af02d18225cbd2c93f8552e13130484f1c8dcfece292b/anyio-4.2.0-py3-none-any.whl (85 kB) Collecting httpcore==1.* (from httpx->gradio==4.4.0) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/11/a6/24139fa27831cf2127fcf578d6d0a852a611f10cefecd800b1c557333d7a/httpcore-1.0.3-py3-none-any.whl (77 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.0/77.0 kB 3.8 MB/s eta 0:00:00 Collecting sniffio (from httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c3/a0/5dba8ed157b0136607c7f2151db695885606968d1fae123dc3391e0cfdbf/sniffio-1.3.0-py3-none-any.whl (10 kB) Requirement already satisfied: attrs>=22.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (23.2.0) Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (2023.12.1) Requirement already satisfied: referencing>=0.28.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (0.33.0) Requirement already satisfied: rpds-py>=0.7.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==4.4.0) (0.18.0) Requirement already satisfied: six>=1.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib~=3.0->gradio==4.4.0) (1.16.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (2.17.2) Collecting exceptiongroup>=1.0.2 (from anyio->httpx->gradio==4.4.0) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b8/9a/5028fd52db10e600f1c4674441b968cf2ea4959085bfb5b99fb1250e5f68/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) Requirement already satisfied: mdurl~=0.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich<14.0.0,>=10.11.0->typer[all]<1.0,>=0.9->gradio==4.4.0) (0.1.2) Installing collected packages: pydub, ffmpy, websockets, typing-extensions, tomlkit, sniffio, shellingham, semantic-version, python-multipart, pyparsing, orjson, kiwisolver, importlib-resources, h11, fonttools, exceptiongroup, cycler, contourpy, colorama, aiofiles, uvicorn, typer, matplotlib, httpcore, anyio, starlette, httpx, gradio-client, fastapi, gradio Attempting uninstall: typing-extensions Found existing installation: typing_extensions 4.7.1 Uninstalling typing_extensions-4.7.1: Successfully uninstalled typing_extensions-4.7.1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. triton 2.0.0 requires cmake, which is not installed. triton 2.0.0 requires lit, which is not installed. Successfully installed aiofiles-23.2.1 anyio-4.2.0 colorama-0.4.6 contourpy-1.2.0 cycler-0.12.1 exceptiongroup-1.2.0 fastapi-0.109.2 ffmpy-0.3.2 fonttools-4.49.0 gradio-4.4.0 gradio-client-0.7.0 h11-0.14.0 httpcore-1.0.3 httpx-0.26.0 importlib-resources-6.1.1 kiwisolver-1.4.5 matplotlib-3.8.3 orjson-3.9.14 pydub-0.25.1 pyparsing-3.1.1 python-multipart-0.0.9 semantic-version-2.10.0 shellingham-1.5.4 sniffio-1.3.0 starlette-0.36.3 tomlkit-0.12.0 typer-0.9.0 typing-extensions-4.9.0 uvicorn-0.27.1 websockets-11.0.3 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install chromadb==0.4.15 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting chromadb==0.4.15 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f1/2a/549be867b5ab45112aacd9d113af788768a015e9e6d0ade831b45c1df877/chromadb-0.4.15-py3-none-any.whl (479 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 479.8/479.8 kB 2.8 MB/s eta 0:00:00 Requirement already satisfied: requests>=2.28 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (2.31.0) Requirement already satisfied: pydantic>=1.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (2.6.1) Collecting chroma-hnswlib==0.7.3 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2f/48/f7609a3cb15a24c5d8ec18911ce10ac94144e9a89584f0a86bf9871b024c/chroma_hnswlib-0.7.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 15.7 MB/s eta 0:00:00 Requirement already satisfied: fastapi>=0.95.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.109.2) Requirement already satisfied: uvicorn>=0.18.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) (0.27.1) Collecting posthog>=2.4.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/55/05/81ace5be5e4026c09fb2dfde6ff7862b9133535a471fcec4c2232727160f/posthog-3.4.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.1/41.1 kB 1.4 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions>=4.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (4.9.0) Collecting pulsar-client>=3.1.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/5d/d0/5d9ae2c1732eacbbd679e700027888da14aa4bc491874363450458edcb7e/pulsar_client-3.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 49.9 MB/s eta 0:00:00 Collecting onnxruntime>=1.14.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7c/c8/9131986ad60c900af8790dad66d7422b169daa578d6e047798ff02434c48/onnxruntime-1.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (6.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 56.7 MB/s eta 0:00:00 Collecting opentelemetry-api>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fc/2e/a8509051aa446783e24ee03d74bd268c07d5d25a8d48686cfcf3429d5d32/opentelemetry_api-1.22.0-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.9/57.9 kB 3.7 MB/s eta 0:00:00 Collecting opentelemetry-exporter-otlp-proto-grpc>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/88/76/9057dce1afb24204cbe7f1c04629980f7b0f9aa5f5114c39d2e25f24209a/opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl (18 kB) Collecting opentelemetry-sdk>=1.2.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ff/94/588f49e0dd9a62ec46102736d2378330032a55e19c79ff7e4febea7ebed1/opentelemetry_sdk-1.22.0-py3-none-any.whl (105 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 105.6/105.6 kB 7.9 MB/s eta 0:00:00 Requirement already satisfied: tokenizers>=0.13.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.15.2) Collecting pypika>=0.48.9 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c7/2c/94ed7b91db81d61d7096ac8f2d325ec562fc75e35f3baea8749c85b28784/PyPika-0.48.9.tar.gz (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.3/67.3 kB 4.3 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Installing backend dependencies ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: tqdm>=4.65.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (4.66.2) Collecting overrides>=7.3.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/2c/ab/fc8290c6a4c722e5514d80f62b2dc4c4df1a68a41d1364e625c35990fcf3/overrides-7.7.0-py3-none-any.whl (17 kB) Requirement already satisfied: importlib-resources in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (6.1.1) Collecting grpcio>=1.58.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/db/d4/8643b32c1ca0efa31b0a75b33e5750fe1597724bff684128096670eea13d/grpcio-1.60.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 50.3 MB/s eta 0:00:00 Collecting bcrypt>=4.0.1 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/42/9d/a88027b5a8752f4b1831d957470f48e23cebc112aaf762880f3adbfba9cf/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 10.5 MB/s eta 0:00:00 Requirement already satisfied: typer>=0.9.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (0.9.0) Collecting kubernetes>=28.1.0 (from chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/34/164e57fec8a9693d7e6ae2d1a345482020ea9e9b32eab95a90bb3eaea83d/kubernetes-29.0.0-py2.py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 27.9 MB/s eta 0:00:00 Requirement already satisfied: tenacity>=8.2.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (8.2.3) Requirement already satisfied: numpy>=1.22.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from chromadb==0.4.15) (1.26.2) Requirement already satisfied: starlette<0.37.0,>=0.36.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from fastapi>=0.95.2->chromadb==0.4.15) (0.36.3) Requirement already satisfied: certifi>=14.05.14 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (2023.11.17) Requirement already satisfied: six>=1.9.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (1.16.0) Requirement already satisfied: python-dateutil>=2.5.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (2.8.2) Requirement already satisfied: pyyaml>=5.4.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (6.0.1) Collecting google-auth>=1.0.1 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ff/ce/1b4dc8b5ecdc9a99202b093729192b69301c33064d0e312fb8d9e384dbe0/google_auth-2.28.0-py2.py3-none-any.whl (186 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 186.9/186.9 kB 8.5 MB/s eta 0:00:00 Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1e/70/1e88138a9afbed1d37093b85f0bebc3011623c4f47c166431599fe9d6c93/websocket_client-1.7.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.5/58.5 kB 2.9 MB/s eta 0:00:00 Collecting requests-oauthlib (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/bb/5deac77a9af870143c684ab46a7934038a53eb4aa975bc0687ed6ca2c610/requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting oauthlib>=3.2.2 (from kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7e/80/cab10959dc1faead58dc8384a781dfbf93cb4d33d50988f7a69f1b7c9bbe/oauthlib-3.2.2-py3-none-any.whl (151 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 6.2 MB/s eta 0:00:00 Requirement already satisfied: urllib3>=1.24.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from kubernetes>=28.1.0->chromadb==0.4.15) (1.26.18) Collecting coloredlogs (from onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a7/06/3d6badcf13db419e25b07041d9c7b4a2c331d3f4e7134445ec5df57714cd/coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 2.0 MB/s eta 0:00:00 Collecting flatbuffers (from onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6f/12/d5c79ee252793ffe845d58a913197bfa02ae9a0b5c9bc3dc4b58d477b9e7/flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) Requirement already satisfied: packaging in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (23.2) Requirement already satisfied: protobuf in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (4.25.3) Requirement already satisfied: sympy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from onnxruntime>=1.14.1->chromadb==0.4.15) (1.11.1) Collecting deprecated>=1.2.6 (from opentelemetry-api>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/20/8d/778b7d51b981a96554f29136cd59ca7880bf58094338085bcf2a979a0e6a/Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB) Requirement already satisfied: importlib-metadata<7.0,>=6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from opentelemetry-api>=1.2.0->chromadb==0.4.15) (6.11.0) Collecting backoff<3.0.0,>=1.10.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/df/73/b6e24bd22e6720ca8ee9a85a0c4a2971af8497d8f3193fa05390cbd46e09/backoff-2.2.1-py3-none-any.whl (15 kB) Collecting googleapis-common-protos~=1.52 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f0/43/c9d8f75ddf08e2a0a27db243c13a700c3cc7ec615b545b697cf6f715ad92/googleapis_common_protos-1.62.0-py2.py3-none-any.whl (228 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.7/228.7 kB 8.0 MB/s eta 0:00:00 Collecting opentelemetry-exporter-otlp-proto-common==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ee/75/0972205c139695ff3b21a58063e0e0440a81eaa2c5dd6ef4c1f22f58fdd5/opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl (17 kB) Collecting opentelemetry-proto==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c7/0d/579c664af2f1faca957c3d8c9159ae9fc7a1fe8de7b40a2d2e4fa1832574/opentelemetry_proto-1.22.0-py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.8/50.8 kB 2.3 MB/s eta 0:00:00 Collecting opentelemetry-semantic-conventions==0.43b0 (from opentelemetry-sdk>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/26/69be0f1a56a362c68fa0c7632d841b1b8f29d809bc6b1b897387c9f46973/opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl (36 kB) Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9a/67/7e8406a29b6c45be7af7740456f7f37025f0506ae2e05fb9009a53946860/monotonic-1.6-py2.py3-none-any.whl (8.2 kB) Requirement already satisfied: annotated-types>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=1.9->chromadb==0.4.15) (0.6.0) Requirement already satisfied: pydantic-core==2.16.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from pydantic>=1.9->chromadb==0.4.15) (2.16.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.28->chromadb==0.4.15) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests>=2.28->chromadb==0.4.15) (3.4) Requirement already satisfied: huggingface_hub<1.0,>=0.16.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from tokenizers>=0.13.2->chromadb==0.4.15) (0.20.3) Requirement already satisfied: click<9.0.0,>=7.1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typer>=0.9.0->chromadb==0.4.15) (8.1.7) Requirement already satisfied: h11>=0.8 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn>=0.18.3->uvicorn[standard]>=0.18.3->chromadb==0.4.15) (0.14.0) Collecting httptools>=0.5.0 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/e7/dd5ba95c84047118a363f0755ad78e639e0529be92424bb020496578aa3b/httptools-0.6.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (341 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 341.4/341.4 kB 9.4 MB/s eta 0:00:00 Collecting python-dotenv>=0.13 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/3e/b68c118422ec867fa7ab88444e1274aa40681c606d59ac27de5a5588f082/python_dotenv-1.0.1-py3-none-any.whl (19 kB) Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/ab/ed/12729fba5e3b7e02ee70b3ea230b88e60a50375cf63300db22607694d2f0/uvloop-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 59.2 MB/s eta 0:00:00 Collecting watchfiles>=0.13 (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f7/4b/b90dcdc3bbaf3bb2db733e1beea2d01566b601c15fcf8e71dfcc8686c097/watchfiles-0.21.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 42.3 MB/s eta 0:00:00 Requirement already satisfied: websockets>=10.4 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from uvicorn[standard]>=0.18.3->chromadb==0.4.15) (11.0.3) Collecting wrapt<2,>=1.10 (from deprecated>=1.2.6->opentelemetry-api>=1.2.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/49/83/b40bc1ad04a868b5b5bcec86349f06c1ee1ea7afe51dc3e46131e4f39308/wrapt-1.16.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (80 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.3/80.3 kB 5.3 MB/s eta 0:00:00 Requirement already satisfied: cachetools<6.0,>=2.0.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) (5.3.2) Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/cd/8e/bea464350e1b8c6ed0da3a312659cb648804a08af6cacc6435867f74f8bd/pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 10.4 MB/s eta 0:00:00 Collecting rsa<5,>=3.1.4 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/49/97/fa78e3d2f65c02c8e1268b9aba606569fe97f6c8f7c2d74394553347c145/rsa-4.9-py3-none-any.whl (34 kB) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb==0.4.15) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb==0.4.15) (2024.2.0) Requirement already satisfied: zipp>=0.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from importlib-metadata<7.0,>=6.0->opentelemetry-api>=1.2.0->chromadb==0.4.15) (3.17.0) Requirement already satisfied: anyio<5,>=3.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (4.2.0) Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime>=1.14.1->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f0/0f/310fb31e39e2d734ccaa2c0fb981ee41f7bd5056ce9bc29b2248bd569169/humanfriendly-10.0-py2.py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 5.2 MB/s eta 0:00:00 Requirement already satisfied: mpmath>=0.19 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sympy->onnxruntime>=1.14.1->chromadb==0.4.15) (1.3.0) Requirement already satisfied: sniffio>=1.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from anyio<5,>=3.4.0->starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (1.3.0) Requirement already satisfied: exceptiongroup>=1.0.2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from anyio<5,>=3.4.0->starlette<0.37.0,>=0.36.3->fastapi>=0.95.2->chromadb==0.4.15) (1.2.0) Collecting pyasn1<0.6.0,>=0.4.6 (from pyasn1-modules>=0.2.1->google-auth>=1.0.1->kubernetes>=28.1.0->chromadb==0.4.15) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/d1/75/4686d2872bf2fc0b37917cbc8bbf0dd3a5cdb0990799be1b9cbf1e1eb733/pyasn1-0.5.1-py2.py3-none-any.whl (84 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.9/84.9 kB 5.4 MB/s eta 0:00:00 Building wheels for collected packages: pypika Building wheel for pypika (pyproject.toml) ... done Created wheel for pypika: filename=PyPika-0.48.9-py2.py3-none-any.whl size=53723 sha256=9e820bd826f21c74e3dc851ce1794c67a87f7959a2b6beaec86acef05bd55771 Stored in directory: /root/.cache/pip/wheels/06/08/01/e1ce9a2b2e9e51d8540e77461c4cc395c902b9020c296aae50 Successfully built pypika Installing collected packages: pypika, monotonic, flatbuffers, wrapt, websocket-client, uvloop, python-dotenv, pyasn1, pulsar-client, overrides, opentelemetry-semantic-conventions, opentelemetry-proto, oauthlib, humanfriendly, httptools, grpcio, googleapis-common-protos, chroma-hnswlib, bcrypt, backoff, watchfiles, rsa, requests-oauthlib, pyasn1-modules, posthog, opentelemetry-exporter-otlp-proto-common, deprecated, coloredlogs, opentelemetry-api, onnxruntime, google-auth, opentelemetry-sdk, kubernetes, opentelemetry-exporter-otlp-proto-grpc, chromadb Successfully installed backoff-2.2.1 bcrypt-4.1.2 chroma-hnswlib-0.7.3 chromadb-0.4.15 coloredlogs-15.0.1 deprecated-1.2.14 flatbuffers-23.5.26 google-auth-2.28.0 googleapis-common-protos-1.62.0 grpcio-1.60.1 httptools-0.6.1 humanfriendly-10.0 kubernetes-29.0.0 monotonic-1.6 oauthlib-3.2.2 onnxruntime-1.17.0 opentelemetry-api-1.22.0 opentelemetry-exporter-otlp-proto-common-1.22.0 opentelemetry-exporter-otlp-proto-grpc-1.22.0 opentelemetry-proto-1.22.0 opentelemetry-sdk-1.22.0 opentelemetry-semantic-conventions-0.43b0 overrides-7.7.0 posthog-3.4.1 pulsar-client-3.4.0 pyasn1-0.5.1 pyasn1-modules-0.3.0 pypika-0.48.9 python-dotenv-1.0.1 requests-oauthlib-1.3.1 rsa-4.9 uvloop-0.19.0 watchfiles-0.21.0 websocket-client-1.7.0 wrapt-1.16.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install sentence-transformers==2.2.2 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting sentence-transformers==2.2.2 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/20/9c/f07bd70d128fdb107bc02a0c702b9058b4fe147d0ba67b5a0f4c3cf15a54/sentence-transformers-2.2.2.tar.gz (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.0/86.0 kB 968.6 kB/s eta 0:00:00 Preparing metadata (setup.py) ... done Requirement already satisfied: transformers<5.0.0,>=4.6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (4.35.2) Requirement already satisfied: tqdm in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (4.66.2) Requirement already satisfied: torch>=1.6.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (2.0.1) Requirement already satisfied: torchvision in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.15.2) Requirement already satisfied: numpy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (1.26.2) Collecting scikit-learn (from sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/bc/b9/6a637668d69de04b7f8b917e837aff282950601f09998a5f6c9f23f6642d/scikit_learn-1.4.1.post1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.1/12.1 MB 63.4 MB/s eta 0:00:00 Requirement already satisfied: scipy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (1.12.0) Collecting nltk (from sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a6/0a/0d20d2c0f16be91b9fa32a77b76c60f9baf6eba419e5ef5deca17af9c582/nltk-3.8.1-py3-none-any.whl (1.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 40.9 MB/s eta 0:00:00 Requirement already satisfied: sentencepiece in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.1.99) Requirement already satisfied: huggingface-hub>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sentence-transformers==2.2.2) (0.20.3) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2024.2.0) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2.31.0) Requirement already satisfied: pyyaml>=5.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (6.0.1) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (4.9.0) Requirement already satisfied: packaging>=20.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (23.2) Requirement already satisfied: sympy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (1.11.1) Requirement already satisfied: networkx in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (3.1) Requirement already satisfied: jinja2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers==2.2.2) (3.1.2) Requirement already satisfied: regex!=2019.12.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (2023.12.25) Requirement already satisfied: tokenizers<0.19,>=0.14 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (0.15.2) Requirement already satisfied: safetensors>=0.3.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers==2.2.2) (0.4.2) Requirement already satisfied: click in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->sentence-transformers==2.2.2) (8.1.7) Collecting joblib (from nltk->sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/10/40/d551139c85db202f1f384ba8bcf96aca2f329440a844f924c8a0040b6d02/joblib-1.3.2-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 9.2 MB/s eta 0:00:00 Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers==2.2.2) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b1/2c/f504e55d98418f2fcf756a56877e6d9a45dd5ed28b3d7c267b300e85ad5b/threadpoolctl-3.3.0-py3-none-any.whl (17 kB) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from torchvision->sentence-transformers==2.2.2) (9.5.0) Requirement already satisfied: MarkupSafe>=2.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from jinja2->torch>=1.6.0->sentence-transformers==2.2.2) (2.1.1) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface-hub>=0.4.0->sentence-transformers==2.2.2) (2023.11.17) Requirement already satisfied: mpmath>=0.19 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers==2.2.2) (1.3.0) Building wheels for collected packages: sentence-transformers Building wheel for sentence-transformers (setup.py) ... done Created wheel for sentence-transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=6b3b9561ed651ab64c69d352e7f04f0f724ba58ccce3d3295852c7ab41a8b982 Stored in directory: /root/.cache/pip/wheels/66/0c/99/a3942d61ac4446e2d615ed4634a1f3ed69a37728e5ac184cf3 Successfully built sentence-transformers Installing collected packages: threadpoolctl, joblib, scikit-learn, nltk, sentence-transformers Successfully installed joblib-1.3.2 nltk-3.8.1 scikit-learn-1.4.1.post1 sentence-transformers-2.2.2 threadpoolctl-3.3.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install unstructured==0.10.30 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting unstructured==0.10.30 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e3/95/28c08bbdd98a9bdbb7f52c07c0e81090ea5f89af5b6cac7c7c6d86ce2a5e/unstructured-0.10.30-py3-none-any.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 7.8 MB/s eta 0:00:00 Collecting chardet (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/38/6f/f5fbc992a329ee4e0f288c1fe0e2ad9485ed064cac731ed2fe47dcc38cbf/chardet-5.2.0-py3-none-any.whl (199 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 11.4 MB/s eta 0:00:00 Collecting filetype (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/18/79/1b8fa1bb3568781e84c9200f951c735f3f157429f44be0495da55894d620/filetype-1.2.0-py2.py3-none-any.whl (19 kB) Collecting python-magic (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6c/73/9f872cb81fc5c3bb48f7227872c28975f998f3e7c2b1c16e95e6432bbb90/python_magic-0.4.27-py2.py3-none-any.whl (13 kB) Collecting lxml (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/25/5c/979167df4ca5a1c308105bb1590412c54bd1b0baa1883212f39cb42d4fcd/lxml-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.0/8.0 MB 62.5 MB/s eta 0:00:00 Requirement already satisfied: nltk in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (3.8.1) Collecting tabulate (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/40/44/4a5f08c96eb108af5cb50b41f76142f0afa346dfa99d5296fe7202a11854/tabulate-0.9.0-py3-none-any.whl (35 kB) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (2.31.0) Collecting beautifulsoup4 (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b1/fe/e8c672695b37eecc5cbf43e1d0638d88d66ba3a44c4d321c796f4e59167f/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.9/147.9 kB 6.8 MB/s eta 0:00:00 Collecting emoji (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/98/00/00d56e704d69cee4a92b1d517676579b4af5f2f8bc72946c464a504705b2/emoji-2.10.1-py2.py3-none-any.whl (421 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 421.5/421.5 kB 11.8 MB/s eta 0:00:00 Requirement already satisfied: dataclasses-json in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (0.5.14) Collecting python-iso639 (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/01/62/2fed44ba10fe805345fb0e9c46c7f8dcdaf1bffd642f051fcc3db9bf55d8/python_iso639-2024.2.7-py3-none-any.whl (274 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 274.7/274.7 kB 6.5 MB/s eta 0:00:00 Collecting langdetect (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/0e/72/a3add0e4eec4eb9e2569554f7c70f4a3c27712f40e3284d483e88094cc0e/langdetect-1.0.9.tar.gz (981 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 981.5/981.5 kB 27.2 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Requirement already satisfied: numpy in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (1.26.2) Collecting rapidfuzz (from unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/02/39/3f94121e21b78e0a2699b272a8906ee5eb6f9d70082d90784464b0a4fcc8/rapidfuzz-3.6.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 54.0 MB/s eta 0:00:00 Requirement already satisfied: backoff in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (2.2.1) Requirement already satisfied: typing-extensions in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from unstructured==0.10.30) (4.9.0) Collecting soupsieve>1.2 (from beautifulsoup4->unstructured==0.10.30) Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl (36 kB) Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from dataclasses-json->unstructured==0.10.30) (3.20.2) Requirement already satisfied: typing-inspect<1,>=0.4.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from dataclasses-json->unstructured==0.10.30) (0.9.0) Requirement already satisfied: six in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from langdetect->unstructured==0.10.30) (1.16.0) Requirement already satisfied: click in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (8.1.7) Requirement already satisfied: joblib in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (1.3.2) Requirement already satisfied: regex>=2021.8.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (2023.12.25) Requirement already satisfied: tqdm in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from nltk->unstructured==0.10.30) (4.66.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->unstructured==0.10.30) (2023.11.17) Requirement already satisfied: packaging>=17.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->unstructured==0.10.30) (23.2) Requirement already satisfied: mypy-extensions>=0.3.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from typing-inspect<1,>=0.4.0->dataclasses-json->unstructured==0.10.30) (1.0.0) Building wheels for collected packages: langdetect Building wheel for langdetect (setup.py) ... done Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993224 sha256=76cfd25e44e53b8b0e53f438122aa9c4351991aa70793d77eaeb7f3e659d29a2 Stored in directory: /root/.cache/pip/wheels/ee/e9/63/fe12d571f8675325c5e131236f64a52b7ed05da124bd628a74 Successfully built langdetect Installing collected packages: filetype, tabulate, soupsieve, rapidfuzz, python-magic, python-iso639, lxml, langdetect, emoji, chardet, beautifulsoup4, unstructured Successfully installed beautifulsoup4-4.12.3 chardet-5.2.0 emoji-2.10.1 filetype-1.2.0 langdetect-1.0.9 lxml-5.1.0 python-iso639-2024.2.7 python-magic-0.4.27 rapidfuzz-3.6.1 soupsieve-2.5 tabulate-0.9.0 unstructured-0.10.30 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install markdown==3.3.7 Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Collecting markdown==3.3.7 Downloading https://pypi.tuna.tsinghua.edu.cn/packages/f3/df/ca72f352e15b6f8ce32b74af029f1189abffb906f7c137501ffe69c98a65/Markdown-3.3.7-py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.8/97.8 kB 938.8 kB/s eta 0:00:00 Installing collected packages: markdown Successfully installed markdown-3.3.7 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# pip install -U huggingface_hub Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Requirement already satisfied: huggingface_hub in /root/.conda/envs/InternLM/lib/python3.10/site-packages (0.20.3) Requirement already satisfied: filelock in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (2024.2.0) Requirement already satisfied: requests in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (2.31.0) Requirement already satisfied: tqdm>=4.42.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (4.66.2) Requirement already satisfied: pyyaml>=5.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (6.0.1) Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (4.9.0) Requirement already satisfied: packaging>=20.9 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from huggingface_hub) (23.2) Requirement already satisfied: charset-normalizer<4,>=2 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (1.26.18) Requirement already satisfied: certifi>=2017.4.17 in /root/.conda/envs/InternLM/lib/python3.10/site-packages (from requests->huggingface_hub) (2023.11.17) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv (InternLM) root@intern-studio-069640:/opt/jupyterlab# ls jupyterlab jupyterlab.tar.gz (InternLM) root@intern-studio-069640:/opt/jupyterlab# cd /root/data (InternLM) root@intern-studio-069640:~/data# ls download_hf.py model (InternLM) root@intern-studio-069640:~/data# python download_hf.py Consider using `hf_transfer` for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 14 files: 0%| | 0/14 [00:00<?, ?it/s]downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/.gitattributes to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/ef4a55971246c7825073cfa3690eeda3d967f376.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/1_Pooling/config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/d1514c3162bbe87b343f565fadc62e6c06f04f03.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/config_sentence_transformers.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/b974b349cb2d419ada11181750a733ff82f291ad.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/README.md to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/065b011b76fe98894d8975acfa28f028085fa35b.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/sentence_bert_config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/5fd10429389515d3e5cccdeda08cae5fea1ae82e.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/modules.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/f7640f94e81bb7f4f04daf1668850b38763a13d9.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/c06d5b49495f044e6380e68a60538be17a6bd5d1.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/pytorch_model.bin to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/16cc9e54df6e083272378abec2d75dc34d7a48b5276db3ccc050d18de672ac59.incomplete .gitattributes: 968B [00:00, 2.24MB/s] 1_Pooling/config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 190/190 [00:00<00:00, 1.02MB/s] config_sentence_transformers.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 122/122 [00:00<00:00, 1.35MB/s] README.md: 4.12kB [00:00, 14.5MB/s] sentence_bert_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 53.0/53.0 [00:00<00:00, 387kB/s] modules.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 229/229 [00:00<00:00, 2.64MB/s] config.json: 645B [00:00, 6.97MB/s] Fetching 14 files: 29%|███████████████████████████████████████████████▍ | 4/14 [00:01<00:02, 4.62it/s]downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/sentencepiece.bpe.model to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/cfc8146abe2a0488e9e2a0c56de7952f7c11ab059eca145a0a727afce0db2865.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/special_tokens_map.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tokenizer.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/2c3387be76557bd40970cec13153b3bbf80407865484b209e655e5e4729076b8.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tf_model.h5 to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/22150b6ba00e477c7f816f1988d028fff924e2b52e14540889690c72c5add40e.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/tokenizer_config.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/0da3507018a1a1c625ff93179ff60bdb9202cc6c.incomplete downloading https://hf-mirror.com/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/43dcf585e1eb6d4ece18c2e0c29474d9c5146b70/unigram.json to /root/.cache/huggingface/hub/models--sentence-transformers--paraphrase-multilingual-MiniLM-L12-v2/blobs/71b44701d7efd054205115acfa6ef126c5d2f84bd3affe0c59e48163674d19a6.incomplete special_tokens_map.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 239/239 [00:00<00:00, 2.12MB/s] tokenizer_config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 480/480 [00:00<00:00, 4.65MB/s] unigram.json: 14.8MB [00:02, 5.12MB/s] | 0.00/480 [00:00<?, ?B/s] sentencepiece.bpe.model: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5.07M/5.07M [00:02<00:00, 2.03MB/s] tokenizer.json: 9.08MB [00:02, 3.37MB/s] | 0.00/471M [00:00<?, ?B/s] pytorch_model.bin: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [01:02<00:00, 7.52MB/s] Fetching 14 files: 50%|███████████████████████████████████████████████████████████████████████████████████ | 7/14 [01:05<01:21, 11.61s/it] tf_model.h5: 49%|██████████████████████████████████████████████████████████████████████████████████▎ | 231M/471M [00:57<01:50, 2.17MB/s] tf_model.h5: 71%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▍ | 336M/471M [09:07<08:57, 252kB/s] pytorch_model.bin: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [01:02<00:00, 7.67MB/s] c tf_model.h5: 73%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ | 346M/471M [10:12<10:19, 202kB/s] tf_model.h5: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [16:10<00:00, 485kB/s] Fetching 14 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [16:12<00:00, 69.49s/it] /root/data/model/sentence-transformer██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 471M/471M [16:10<00:00, 271kB/s] (InternLM) root@intern-studio-069640:~/data#
1.4 下载 NLTK 相关资源
由于需要用到nltk工具，可以先从国内镜像站点gitee上clone到本地，然后从本地目录安装相关nltk的工具。
cd /root git clone https://gitee.com/yzy0612/nltk_data.git --branch gh-pages cd nltk_data mv packages/* ./ cd tokenizers unzip punkt.zip cd ../taggers unzip averaged_perceptron_tagger.zip
屏幕输出：
(InternLM) root@intern-studio-069640:~# git clone https://gitee.com/yzy0612/nltk_data.git --branch gh-pages Cloning into 'nltk_data'... remote: Enumerating objects: 1692, done. remote: Total 1692 (delta 0), reused 0 (delta 0), pack-reused 1692 Receiving objects: 100% (1692/1692), 952.80 MiB | 23.29 MiB/s, done. Resolving deltas: 100% (909/909), done. Updating files: 100% (244/244), done. (InternLM) root@intern-studio-069640:~# cd nltk_data (InternLM) root@intern-studio-069640:~/nltk_data# mv packages/* ./ (InternLM) root@intern-studio-069640:~/nltk_data# cd tokenizers (InternLM) root@intern-studio-069640:~/nltk_data/tokenizers# unzip punkt.zip Archive: punkt.zip creating: punkt/ inflating: punkt/greek.pickle inflating: punkt/estonian.pickle inflating: punkt/turkish.pickle inflating: punkt/polish.pickle creating: punkt/PY3/ inflating: punkt/PY3/greek.pickle inflating: punkt/PY3/estonian.pickle inflating: punkt/PY3/turkish.pickle inflating: punkt/PY3/polish.pickle inflating: punkt/PY3/russian.pickle inflating: punkt/PY3/czech.pickle inflating: punkt/PY3/portuguese.pickle inflating: punkt/PY3/README inflating: punkt/PY3/dutch.pickle inflating: punkt/PY3/norwegian.pickle inflating: punkt/PY3/slovene.pickle inflating: punkt/PY3/english.pickle inflating: punkt/PY3/danish.pickle inflating: punkt/PY3/finnish.pickle inflating: punkt/PY3/swedish.pickle inflating: punkt/PY3/spanish.pickle inflating: punkt/PY3/german.pickle inflating: punkt/PY3/italian.pickle inflating: punkt/PY3/french.pickle inflating: punkt/russian.pickle inflating: punkt/czech.pickle inflating: punkt/portuguese.pickle inflating: punkt/README inflating: punkt/dutch.pickle inflating: punkt/norwegian.pickle inflating: punkt/slovene.pickle inflating: punkt/english.pickle inflating: punkt/danish.pickle inflating: punkt/finnish.pickle inflating: punkt/swedish.pickle inflating: punkt/spanish.pickle inflating: punkt/german.pickle inflating: punkt/italian.pickle inflating: punkt/french.pickle inflating: punkt/.DS_Store inflating: punkt/PY3/malayalam.pickle inflating: punkt/malayalam.pickle (InternLM) root@intern-studio-069640:~/nltk_data/tokenizers# cd ../taggers (InternLM) root@intern-studio-069640:~/nltk_data/taggers# unzip averaged_perceptron_tagger.zip Archive: averaged_perceptron_tagger.zip creating: averaged_perceptron_tagger/ inflating: averaged_perceptron_tagger/averaged_perceptron_tagger.pickle (InternLM) root@intern-studio-069640:~/nltk_data/taggers#
2 知识库搭建
选择由上海人工智能实验室开源的一系列大模型工具开源仓库作为语料库来源,首先我们需要将上述远程开源仓库 Clone 到本地，可以使用以下命令:
# 进入到数据库盘 cd /root/data # clone 上述开源仓库 git clone https://gitee.com/open-compass/opencompass.git git clone https://gitee.com/InternLM/lmdeploy.git git clone https://gitee.com/InternLM/xtuner.git git clone https://gitee.com/InternLM/InternLM-XComposer.git git clone https://gitee.com/InternLM/lagent.git git clone https://gitee.com/InternLM/InternLM.git
屏幕输出：
(InternLM) root@intern-studio-069640:~/nltk_data/taggers# cd /root/data (InternLM) root@intern-studio-069640:~/data# # clone 上述开源仓库 (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/open-compass/opencompass.git Cloning into 'opencompass'... remote: Enumerating objects: 7129, done. remote: Counting objects: 100% (2550/2550), done. remote: Compressing objects: 100% (958/958), done. remote: Total 7129 (delta 1641), reused 2434 (delta 1569), pack-reused 4579 Receiving objects: 100% (7129/7129), 2.39 MiB | 716.00 KiB/s, done. Resolving deltas: 100% (4403/4403), done. Updating files: 100% (1594/1594), done. (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/InternLM/lmdeploy.git Cloning into 'lmdeploy'... remote: Enumerating objects: 4485, done. remote: Total 4485 (delta 0), reused 0 (delta 0), pack-reused 4485 Receiving objects: 100% (4485/4485), 2.23 MiB | 596.00 KiB/s, done. Resolving deltas: 100% (2914/2914), done. Updating files: 100% (455/455), done. (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/InternLM/xtuner.git Cloning into 'xtuner'... remote: Enumerating objects: 6342, done. remote: Counting objects: 100% (3757/3757), done. remote: Compressing objects: 100% (747/747), done. remote: Total 6342 (delta 3080), reused 3614 (delta 2964), pack-reused 2585 Receiving objects: 100% (6342/6342), 1.14 MiB | 1.18 MiB/s, done. Resolving deltas: 100% (4901/4901), done. Updating files: 100% (552/552), done. (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/InternLM/InternLM-XComposer.git Cloning into 'InternLM-XComposer'... remote: Enumerating objects: 680, done. remote: Counting objects: 100% (680/680), done. remote: Compressing objects: 100% (273/273), done. remote: Total 680 (delta 361), reused 680 (delta 361), pack-reused 0 Receiving objects: 100% (680/680), 10.74 MiB | 856.00 KiB/s, done. Resolving deltas: 100% (361/361), done. (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/InternLM/lagent.git Cloning into 'lagent'... remote: Enumerating objects: 414, done. remote: Total 414 (delta 0), reused 0 (delta 0), pack-reused 414 Receiving objects: 100% (414/414), 214.97 KiB | 456.00 KiB/s, done. Resolving deltas: 100% (197/197), done. (InternLM) root@intern-studio-069640:~/data# git clone https://gitee.com/InternLM/InternLM.git Cloning into 'InternLM'... remote: Enumerating objects: 2604, done. remote: Counting objects: 100% (592/592), done. remote: Compressing objects: 100% (264/264), done. remote: Total 2604 (delta 324), reused 581 (delta 318), pack-reused 2012 Receiving objects: 100% (2604/2604), 4.87 MiB | 1.16 MiB/s, done. Resolving deltas: 100% (1608/1608), done. (InternLM) root@intern-studio-069640:~/data#
在/root/data目录下建立一个demo的文件夹，并在文件夹中创建create_db.py的python脚本，其代码如下：
# 首先导入所需第三方库 from langchain.document_loaders import UnstructuredFileLoader from langchain.document_loaders import UnstructuredMarkdownLoader from langchain.text_splitter import RecursiveCharacterTextSplitter from langchain.vectorstores import Chroma from langchain.embeddings.huggingface import HuggingFaceEmbeddings from tqdm import tqdm import os # 获取文件路径函数 def get_files(dir_path): # args：dir_path，目标文件夹路径 file_list = [] for filepath, dirnames, filenames in os.walk(dir_path): # os.walk 函数将递归遍历指定文件夹 for filename in filenames: # 通过后缀名判断文件类型是否满足要求 if filename.endswith(".md"): # 如果满足要求，将其绝对路径加入到结果列表 file_list.append(os.path.join(filepath, filename)) elif filename.endswith(".txt"): file_list.append(os.path.join(filepath, filename)) return file_list # 加载文件函数 def get_text(dir_path): # args：dir_path，目标文件夹路径 # 首先调用上文定义的函数得到目标文件路径列表 file_lst = get_files(dir_path) # docs 存放加载之后的纯文本对象 docs = [] # 遍历所有目标文件 for one_file in tqdm(file_lst): file_type = one_file.split('.')[-1] if file_type == 'md': loader = UnstructuredMarkdownLoader(one_file) elif file_type == 'txt': loader = UnstructuredFileLoader(one_file) else: # 如果是不符合条件的文件，直接跳过 continue docs.extend(loader.load()) return docs # 目标文件夹 tar_dir = [ "/root/data/InternLM", "/root/data/InternLM-XComposer", "/root/data/lagent", "/root/data/lmdeploy", "/root/data/opencompass", "/root/data/xtuner" ] # 加载目标文件 docs = [] for dir_path in tar_dir: docs.extend(get_text(dir_path)) # 对文本进行分块 text_splitter = RecursiveCharacterTextSplitter( chunk_size=500, chunk_overlap=150) split_docs = text_splitter.split_documents(docs) # 加载开源词向量模型 embeddings = HuggingFaceEmbeddings(model_name="/root/data/model/sentence-transformer") # 构建向量数据库 # 定义持久化路径 persist_directory = 'data_base/vector_db/chroma' # 加载数据库 vectordb = Chroma.from_documents( documents=split_docs, embedding=embeddings, persist_directory=persist_directory # 允许我们将persist_directory目录保存到磁盘上 ) # 将加载的向量数据库持久化到磁盘上 vectordb.persist()
切换到/root/data/demo目录并运行上述python脚本：
屏幕输出：
(InternLM) root@intern-studio-069640:~/data# cd demo (InternLM) root@intern-studio-069640:~/data/demo# ls create_db.py (InternLM) root@intern-studio-069640:~/data/demo# python create_db.py 0%| | 0/25 [00:00<?, ?it/s]/root/.conda/envs/InternLM/lib/python3.10/site-packages/unstructured/documents/html.py:498: FutureWarning: The behavior of this method will change in future versions. Use specific 'len(elem)' or 'elem is not None' test instead. rows = body.findall("tr") if body else [] 40%|█████████████████████████████████████████████████████████████████████████▌ | 10/25 [00:28<00:24, 1.61s/it]/root/.conda/envs/InternLM/lib/python3.10/site-packages/unstructured/documents/html.py:498: FutureWarning: The behavior of this method will change in future versions. Use specific 'len(elem)' or 'elem is not None' test instead. rows = body.findall("tr") if body else [] 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 25/25 [00:29<00:00, 1.19s/it] 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:00<00:00, 22.35it/s] 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<00:00, 38.77it/s] 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 72/72 [00:02<00:00, 25.19it/s] 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 130/130 [00:06<00:00, 19.27it/s] 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 38/38 [00:02<00:00, 18.74it/s] (InternLM) root@intern-studio-069640:~/data/demo#
建成生成的向量数据库文件：
3 InternLM 接入 LangChain
自定义一个 InternLM LLM 子类，从而实现将 InternLM 接入到 LangChain 框架中。在demo下新建一个InternLM_LLM的python脚本文件：
from langchain.llms.base import LLM from typing import Any, List, Optional from langchain.callbacks.manager import CallbackManagerForLLMRun from transformers import AutoTokenizer, AutoModelForCausalLM import torch class InternLM_LLM(LLM): # 基于本地 InternLM 自定义 LLM 类 tokenizer : AutoTokenizer = None model: AutoModelForCausalLM = None def __init__(self, model_path :str): # model_path: InternLM 模型路径 # 从本地初始化模型 super().__init__() print("正在从本地加载模型...") self.tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True) self.model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True).to(torch.bfloat16).cuda() self.model = self.model.eval() print("完成本地模型的加载") def _call(self, prompt : str, stop: Optional[List[str]] = None, run_manager: Optional[CallbackManagerForLLMRun] = None, **kwargs: Any): # 重写调用函数 system_prompt = """You are an AI assistant whose name is InternLM (书生·浦语). - InternLM (书生·浦语) is a conversational language model that is developed by Shanghai AI Laboratory (上海人工智能实验室). It is designed to be helpful, honest, and harmless. - InternLM (书生·浦语) can understand and communicate fluently in the language chosen by the user such as English and 中文. """ messages = [(system_prompt, '')] response, history = self.model.chat(self.tokenizer, prompt , history=messages) return response @property def _llm_type(self) -> str: return "InternLM"
4 构建检索问答链
编写脚本代码run_gradio.py，功能包括加载向量数据库，实例化自定义 LLM 与 Prompt Template，以及构建检索问答链：
from langchain.vectorstores import Chroma from langchain.embeddings.huggingface import HuggingFaceEmbeddings import os from LLM import InternLM_LLM from langchain.prompts import PromptTemplate from langchain.chains import RetrievalQA def load_chain(): # 加载问答链 # 定义 Embeddings embeddings = HuggingFaceEmbeddings(model_name="/root/data/model/sentence-transformer") # 向量数据库持久化路径 persist_directory = 'data_base/vector_db/chroma' # 加载数据库 vectordb = Chroma( persist_directory=persist_directory, # 允许我们将persist_directory目录保存到磁盘上 embedding_function=embeddings ) # 加载自定义 LLM llm = InternLM_LLM(model_path = "/root/data/model/Shanghai_AI_Laboratory/internlm-chat-7b") # 定义一个 Prompt Template template = """使用以下上下文来回答最后的问题。如果你不知道答案，就说你不知道，不要试图编造答 案。尽量使答案简明扼要。总是在回答的最后说“谢谢你的提问！”。 {context} 问题: {question} 有用的回答:""" QA_CHAIN_PROMPT = PromptTemplate(input_variables=["context","question"],template=template) # 运行 chain qa_chain = RetrievalQA.from_chain_type(llm,retriever=vectordb.as_retriever(),return_source_documents=True,chain_type_kwargs={"prompt":QA_CHAIN_PROMPT}) return qa_chain class Model_center(): """ 存储检索问答链的对象 """ def __init__(self): # 构造函数，加载检索问答链 self.chain = load_chain() def qa_chain_self_answer(self, question: str, chat_history: list = []): """ 调用问答链进行回答 """ if question == None or len(question) < 1: return "", chat_history try: chat_history.append( (question, self.chain({"query": question})["result"])) # 将问答结果直接附加到问答历史中，Gradio 会将其展示出来 return "", chat_history except Exception as e: return e, chat_history
import gradio as gr # 实例化核心功能对象 model_center = Model_center() # 创建一个 Web 界面 block = gr.Blocks() with block as demo: with gr.Row(equal_height=True): with gr.Column(scale=15): # 展示的页面标题 gr.Markdown("""<h1><center>InternLM</center></h1> <center>书生浦语</center> """) with gr.Row(): with gr.Column(scale=4): # 创建一个聊天机器人对象 chatbot = gr.Chatbot(height=450, show_copy_button=True) # 创建一个文本框组件，用于输入 prompt。 msg = gr.Textbox(label="Prompt/问题") with gr.Row(): # 创建提交按钮。 db_wo_his_btn = gr.Button("Chat") with gr.Row(): # 创建一个清除按钮，用于清除聊天机器人组件的内容。 clear = gr.ClearButton( components=[chatbot], value="Clear console") # 设置按钮的点击事件。当点击时，调用上面定义的 qa_chain_self_answer 函数，并传入用户的消息和聊天历史记录，然后更新文本框和聊天机器人组件。 db_wo_his_btn.click(model_center.qa_chain_self_answer, inputs=[ msg, chatbot], outputs=[msg, chatbot]) gr.Markdown("""提醒：<br> 1. 初始化数据库时间可能较长，请耐心等待。 2. 使用中如果出现异常，将会在文本输入框进行展示，请不要惊慌。 <br> """) gr.close_all() # 直接启动 demo.launch()
5 运行run_gradio脚本
切换到/root/data/demo目录，运行命令：
python run_gradio.py
屏幕输出：
(InternLM) root@intern-studio-069640:~/data/demo# pwd /root/data/demo (InternLM) root@intern-studio-069640:~/data/demo# ls LLM.py create_db.py data_base run_gradio.py (InternLM) root@intern-studio-069640:~/data/demo# python run_gradio.py 正在从本地加载模型... Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:33<00:00, 4.16s/it] 完成本地模型的加载 Running on local URL: http://127.0.0.1:7860 To create a public link, set `share=True` in `launch()`.
本地端口映射：在本地的MacBook上执行：
ssh -CNg -L 7860:127.0.0.1:7860 root@ssh.intern-ai.org.cn -p 36970 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null
在本地浏览器上输入http://127.0.0.1:7860即可进入到知识库试用的界面：
进阶作业：
选择一个垂直领域，收集该领域的专业资料构建专业知识库，并搭建专业问答助手，并在 OpenXLab 上成功部署（截图，并提供应用地址）
posted on 2024-02-17 18:37 littlesuccess 阅读(54) 评论(0) 编辑 收藏 举报
