shoufeng

瘦风的南墙

Hadoop - macOS 上编译 Hadoop 3.2.1

1 - 为什么要自己编译 Hadoop

一般个人安装使用的都是 Apache 的 Hadoop(还有 CDH Hadoop等等)。

从 Apache 官网下载的安装包是在一些特定的机器上编译而来的,并不能兼容所有的环境,尤其是本地库(用来压缩,支持C程序等等),不同平台有不同的限制。

2 - 准备编译环境

1)本机系统:macOS Big Sur 11.0.1版本;

保证能够连接互联网,Linux 系统,需要关闭防火墙和SELinux:

service iptables stop
chkconfig iptables off

# 关闭SELinux
vim /etc/selinux/config
# 注释:SELINUX=enforcing
# 添加:SELINUX=disable

2)配置 JDK 环境变量,版本为1.8.0_162;

Linux 系统,一般要卸载掉系统自带的 Java 环境:

# 查看已安装的版本:
rpm -qa | grep java
# 卸载:
rpm -e java-1.6.0-openjdk-1.6.0.41-1.13.13.1.el6_8.x86_64  java-1.7.0-openjdk-1.7.0.131-2.6.9.0.el6_8.x86_64

3)安装 Maven,版本为 3.5.2;

为了加速依赖的下载,可以添加阿里云的 Maven 镜像:

 <mirror>
      <id>alimaven</id>
      <name>aliyun maven repo</name>
      <url>http://maven.aliyun.com/nexus/content/groups/public/</url>
      <mirrorOf>central</mirrorOf>
    </mirror>

4)上述软件的环境变量信息:

export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_162.jdk/Contents/Home
export CLASSPATH=$JAVA_HOME/lib/tools.jar:$JAVA_HOME/lib/dt.jar:.
export PATH=$JAVA_HOME/bin:$PATH:.

export MAVEN_HOME=/usr/local/apache-maven-3.5.2
export PATH=$PATH:$MAVEN_HOME/bin

3 - 安装依赖库

macOS 系统一般通过 Homebrew 安装依赖,方便快捷。

建议把 Homebrew 的仓库修改到国内,避免速度慢导致安装失败:https://zhuanlan.zhihu.com/p/351199589

1)安装 gcc,cmake,以及 GNU 相关库:

brew install gcc cmake autoconf automake libtool

2)安装 gzip、bzip2、zlib、snappy 等压缩库:

brew install gzip bzip2 zlib

手动安装 snappy 1.1.4 —— 其他版本会出错!

# 下载并解压:
wget https://github.com/google/snappy/archive/1.1.4.tar.gz
tar -zxf 1.1.4.tar.gz
cd snappy-1.1.4

# 指定安装路径,便于 brew 链接(不指定,就会安装到 /usr/local/bin)
./autogen.sh
./configure --prefix=/usr/local/Cellar/snappy/1.1.4
# 编译并安装到上面的路径:
make && make install
# 添加到环境变量:
brew link snappy

3)安装 openssl 依赖,并配置环境变量:

brew install openssl

~/.bash_profile 中添加环境变量:

export OPENSSL_ROOT_DIR="/usr/local/opt/openssl@1.1"
export OPENSSL_INCLUDE_DIR="$OPENSSL_ROOT_DIR/include"
export PKG_CONFIG_PATH="${OPENSSL_ROOT_DIR}/lib/pkgconfig" 

# 保存后,令环境变量立即生效:
source ~/.bash_profile

4)手动安装 protobuf 2.5.0:

必须安装此版本,否则在编译源码过程中,会报错:org.apache.maven.plugin.MojoExecutionException: protoc version is ‘libprotoc 3.11.2’, expected version is ‘2.5.0’
brew 源中是最新版,没有 2.5.0,需要下载然后编译安装。

下载链接:https://github.com/protocolbuffers/protobuf/releases/tag/v2.5.0,解压后,编译安装:

wget https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
tar -zxf protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
# 指定安装路径,便于 brew 链接(不指定,就会安装到 /usr/local/bin)
./configure --prefix=/usr/local/Cellar/protobuf/2.5.0
# 编译,并安装到上面的路径:
make && make install
# 添加到环境变量:
brew link protobuf

5)可选安装 isa-l:

先安装 nasm:brew install nasm

然后下载源码包(https://github.com/intel/isa-l/releases),编译安装:

cd isa-l-2.28.0

# 执行创建configure
autoreconf --install --symlink -f
./configure --prefix=/usr/local/Cellar/isa-l --libdir=/usr/local/Cellar/isa-l/lib  AS=yasm --target=darwin

# 编译安装:
make && make install

# 创建软链接:
cd /usr/local/lib
ln -s /usr/local/Cellar/isa-l/lib/libisal.2.dylib libisal.2.dylib
ln -s /usr/local/Cellar/isa-l/lib/libisal.a libisal.a
ln -s /usr/local/Cellar/isa-l/lib/libisal.dylib libisal.dylib
ln -s /usr/local/Cellar/isa-l/lib/libisal.la libisal.la

cd /usr/local/lib/pkgconfig
ln -s /usr/local/Cellar/isa-l/lib/pkgconfig/libisal.pc libisal.pc

4 - 编译 Hadoop 源码

下载 Apache Hadoop 源码包,这里下载 3.2.1 版本(https://archive.apache.org/dist/hadoop/core/hadoop-3.2.1/);

下载后,解压到 ${HOME}/bigdata/,然后编译源码,编译命令是:

cd ${HOME}/bigdata/hadoop-3.2.1-src

# 编译支持 snappy 压缩,需要指定 openssl.prefix,否则默认使用 macOS 自带的 openssl,会导致编译失败
# -e -X 参数是打印编译过程中的所有日志:
mvn clean package -DskipTests -Pdist,native -Dmaven.javadoc.skip -Dtar \
-Drequire.bzip2 -Dbzip2.prefix=/usr/local/Cellar/bzip2/1.0.8 \
-Drequire.openssl -Dopenssl.prefix=/usr/local/Cellar/openssl@1.1/1.1.1k \
-Drequire.snappy -Dsnappy.lib=/usr/local/Cellar/snappy/1.1.4/lib \
-Drequire.isal -Disal.prefix=/usr/local/Cellar/isa-l -Disal.lib=/usr/local/Cellar/isa-l/lib \
-e -X

5 - 遇到的问题及解决方法

5.1 hadoop-common 模块编译出错

[WARNING] CMake Warning (dev) at CMakeLists.txt:47 (find_package):
[WARNING]   Policy CMP0074 is not set: find_package uses <PackageName>_ROOT variables.
[WARNING]   Run "cmake --help-policy CMP0074" for policy details.  Use the cmake_policy
[WARNING]   command to set the policy and suppress this warning.
[WARNING]
[WARNING]   Environment variable ZLIB_ROOT is set to:
[WARNING]
[WARNING]     /usr/local/Cellar/zlib/1.2.11/
[WARNING]
[WARNING]   For compatibility, CMake is ignoring the variable.
[WARNING] This warning is for project developers.  Use -Wno-dev to suppress it.
[WARNING]
[WARNING] CMake Error at /usr/local/Cellar/cmake/3.20.5/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
[WARNING]   Could NOT find ZLIB (missing: ZLIB_LIBRARY) (found version "1.2.11")
[WARNING] Call Stack (most recent call first):
[WARNING]   /usr/local/Cellar/cmake/3.20.5/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
[WARNING]   /usr/local/Cellar/cmake/3.20.5/share/cmake/Modules/FindZLIB.cmake:120 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
[WARNING]   CMakeLists.txt:47 (find_package)

它提示说找不到 ZLIB_LIBRARY,而 ZLIB_ROOT 被忽略了。看看我的环境变量:

export ZLIB_ROOT=/usr/local/Cellar/zlib/1.2.11
export ZLIB_LIBRARY=/usr/local/Cellar/zlib/1.2.11/lib
export ZLIB_INCLUDE_DIR=/usr/local/Cellar/zlib/1.2.11/include

经过一番查找,原来 XXX_ROOT 在 CMake 3.12 以上是这样的作用:

再参考这位大神(https://github.com/MarkDana/Compile-Hadoop2.2.0-on-MacOS)的分析:

如果是通过 brew 安装的 zlib 库,那么可以到这个路径查看:

cd /usr/local/Cellar/cmake/3.20.5/share/cmake/Modules
vim FindZLIB.cmake

约 60行,它会先去查看 ZLIB_ROOT 变量:

所以我们只需要设置 ZLIB_ROOT 即可,为了让此变量生效,需要在 CMakeFile 中启用 cmake 的 CMP0074 策略:

修改报错项目对应的 CMake 配置:

vim hadoop-common-project/hadoop-common/src/CMakeLists.txt,启用新特性:

# 在 cmake_minimum_required(VERSION 3.1 FATAL_ERROR) 之后,加入这一行:
cmake_policy(SET CMP0074 NEW)

最后,环境变量中只需要保留这一行即可:

export ZLIB_ROOT=/usr/local/Cellar/zlib/1.2.11

然后,此错误就消失了。

5.2 hadoop-common 模块,仍然出错

[WARNING] CMake Warning (dev) in CMakeLists.txt:
[WARNING]   No project() command is present.  The top-level CMakeLists.txt file must
[WARNING]   contain a literal, direct call to the project() command.  Add a line of
[WARNING]   code such as
[WARNING]
[WARNING]     project(ProjectName)
[WARNING]
[WARNING]   near the top of the file, but after cmake_minimum_required().
[WARNING]
[WARNING]   CMake is pretending there is a "project(Project)" command on the first
[WARNING]   line.
[WARNING] This warning is for project developers.  Use -Wno-dev to suppress it.
[WARNING]
[WARNING] CMake Error at CMakeLists.txt:68 (message):
[WARNING]   Required bzip2 library and/or header files could not be found.
[WARNING]
[WARNING]
[WARNING] -- Configuring incomplete, errors occurred!

找不到 bzip2 库或相关的头文件。。。可是我的 bzip2 环境变量都已经设置了呀:

export BZIP2_ROOT=/usr/local/Cellar/bzip2/1.0.8
export BZIP2_INCLUDE_DIR=/usr/local/Cellar/bzip2/1.0.8/include
export BZIP2_LIBRARY=/usr/local/Cellar/bzip2/1.0.8

其他各种环境变量和 LDFLAGS、CPPFLAGS 设置都无效;

经过各种搜索,感觉 macOS 上就不能编译 bzip2。所以,我改了这里,跳过检查:

# 修改下面一行,直接设置了 REQUIRE_BZIP2,即 TRUE
# if(BZIP2_INCLUDE_DIR AND BZIP2_LIBRARIES)
if(REQUIRE_BZIP2)

5.3 MapReduce NativeTask 模块编译出错

[WARNING] 2 warnings and 12 errors generated.
[WARNING] make[2]: *** [CMakeFiles/nttest.dir/main/native/test/TestCompressions.cc.o] Error 1
[WARNING] make[2]: *** Waiting for unfinished jobs....
[WARNING] make[1]: *** [CMakeFiles/nttest.dir/all] Error 2
[WARNING] make: *** [all] Error 2
......
[INFO] Apache Hadoop MapReduce NativeTask ................. FAILURE [ 21.506 s]

搜索后得知,brew 安装的 snappy 版本是最新的 1.1.9,是通过 C++11 编译的,但是 Hadoop 3.2.1 的编译不支持C++11。

期间,又尝试安装了 snappy 1.1.5 编译还是会出错:

[WARNING] CMake Error at CMakeLists.txt:96 (message):
[WARNING]   Required snappy library could not be found.
[WARNING]   SNAPPY_LIBRARY=SNAPPY_LIBRARY-NOTFOUND, SNAPPY_INCLUDE_DIR=,
[WARNING]   CUSTOM_SNAPPY_INCLUDE_DIR=, CUSTOM_SNAPPY_PREFIX=, CUSTOM_SNAPPY_INCLUDE=

尝试添加了环境变量,不起作用:

export SNAPPY_LIBRARY=/usr/local/Cellar/snappy/1.1.5
export SNAPPY_INCLUDE_DIR=/usr/local/Cellar/snappy/1.1.5/include

# 仍然会报下面的错:
Required snappy library could not be found.
[WARNING]   SNAPPY_LIBRARY=SNAPPY_LIBRARY-NOTFOUND, SNAPPY_INCLUDE_DIR=,
[WARNING]   CUSTOM_SNAPPY_INCLUDE_DIR=, CUSTOM_SNAPPY_PREFIX=, CUSTOM_SNAPPY_INCLUDE=

找了这么一个编译 snappy 的方法,macOS Big Sur 系统验证不可用:

下载 https://github.com/electrum/hadoop-snappy.git,并编译,然后拷贝至 Hadoop 集群的 native 下。

这里还有一个大神解决 snappy 版本编译的操作,我没有试,提供参考:https://blog.csdn.net/weixin_44570264/article/details/106846117

所以我又安装了最上面提到的 snappy 1.1.4,再测试,然后它终于编译成功了✌️

6 - 编译成功,测试验证

编译命令已经放在上面第4姐了。贴上编译成功的证明✌️

[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [  1.893 s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [  4.338 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  1.560 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  2.337 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.359 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  1.777 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  3.786 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  0.951 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [  6.846 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  1.994 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [ 54.530 s]
[INFO] Apache Hadoop NFS .................................. SUCCESS [  3.630 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [  5.173 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.118 s]
[INFO] Apache Hadoop HDFS Client .......................... SUCCESS [ 27.638 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [ 31.633 s]
[INFO] Apache Hadoop HDFS Native Client ................... SUCCESS [02:38 min]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [  4.768 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [  1.722 s]
[INFO] Apache Hadoop HDFS-RBF ............................. SUCCESS [  5.303 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [  0.042 s]
[INFO] Apache Hadoop YARN ................................. SUCCESS [  0.054 s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [  6.738 s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [  9.302 s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [  2.945 s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [  0.133 s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [  8.103 s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [ 40.942 s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [  1.310 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [  2.386 s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [  1.992 s]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [ 12.021 s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [  1.714 s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [  2.445 s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [  1.740 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [  1.592 s]
[INFO] Apache Hadoop YARN TimelineService HBase Backend ... SUCCESS [  0.061 s]
[INFO] Apache Hadoop YARN TimelineService HBase Common .... SUCCESS [  2.382 s]
[INFO] Apache Hadoop YARN TimelineService HBase Client .... SUCCESS [  2.167 s]
[INFO] Apache Hadoop YARN TimelineService HBase Servers ... SUCCESS [  0.124 s]
[INFO] Apache Hadoop YARN TimelineService HBase Server 1.2  SUCCESS [  2.625 s]
[INFO] Apache Hadoop YARN TimelineService HBase tests ..... SUCCESS [  3.917 s]
[INFO] Apache Hadoop YARN Router .......................... SUCCESS [  1.785 s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [  0.119 s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [  1.679 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [  1.112 s]
[INFO] Apache Hadoop MapReduce Client ..................... SUCCESS [  0.196 s]
[INFO] Apache Hadoop MapReduce Core ....................... SUCCESS [  5.185 s]
[INFO] Apache Hadoop MapReduce Common ..................... SUCCESS [  2.387 s]
[INFO] Apache Hadoop MapReduce Shuffle .................... SUCCESS [  1.852 s]
[INFO] Apache Hadoop MapReduce App ........................ SUCCESS [  3.299 s]
[INFO] Apache Hadoop MapReduce HistoryServer .............. SUCCESS [  1.948 s]
[INFO] Apache Hadoop MapReduce JobClient .................. SUCCESS [  3.972 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [  1.252 s]
[INFO] Apache Hadoop YARN Services ........................ SUCCESS [  0.040 s]
[INFO] Apache Hadoop YARN Services Core ................... SUCCESS [  2.626 s]
[INFO] Apache Hadoop YARN Services API .................... SUCCESS [  1.434 s]
[INFO] Apache Hadoop Image Generation Tool ................ SUCCESS [  0.980 s]
[INFO] Yet Another Learning Platform ...................... SUCCESS [  1.346 s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [  0.044 s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [  0.069 s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [  9.978 s]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins ...... SUCCESS [  0.671 s]
[INFO] Apache Hadoop MapReduce NativeTask ................. SUCCESS [ 39.343 s]
[INFO] Apache Hadoop MapReduce Uploader ................... SUCCESS [  0.862 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  1.086 s]
[INFO] Apache Hadoop MapReduce ............................ SUCCESS [  4.303 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  0.906 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [  1.362 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [  0.496 s]
[INFO] Apache Hadoop Archive Logs ......................... SUCCESS [  0.599 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [  1.424 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [  0.968 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [  0.466 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [  0.543 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [  4.609 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [  0.960 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [  3.611 s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [  0.838 s]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [  2.333 s]
[INFO] Apache Hadoop Aliyun OSS support ................... SUCCESS [  0.449 s]
[INFO] Apache Hadoop Client Aggregator .................... SUCCESS [  3.429 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [  2.420 s]
[INFO] Apache Hadoop Resource Estimator Service ........... SUCCESS [  1.536 s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [  0.592 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 10.087 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [  0.048 s]
[INFO] Apache Hadoop Client API ........................... SUCCESS [01:24 min]
[INFO] Apache Hadoop Client Runtime ....................... SUCCESS [01:05 min]
[INFO] Apache Hadoop Client Packaging Invariants .......... SUCCESS [  0.262 s]
[INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [02:00 min]
[INFO] Apache Hadoop Client Packaging Invariants for Test . SUCCESS [  0.174 s]
[INFO] Apache Hadoop Client Packaging Integration Tests ... SUCCESS [  0.151 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [ 22.983 s]
[INFO] Apache Hadoop Client Modules ....................... SUCCESS [  0.053 s]
[INFO] Apache Hadoop Cloud Storage ........................ SUCCESS [  0.607 s]
[INFO] Apache Hadoop Cloud Storage Project ................ SUCCESS [  0.054 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14:07 min
[INFO] Finished at: 2021-06-30T00:10:40+08:00
[INFO] Final Memory: 406M/2110M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "dev" could not be activated because it does not exist.

看截图:

编译好的安装文件,在这个目录下:

${源码}/hadoop-dist/target/hadoop-3.2.1

我们需要的压缩包在 lib/native 下。

${源码}/hadoop-dist/target/hadoop-3.2.1/lib/native

拷贝 native 下的文件,到已经 Hadoop 集群的安装目录中,然后检查它对本地库的支持。

没有恼人的 WARN 警告,zlib、snappy 等压缩功能也都有了✌️

7 - 经验总结

1)尽量用 CentOS系统编译。macOS 编译,大部分本地库都不会通过,会卡死在 CMake。

2)额外使用的环境变量如下:

# 本地编译 Hadoop,必须设置 ZLIB_ROOT,且在 CMakeFile 中启用 cmake 的 CMP0074 策略:
export ZLIB_ROOT=/usr/local/Cellar/zlib/1.2.11
# export ZLIB_LIBRARY=/usr/local/Cellar/zlib/1.2.11/lib
# export ZLIB_INCLUDE_DIR=/usr/local/Cellar/zlib/1.2.11/include

export OPENSSL_ROOT_DIR="/usr/local/opt/openssl@1.1"
export OPENSSL_INCLUDE_DIR="$OPENSSL_ROOT_DIR/include"
export PKG_CONFIG_PATH="${OPENSSL_ROOT_DIR}/lib/pkgconfig"

参考资料 - 价值顺序

mac系统编译3.2.1版本hadoop
Mac OSX 编译hadoop本地库
Compile-Hadoop2.2.0-on-MacOS
hadoop源码研究 编译错误记录


版权声明

作者:瘦风(https://healchow.com)

出处:博客园-瘦风的南墙(https://www.cnblogs.com/shoufeng)

感谢阅读,公众号 「瘦风的南墙」 ,手机端阅读更佳,还有其他福利和心得输出,欢迎扫码关注🤝

本文版权归博主所有,欢迎转载,但 [必须在页面明显位置标明原文链接],否则博主保留追究相关人士法律责任的权利。

posted @ 2021-07-02 09:23  瘦风  阅读(3557)  评论(0编辑  收藏  举报