webmagic创始人回答:ebMagic默认的HttpClient只会用TLSv1去请求,对于某些只支持TLS1.2的站点(例如 https://juejin.im/) ,就会报错:
见官方文档解决方案:https://github.com/code4craft/webmagic/issues/701
webmagic创始人回答:
code4craft commented on 29 Nov 2017 • 更新会在0.7.4版本发布。 临时适配方式,修改HttpClientGenerator中的buildSSLConnectionSocketFactory方法, return new SSLConnectionSocketFactory(createIgnoreVerifySSL(), new String[]{"SSLv3", "TLSv1", "TLSv1.1", "TLSv1.2"}, null, new DefaultHostnameVerifier())
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | WebMagic默认的HttpClient只会用TLSv1去请求,对于某些只支持TLS1. 2 的站点(例如 https: //juejin.im/) ,就会报错: javax.net.ssl.SSLException: Received fatal alert: protocol_version at sun.security.ssl.Alerts.getSSLException(Alerts.java: 208 ) at sun.security.ssl.Alerts.getSSLException(Alerts.java: 154 ) at sun.security.ssl.SSLSocketImpl.recvAlert(SSLSocketImpl.java: 2023 ) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java: 1125 ) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java: 1375 ) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java: 1403 ) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java: 1387 ) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java: 394 ) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java: 353 ) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java: 141 ) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java: 353 ) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java: 380 ) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java: 236 ) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java: 184 ) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java: 88 ) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java: 110 ) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java: 184 ) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java: 82 ) at us.codecraft.webmagic.downloader.HttpClientDownloader.download(HttpClientDownloader.java: 85 ) 现在的修改方式是在HttpClientGenerator中构建SSLConnectionSocketFactory时加上支持。 |
做产品的程序,才是好的程序员!
分类:
httpClient
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· Linux系列:如何用heaptrack跟踪.NET程序的非托管内存泄露
· 开发者必知的日志记录最佳实践
· SQL Server 2025 AI相关能力初探
· Linux系列:如何用 C#调用 C方法造成内存泄露
· AI与.NET技术实操系列(二):开始使用ML.NET
· 被坑几百块钱后,我竟然真的恢复了删除的微信聊天记录!
· 没有Manus邀请码?试试免邀请码的MGX或者开源的OpenManus吧
· 【自荐】一款简洁、开源的在线白板工具 Drawnix
· 园子的第一款AI主题卫衣上架——"HELLO! HOW CAN I ASSIST YOU TODAY
· Docker 太简单,K8s 太复杂?w7panel 让容器管理更轻松!