Scraping multiple sites in parallel and memory consumption - Google Groups
Ross Chapman Post reply
![]()
May 4 (2 days ago)
Depending on how thorough you're scraping, you can disable image loading, running javascript, and loading plugins (flash, silverlight, etc...) when constructing casper in the options argument. This will definitely save memory.Eg:var casper = require('casper').create({loadImages: false,javascriptEnabled: false,loadPlugins: false});
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】凌霞软件回馈社区,博客园 & 1Panel & Halo 联合会员上线
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】博客园社区专享云产品让利特惠,阿里云新客6.5折上折
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步