2020
09-27
09-27
如何基于线程池提升request模块效率
普通方法:爬取梨视频importreimporttimeimportrandomimportrequestsfromlxmlimportetreestart_time=time.time()url="https://www.pearvideo.com/category_3"headers={"User-Agent":"Mozilla/5.0(WindowsNT10.0;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/79.0.3945.88Safari/537.36"}ex='srcUrl="(.*?)",vdoUrl=srcUrl'defrequest_video(url):"""向视频链接发送请求"""retu...
继续阅读 >