不完整的网页xpath

if page == 1:
　　res = utils.multi_requests(url='https://moh.nugmyanmar.org/news-media/')
　　selector = etree.HTML(res.text)
　　tag_groups = selector.xpath("//*[@class='eael-post-grid eael-post-appender eael-post-appender-b68980b eael-post-grid-style-default']/article")
else:
　　res = self.multi_requests(url=url, data=payload, headers=headers)
　　selector = etree.HTML(res.text)
　　tag_groups = selector.xpath("body//article")
　　# selector = BeautifulSoup(res.text, "lxml")
　　# childrens = selector.select("article")

page不为一时 res.text时不完整的html   执行selector = etree.HTML(res.text)时 会在外面包裹一层body  可能还包裹了其他标签 所以 tag_groups = selector.xpath("body//article")

 

beautifulsoup对象也可用xpath  

webpage = requests.get(URL, headers=HEADERS,)
soup = BeautifulSoup(webpage.content, "html.parser")
dom = etree.HTML(str(soup))
print(dom.xpath('//*[@id="Python4"]/font')[0].text)