使用XPath获取HTML元素的文本内容？

Question

见这个网站

<div> 
    <p> 
    <span class="abc">Monitor</span> <b>$300</b> 
    </p> 
    <a href="/add">Add to cart</a> 
</div> 
<div> 
    <p> 
    <span class="abc">Keyboard</span> $20 
    </p> 
    <a href="/add">Add to cart</a> 
</div> 

使用XPath我想分析Monitor $300和Keyboard $20。我用这个xpath

//div[a[contains(., "Add to cart")]]/p/text() 

但它选择<span class="abc">Monitor</span> <b>$300</b>。我不想要标签。我如何获得文本？

Answer 1

您想选择所有后代文本，不只是孩子的文字：

//div[a[contains(., "Add to cart")]]/p//text() 

注p和text()之间存在的双斜线。

虽然这可能也会包含大量的内部标记空白，但您需要清理它。使用示例lxml：

>>> import lxml.etree as ET 
>>> tree = ET.fromstring('''<div> 
... <div> 
...  <p> 
...  <span class="abc">Monitor</span> <b>$300</b> 
...  </p> 
...  <a href="/add">Add to cart</a> 
... </div> 
... <div> 
...  <p> 
...  <span class="abc">Keyboard</span> $20 
...  </p> 
...  <a href="/add">Add to cart</a> 
... </div> 
... </div>''') 
>>> tree.xpath('//div[a[contains(., "Add to cart")]]/p//text()') 
['\n ', 'Monitor', ' ', '$300', '\n ', '\n ', 'Keyboard', ' $20 \n '] 
>>> res = _ 
>>> [txt for txt in (txt.strip() for txt in res) if txt] 
['Monitor', '$300', 'Keyboard', '$20']