为什么选择文本的XPath不工作？

Question

 <span>
    <a href="www.imagine_a_link_here.org">
      "
                This is the text I need to access
             "
    </a>
 </span>

import requests
from lxml import html,etree
from lxml.html import document_fromstring

page = requests.get('https://www.the_link_im_trying_to_webscrape.org')
tree = html.fromstring(page.content)
the_text_i_need_to_access_xpath = '/span/a/text()'
the_text_i_need_to_access = tree.xpath(the_text_i_need_to_access_xpath)

Answer 1

如果XPath中的文本没有节点，如何访问它？

XML或HTML文档中的文本将与节点相关联。这不是这里的问题。而“”分隔符只是用来显示周围的空格。

如图所示，XPath应该选择a元素中的文本。以下是一些可能不会发生的原因：

null

null

fromString(string):返回document_fromString或fragment_fromString，根据字符串看起来是完整的文档还是只是一个片段。

鉴于此，以下是对您的代码的更新，它将按照预期选择目标文本：

import requests
from lxml import html
from lxml.html import document_fromstring

htmlstr = """
<span>
   <a href="www.imagine_a_link_here.org">
     "
               This is the text I need to access
            "
   </a>
</span>
"""

tree = html.fromstring(htmlstr)
print(html.tostring(tree))
the_text_i_need_to_access_xpath = '//span/a/text()'
the_text_i_need_to_access = tree.xpath(the_text_i_need_to_access_xpath)
print(the_text_i_need_to_access)

或者，如果您不需要/不想要HTML惊喜，这也会选择文本：

import lxml.etree as ET

xmlstr = """
 <span>
    <a href="www.imagine_a_link_here.org">
      "
                This is the text I need to access
             "
    </a>
 </span>
"""

root = ET.fromstring(xmlstr)
print(root.xpath('/span/a/text()'))