如何搜索网站投资获取股票的每一个技术分析

Question

null

下面是一张查看我想获取的数据的图像:https://I.ibb.co/mhpm0yw/capture-d-e-cran-2019-08-14-a-00-15-45.png

url是https://investing.com/equities/credit-agricole-technical

当您导航到浏览器时，期间被设置为“每小时”，您必须单击另一个期间才能获得正确的数据。DOM在XML请求之后更新。

我试着用Mechanize刮，点击“Weekly”，让DOM刮它，但我得到了一个错误

下面是我的代码：

    def mechanize_scraper(url)
      agent = Mechanize.new
      puts agent.user_agent_alias = 'Mac Safari'
      page = agent.get(url)
      link = page.link_with(text: 'Weekly')
      new_page = link.click
    end


    url = "https://investing.com/equities/credit-agricole-technical"
    mechanize_scraper(url)

以下是错误：

    <li pairid="407" data-period="week" class="">
      <a href="javascript:void(0);">Weekly</a>
    </li>

    def watir_scraper(url)
      Watir.default_timeout = 10
      browser = Watir::Browser.new
      browser.goto(url)       
      link = browser.link(text: /weekly/).click
      pp link
    end

    url = "https://investing.com/equities/credit-agricole-technical"
    watir_scraper(url)

40：摘自第47页：在''

39：摘自app.rb:32:在'watir_scraper'中

38：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/watir-6.16.5/lib/watir/elements/element.rb:145:在`单击‘中

35：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/common/element.rb:74:在`单击‘中

34：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/w3c/bridge.rb:371:在'click_element'中

33：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/w3c/bridge.rb:567:在`执行‘中

32：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/bridge.rb:167:在`execute'中

31：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/http/common.rb:64:在`调用‘中

30：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/http/default.rb:114:在“请求”中

29：from/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/http/common.rb:88:in'create_response‘

28：来自/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/http/common.rb:88:在`新建‘中

27：from/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/response.rb:34:in'initialize'

26：from/users/remicarette/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/selenium-webdriver-3.142.3/lib/selenium/webdriver/remote/response.rb:72:in'assert_ok'

25:from 25 libsystem_pthread.dylib 0x00007fff5aaa440d thread_start+13

24:from 24 libsystem_pthread.dylib 0x00007fff5aaa8249_pthread_start+66

22：从22 chromedriver 0x000000010B434E67 chromedriver+3673703

21：从21 chromedriver 0x000000010B416014 chromedriver+3547156

20：从20 chromedriver 0x000000010B3E0F07 chromedriver+3329799

16：从16 chromedriver 0x000000010B3F8940 chromedriver+3426624

15：从15 chromedriver 0x000000010B3ECC1F chromedriver+3378207

14：从14 chromedriver 0x000000010B0CE8A5 chromedriver+108709

10：从10 chromedriver 0x000000010B0F1C4E chromedriver+253006

9：从9 chromedriver 0x000000010B0CFA66 chromedriver+113254

8：从8 chromedriver 0x000000010B0F1A72 chromedriver+252530

4：从4 chromedriver 0x000000010B0D8D19 chromedriver+150809

3：从3 chromedriver 0x000000010B0DA569 chromedriver+157033

2：从2 chromedriver 0x000000010B15FCEF chromedriver+703727

1：从1 chromedriver 0x000000010B3BF133 chromedriver+3191091 0x000000010B42F129 chromedriver+3649833:元素单击拦截：元素...在点（544,704）不可单击。其他元素将收到click:...(Selenium：：WebDriver：：Error：：ElementClickInterceptedError）（会话信息:chrome=76.0.3809.100)

我希望一切能帮助你理解我的问题。我想知道我是否可以用Mechanize或WATIR刮数据。如果没有，哪些工具可以完成这项工作？

多谢！

Answer 1

我不认为这正是你要找的，但它可能会让你更近一点。

使用HTTP嗅探器，发现您试图单击的链接生成了一个帖子。该帖子的回应可通过以下方式获得：

def mechanize_poster(url)
  agent = Mechanize.new
  headers = {
    'X-Requested-With' => 'XMLHttpRequest',
    'User-Agent' => 'Mac Safari',
    'Content-Type' => 'application/x-www-form-urlencoded',
    'Referer' => 'https://www.investing.com/equities/credit-agricole-technical'
  }
  fields = {
    period: 'week',
    viewType: 'normal',
    pairID: '407'
  }
  page = agent.post(url, fields, headers)
  p page
end

我认为您需要使用一些Nokogiri来获取数据值。