NUTCH 1.13获取url失败：org.apache.NUTCH.protocol.protocolnotfound：未找到url=HTTP的协议

Question

获取httpurl失败，原因是：org.apache.nutch.protocol.protocolnotfound：在org.apache.nutch.protocol.protocolfactory.getProtocol(protocolfactory.java:85)在org.apache.nutch.fetcher.fetcherthread.run（fetcherthread.java:285)处未找到URL=HTTP的协议

使用队列模式：byHost，对httpsurl的fetch失败，:org.apache.nutch.protocol.protocolnotfound:在org.apache.nutch.protocol.protocolfactory.getProtocol(protocolfactory.java:85)，在org.apache.nutch.fetcher.fetcherthread.run（fetcherthread.java:285)，没有找到URL=https的协议

在使用Solr6.6.0运行Nutch1.13时，我得到了高于此的结果

我使用的命令是

bin/crawl-i-d solr.server.url=http://myip/solr/nutch/urls/crawl 2

  <name>plugin.includes</name>
  <value>
protocol-(http|httpclient)|urlfilter-regex|parse-(html)|index-(basic|anchor)|indexer-solr|query-(basic|site|url)|response-(json|xml)|summary-basic|scoring-opic|urlnormalizer-(pass|regex|basic)
</value>

    [root@localhost apache-nutch-1.13]# ls plugins
creativecommons      index-more           nutch-extensionpoints   protocol-file                 scoring-similarity         urlnormalizer-ajax
feed                 index-replace        parse-ext               protocol-ftp                  subcollection              urlnormalizer-basic
headings             index-static         parsefilter-naivebayes  protocol-htmlunit             tld                        urlnormalizer-host
index-anchor         language-identifier  parsefilter-regex       protocol-http                 urlfilter-automaton        urlnormalizer-pass
index-basic          lib-htmlunit         parse-html              protocol-httpclient           urlfilter-domain           urlnormalizer-protocol
indexer-cloudsearch  lib-http             parse-js                protocol-interactiveselenium  urlfilter-domainblacklist  urlnormalizer-querystring
indexer-dummy        lib-nekohtml         parse-metatags          protocol-selenium             urlfilter-ignoreexempt     urlnormalizer-regex
indexer-elastic      lib-regex-filter     parse-replace           publish-rabbitmq              urlfilter-prefix           urlnormalizer-slash
indexer-solr         lib-selenium         parse-swf               publish-rabitmq               urlfilter-regex
index-geoip          lib-xml              parse-tika              scoring-depth                 urlfilter-suffix
index-links          microformats-reltag  parse-zip               scoring-link                  urlfilter-validator
index-metadata       mimetype-filter      plugin                  scoring-opic                  urlmeta

我被这个问题卡住了。正如您所看到的，我已经包含了两个协议-（httphttpclient）。但是仍然无法获取url。提前谢了。

更新问题Hadoop.log

2017-09-01 14:35:07,172 INFO solr.solrindexwriter-solrindexer:deleting 1/1 documents 2017-09-01 14:35:07,321 WARN Output.fileoutputcommitter-output Path is null in cleanupJob（）2017-09-01 14:35:07,323 WARN mapred.localjobrunner-job_local1176811933_0001 java.lang.exception:java.lang.illegalstateexception：连接池在LocalJobrunner$job.run（localJobrunner.java:529)引起的原因：java.lang.IllegalStateException：连接池在org.apache.http.util.asserts.check（asserts.java:34)在org.apache.http.pool.abstractConnpool.lease（AbstractConnpool.java:169)在org.apache.http.pool.abstractConnpool.lease（AbstractConnpool.java:202)在defaultRequestDirector.java:415)位于org.apache.ht在org.apache.http.impl.client.closeablehttpclient.closeablehttpclient.execute(closeablehttpclient.java:863)，在org.apache.http.impl.client.closeablehttpclient.java:106)，在org.apache.http.impl.client.closeablehttpclient.execute(closeablehttpclient.java:57)，在org.apache.solr.client.solrj.impl.httpsolrclient.executeemethod(httpsolrclient.java:481)Apache.solr.client.solrj.impl.httpsolrclient.request(httpsolrclient.java:240)在org.apache.solr.client.solrj.impl.httpsolrclient.request(httpsolrclient.java:229)在org.apache.solr.client.solrrequest.process（solrrequest.java:149)在org.apache.solr.client.solrclient.commit（solrclient.java:482)在solrIndexWriter.commit（solrIndexWriter.java:191)在org.apache.nutch.IndexWriter.solr.IndexWriter.close（solrIndexWriter.java:179)在org.apache。在org.apache.nutch.indexwriters.close(indexwriters.java:117)在org.apache.nutch.indexer.cleaningjob$deleterreducer.close(cleaningjob.java:122)在org.apache.hadoop.io.ioutils.cleanup(ioutils.java:244)在org.apache.hadoop.mapred.reducetask.runoldreducer(reducetask.java:459)在org.apache.hadoop.mapred.reducetask.run jobrunner.java:319)在java.util.concurrent.executors$runnableadapter.call（executors.java:511)在java.util.concurrent.futuretask.run（futuretask.java:266)在java.util.concurrent.threadpoolexecutor.runworker（threadpoolexecutor.java:1149)在java.util.concurrent.threadpoolexecutor.worker.run（在org.apache.hadoop.mapred.jobclient.runjob(jobclient.java:865)在org.apache.nutch.indexer.cleaningjob.delete（cleaningjob.java:174)在org.apache.nutch.indexer.cleaningjob.run（cleaningjob.java:174)在org.apache.nutch.indexer.cleaningjob.run（cleaningjob.java:197)在org.apache.hadoop.util.toolrunner.run（

Answer 1

我不知怎么解决了这个问题。我认为nutch-site.xml中的空间导致了新插件的问题。包括其他来这里的人的部分。

      <name>plugin.includes</name>
  <value>protocol-http|protocol-httpclient|urlfilter-regex|parse-(html)|index-(basic|anchor)|indexer-solr|query-(basic|site|url)|response-(json|xml)|summary-basic|scoring-opic|urlnormalizer-(pass|regex|basic)</value>