2017-07-03 108 views
0

我试图将我的scratch数据放在云上的firebase帐户上,但是当我运行蜘蛛时,我得到了这个ImportError。我尝试制作新项目,甚至在Python的特定版本上重新安装了firebaseshub,但没有任何帮助。ScrapingHub:ImportError:没有名为firebase的模块

蜘蛛在我的机器上完美运行,并且不显示任何ImportErrors。 这里是错误日志。

Traceback (most recent call last): 
    File "/usr/local/lib/python2.7/site-packages/scrapy/utils/defer.py", line 102, in iter_errback 
    yield next(it) 
    File "/usr/local/lib/python2.7/site-packages/sh_scrapy/middlewares.py", line 30, in process_spider_output 
    for x in result: 
    File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in process_spider_output 
    for x in result: 
    File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/referer.py", line 339, in <genexpr> 
    return (_set_referer(r) for r in result or()) 
    File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/urllength.py", line 37, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/usr/local/lib/python2.7/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/app/__main__.egg/Terminator/spiders/IcyTermination.py", line 18, in parse 
    from firebase import firebase 
ImportError: No module named firebase 

有帮助吗?

回答

1

由于声誉我无法评论。但是你有没有创建你的requirements.txt?

Here你会发现如何将自己的依赖部署到scrapinghub。

基本上你创建你的项目的根requirements.txt文件,每行一个依赖性,并添加

requirements_file:requirements.txt

您scrapinghub.yml文件

+0

但是,这不是” t那require.txt是出于错误的目的是在项目的部署中?我的项目成功部署,但在运行时出现此错误。 –

+0

requirements.txt会通知scrapinghub它必须安装哪些新软件包来运行你的蜘蛛。您可能会成功部署并仍然会导入错误。 如果你已经设置了requirements.txt文件,让我看看你的scrapinghub.yml –