僵尸错误 - 获取http请求时出错

我正在使用NodeJs和ZombieJS在虚拟浏览器环境中获取url请求。僵尸错误 - 获取http请求时出错

我使用下面的代码：

var zombie = require('zombie'), 
jsdom = require('jsdom'), 
my_sandbox = require('sandbox'), 
url = require('url'), 
http = require('http'), 
request = require('request'), 
httpProxy = require('./lib/node-http-proxy'), 
des = '', 
util = require('util'), 
colors = require('colors'), 
is_host = true; 

var s = new my_sandbox(); 
var browser = new zombie.Browser; 

httpProxy.createServer(9000, 'localhost').listen(8000); 

function zombieFetching(page) { 
    browser.visit(page, { debug: false }, 
    function(err, browser, status) { 
     if(err) { 
     console.log('There is an error. Fix it'); 
     throw(err.message); 
     } else { 
      console.log('Browser visit successful') ; 
     } 
    }); 
} 

var server = http.createServer(function (req, res) { 
    var pathname = ''; 

    if(is_host) { 
     dest = req.url.substr(0, req.url.length); 
     pathname = dest; 
     is_host = false; 
    } else { 
     pathname = req.url.substr(0, req.url.length); 
     if(pathname.charAt(0) == "/") { 
      console.log('new request'); 
      console.log(pathname); 
      pathname = dest + pathname; 
     } 
    } 

    request.get({uri: pathname}, function (err, response, html) { 
      console.log('The pathname is:::::::::: ' + pathname); 
      zombieFetching(pathname); 
      res.end(html); 
    }); 
}); 

server.listen(9000);

我看到下面的错误，当我尝试获取的URL： “www.yahoo.com”

home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/tokenizer.js:62 
       throw(e); 
    ^
Error: undefined: Invalid character in tag name: �� 
    at Object.createElement (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/jsdom/lib/jsdom/level1/core.js:1174:13) 
    at TreeBuilder.createElement (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/treebuilder.js:29:25) 
    at TreeBuilder.insert_element_normal (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/treebuilder.js:61:21) 
    at TreeBuilder.insert_element (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/treebuilder.js:52:15) 
    at Object.startTagOther (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/parser/in_body_phase.js:483:12) 
    at Object.processStartTag (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/parser/phase.js:43:44) 
    at EventEmitter.do_token (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/parser.js:94:20) 
    at EventEmitter.<anonymous> (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/parser.js:112:30) 
    at EventEmitter.emit (events.js:64:17) 
    at EventEmitter.emitToken (/home/seed/Desktop/Cloud project/node_modules/zombie/node_modules/html5/lib/html5/tokenizer.js:84:7)

此外，日志报表如下：

The pathname is:::::::::: http://www.yahoo.com/ 
The pathname is:::::::::: http://l1.yimg.com/a/i/ww/news/2011/05/06/zuckhouse-sm.jpg 
The pathname is:::::::::: http://l1.yimg.com/a/i/ww/news/2011/05/07/cable-sm.jpg 
The pathname is:::::::::: http://l.yimg.com/a/a/1-/flash/promotions/yahoo/081120/70x50iltlb_2.jpg 

Browser visit successful 

Browser visit successful 

Browser visit successful 

Browser visit successful 

The pathname is:::::::::: http://l.yimg.com/a/i/vm/2011may/bird74.jpg 
The pathname is:::::::::: http://www.yahoo.com/jserror?ad=1&target=cms&data=FPAD

从我所了解的情况来看，前四个获得请求是成功的。不过，我不知道为什么僵尸被提取的无效请求：

"http://www.yahoo.com/jserror?ad=1&target=cms&data=FPAD"

而且，是什么原因造成的标记名称错误的无效字符？

感谢，索尼

来源

2011-05-08 sony

如果我请求url：http://unixhelp.ed.ac.uk/CGI/man-cgi?grep，错误日志是：throw（err.message）; ^ 无法加载资源http://unixhelp.ed.ac.uk/favicon.ico，得到404.此网址无效，我不确定为何要提取此请求。我不确定这是否是node/zombie中的错误，或者我的代码中是否有错误。 – sony 2011-05-08 23:03:54

favicon.ico总是由浏览器请求;僵尸正在模拟这种行为。它不在HTTP协议的任何位置，但它只是浏览器倾向于做的事情，所以它们在支持它的网站的地址栏中显示那个漂亮的图标。您可能会看到jserror?请求，因为Zombie在某个时间收到301（重定向）该URL，并且一直跟随它，或者页面上的某个其他元素引用它。默认情况下，Zombie的处理程序试图关注所有内容，这就是为什么你要获取图像等等，就像浏览器一样。

如果你设置了browser.debug = true我认为你可以获得比你的日志语句给你更多的信息。

来源

2011-05-09 23:35:58

僵尸错误 - 获取http请求时出错

回答

相关问题