2012-08-08 64 views
1

我正在尝试龙卷风框架。但是我发现龙卷风在压力测试(使用多机械化)30秒后经常失败。我在多机械化中使用10个线程,并运行100秒,大约500个请求/秒。 30秒后失效率约为15%。整个测试大约100秒![在这里输入图片描述] [1]。根据统计数据,我意识到,失败可能是由于0.2秒后的超时。我搜索了几种方法来增加网络上的超时时间,但没有任何效果。下面如何增加龙卷风的超时时间

的是我的龙卷风代码:

import tornado.ioloop 
import tornado.web 

class MainHandler(tornado.web.RequestHandler): 
    @tornado.web.asynchronous 
    def get(self): 
     self.write("Hello, world") 
     self.finish() 

application = tornado.web.Application([ 
    (r"/", MainHandler), 
]) 

if __name__ == "__main__": 
    application.listen(8000) 
    tornado.ioloop.IOLoop.instance().start() 

这里是我的多机械化测试脚本:

import requests 
import random 
import time 

class Transaction(object): 
    def __init__(self): 
     pass 
    def run(self): 
     r = requests.get('http://127.0.0.1:8000') 
     output = r.raw.read() 
     assert(r.status_code == 200) 
     return output 

if __name__ == '__main__': 
    trans = Transaction() 
    trans.run() 
    print trans.custom_timers 

以下是我从multimech运行得到了错误消息

Traceback (most recent call last): 
    File "././test_scripts/v_user.py", line 12, in run 
    r = requests.get('http://127.0.0.1:8000') 
    File "/Library/Python/2.7/site-packages/requests/api.py", line 54, in get 
    return request('get', url, **kwargs) 
    File "/Library/Python/2.7/site-packages/requests/safe_mode.py", line 37, in wrapped 
    return function(method, url, **kwargs) 
    File "/Library/Python/2.7/site-packages/requests/api.py", line 42, in request 
    return s.request(method=method, url=url, **kwargs) 
    File "/Library/Python/2.7/site-packages/requests/sessions.py", line 230, in request 
    r.send(prefetch=prefetch) 
    File "/Library/Python/2.7/site-packages/requests/models.py", line 603, in send 
    timeout=self.timeout, 
    File "/Library/Python/2.7/site-packages/requests/packages/urllib3/connectionpool.py", line 415, in urlopen 
    body=body, headers=headers) 
    File "/Library/Python/2.7/site-packages/requests/packages/urllib3/connectionpool.py", line 267, in _make_request 
    conn.request(method, url, **httplib_request_kw) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 941, in request 
    self._send_request(method, url, body, headers) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 975, in _send_request 
    self.endheaders(body) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 937, in endheaders 
    self._send_output(message_body) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 797, in _send_output 
    self.send(msg) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 759, in send 
    self.connect() 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 740, in connect 
     self.timeout, self.source_address) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 571, in create_connection 
    raise err 
error: [Errno 49] Can't assign requested address 
+0

那么,你每秒发送5,000个请求? – 2012-08-08 01:53:01

+0

如果您需要每秒处理5000个请求,您将需要更多的后端。加载时间> 30秒的页面更糟糕,404的 – 2012-08-08 02:34:22

+0

我的Mac上每秒有大约500个请求。多机械化捕获的错误是Socket.error。 – Jimmy 2012-08-08 10:12:43

回答

0

要回答你如何更改龙卷风超时的问题,你需要修改龙卷风的bind_socket函数灰来设定超时:http://www.tornadoweb.org/documentation/_modules/tornado/netutil.html

sock.setblocking(0) 
sock.bind(sockaddr) 
sock.listen(backlog) 
sockets.append(sock) 

变化的第一行至sock.setblocking(1)。根据文档:http://docs.python.org/library/socket.html#socket.socket.settimeout

设置无的超时套接字操作上 s.settimeout(无)禁用超时相当于s.setblocking(1)。

但是,正如评论中所建议的,我认为你应该看看分配负载。

+0

我试过了你的建议,并增加了httpserver上的处理器。但它仍然在30秒后约15%(每秒约500个请求) – Jimmy 2012-08-09 02:06:26

+0

嗨,具体的错误代码和消息是什么? – 2012-08-09 02:21:26

+0

顺便说一句,我试图使用sock.listen(999999999999),似乎有助于将故障率降低到5%。但失败发生在30秒左右。之后,没有更多的失败发生。我不知道背后发生了什么。 – Jimmy 2012-08-13 05:10:19