python multi_python模块介绍- multi-mechanize 性能测试工具
python模块介绍- multi-mechanize 性能测试工具
2013-09-13 磁针石
#承接软件自动化实施与培训等gtalk：ouyangchongwu#gmail.comqq 37391319
#版权所有，转载刊登请来函联系
# 深圳测试自动化python项目接单群113938272深圳广州软件测试开发 6089740
#深圳湖南人业务户外群 66250781武冈洞口城步新宁乡情群49494279
#参考资料：python手册
Multi-Mechanize 是一个开源的性能和负载测试框架，它并发运行多个 Python 脚本对网站或者服务生成负载(组合事务)。
Multi-Mechanize最常用于web性能和可扩展性(scalability)测试，也适用于任何python可以访问的API。
测试输出报告保存为HTML或JMeter的兼容的XML。主要特性：
支持各种 HTTP methods
高级超链接和HTML表单支持
支持 SSL
自动处理 Cookies
可设置HTTP头
自动处理重定向
支持代理
支持 HTTP 认证
安装
使用标准的python安装方式。注意，需要安装matplotlib以支持作图，在centos6下面可以这样安装yum -y install python27-matplotlib。这里都以linux(centos)为例。
快速入门：
创建项目：# multimech-newproject my_project
执行项目：# multimech-run my_project
user_groups: 2
threads: 6
[================100%==================] 30s/30s transactions: 119 timers:119 errors: 0
waiting for all requests tofinish...
analyzing results...
transactions: 125
errors: 0
test start: 2013-09-13 11:47:47
test finish: 2013-09-13 11:48:16
created:./my_project/results/results_2013.09.13_11.47.46/results.html
done.
至此，我们已经完成了一个简单的性能测试。
查看性能测试结果：./my_project/results/results_2013.09.13_11.47.46/results.html
Performance Results Report
Summary
transactions:125
errors:0
run time: 30 secs
rampup: 0 secs
test start: 2013-09-1311:47:47
test finish: 2013-09-1311:48:16
time-series interval: 10secs
workload configuration:
group name
threads
script name
user_group-1
3
v_user.py
user_group-2
3
v_user.py
All Transactions
Transaction Response Summary (secs)
count
min
avg
80pct
90pct
95pct
max
stdev
125
1.021
1.499
1.796
1.890
1.972
2.002
0.282
Interval Details (secs)
interval
count
rate
min
avg
80pct
90pct
95pct
max
stdev
1
43
4.30
1.021
1.462
1.688
1.841
1.897
2.002
0.263
2
39
3.90
1.026
1.543
1.830
1.934
1.976
1.986
0.290
3
37
3.70
1.025
1.495
1.806
1.964
1.985
1.988
0.295
Graphs
Response Time: 10 sectime-series
Response Time: raw data (allpoints)
Throughput: 5 sec time-series
Custom Timer: Example_Timer
Timer Summary (secs)
count
min
avg
80pct
90pct
95pct
max
stdev
119
1.020
1.497
1.794
1.889
1.970
2.000
0.281
Interval Details (secs)
interval
count
rate
min
avg
80pct
90pct
95pct
max
stdev
1
43
4.30
1.020
1.461
1.686
1.839
1.895
2.000
0.262
2
39
3.90
1.025
1.542
1.828
1.932
1.975
1.984
0.289
3
37
3.70
1.024
1.493
1.804
1.962
1.983
1.986
0.295
Graphs
Response Time: 10 sectime-series
Response Time: raw data (allpoints)
Throughput: 10 sec time-series
目录结构：
每个测试项目包含以下内容：
config.cfg的配置文件。用于设定测试选项。
test_scripts/虚拟用户脚本的目录。在这里添加您的测试脚本。
results/:结果存储目录。对于每个测试都声称一个时间戳目录，里面包含结果的报告。
multimech-newproject，默认生成一个随机数的脚本。脚本如下：
# cat v_user.py
import random
import time
class Transaction(object):
def__init__(self):
pass
defrun(self):
r= random.uniform(1, 2)
time.sleep(r)
self.custom_timers['Example_Timer'] = r
if __name__ == '__main__':
trans= Transaction()
trans.run()
print trans.custom_timers
配置参数的含义如下：
run_time: duration of test (seconds)
rampup: duration of user rampup (seconds)
results_ts_interval: time series interval for results analysis (seconds)
progress_bar: turn on/off console progress bar during test run
console_logging: turn on/off logging to stdout
xml_report: turn on/off xml/jtl report
results_database: database connection string (optional)
post_run_script: hook to call a script at test completion (optional)
特别提下 rampup表示多长时间内加载完所有用户。详细的配置参见：http://testutils.org/multi-mechanize/configfile.html
脚本书写：
用Python书写，
测试脚本模拟虚拟用户对网站/服务/ API的请求，
每个脚本必须实现一个Transaction()类。这个类必须实现一个run()方法。基本的测试脚本结构如下：
class Transaction(object):
def run(self):
# do something here
return
运行期间，Transaction()实例化一次，run()方法则反复调用：
class Transaction(object):
def __init__(self):
# do per-user user setup here
#this gets called once on user creation
return
def run(self):
# do user actions here
# this gets called repeatedly
return
从结构上看，如果每次run如果需要setup和teardown，时间也会计算在run里面，会显得事务处理的时间更长。这个就需要使用定时器来精确计时。
另外脚本建议先调试之后在运行，因为Multi-Mechanize有可能报错不够精准。可以这样运行：# python v_suds.py。v_suds.py是你实际使用的脚本名。另外suds这个库好像实现时性能一般，并发200时，客户端cpu占用率经常会100%，为此web service如果要上大量用户的话，建议用其他库替代，比如soapPy。
下例使用mechanize进行web测试。
class Transaction(object):
def __init__(self):
pass
def run(self):
br = mechanize.Browser()
br.set_handle_robots(False)
resp =br.open('http://192.168.4.13/env.htm')
assert (resp.code == 200), 'BadResponse: HTTP %s' % resp.codes
assert ('service name' inresp.get_data())
下面用httplib库重写脚本，并增加定时器。通过定时器，可以分析各个步骤的耗时。
import httplib
import time
class Transaction(object):
defrun(self):
conn = httplib.HTTPConnection('192.168.4.13')
start = time.time()
conn.request('GET', '/env.htm')
request_time = time.time()
resp = conn.getresponse()
response_time = time.time()
conn.close()
transfer_time = time.time()
self.custom_timers['request sent'] = request_time - start
self.custom_timers['response received'] = response_time - start
self.custom_timers['content transferred'] = transfer_time - start
assert (resp.status == 200), 'Bad Response: HTTP %s' % resp.status
if __name__ == '__main__':
trans= Transaction()
trans.run()
fortimer in ('request sent', 'response received', 'content transferred'):
print '%s: %.5f secs' % (timer, trans.custom_timers[timer])
importmechanize
importtime
classTransaction(object):
def__init__(self):
pass
defrun(self):
# create a Browserinstance
br =mechanize.Browser()
# don't bother withrobots.txt
br.set_handle_robots(False)
# add a customheader so wikipedia allows our requests
br.addheaders=[('User-agent','Mozilla/5.0Compatible')]
# start the timer
start_timer=time.time()
# submit therequest
resp =br.open('http://www.wikipedia.org/')
resp.read()
# stop the timer
latency =time.time()-start_timer
# store the customtimer
self.custom_timers['Load_Front_Page']=latency
# verify responsesare valid
assert(resp.code==200),'Bad Response: HTTP%s'%resp.code
assert('Wikipedia, thefree encyclopedia'inresp.get_data())
# think-time
time.sleep(2)
# select first(zero-based) form on page
br.select_form(nr=0)
# set form field
br.form['search']='foo'
# start the timer
start_timer=time.time()
# submit the form
resp =br.submit()
resp.read()
# stop the timer
latency =time.time()-start_timer
# store the customtimer
self.custom_timers['Search']=latency
# verify responsesare valid
assert(resp.code==200),'Bad Response: HTTP%s'%resp.code
assert('foobar'inresp.get_data()),'Text AssertionFailed'
# think-time
time.sleep(2)
importurllib2
importtime
classTransaction(object):
defrun(self):
start_timer=time.time()
resp =urllib2.urlopen('http://www.example.com/')
content =resp.read()
latency =time.time()-start_timer
self.custom_timers['Example_Homepage']=latency
assert(resp.code==200),'Bad Response: HTTP%s'%resp.code
assert('Example Web Page'incontent),'Text AssertionFailed'
importurllib2
importtime
classTransaction(object):
def__init__(self):
self.custom_timers={}
withopen('soap.xml')asf:
self.soap_body=f.read()
defrun(self):
req =urllib2.Request(url='http://www.foo.com/service', data=self.soap_body)
req.add_header('Content-Type','application/soap+xml')
req.add_header('SOAPAction','http://www.foo.com/action')
start_timer=time.time()
resp =urllib2.urlopen(req)
content =resp.read()
latency =time.time()-start_timer
self.custom_timers['Example_SOAP_Msg']=latency
assert(resp.code==200),'Bad Response: HTTP%s'%resp.code
assert('Example SOAPResponse'incontent),'Text AssertionFailed'
importhttplib
importurllib
importtime
classTransaction(object):
def__init__(self):
self.custom_timers={}
defrun(self):
post_body=urllib.urlencode({
'USERNAME':'corey',
'PASSWORD':'secret',})
headers ={'Content-type':'application/x-www-form-urlencoded'}
start_timer=time.time()
conn =httplib.HTTPConnection('www.example.com')
conn.request('POST','/login.cgi', post_body, headers)
resp =conn.getresponse()
content =resp.read()
latency =time.time()-start_timer
self.custom_timers['LOGIN']=latency
assert(resp.status==200),'Bad Response: HTTP%s'%resp.status
assert('Example Web Page'incontent),'Text AssertionFailed'
参考资料：
http://testutils.org/multi-mechanize/