在python中提供测试数据

Question

如何针对大量不同的数据运行相同的测试？我想要报告全部失败。

例如：

def isEven(number): 
    return True # quite buggy implementation 

data = [ 
    (2, True), 
    (3, False), 
    (4, True), 
    (5, False), 
] 

class MyTest: 
    def evenTest(self, num, expected): 
     self.assertEquals(expected, isEven(num)) 

我已经找到解决方案，提出了只有第一次失败的错误： http://melp.nl/2011/02/phpunit-style-dataprovider-in-python-unit-test/

如何运行测试报告所有的失败？

Answer 1

您应该使用py.test，我觉得unittest模块盲目地从JUnit的复制，反正你可以破解你的方式是这样

import unittest 

data = [ 
    (2, True), 
    (3, False), 
    (4, True), 
    (5, False)] 

# this should be imported from a separate module. 
def isEven(number): 
    return True # quite buggy implementation 

def create_test_func(num, expected): 
    def _test_func(self): 
     self.assertEqual(expected, isEven(num)) 
    return _test_func 

class TestIsEven(unittest.TestCase): 

    pass 

# pyunit isn't pythonic enought use py.test instead 
# till then we rely on such hackery 
import new 
for i, (num, expected) in enumerate(data): 
    setattr(TestIsEven, 'test_data_%d'%i, create_test_func(num, expected)) 

if __name__ == "__main__": 
    unittest.main() 

和输出：

.F.F 
====================================================================== 
FAIL: test_data_1 (__main__.TestIsEven) 
---------------------------------------------------------------------- 
Traceback (most recent call last): 
    File "untitled-1.py", line 15, in _test_func 
    self.assertEqual(expected, isEven(num)) 
AssertionError: False != True 

====================================================================== 
FAIL: test_data_3 (__main__.TestIsEven) 
---------------------------------------------------------------------- 
Traceback (most recent call last): 
    File "untitled-1.py", line 15, in _test_func 
    self.assertEqual(expected, isEven(num)) 
AssertionError: False != True 

---------------------------------------------------------------------- 
Ran 4 tests in 0.000s 

FAILED (failures=2) 

使用这种方法你可以添加更多的细节，如打印调试失败信息等

Answer 2

import unittest 

data = [ 
    (2, True), 
    (3, False), 
    (4, True), 
    (5, False)] 

# this should be imported from a separate module. 
def isEven(number): 
    return True # quite buggy implementation 


class TestIsEven(unittest.TestCase): 
    def test_is_even(self): 
     for num, expected in data: 
      self.assertEqual(expected, isEven(num)) 

Answer 3

一种解决方案是让每个条目不同的测试案例的实例在data：

class MyTest(unittest.TestCase): 
    def __init__(self, num, expected): 
     unittest.TestCase.__init__(self, "evenTest") 
     self.num = num 
     self.expected = expected 
    def evenTest(self): 
     self.assertEqual(self.expected, isEven(self.num)) 

对于unittest知道如何构建测试的情况下，添加一个load_tests()功能，以您的模块：

def load_tests(loader, tests, pattern): 
    return unittest.TestSuite(MyTest(num, expected) 
           for num, expected in data) 

Answer 4

你是在找这样的事：

import unittest 


def is_even(number): 
    return True # quite buggy implementation 


class TestCase(unittest.TestCase): 
    def setUp(self): 
     self.expected_output = [ 
      (2, True), 
      (3, False), 
      (4, True), 
      (5, False) 
     ] 

    def test_is_even(self): 
     real_res = [] 

     for arg, _ in self.expected_output: 
      real_res.append((arg, is_even(arg))) 

     msg_error = '\nFor %s Expected %s Got %s' 
     msg = [] 
     for res1, res2 in zip(real_res, self.expected_output): 
      if res1[1] != res2[1]: 
       msg.append(msg_error % (res1[0], res1[1], res2[1])) 


     self.assertEqual(real_res, self.expected_output, "".join(msg)) 


if __name__ == '__main__': 
    unittest.main() 

输出：

F 
====================================================================== 
FAIL: test_is_even (__main__.TestCase) 
---------------------------------------------------------------------- 
Traceback (most recent call last): 
    File "test.py", line 29, in test_example 
    self.assertEqual(real_res, self.expected_output, ''.join(msg)) 
AssertionError: 
For 3 Expected True Got False 
For 5 Expected True Got False 

---------------------------------------------------------------------- 
Ran 1 test in 0.000s 

FAILED (failures=1) 

Answer 5

我还发现阿德里安Panasiuk方法，从这样的回答：

Python's unittest and dynamic creation of test cases

有了这个解决方案，可以根据数据来设置不同的测试名称。

Answer 6

如果您使用的是pytest y OU可以走这条路：

import pytest                             

def is_even(number): 
    return True # quite buggy implementation 

@pytest.mark.parametrize("number, expected", [ 
    (2, True), 
    (3, False), 
    (4, True), 
    (5, False) 
]) 
def test_is_even(number, expected): 
    assert is_even(number) == expected 

你会得到类似的信息（缩短）：

/tmp/test_it.py:13: AssertionError 
=========== 2 failed, 2 passed in 0.01 seconds ====================