[pytest-dev] parametrize + xfail

[Brianna Laugher]

Hi again :)

A common problem I have is that I have a test that is parametrized with
py.test.mark.parametrize, I discover a bug, I want to add another test case
for that bug and mark it as xfail.

I have done something based on
http://stackoverflow.com/questions/12364801/how-to-mark-some-generated-tests-as-xfail-skip
for pytest_generate type functions, but it is awkward to do without
disrupting the existing cases, and somewhat overkill in cases where the
xfail is likely to be resolved (the bug is fixed) soon.

With py.test.mark.parametrize, I notice
https://bitbucket.org/hpk42/pytest/issue/124/allow-individual-parametrized-values-to-be

I was just thinking about this now and I wonder if it is possible to build
a decorator like this?

@py.test.mark.parametrizexfail('duration', 'expectedBrackets'), [
    (7, [None, None, None, 7]),
    (19, [None, 7, 6, 6]),
])
@py.test.mark.parametrize(('duration', 'expectedBrackets'), [
    (24, [6, 6, 6, 6]),
    (23, [6, 6, 6, 6]),
    (25, [6, 6, 6, 6]),
])

So 5 cases would be fed into the test, with only the first two marked as
xfail.


Also while I'm at it, it could be good for pytest to issue a warning if
someone uses a mark called parameterize, parametrise or parameterise,
because I've been caught pondering why a mark wasn't working properly at
least once :)

cheers
Brianna



-- 
They've just been waiting in a mountain for the right moment:
http://modernthings.org/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pytest-dev/attachments/20130422/5616c387/attachment.html>