[Pytest-commit] Issue #654: add pass rate option to pytest (hpk42/pytest)

[Sorin Sbarnea]

New issue 654: add pass rate option to pytest
https://bitbucket.org/hpk42/pytest/issue/654/add-pass-rate-option-to-pytest

Sorin Sbarnea:

When you are doing testing at a big scale, and more than just unittesting, like integration testing you will definitely end-up having test that are broken for a long time, tests that to fail almost randomly (flapping) and you will probably never be able to obtain a 100% pass rate.

This means that pytest will always fail and you will not be able to pass this stage. 

As a side effect the development team will give less importance to this as it always RED.

If we would have a pass rate, this would enable to make the result as a success even if we have some failures. 

This would allow you to start CI process with a low pass rate and to slowly increase it over time.

It seems that currently pytest does not allow this, or I just don't know how to obtain this behaviour.