in the meantime, till all tests clean up their data, i think it is best to fail that test, delete the data and then continue. no ?
the extra checks i added reveal that a lot more tests don't yet clean up their data then originally was indicated in terms of jira issues.
Well, as you can see here
a large portion of tests are failing because of this. Generally, if one introduces regression he should fix it the next day, which should always possible with rollback.
We did have successful test runs where these additional left over records did not matter. Yes the test does not clean up properly, but if the following tests are not effected this is not a critical issue and can be dealt with in the next release cycle.