🕷 software projects

by ryan davis



Allow known bad tests to fail without failing CI

= minitest-allow

  • Allows you to provide an exclusion list of allowed failures/errors.
  • Failures and errors on this list still get run and reported as usual, but do not cause a non-zero exit code.
  • This enables you to have a green CI with against a list of known bad tests.
  • Run with -A path/to/allowed.yml to generate a list of failing tests.
  • Run with -a path/to/allowed.yml to allow listed tests to fail.
% ruby -Ilib test/has_known_bad_tests.rb -a allow.yml; echo $?
# or: rake test TESTOPTS="-a allow.yml"

Run options: -a allow.yml --seed 5200

# Running:


Finished in 0.000325s, 3076.9239 runs/s, 3076.9239 assertions/s.

  1) Failure:
TestMinitest::TestAllow#test_sanity [test/minitest/test_allow_plugin.rb:8]:
write tests or I will kneecap you

7 runs, 7 assertions, 1 failures, 0 errors, 0 skips

Get The Code

If you just want to use minitest-allow, you can install it via RubyGems:
gem install minitest-allow
Fork me on GitHub If you want to hack on minitest-allow, clone it from GitHub:
git clone git://github.com/seattlerb/minitest-allow

Latest Activity