Fixes #1051 Closes #919 (I hope so)
I am mostly interested in running all python and vim tests separately from other tests.