Opened 4 years ago

Last modified 3 years ago

#3445 assigned undecided

add test configuration that runs random subset of tests in random order

Reported by: rutsky Owned by:
Priority: major Milestone: 0.9.+
Version: master Keywords: simple


When all tests are run sequentially some subtle issues can be missed, e.g.

Additional metabbocfg/Travis configuration should be added that will run random subset of tests in random order.

Dustin says, that trial has support such tests run mode. Also Dustin mentioned, that it would be nice to have control over random seed, so that these tests would be reproducible.

Change History (4)

comment:1 Changed 4 years ago by rutsky

  • Owner set to dustin
  • Status changed from new to assigned

comment:2 Changed 4 years ago by dustin

  • Keywords simple added
  • Owner dustin deleted

comment:3 Changed 4 years ago by dustin

aditya97: this bug isn't specifically about the Row._next_id. Rather, it's about the order that the tests run. I think there's an option to trial to make this happen.

Note: See TracTickets for help on using tickets.