2-3 weeks ago, we updated our dev server, went through our checklist of things to make sure nothing popped up in Watchdog and what not.
After deploying the updates from our dev server to the production server, everything seemed fine. Until today ( Monday, I might add ).
Apparently something changed in Feeds which screwed up our Rules any where we had Private Messages in the actions. This caused all of those rules to fail. No one noticed until today. Fortunately, it is just a mess, but there is no data loss.
So, as the complexity of this particular site increases and there are more potential points of failure, and the conditions in which a failure would reveal itself are harder for us to reproduce manually, I am really wanting / needing a highly configurable testing solution. Something that can perform all of the primary functions on the site, from the context of differing user roles, etc.
I am not really looking for a tool for checking if there are coding errors so much as things that change the way the site works in a way that breaks our environment.
- unit tests
Usually behat is used to test your most important workflows and it is very good in that, but it can also be slow as you directly interact with the users UI.
Casper JS is an alternative to that.
simpletest is most useful for custom modules and ensuring those work properly - testing the site in the same way as core and contributed modules test themselves.
Unit tests are great for testing code correctness - less important for you.