We have a test framework in Drupal 7

Every major Drupal release we should ask ourselves what steps we can take to double the capacity of our community.

I spent the weekend in Paris where we had a two day code sprint. Our main accomplishment was getting Drupal's test framework into Drupal core -- the culmination of three years of hard work carried out by many people and companies in the Drupal community.

Writing tests for drupal

Here is why a strong investment in testing will help double the capacity of our community:

  • For developers, upgrading, maintaining and releasing your modules becomes easier. The combination of test results and code coverage reports makes it easier to determine the release readiness of your code. This translates to fewer betas, shorter code freeze periods and more frequent releases. Furthermore, design for testability leads to easier to use and more complete APIs. It is guaranteed to make Drupal a better development platform.
  • For end users, it is important that we provide quantifiable reporting on the health of Drupal core and the many contributed modules.
  • For patch reviewers, tests are great because it allows them to focus on the architectural and the algorithmic changes that the patch introduces. With good test coverage, we can rely on the tests to discover any unwanted side-effects. Patches can be committed faster.
  • For people new to Drupal, tests lower the barrier to entry and encourage collaboration and innovation, two of Drupal's core values. With good test coverage, you don't necessarily have to understand the entire code base before you can comfortably propose changes or help maintain a module.
  • For me, it means I'll sleep better at night. ;-) With hundreds of thousands of people using Drupal, the availability of a test framework takes some pressure of my shoulders.

As of today, it is expected that you submit test cases with your patches for Drupal 7. Writing good tests takes time: it is not unlikely that you'll spent twice as long working on a patch. This might take some time getting used to but you'll find that it pays off and that it is actually very rewarding.

Thanks to Ori Pekelman of AF83 for being such a great host when in Paris. And a special thanks to everyone who helped get the test framework in Drupal 7.

Comments

bobacronius@dru... (not verified):

Does this mean that SimpleTest is the standard or de facto testing framework for Drupal now? Or is the future still open for other testing frameworks to gain acceptance? I'm not making a case for another testing framework, as that is another discussion entirely, just curious from a developer's perspective.

Regardless of the framework, it is definitely a welcome step forward to get unit testing into Drupal.

April 21, 2008
Larry Garfield (not verified):

it is not unlikely that you'll spent twice as long working on a patch. This might take some time getting used to but you'll find that it pays off and that it is actually very rewarding.

Dries is spot-on here. I've been using unit tests for the Database API rewrite, and despite the time it takes to write them and tweak and debug those, too, it has greatly paid off. Especially as I've been refactoring or rewriting various pieces of it in response to feedback and, yes, testing, the ability to push a button and confirm "yay, I didn't break Drupal!" has saved me more time than writing the tests took.

If you want to reduce the time it takes to write good tests, write testable code. It will get you better code in the end anyway. :-)

April 22, 2008
Nicolas Leroy (not verified):

Unit test also provide what they call "executable documentation". You can have a look at it and you'll understand what the piece of code it is testing should do. And it will always be up to date. Nice to hear unit testing has found its way into Drupal.

April 22, 2008

Add new comment

© 1999-2014 Dries Buytaert Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License.
Drupal is a Registered Trademark of Dries Buytaert.