Skip to main content

Cucumber - my perspective

I have been using Cucumber ( at my current gig for about a year now. My initial reaction was that I absolutely hated it. It didn't seem to make sense for a programmer to write out tests (features) in plain English and then write out a bunch of regular expressions to turn that plain English into runnable code. What a palaver!

The other problem, is that the Cucumber tests were extremely fragile. Even making text and/or HTML changes would break things in lots of random places.

Anyways, as it turns out, I don't really hate Cucumber, I just hate the way it is implemented in my current gig. Here are some lessons I learnt on the way...

1) Features are not supposed to be written by programmers.
You can write features as a programmer, but you are not the intended audience. The reason why features are written in plain text is that they are supposed to be written by business owners. As a programmer though, you can use features to organize your thoughts in plain English.

For example

Given I am a shopper
When I add something to the cart
Then I should see it in the cart

2) Keep all implementation details out of the features.
The features are not for you (the programmer). They are for the business owners. You are just supposed to make them pass and use them as a guide.

3) Don't aim to re-use features
Testing is about the one place where DRY (Do not Repeat Yourself) does not apply. When you re-use the same tests/step definitions in multiple places, you are creating hidden dependencies between 2 sections of code which probably don't need to be there. A lot of developers also fall into this trap with CSS. As developers we are trained to look for similar behaviours and abstract them out into their own methods, but unless the business owner really decides the two features are linked, they should be kept separate. The one area where I don't agree with Cucumber is that all the step definitions are shared globally (I personally think each feature should have its own step definition file).

4) Features are not supposed to cover every possible edge case
Specs are used to make sure all your edge cases are covered. Features should only cover what is asked for by the business owners.

5) Do not tie your step definitions to HTML elements
This makes it impossible to do any redesign. It is a bit annoying that copy (or text) changes can break your tests, but at the end of the day, business owners are the ones who are in charge of copy and they should be aware that copy changes will come at a cost.

So at the end of the day, keep your features concise, don't reuse steps and write them like you are not a programmer and then you should be happy with Cucumber.


Popular posts from this blog

Master of my domain

Hi All, I just got myself a new domain ( ). The reason is that is offering cheap domain via and I thought after having this nickname for nigh on 10 years it was time to buy the domain before someone else did (also I read somewhere that using in your domain is the equivalent of an or email address...shudder...). Of course I forgot that I would have to re-register my blog everywhere (which is taking ages) not to mention set up all my stats stuff again. *sigh*. It's a blogger's life... In any case, don't forget to bookmark the new address and to vote me up on Technorati !

Elixir - destructuring, function overloading and pattern matching

Why am I covering 3 Elixir topics at once? Well, perhaps it is to show you how the three are used together. Individually, any of these 3 are interesting, but combined, they provide you with a means of essentially getting rid of conditionals and spaghetti logic. Consider the following function. def greet_beatle(person) do case person.first_name do "John" -> "Hello John." "Paul" -> "Good day Paul." "George" -> "Georgie boy, how you doing?" "Ringo" -> "What a drummer!" _-> "You are not a Beatle, #{person.first_name}" end end Yeah, it basically works, but there is a big old case statement in there. If you wanted to do something more as well depending on the person, you could easily end up with some spaghetti logic. Let's see how we can simplify this a little. def greet_beatle(%{first_name: first_name}) do case first_name d

Speeding up RSpec

So today I have been looking into getting our enormous battery of tests to run faster. I have yet to find anything that works for Cucumber, but I did find an interesting way to speed up RSpec which is detailed here. Basically, it seems that by not collecting garbage too frequently, you can make your tests run much faster (at the expense of memory management of course). We observed a 30% reduction in the time it takes to run an RSpec test suite. I did try to implement this on Cucumber, however because we need to store much more in memory to set up and tear down our objects, it meant that I kept running out of memory when I wasn't using the default Garbage Collection and the tests took even longer (so, buyer beware). I suppose if you had a small set of features though you might see some benefit.