Search the web
Sign In
New User? Sign Up
extremeprogramming · Extreme Programming
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want your group to be featured on the Yahoo! Groups website? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
[agileprogramming-ottawa-canada] New Blog Entry - Agile Circling the   Message List  
Reply | Forward Message #146411 of 152241 |
[XP] Re: Local adaptations (was: New Blog Entry - Agile Circling the Drain?)

Ron,

--- In extremeprogramming@yahoogroups.com, Ron Jeffries
<ronjeffries@...> wrote:
> Distinction without a difference? Or would you care to say what
> problem they are symptoms of? Anyway, doesn't matter to my point,
> which is that acceptance tests can help address those issues.

There is a difference and I am asking what you (and others) think the
root causes are that are somehow addressed by acceptance tests.

I suppose I could accept that bugs are the real problem and there is no
need to look any deeper.

I have a feeling if I ever suggested on this list that there was no need
to search for root causes, you and others would loudly object. :)

> I think the OP was asking you how you manage to avoid those issues
> without acceptance tests. How do you?

I asked first! :) In all honesty, I am not being Socratic... I am
trying to figure this out myself.


> Anyway, if you're not having those issues listed, we're wondering
> what you think is helping you to avoid them ... besides just being
> incredibly smart and careful. And if you are ... well, you know what
> we might recommend. But I'm guessing you aren't, and wonder why. :)

Well if I was incredibly smart I wouldn't be asking, I would be telling!

We had a discussion this afternoon on our team and with the boss. We
discussed the possibility that Rob mentioned... that having a single
lead developer across the lifespan of the project can help avoid
pitfalls. This might be true... and if so, it's not very Agile.

The other possibility is that the acceptance tests that we *do* have are
around the high risk, core business functionality. But even those have
proven marginal in value.

Another topic that came up was small team size. The development team
has ranged from 2 to at most 5 developers. This eliminates a lot of
communication issues although I am not convinced that communication is a
root cause of many bugs.

Interestingly, we all feel that Fitnesse and Watin tests both lack the
true "end to end" testing that would give us the level of comfort that
many people get from acceptance tests. We aren't against acceptance
tests... we just want more for our money than we are currently getting!

Ultimately, what I hope will come from this conversation is an
understanding of what root problems are addressed with acceptance
testing. If we understand that better, we can tailor our solutions to
the specific problem(s) that we are most prone to. We can also justify
throwing money at a problem if we can identify it.

Thanks,

Matt








Fri Nov 21, 2008 6:06 am

maswaffer
Offline Offline
Send Email Send Email

Forward
Message #146411 of 152241 |
Expand Messages Author Sort by Date

Hello, Matt. On Thursday, November 20, 2008, at 4:46:58 PM, you ... Distinction without a difference? Or would you care to say what problem they are symptoms...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 21, 2008
3:51 am

Ron, ... There is a difference and I am asking what you (and others) think the root causes are that are somehow addressed by acceptance tests. I suppose I...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
6:06 am

To jump in: The root cause acceptance tests solve for me is that: - I do forget to write unit tests for corner cases, even if I try to do TDD, probably because...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
7:49 am

Manuel, ... Is it easier to cover corner cases at the acceptance level than the unit level? We have experienced the opposite, as corner cases at the unit ...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
3:52 pm

... I did not mean that it is easier to cover corner cases at the acceptance level, I just said that I forget to see them at the unit level, and that sometimes...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
4:13 pm

Manuel, ... unit ... It's hard to sell the notion that "sometimes" my acceptance tests will tell me that I forgot something. Wouldn't it be cheaper to find a...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
4:32 pm

... Sometimes my unit tests will catch bugs. Wouldn't it be cheaper to not insert them in the first place? I don't see what you're aiming at... ... So how do...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
4:42 pm

Manuel, ... will ... way ... I don't use TDD to catch bugs, I use TDD to prevent bugs. So yes, it is cheaper to not put them in in the first place... and I use...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
5:06 pm

... Sounds like nit-picking to me: if I write a line, and a test breaks unexpectedly, then I call that "catching a bug". If I had not caught this bug, it would...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
5:47 pm

Manuel, ... If you read the thread, I haven't said we have zero bugs... but our bug count is incredibly low considering we don't have a large suite of ...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
6:02 pm

Hello, Matt. On Friday, November 21, 2008, at 1:02:12 PM, you ... Please say what "incredibly low considering we don't have a large suite of acceptance tests"...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 21, 2008
6:30 pm

Ron, ... a ... In the project in question we do have more integration tests because the mocking capabilities aren't quite as good as they are in our other ...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
7:17 pm

Hello, Matt. On Friday, November 21, 2008, at 2:17:26 PM, you ... Yes. When I TDD, I write whatever test interests me, and many of these tests use more than...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 21, 2008
10:51 pm

On Fri, Nov 21, 2008 at 1:30 PM, Ron Jeffries ... LOL! Just had a 'milk-out-my-nose' experience reading this. You owe me a milk. Chris. [Non-text portions of...
Chris Wheeler
chris_h_wheeler
Offline Send Email
Nov 21, 2008
8:32 pm

... The old game: how do you know acceptance tests would not further reduce your bug count? Or is the point that you simply think that would not give you any...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
7:23 pm

Manuel, ... bug ... Because they didn't. We tried acceptance tests and they weren't that useful for us. We stopped doing them and our bug count didn't go up....
Matt
maswaffer
Offline Send Email
Nov 21, 2008
8:14 pm

... I have found acceptance tests that exercise the software through the GUI tend to be brittle. Is this a possible explanation for your observation. I have...
Steven Gordon
sfman2k
Offline Send Email
Nov 21, 2008
8:41 pm

I guess one point would be acceptance tests are closer to the business value than unit tests -- acceptance tests verify that user stories actually work. And as...
Olof Bjarnason
olof.bjarnason@...
Send Email
Nov 21, 2008
9:29 pm

Olof, ... value ... work. ... really ... quality ..) I agree with this. In our case our paying customers don't know or care that we have *any* tests and our...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
9:46 pm

Steven, ... Thanks for the observation. The only GUI testing we tried to do was in the web world with Watin. It works fairly well and we actually still have...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
9:42 pm

... This looks interesting. Tests that you have to change all the time are clearly a red flag. The interesting thing for me is that I see that problem more...
Manuel Klimek
manuel.klimek
Offline Send Email
Nov 21, 2008
10:33 pm

... Brittle tests are a red flag to us. We saw this a lot when we were trying to do a lot of FitNesse tests on our C# project. I will be the first to admit...
mrlukelanphear
Offline Send Email
Nov 21, 2008
11:43 pm

... Acceptance tests may reduce our bug count, but at what cost? It is VERY rare for us to ship a critical bug OR to have a bug fix take more than an hour or...
mrlukelanphear
Offline Send Email
Nov 21, 2008
10:47 pm

Hello, Matt. On Friday, November 21, 2008, at 11:32:20 AM, you ... Um ... what would be cheaper and actually work? Ron Jeffries www.XProgramming.com ...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 21, 2008
6:24 pm

Hello, Matt. On Friday, November 21, 2008, at 1:06:16 AM, you ... There are tons of root causes. I think acceptance tests address the possibility of having...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 21, 2008
11:06 pm

Ron, ... I think we have addressed these concerns with other process improvements. ... "Mistake on the story" is an interesting one. Mistakes in code are my ...
Matt
maswaffer
Offline Send Email
Nov 21, 2008
11:40 pm

Hello, Matt. On Friday, November 21, 2008, at 6:40:41 PM, you ... Could you please give us a quick list of things that you do that address these? Should be...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 22, 2008
1:17 am

Ron, ... All three of these stem from communication issues. During our release and iteration planning meetings the team used to flesh these details out and...
Matt
maswaffer
Offline Send Email
Nov 22, 2008
9:35 pm

Hello, Matt. On Saturday, November 22, 2008, at 4:35:05 PM, you ... Yes. That's why in my writing I call them Customer Tests ... ... Well if you're happy I...
Ron Jeffries
RonaldEJeffries
Offline Send Email
Nov 22, 2008
10:24 pm

Matt, Loud responses don't equal concensus. What I hear is that you tried developing with acceptance tests and without, and without works better overall....
kentb
kentlbeck
Offline Send Email
Nov 21, 2008
11:59 pm
 First  |  |  Next > Last 
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help