Search the web
Sign In
New User? Sign Up
agile-testing · Agile Software Testing
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Message search is now enhanced, find messages faster. Take it for a spin.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
How many test cases   Message List  
Reply | Forward Message #10268 of 18129 |

I was recently asked this question on an interview for a "QA manager"
position.

The context was the content of a test plan for a simple program that will:
1. Open a file for writing
2. Replace the first 50 bytes with "0"s
3. Close the file.

My (wrong) answer was that one test case may be enough to cover such simple
functionality. The interviewer was actually expecting a separate test case
for one positive scenario and for each "negative" situation the testers can
think about like:
1. non-existent file
2. file length less than 50 bytes
3. file write protected.
... and so on (a "live" document)

In my SW testing career (10+ years) I don't recall we ever have developed a
test case just for one requirement. The main criterion for a "good" test
plan or procedure was to cover as much requirements (functionality) as
possible in one test case to minimize duplicate descriptions, preparation
and start-up time, etc.

I also argued (apparently not a good thing to do on a job interview :-) that
the above "negative cases" are in fact requirements that were probably
already elaborated during the development of the application. In such case
they become "positive" as now there is a known outcome associated (e.g.
display a warning or increase the length of the file). However, the
interviewer was not interested in my knowledge of other SDLC processes.

I was just wondering, is having a test case for each requirement a common
thing? Can someone enlighten me and explain why would this be more useful
than having one elaborated scenario covering multiple requirements? Note
that as far as I know the organization I have applied is not known for using
agile processes as TDD.

Thanks.
--
View this message in context:
http://www.nabble.com/How-many-test-cases-tf2662862.html#a7426739
Sent from the Agile Testing mailing list archive at Nabble.com.




Sun Nov 19, 2006 6:40 am

yosip_55
Offline Offline
Send Email Send Email

Forward
Message #10268 of 18129 |
Expand Messages Author Sort by Date

I was recently asked this question on an interview for a "QA manager" position. The context was the content of a test plan for a simple program that will: 1....
Yosip
yosip_55
Offline Send Email
Nov 19, 2006
6:14 pm

... Hello, My experience with software testing is shorter than yours but I can think of at least one reason to require several test cases: Automation. If each...
Arnaud Bailly
arnaud.baillly
Offline Send Email
Nov 19, 2006
8:47 pm

Thanks Arnaud, You've made two valid points. Automation might be a reason for having shorter test cases especially if the application is simple. My experience...
yosip_55
Offline Send Email
Nov 20, 2006
3:04 pm

Hello, Yosip. On Sunday, November 19, 2006, at 1:40:34 AM, you ... In what's below, I'll mention, just for fun, my notion of what a program might reasonably...
Ron Jeffries
ronaldejeffries
Offline Send Email
Nov 20, 2006
12:51 am

yosip wrote>>>: The main criterion for a "good" test plan or procedure was to cover as much requirements (functionality) as possible in one test case to...
erik petersen
wvole
Offline Send Email
Nov 20, 2006
4:30 am

Hello, erik. On Sunday, November 19, 2006, at 11:20:28 PM, you ... My most common bug, now that languages require returns of a value from functions. That's...
Ron Jeffries
ronaldejeffries
Offline Send Email
Nov 20, 2006
11:29 am

Thanks to both Ron and Erik for the response. I was a little bit worried I've got it all wrong but I'm happy to hear from you this is not the case. I agree...
yosip_55
Offline Send Email
Nov 20, 2006
3:04 pm

... point is here that I don't think you can plan for negative testing. Can you imagine a risk, and then test for it?...
Michael Bolton
michael_a_bo...
Offline Send Email
Nov 20, 2006
6:09 pm

... Yes, It was called "Safety Testing" and there was a separate plan (and budget) for it. A hazard database was maintained by a special working group and ...
Yosip
yosip_55
Offline Send Email
Nov 21, 2006
5:34 am

... for it. A hazard database was maintained by a special working group and everyone was able to raise a safety issue. However, only a small portion of the...
Michael Bolton
michael_a_bo...
Offline Send Email
Nov 21, 2006
9:08 am

... No doubt it took quite a bit of deliberation to convert a safty issue into a hazard and then plan for the testing that will provide more insight into the ...
Yosip
yosip_55
Offline Send Email
Nov 22, 2006
4:59 am

... In a program, any time we insert have a :default clause to a switch statement, we're planning for the unexpected; any time we insert a general exception...
Michael Bolton
michael_a_bo...
Offline Send Email
Nov 22, 2006
9:52 am

Hi Michael, English is not my mother tongue and I guess my semantics might be all wrong. Or it might be that I'm forced to use words more carefully. In either...
Yosip
yosip_55
Offline Send Email
Nov 24, 2006
5:52 am

One possible exception are the ... Some suggestions: I have an article in the June 2006 issue of Better Software magazine that discusses how and why to...
chrs_mcmhn
Offline Send Email
Nov 24, 2006
6:31 am

It it true that a test case has to cover "as much requirements as possible" in order to be good? I don't know. To the extreme it would imply we cover all...
STEURS Stefan
stefan.steurs@...
Send Email
Nov 20, 2006
7:24 am

Hello, Stefan. On Monday, November 20, 2006, at 2:16:49 AM, you ... I asked whether testers should "make up" requirements, with, I hope, the implied answer...
Ron Jeffries
ronaldejeffries
Offline Send Email
Nov 20, 2006
11:58 am

Hi all, It has been ages since I commented on something, but I feel there is a need this time. I shudder to think there are Developers developing code without...
Smith, John H
John.Smith2@...
Send Email
Nov 20, 2006
3:02 pm

Folks, Interesting thread this one and many varied opinions :). My experience on testing with func specs(great when u have one) has been on two threads : 1....
Harsha Darsi
darsi_h
Offline Send Email
Nov 20, 2006
5:21 pm

... also that test cases are created not using "Issued Specs". ... Often there is; often there isn't. It depends on what you mean by "spec". Is a...
Michael Bolton
michael_a_bo...
Offline Send Email
Nov 20, 2006
6:19 pm

Hello, John. On Monday, November 20, 2006, at 7:56:39 AM, you ... What do you mean by "a spec"? Ron Jeffries www.XProgramming.com The practices are not the...
Ron Jeffries
ronaldejeffries
Offline Send Email
Nov 20, 2006
8:42 pm

... From: "Smith, John H" <John.Smith2@...> Date: Monday, November 20, 2006 10:05 am Subject: RE: [agile-testing] How many test cases To:...
piratefan1@...
mwemeigh
Offline Send Email
Nov 21, 2006
3:33 am

Hi Stefan, Some very good points. I've inserted my clarifications where I believe we are on the same wavelength and my 2c where our opinions diverge. ... Sorry...
yosip_55
Offline Send Email
Nov 20, 2006
3:16 pm

... In the past 18 years, I've never worked on a project where every single requirement had a test case. In the "real world" of non-military, non-medical...
Bradley, Todd
todd404
Online Now Send Email
Nov 20, 2006
5:13 pm

... functionality. Your answer wasn't universally wrong; your answer was wrong according to that interviewer and the context that he was supposing. Consider:...
Michael Bolton
michael_a_bo...
Offline Send Email
Nov 20, 2006
7:25 pm

... According to Dictionary.com (http://dictionary.reference.com/browse/specs): specs  /spɛks/ –plural noun Informal. 1. spectacles; eyeglasses. 2....
Bradley, Todd
todd404
Online Now Send Email
Nov 20, 2006
9:48 pm

I've been involved in a main activity called Functional Hazard Analysis and the development of Safety Requirements resulting from it, including testing. The...
STEURS Stefan
stefan.steurs@...
Send Email
Nov 21, 2006
9:02 am

... Excellent! And you may say that the purpose of "negative" testing (including safety) is to assure that there is enough "attraction" provided within the ...
Yosip
yosip_55
Offline Send Email
Nov 22, 2006
5:01 am

... The NSA might crack our site. ... Uh, nope. -- Phlip http://www.greencheese.us/ZeekLand <-- NOT a blog!!!...
Phlip
phlipcpp
Offline Send Email
Nov 21, 2006
5:31 pm

Where, in our imperfect world of specifications, we use flows, both the normal and alternative flows reach the same end-point. That means that either the flow...
STEURS Stefan
stefan.steurs@...
Send Email
Nov 22, 2006
12:40 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help