Does anyone have experience automating testing of non-web GUI apps in an XP environment? Everyone says test it just under the GUI, which is the best idea, but...
... in ... enough ... Can't say that I've done it but everyone I talk to suggest using screen scraper type tools if you absolutely have to test at the GUI ...
3
emeade@...
Nov 4, 2001 5:43 pm
... in ... enough ... What kinds of things do you want to test? -- Erik Meade emeade@... Senior Consultant Object Mentor, Inc. ...
I'm not actually trying to test a non-web GUI app, this is a general question because people ask me all the time what tools I recommend for non-web GUI...
I agree that testability issues are more important, but I'm a tester, not the boss, and I can only suggest that the team think more about testability. As long...
6
bret@...
Nov 6, 2001 12:05 am
1. Make sure that your tests are stored in the same configuration management environment as the development code. This makes it easier for the developers to...
7
STEURS Stefan
stefan.steurs@...
Nov 6, 2001 7:00 am
Points of agreement and disagreement highlighted below. Stefan ... Agree. But we have found it also useful to make sure that test framework code is...
In my last project, I used a set of UI test cases to promote JUnit within the organisation. No licencing issues, tests and development code in the same...
... Did you end up refactoring your tests? I think it's common to start with tests like this: press_tab(); press_tab(); press_enter(); press_tab(); ...
I totally agree with your suggestions, although this doesn't seem specific to non-web GUI (Webload and Silktest are for Web apps). Do you think WinRunner is...
... colors, fonts, an so on. So how do you test these things? ... tests suddenly fail, ... actions (I press those and those ... I don't understand the...
12
Erik Meade
emeade@...
Nov 7, 2001 4:19 am
... Add a task "Automate acceptance test" to every story. -- Erik Meade emeade@... Senior Consultant Object Mentor, Inc. ...
13
Erik Meade
emeade@...
Nov 7, 2001 4:19 am
First thing I would have unit tests that show when the create, read, update, and delete methods used by the GUI do the correct thing to the model. Once that is...
14
STEURS Stefan
stefan.steurs@...
Nov 7, 2001 6:49 am
I am using WinRunner to test in an iterative/incremental software development environment. Using a keyword driven/data driven approach, I think it is possible...
... our approach is to mock up the servlet request and response and exercise the servlet straight in junit. See www.mockobjects.com for more info. Steve...
I've put links to papers and articles relevant to agile testing here: <http://testing.com/agile/> Let me know if there's anything else I should include....
... We played around with several options. The one that turned out the easiest to maintain was (java) // somewhere in an interface public static final String...
I have also used support and documentation be 'dummy users'. It has been very effective in catching the types of issues that are often overlooked by people who...
... Yep, we do that. Now, in real life we are automating acceptance tests for web apps, which are somewhat easier even if the app hasn't been designed to be...
Well said. I'm curious, though, is the project you are talking about (50 man years) using XP or some other agile processes? ... to ... testing. ... processing...
... I wonder if "acceptance test" isn't too overloaded a term. I'm inclined to present the issue this way. Suppose I'm a programmer. At any given moment, I'll...
24
Steve Hayes
steve@...
Nov 7, 2001 8:10 pm
Also look at HttpUnit/ServletUnit (they're bundled together). You can find HttpUnit at Sourceforge. Steve Hayes steve@... ...
25
Cem Kaner
kaner@...
Nov 8, 2001 5:08 am
The first problem lies in calling these "acceptance tests." The task of the testing group is to discover the ways in which the product will be unacceptable to...
26
Erik Meade
emeade@...
Nov 8, 2001 5:57 am
So they haven't had an occasion where some story which has already been completed suddenly is no longer complete? If the project goes on long enough I bet it...
27
Erik Meade
emeade@...
Nov 8, 2001 5:57 am
Cem, You do realize that Lisa asked this question in the context of XP? Acceptance tests in XP really are there to define what is acceptable to the customer....
28
STEURS Stefan
stefan.steurs@...
Nov 8, 2001 7:15 am
Hi, Developers who haven't cycled through releases and haven't seen the kind of problems that regression brings to operational systems are harder to convince...
29
Cem Kaner
kaner@...
Nov 8, 2001 7:15 am
Yes, I am completely aware that Lisa asked this question in the context of XP and I am very aware of the descriptions of acceptance testing. Ultimately, the...
30
STEURS Stefan
stefan.steurs@...
Nov 8, 2001 7:27 am
Good question. I'm trying to find out whether you can only be agile when you are doing projects of small sizes (5 manyears or less). Why wouldn't being agile...
