web regression testing suggestions? - web-services

I am looking for some kind of web regression testing tool. I would like it to be free and also allow me to verify download links.
any suggestions are welcome

http://seleniumhq.org/ - free, programmable, probably close to industry standard.

Related

Is there a good way to do TDD in Siebel?

I am looking for a way/solution to implement TDD in Siebel development.
I come from web development world and i used a lot unit testing, integration platform and other XP things.
Today i am working on Siebel CRM development for a new job in business in and i am shocked to see that there is no test automation solution in place.
I am currently searching for some documentations, feedbacks, or all other interesting things regarding TDD in Siebel development environemnt.
I could develop some tools myself but i don't want to reinvent the wheel.
If someone have more informations, interesting articles, interesting way to do this it could be very usefull for me.
Thanks
This is really several questions in one. TDD is a way of working, but I think you are already wel versed in what this entails. It can be applied to any kind of technology. From that stance I feel comfortable saying that it's possible with Siebel as well.
As for the tooling to be used, it very much depends on the version of Siebel you are on (HI/Open UI), the skills of your developers, the way of working at your project (Agile/Waterfall), the test (automation) tooling used and the general level of automation at the project/program.
To me it sounds more like a way-of-working transformation then the implementation of a test approach.

Devising a test strategy

As part of a new job, I have to devise and implement a complete test strategy for the company's new product. So far, all I really know about it is that it is written in C++, uses an SQL database and has a web API which is used by a browser client written using GWT.
As far as I know, there isn't much of an existing strategy, except for using Python scripts to test the web API.
I need to develop and implement a suitable strategy for unit, system, regression and release testing, preferably a fully automated one.
I'm looking for good references for:
Devising the complete test strategy.
Testing the web API.
Testing the GWT based application.
Unit testing C++ code.
In addition, any suitable tools would be appreciated.
Testing Computer Software is a great soup-to-nuts book on the entire testing process. In addition to the items you mentioned, you'll need to think about other types of testing (performance, security, localization, stress testing, to name a few) and how to manage the test process; test plans, issue tracking, test data, test cases, in addition to the tools.
There's a lot there, and you can't do everything at once. I think a phased approach would be best, where you identify the gaps, weaknesses, and risks in the current process, prioritize them, then set up a high level plan to address them one by one.
Software QA Testing and Test Tool Resources is a good starting place for finding some tools to fit your process. StickyMinds is a nice web site dedicated to software testing, and the folks here at StackOverflow certainly know their stuff, so don't be afraid to ask.
Good luck :)
You can find a ton of excellent information on testing and developing a test strategy in general over on James Bach's blog. Specifically by searching through it for tips on testing strategies.
James is an excellent resource for information about how to do great software testing.
Best of luck.
There's a good conversation here on The Purpose of a Test Strategy.
As testing tools you could use Selenium for web testing and CppUnit for c++ unit testing.

What is Robot Army Testing?

What is Robot Army Testing? Where is it used? How can I learn it?
I'm not sure that it exists. There's Rational Robot, an automated testing record-and-playback tool, but you have to buy it. I've yet to hear of Robot Army testing, however, although I agree with Nick - it sounds AWESOME :)
The only mention I can find of it ANYWHERE is on:
http://www.mail-archive.com/wtr-general#rubyforge.org/msg07756.html
So maybe it's also known as MBT (Model Based Testing)?
If so, take a look at http://en.wikipedia.org/wiki/Model-based_testing for information on that and some handy links to tutorials etc.
Hope that helps!
If by "Robot Army Testing" you mean assembling a suite of automated tests on a grand scale (sort of xUnit on steroids) then this presentation provides a helpful introduction. It is also known as Model-Based Testing.
edit
As uberRouse notes, the use of randomly generated values in testing is interesting. I first came across this in 2005. It was a tool called Agitator from Agitar Software which took manually written unit tests and expanded on the coverage by plugging in random values and edge cases.
This term is not on WikiPedia. Everything, that is at least a little popular technology appears there quickly. Are you sure you don't misspell it?
Robot Framework maybe? We use it and it's great!
BTW, it sounds like web-site DDOS testing ;)

ABAP Unit Test Classes - Good References

I'm looking for good reference material regarding the use of ABAP Unit Test Classes.
I'm interested in any of the following:
Documentation on the functionality
Best Practises
"How To Guides"
Blogs/Books on people's experience in using test-driven development in a SAP environment, particularly what sort of scenarios leans themselves to test-driven development & how you get around the dependency of SAP on business data.
There is some documentation in sap.com.
Also, there is a German PDF (see here) that may be helpful if you know some German ;-) At least it contains a few email addresses of people that may be able to help. Not sure because the PDF is from a conference in 2003, so the contact info may not be too up to date.
Lastly. there seems to be a German book (on Amazon Germany) .. again not sure if that helps you.
Wondering if you'd checked these links...
https://wiki.sdn.sap.com/wiki/display/ABAP/ABAP+Unit
https://wiki.sdn.sap.com/wiki/display/ABAP/ABAP+Test+and+Analysis+Tools
Thanks.
I recently wrote a blog article on my experiences here: Adopting Test Driven Development using ABAP Unit
There is some documentation in SE24 for class CL_AUNIT_ASSERT. Doing a where-used on the class gives an indication of how it is meant to be used.
There also is a 5 part blog series on SAP SDN
UPDATE: There is now also an excellent course on ABAP Unit on OpenSAP.com. It is called
Writing Testable Code for ABAP
The URL for the course is: https://open.sap.com/courses/wtc1

Looking for the ways for test automation of web site

We develop custom survey web sites and I am looking for a way to automate the pattern testing of these sites. Surveys often contain many complex rules and branches which are triggered on how items are responded too. All surveys are rigorously tested before being released to clients. This testing results in a lot of manual work. I would like to learn of some options I could use to automate these tests by responding to questions and verifying the results in the database. The survey sites are produced by an engine which creates and writes asp pages and receives the responses to process into a database. So the only way I can determine to test the site is to interact with the web pages themselves. I guess in a way I need to build some type of bot; I really don't know much about the design behind them.
Could someone please provide some suggestions on how to achieve this? Thank you for your time.
Brett
Check out selenium: http://selenium.openqa.org/
Also, check out the answers to this other question: https://stackoverflow.com/questions/484/how-do-you-test-layout-design-across-multiple-browsersoss
You could also check out WatiN.
Sounds like your engine could generate a test script using something like Test::WWW::Mechanize
Usual test methodologies applies; white box and black box.
White box testing for you may mean instrumenting your application to be able to make it go into a particular state, then you can predict the the result you expect.
Black box may mean that you hit a page, then consider of the possible outcomes valid. Repeat and rinse till you get sufficient coverage.
Another thing we use is monitoring statistics for our service. Did we get the expected number of hits on this page. We routinely run a/b tests, and I have run a/b tests against refactored code to verify that nothing changed before rolling things out.
/Allan
I can think of a couple of good web application testing suites that should get the job done - one free/open source and one commercial:
Selenium (open source/cross platform)
TestComplete (commercial/Windows-based)
Both will let you create test suites by verifying database records based on interactions with the web app.
The fact that you're Windows/ASP based might mean that TestComplete will get you up and running faster, as it's native to Windows and .NET. You can download a free trial to see if it'll work for you before making the investment.
Check out the unit testing framework 'lime' that comes with the Symfony framework. http://www.symfony-project.org/book/1_0/15-Unit-and-Functional-Testing. You didn't mention you language, lime is php.
I would suggest the mechanize gem,available for ruby . It's pretty intuitive to use .
I use the QEngine(commerical) for the same purpose. I need to add a data and check the same in the UI. I write one script which does this and call that in a loop. the data can be passed via either csv or excel.
check that www.qengine.com , you can try Watir also.
My proposal is QA Agent (http://qaagent.com). It seems this is a new approach because you do not need to install anything. Just develop your web tests in the browser based ide. By the way you can develop your tests using jQuery and java script. Really cool!