Itron

Challenge

Decrease the cost of test automation maintenance and enable additional team members without scripting experience to automate tests. Additionally, select a product that could be used across an organization with multiple projects on various technologies.

• Initial application tested using Worksoft Certify is a windows client/server .NET application.The application has multiple 3rd party controls which were automated by extending the Worksoft Certify custom .NET library.
• With the previous automation tool, the application would only have one to two people automating tests due to the technical programming skills required to write scripts.

Solution

After a build vs. buy evaluation and consideration of the small test automation staff, Itron selected Worksoft Certify primarily for the ability for non-programmers, such as subject matter experts familiar with business domain to automate tests. The relational repository was a second factor for selection, the central repository can store all test assets such as test cases, test data, and application objects allowing Itron to share across the organization.

• An initial pilot project was selected and included four team members that were trained on Worksoft Certify and development of best practices.
• Itron extended the use of Worksoft Certify to three .NET application projects that included both Java and Web testing.
• The Worksoft Certify solution is located on a central server within the department and users can quickly access specific upgrade or new installation instructions as needed.
• Initial training was provided by Worksoft and was two days long. Now Itron users perform the training themselves for any new users in about 1/2 a day. By comparison, training for Itron's previous testing tool often took closer to two weeks.
• The application map import process determines if a map contains new or modified objects for regression testing.The import process looks for the application maps at a user specified location. After import, objects get marked as New, Deleted, Modified, or Unchanged. If an object has been modified or deleted and is being used as part of existing tests the user is forced to resolve the change.

• Worksoft Certify includes a base set of Crystal Reports with the client for running management reports and analyzing results.

Results

Worksoft Certify enabled Itron to have six people automating and designing tests, without the need for programming experience. Significant time savings was achieved due to the ability for the company to design tests and automate them concurrently. In the past, each of those activities required a different person.

• Standardization of the testing tool across the organization was achieved, and the resultant repository enables reuse of test cases for other projects.
• The deployment of Worksoft Certify ties into the organizational goals of streamlining processes, centralize skills, and serves as a lighthouse project for the entire company.
• Quality of the applications are higher due to significantly reduced manual testing efforts, as well as Worksoft Certify’s ability to provide complete functional testing of the applications.
• Regression testing is now straight-forward, as is the ability to compare differences between versions; ensuring consistency of application quality.