The customer was a U.S. based company developing business intelligence tools for managerial decision support in an enterprise.

The customer wanted an independent party to test their applications. The applications and their database architecture were complex. So the customer required a partner who would stay with them for the long term over a number of releases, and handle the peaks (before release) and valleys (when the development was going on). The offshore testing was also intended to use the time-difference between the development team in the US and the testing team in India, for over-all productivity.

• Test Strategy Design to determine focus and priority of testing.
• High Level Test Plan generation with effort estimation and schedule.
• Detailed screen-based test case feature-based end-to-end test scenario writing
• Application setup (including web-server, app-server, database server and population)
• System and Regression Testing
• Compatibility Testing for various OS's and browsers on client side and web-servers and databases.
• Load Testing
• Internationalization and Localization testing with English and Japanese version respectively.

Platform: Intranet-based software with Java architecture, Web-server, Oracle (8i) & MS Access database.

Key Success:

The project was completely done offshore with complete project management responsibility. Over 18 months, 5 releases, with number of builds for each, were subjected to pre-release testing The complexity of the application and changing requirements were handled within constraints of the budget and the release schedule. The application setup was replicated in our office. The testing group developed domain knowledge and expertise with the application. They also maintained all the test assets – updated test plans, defect database etc. Suggestions were provided to the customer for improvement of process based on the defect metrics.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

The customer was a large global services company developing a web-based application for a leading global banking and finance company.

The application was a shopping cart application.

For this purely testing project from one of their prestigious customers, the customer needed the project management expertise for purely testing projects as well as the testing specific expertise.

• High level test planning including effort estimation and scheduling
• Setting up testing process
• Functional Testing
• Compatibility Testing
• Automation of Regression Test Cases using WinRunner.

Platform: Web-based application, Websphere and database DB2

Key Success:

The testing project was managed completely and successfully. Estimation, high level planning for milestones and deliverables was done in addition to specific testing activities.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

The customer is a medium size Indian software services company developing software solutions for an UK based Customer Relationship Management Software (CRM) company.

This software was capable of interacting with various channels like Internet, WAP etc. It was consisting of data & metadata layers. Metadata layer used to generate its output in XML format, which was used by different COM objects to interact with database. This highly configurable and flexible system uses key technologies like COM, MTS, MSMQ, OLE DB, SQL server, IIS, ASP, XML, XSL, C++, ATL, and STL.

They wanted to have a third party take up the complete testing responsibility both onsite as well as in the offshore development center (ODC).

• System Testing
• Integration Testing
• Functionality.

Major Activities:

• Analyzing different work packets.
• Scoping work packets for testing functionalities.
• Efforts & time estimation for testing process.
• Scheduling testing execution of various work packets.
• Test plan writing
• Test execution
• Defect reporting.

Key Success:

The customer was totally dependent for all testing activities. End-customer satisfaction was achieved in all quality and testing aspects. Eventually, the customer gave the release responsibility of the deliverables from the ODC.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

The customer is an Indian company with an UPS management software ported on a globally leading network management platform.

The software is a tool for monitoring and controlling the UPS's on a network. It integrated with a Network Management System. The core software offers distributed network management architecture for managing various resources on the corporate enterprise. The system used SNMP protocols for managing UPS working. It was included automatic Shutdowns, Scheduled Tests, automatic mail/Pager/notification for critical or warning states.

The testing was specialized functional and load testing that involved network traffic monitoring. Customer had very high degree of quality requirements for successful acceptance of the software as a third party product on a major network management platform.

Key Success:

For a new domain and a specialized application testing methodology was devised, tools evaluated and selected and testing successfully executed.

The customer is a major Indian software services company in the banking and financial sector. They were developing a B2E website for their global customer.

The application had a number of products for Site Authentication, Front-end generation, Online Site Scraping integrated along with a search engine on a Web Sphere Server.

The large number of integration points in the application made it mandatory to check the response times for each layer. The workflows were planned in a manner as to load various individual components. The typical workload on the site was also estimated as per the type of user and the number of users per workflow.

The customer was developing the system for their customer and needed to guarantee the performance. As the system was developed by integrating number of third party components finding the bottlenecks was also important.

• Identifying the important workflows
• Designing of test scenarios
• Scheduling and coordination with the client team.
• Planning the scripts to be run
• Execution of scenarios with increasing number of users up to 400.
• Endurance tests for 24 hours
• Study of performance data, resource monitors and server logs.
• Analyzing the results of the load testing.

Platform: The web site had multitier architecture on Solaris. The database used was Oracle and user profiles were maintained in a Domino LDAP.

Key Success:

For a highly complex architecture, with a number of third party components, the load and endurance testing was successfully planned and executed in close coordination with the development team. With proper use of LoadRunner as well as the resource monitors and logs the bottlenecks were determined.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

The customer was a US based biometrics company.

It is a fingerprints authentication system for users to web-sites. It includes a sensor connected to the client machine and an authentication server to which the web-site connects for the authentication.

The customer wanted to test the application on a large variety of configurations for compatibility. Due to the very tight time to market, the testing was outsourced offshore.

• Setting up of an offshore Compatibility lab with its own network. Ghost images were used for quick installations of OS's and browsers. This was connected to the authentication servers of the customer through internet.
• A Detailed Compatibility Matrix was developed and rotation of the parameters planned to manage the large number of possible configurations of OS's, browsers, sensors, internet connectivity and firewall / proxy.
• Detailed and abridged test suites were developed to be executed everyday and results reported.

Platform: The application had COM/DCOM and JAVA architecture.

Key Success:

The complexity of the large variety of configurations was handled within the constraints of time and budget. Due to the time difference, the development team could achieve the tight release schedules.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

The customer was a US based company who developed an enterprise application that helps an organization to manage multilingual, multi-locale body of information. System is designed to reach beyond Web content and manage the globalization of all content in Web sites, documents, databases, applications and other sources across the enterprise.

Customer wanted us to perform Post Beta testing on the release for the purpose of increasing the quality of the release.

• Product understanding with the help of product documentation
• Test case writing and test scenarios writing
• Identification of test data
• Application set up - Product Installation
• System and Regression Testing
• Defect Reporting and Defect verification

Development Phase Activities:

• Creation of GUI map
• Finding work arounds for the problems of object recognition e.g. dynamic changes in the physical description of the certain objects

Platform: Weblogic Server 6.0, Oracle (8.17) Database, development using Java.

Key Success:

A completely data-driven automation suite was developed offshore and successfully deployed at the customer site. Customer was very much impressed with0 the automation architecture, which we follow while developing the test suite.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

Case tool is developed which can generate distributed applications for a variety of platforms and architectures. Architecture of a Case tool is Distributed, with server side supporting multiple platforms. Operations are Model-based. Generated Application is also Distributed, supporting 5 different platforms (5 product lines).

• Designing the Release and Test Model for the application after studying the whole application and existing testing processes
• Desiging the test strategy and finializing the approach to develop the automation test suite for the GUI of the application

Key Success:

• Designed Release and Test model after understanding the complex architecture of the Case Tool and the major components of the Case Tool.
• Designed entirely different and unusual automated testing approach to automate the GUI testing development of the GUI test suite from the model. The UML sequence diagram can be used for this purpose.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

FULCRUM is the Product which was developed in VB which was useful in generating code useful for a Java developer. The windows application which was developed in client-server mode initially is to be developed in many other operating systems as well as on web. In all, 5 different modules in 4 different builds were tested for Functionality, volume testing and testing with 5 concurrent users.

• Product understanding with the help of product documentation
• Application set up - Product Installation
• Test case writing and test scenarios writing
• Generation of 200 Java classes having 20 methods each alongwith other java files by automation for Volume testing
• System and Regression Testing
• Defect Reporting and Defect verification

Key Success: The services of our Java consultant were useful in technology and domain knowledge related issues.
Also performance testing was carried out with multi-user concurrent operations in client-server mode.

Use of an Automation tool for volume testing was done successfully.

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

Application consisted of four independent modules displaying Live car race data into different modes. One of the modules was enhanced to let user get trained and then test him against professional car race driver. All the modules were designed around .NET framework and XML, Web Services were used extensively. Modules were demonstrated at Microsoft Windows 2003 launch event. Over 2 ½ months period multiple releases were made to the client where each release had new added features.

Key Success: Application was appreciated enough to be demonstrated at Microsoft Windows 2003 launch event.
Multiple releases with changed and new features were handled successfully within the constraints of time and budget.
Use of an Automation tool for Load Testing was done successfully.


------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

Description

Customer is one of the largest online betting and gaming companies in UK.
Customer provides fixed odds gaming and betting services through various channels such as Internet, mobile, Interactive TV, WAP and telephone

In addition to this customer also has a casino which provides facility to bet and play games on actual terminals (kiosks). Customer is currently engaged in development of online and casino games and betting applications that are made available on their websites

The requirement was of setting up independent offshore QA team. This team will be responsible for testing of games and betting application for its functionality, compatibility and usability.

Since all the testing was to be carried out offshore, connectivity with customer environment was required. This was done by setting up VPN connectivity to the customers test environments.

Major Activities

Tested more than 50 games that are currently in production on customers websites.

Testing of Kiosk project from Onsite and Offshore – this involved testing the software components for betting as well as games from offshore and test execution on actual devices being carried out by our resources onsite.

Building Domain Expertise - Initial period during this engagement was spent by the offshore team to understand the customer’s domain in detail. This included study of business workflows for betting applications and understanding game architecture
Timely delivery for each project and during all the major releases.

Flexible onsite Offshore model

Ability to increase the team size based on project requirements.

Being able to establish proper training mechanism with the help of customer, this enables new members of the team to come up to speed in short duration of time.


------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

Load Testing of Gaming Application

This project was carried for Singapore based customer. The basic testing requirement was to load test their gaming application i.e. Poker Table for 2,000 concurrent users and 223 tables. On each table 9 users can play the game activities

Front End	Thin Client in ‘C++’
Database	MySQL
Operating Systems	Sun Solaris
Tool Used	LoadRunner 8.0

Team Size : 8

Major Activities

• Application understanding.
• Identifying the critical scenarios from performance perspective.
• Designing test strategy.
• Test environment setup.
• Designing test scenarios.
• Recording and customizing scripts for dynamic and runtime data.
• Scripts executing.
• Result capturing.
• Analyzing the results.
• Bottleneck Identification
• Reporting.

Asynchronous communication

Unlike the regular web and client server application this application was designed in such way that requests from client were not dependent on the server responses. Server used to send the dynamic responses like ping message to client and client has to respond to that request using pong message. To capture these kinds of dynamic messages at runtime was very difficult task.

Dynamic gaming activities

Next challenge was to simulate the dynamic gaming activities for 9 users per table through load testing tool. For every game session server was using different logic so simulate this kind of dynamic scenarios was very critical task.

Encryption and decryption

For request and responses encryption and decryption mechanism was used. To simulate the proper load conditions it was mandatory to use same mechanism through the load test scripts.

Key Success

• Appropriate workarounds were found out to capture the dynamic responses and responding them these with proper responses
• 9 users game activity was simulated through single script only. For simulating 2,000 concurrent users game activity only 223 virtual users were required. Due to this approach cost of 1,800 users was saved
• Utility functions were successfully developed and used in the load test script for encryption and decryption of requests

------------------------ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ------------------------

Description

Customer has fixed odds games and betting services on various channels such as
Internet, Interactive TV, WAP and telephone. Customer has one of the largest
infrastructures in interactive betting services in the UK.

Present case study highlights the testing activities performed by VeriSoft for Snapjax game that is presently hosted on customers production environment.

'Snapjax' is a typical fixed odd game with multi currency and multi-bet features. Game can be played by registered as well as anonymous user. Game has 2 modes "Real Play & Demo Play". The game is integrated to third party administration system from where it is configured. Back end consists of Oracle database that interacts with the game to provide user specific information such user profile, transaction history etc

Customer need

• Functional and Integration testing on different test setups
• To carryout compatibility testing on different browser and flash versions
• Regression testing
• Usability testing
  

Setup

There is a dedicated VPN connectivity established between customers testing environments in UK and Verisoft office in Pune. The game once released to any test environment can be accessed from Verisoft office through VPN.

Team Size : 06

• Application Understanding through documents provided and by referring to the game demo
• Requirement review- Verify the correctness and completeness of requirements provided.
• Preparing Test Objective Document
• Test Cases Writing
• Preparing compatibility Matrix


• Test execution on Test set ups
• Regression
• Compatibility
• Usability
• Defect Reporting and Verification
• Preparation of Closure Report

Challenges

Game consisted of functionality that allowed the user to place multiple bets. For each type of bet there were different payouts defined (probable winnings). It was required to test the game for its functionality by placing all possible combination of bets. Team was able to design a metrics that helped us to verify correct behavior of the game for each possible combination.

Key Success

Able to complete all the testing in time for the release
Test cases covered all the functionality mentioned in the Requirements
No defects reported once the game was released onto live environment