I have tried to summarize what the tool has in common with other such solutions and what it does differently.
Like other GUI testing solutions
- It provides script-less test case creation with just point and clicks. The powerful built-in test recorder can convert your tests to .NET code which can be further customized or extended in Visual Studio if needed.
- The tool supports cross-browser testing on IE, Google Chrome, Safari and Mozilla firefox.
- Facilitates parallel test scheduling. Test Studio allows you to schedule and execute tests across the entire testing environment. Automatically collect results into a centralized repository and then analyze them on your local machine! Get email notifications upon run completion.
- Separation of Test data from Test case for leveraging re-usability. Test Studio supports various data sources: Excel, CSV, XML. In addition, it has a built-in data grid that allows you to quickly create your own data source right inside your test without having to revert to external sources.
- Provides support for Image Verification. But the method adopted for doing image verification is different from rest of the tools. Here the Image verification is based upon the element’s visual rendering rather than its properties or attributes. Elements with rich graphic rendering can make use of this feature to automate some of the test scenarios that can be executed manually only. The verification area within an element can be refined down to the pixel level and error tolerance for the matching can also be assigned.
- Test Reports can be exported to word and excel.
Ranorex, Rapise and Testing Anywhere all support cross browser testing, provide facility to separate test cases from the test data, provide image recognition and verification support, But there are a few things that Test Studio does differently.
What it does differently
- TestStudio provides support for congregation of manual and automated test cases i.e all the automated and manual test cases can be maintained at one place. Test Studio’s Manual Test Type makes manual test creation and execution more organized, productive and faster. Time consuming repetitive manual tasks can be automated to save time.
- Conditional statements like IF-ELSE, WHILE LOOP can be added to the test cases without writing any code.
- TestStudio provides a 3D element viewer. The 3D Viewer enables you to see the element hierarchy from the selected element to the node making it easier for the user to understand the parent child relation of any element on the web page. The viewer also provides a complete set of pre-built verification sentences that can be performed on the selected element. Elements explorer maintains a unique list of elements across all the test cases in the project. Modification of the element is reflected across all the test cases in a project.
- Visual Debugger helps real time debugging of the application in case of failure i.e the debugger can be configured to pause in case of a failure allowing the user to analyze the situation an resolve the defect.
- The recorded test cases can be executed seamlessly on any build server - CruiseControl, TeamCity or Visual Studio’s Build Server etc.
- Provides Test Management support. Test Studio provides a Test List tab; here the tests can be segregated as Static Test List – grouped on the basis of some commonalities and Dynamic Test List – Test list created dynamically on the basis of some rules for filtering the test cases. These test lists can also be cloned giving flexibility to the user to customize the Test List as per needs i.e for different browsers, servers etc.
- Test Studio provides a common platform for testers and developers to work together. The tool ships with a standalone app and a Visual Studio plug-in that use the same repositories and file formats. QAs can check-in tests in the main project, which developers can then extend with code.
- Test Studio seamlessly integrates with Test Control Systems lie Microsoft Team Foundation Server to simplify the collaboration among QAs and developers. Test Studio can also interact with any other file based source control system.
- The visual storyboard can be exported as an HTML Test Plan. This feature is very helpful for documentation of the test case as all the steps of the test case are listed with appropriate screen shots.
- Test Studio comes with support for Telerik’s agile project management solution – TeamPulse.
- Performance Testing
- The test cases used for functional testing can also be used for doing performance testing with some minor changes.
- Metrics such as server processing time, network latency, HTTP traffic requests, performance counter data, client rendering time etc, which help evaluating the performance of the AUT can be captured using the TestStudio.
- The user can even dig down in to the application’s code base to see detailed metrics around specific components of the system.
- TestStudio also facilitates creation of benchmarks if pre-existing information is not available.
- Test Studio also facilitates comparison of test runs to identify potential regressions.
The cost of Telerik Test Studio single floating is $2,499 including 1 Year of maintenance. Quick customer support is available and the response time for the queries posted on working days is 24 hours. The existing subscriptions can be renewed at discounted rates.
Scope of improvement
- The tool still lacks some features that many tools in this arena provide like support for testing desktop applications other than WPF, support for testing apps on Mac, Linux etc.
- Support for 3rd party controls other than telerik like DevExpress, Infragistics etc.
- It has come up with a beta release for test iOS apps and there is a lot of scope for widening the portfolio in terms of the mobile platforms supported.
- In addition to performance test if support for load test, stress test and capacity test of AUT is also available it would become a very powerful tool.
I am sure as the tool matures it will provide much more features to its users and emerge as a very powerful tool. First hand information from the users of such tools would be beneficial to the testing community, so please feel free to chip in your comments.