OpenAccess Test Manager 5.0 and Test Suites

Software Distribution

Licensees under support or evaluation agreements are free to download the latest version of our software.

Download OpenAccess Stress Program and documentation for Windows. The OpenAccess Stress program allows the simultaneous execution of one of more queries on any number of connections through ODBC or OLE DB. It creates one thread for each connection and then executes a randomly selected query from a user-supplied list with optional delay between query executions (Download).

Download OpenAccess Test Manager v5.0 for Win95/98/NT/2000/XP (Download).

Please follow the instructions in OpenAccess Test Manager User's Guide.pdf for installing and using OpenAccess Test Manager.

OpenAccess Test Manager Overview

The OpenAccess Test Manager is a Microsoft Windows based harness for automatically executing tests. It comes with a base set of tests and can be expanded by adding user defined test cases using C++ and through SQL command files. OTM is designed to facilitate regression testing at OpenAccess Software and to enable our customers to implement their own regression testing.

OTM with its base set of tests provided a comprehensive platform for OpenAccess Software to run its regression tests and for our customers to implement their regression testing. OpenAccess Software's objective is to test all the components so that our customers only have to worry about testing the code they have added. Running SQL queries to exercise the features your IP is supporting - SELECT, UPDATE, INSERT and DELETE - easily tests the code that is added. OTM contains a sample queries that can be modified to achieve this.

Some of the tests, for example the Stress Testbed, are easily configured to go against any data source. The Stress Test Bed takes as inputs a DSN, a query, number of connections, and number of query iterations. You can use it to easily check the performance of your configuration and to simulate concurrent access.

Certain tests are written to make use of specific tables. An example of this is the Conversion Matrix test. This test executes queries against a table called TYPES to test out the various data conversions supported by ODBC. The table(s) required by these test exist in the sample DB3 database supplied with the SDK. You data source may have a fixed schema in which case this test would not apply. If you database does allow the creation of arbitrary tables then you can use the supplied DDL files to create the required files and run all the tests.

Objectives

OTM is included as part of the OpenAccess SDK and is licensed for use only with OpenAccess. You can modify the supplied source code and/or add your own tests.

Client API functional test - make sure each of the client APIs implement the functions in the standards specifications.

Client API usage tests - test compatibility of the supported API with client applications that will make requests in certain sequences. For ODBC, these include MS Access, Excel, ADO, ADO.NET, etc.

SQL processing - if DAM is used, then test the functionality of the SQL processing. This includes all the supported SQL and scalar functions.

DAM API functional tests - validate the various operational modes and the DAM API.

DAM and IP interaction - ensure the correct interaction between the DAM and the IP in various modes. This is for correct functioning and optimized execution.

Client/Server operations - passing of data between client and server, performance, robustness under various connectivity failures, etc.

Performance - benchmarking, resource usage, etc.

Automated - as much as possible, all tests should be run automatically at a push of a button and the results validated.

User Customizable - as much as possible the customer should be able to customize the tests for their end product.

SQL/JSQL IP API functional tests - validate the various operational modes and the functions.

SQL/JSQL IP interaction - ensure the correct interaction between the SQLS and the IP in various modes. This is for correct functioning and optimized execution.

Features

The OTM consists of the test harness, helper tools that execute various test cases, executables for specific tests, and scripts that define test cases that are run using the helper tools.

OTM test harness features:

• Execute any specified subset of tests.
• Terminate currently executing or all tests scheduled to start,
• Change global (applied to all tests) and local (applied to a single test) properties.
• Adjust output to window, file and console.
• Save and load settings from file, automatic load of last configuration.
• Set background and font colors for all windows.
• Execute SQL commands from a file and compare with previous results

Helper tools provided with OTM:

• SQL query executor - SQL script execution to execute a set of commands and to compare against previously saved results. All queries used here at OpenAccess Software are included.
• Windows based ISQL program to view all the tables and to run queries. This tool allows you to quickly see all your tables and test operations against them.
• Stress Test Bed - an application that can create any number of threads to concurrently execute queries against a server.

Test Cases

• Over 100 SQL files containing different kinds of queries - these are used for our standard testing and can be used as is or modified for your schema. You can use them as is if your backend allows the required tables to be created and data to be inserted.

The current release of OTM includes many tests that assume specific schema. Future releases of OTM will focus on making these tests work with user-defined schema. The current release can be used with any schema to run specific queries from SQL files and to test performance and concurrent connections.