OpentestFAQ

From AragoWiki

(Difference between revisions)
Jump to: navigation, search
(Created page with 'Back to Opentest's Home == General Questions == === Is Opentest right for me? === If you are working with one of the TI products that use Opentest then you might wa…')
(What is the format for importing test result into TestLink)
(3 intermediate revisions not shown)
Line 13: Line 13:
== TMS-related Questions ==
== TMS-related Questions ==
=== What is the format for importing test result into TestLink ===
=== What is the format for importing test result into TestLink ===
-
TestLink expects XML format to import to testlink. You can find the template of result XML file at [\\158.218.106.35\gguser\ale\Auto\TestLink\testlink_import_result_template.xml].
+
TestLink uses XML files to import results. <br>
 +
Check [[Opentest-SampleResultsXml | Sample results file]] <br>
 +
Check [[Opentest-SamplePerformanceResultsXml | Sample results file with performance data]]
=== What is the format for importing test suite(s) ===
=== What is the format for importing test suite(s) ===
-
XML file is the recommend format in TestLink. You can also import test cases to TestLink using XLS format; but the support is very limited. You can not import KEYWORD or CUSTOM FIELD. [file: \\158.218.106.35\gguser\ale\Auto\TestLink\testlink_import_tests_helloworld.xml] is an example of XML file which can be imported into TestLink.
+
The preferred way to import is using XML files. You can also import test cases to TestLink using XLS format; but the support is very limited. You can not import KEYWORD or CUSTOM FIELD.  
 +
Check [[Opentest-SampleImportXml | Sample test suite file]]
=== Why the exported XML is empty after I click Execute and Save Results button ===
=== Why the exported XML is empty after I click Execute and Save Results button ===
Currently, we only export automated test case after you click this button. So check if 'execute type' is set to Automated. If it set to Manual, this test case will not be exported.
Currently, we only export automated test case after you click this button. So check if 'execute type' is set to Automated. If it set to Manual, this test case will not be exported.
-
=== I forget my password, what should I do ===
+
=== I forgot my password, what should I do ===
In testlink login page, click 'Lost Password' link and then enter your login name. Testlink will reset password and send the new password to based upon your user name and the email address you entered when you setup user account. After you login with this new password, you can click Personal link on the top right corner and change the password to whatever you want.
In testlink login page, click 'Lost Password' link and then enter your login name. Testlink will reset password and send the new password to based upon your user name and the email address you entered when you setup user account. After you login with this new password, you can click Personal link on the top right corner and change the password to whatever you want.
Line 30: Line 33:
=== What account should Staf run under?  Does the windows account have to match the Linux account? ===
=== What account should Staf run under?  Does the windows account have to match the Linux account? ===
-
Tipycally it should not matter because in the Staf config files one can grant access to anybody on a given subnet (x.y.z.*). So any Staf machine can request services on another Staf machine as long as it is on the same  subnet.  
+
Typically it should not matter because in the Staf config files one can grant access to anybody on a given subnet (x.y.z.*). So any Staf machine can request services on another Staf machine as long as it is on the same  subnet.  
=== My system was setup with DynaLoader 1.05 and libPLSTAF.so is expecting 1.04.  How do we get around this (assuming we cannot change the system version of perl? ===
=== My system was setup with DynaLoader 1.05 and libPLSTAF.so is expecting 1.04.  How do we get around this (assuming we cannot change the system version of perl? ===
Line 45: Line 48:
== TEE-related Questions ==
== TEE-related Questions ==
=== What are the available TEE types? ===
=== What are the available TEE types? ===
-
# '''DSS TEE''': Test Execution engine that uses TI's Debug Server Scripting facilities to run tests.
 
-
# '''Linux TEE''': Target-based test execution engine customized for running tests on a Linux system.
 
-
# '''STAX''': Test execution engine provided by STAF.
 
# '''VATF TEE''': Host-based or Target-based execution engine written in Ruby that is capable of running test on many different environments.
# '''VATF TEE''': Host-based or Target-based execution engine written in Ruby that is capable of running test on many different environments.
 +
# '''STAX''': Test execution engine provided by STAF.
== VATF-related Questions ==
== VATF-related Questions ==
Line 62: Line 63:
=== How do I set site-specific information in VATF ===
=== How do I set site-specific information in VATF ===
-
Some site-specific information like e-mail server address, video files repository, etc must be specified in the site_info.rb file located in the vatf's root directory.
+
Some site-specific information like e-mail server address, log files repository, etc must be specified in the site_info.rb file located in the vatf's root directory.
 +
 
 +
=== How do I point to a specific ruby version ===
 +
Before you call /usr/local/staf/startSTAFProc.sh to start STAF, set PATH, GEM_HOME and GEM_PATH environment variables
 +
at the beginning of the /usr/local/staf/STAFEnv.sh file. For example:
 +
PATH=/usr/local/staf/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/X11R6/bin:/home/bin
 +
GEM_HOME=/var/lib/gems/1.9.1
 +
GEM_PATH=/var/lib/gems/1.9.1

Revision as of 19:35, 18 April 2013

Back to Opentest's Home

Contents

General Questions

Is Opentest right for me?

If you are working with one of the TI products that use Opentest then you might want to consider using Opentest for your own testing. Depending on your situation, you might want to use parts of Opentest like a Test Execution Engine instead of the full system. The full system is tailored to handle situations where there are many users working on many projects in parallel. If your team is small and you are only working on one project then it might make more sense for you to use some components of Opentest rather than the whole solution.

Architecture-related Questions

How does testlink and staf tie in together? I do not see configuration options in either that describe the interface (system level tie in)

There is a “Execute & Save” button in the TestLink Execute tab that triggers a Staf call from TestLink to the Test Master Controller. Every single machine that it is part of the test automation system MUST be running Staf. The machines in the system communicate w/ each other by calling Staf request on each other. TestLink only talks to the Test Master Controller (Dispatcher service). The Dispatcher will then contact the appropriate Build and Test Execution Engines. Once the TEE completes a test, the test results are sent to the Dispatcher and then the Dispatcher writes them to the TestLink database

TMS-related Questions

What is the format for importing test result into TestLink

TestLink uses XML files to import results.
Check Sample results file
Check Sample results file with performance data

What is the format for importing test suite(s)

The preferred way to import is using XML files. You can also import test cases to TestLink using XLS format; but the support is very limited. You can not import KEYWORD or CUSTOM FIELD. Check Sample test suite file

Why the exported XML is empty after I click Execute and Save Results button

Currently, we only export automated test case after you click this button. So check if 'execute type' is set to Automated. If it set to Manual, this test case will not be exported.

I forgot my password, what should I do

In testlink login page, click 'Lost Password' link and then enter your login name. Testlink will reset password and send the new password to based upon your user name and the email address you entered when you setup user account. After you login with this new password, you can click Personal link on the top right corner and change the password to whatever you want.


TMC-related Questions

What services are provided by the Test Master Controller

The test master controller layer is implemented as four separate staf services: the dispatcher, which is the front end of the test master controller to testlink, schedules jobs based on test session request coming from test link; the resource manager used by the dispatcher for resource reservation and allocation; the test link adapter used by the dispatcher to write results to the testlink database; and the email service used by the dispatcher to send email notifications to the user once a test session has finished execution.

What account should Staf run under? Does the windows account have to match the Linux account?

Typically it should not matter because in the Staf config files one can grant access to anybody on a given subnet (x.y.z.*). So any Staf machine can request services on another Staf machine as long as it is on the same subnet.

My system was setup with DynaLoader 1.05 and libPLSTAF.so is expecting 1.04. How do we get around this (assuming we cannot change the system version of perl?

If you are get libPLSTAF.so errors, you must likely will need to rebuild the libPLSTAF.so in your setup. The instructions for rebuilding it can be found at: http://staf.sourceforge.net/current/stafdg.html#Header_buildPerl

BEE-related Questions

What are the available BEE types?

  1. File BEE: Use to retrieve pre-built files from Windows' UNC paths
  2. HTTP BEE: Use to retrieve pre-built files from HTTP servers
  3. FTP BEE: Use to retrieve pre-built files from FTP servers
  4. Arago BEE: Use to build files from existing Arago recipes.

TEE-related Questions

What are the available TEE types?

  1. VATF TEE: Host-based or Target-based execution engine written in Ruby that is capable of running test on many different environments.
  2. STAX: Test execution engine provided by STAF.

VATF-related Questions

How do I add a new test equipment driver in VATF

  1. First you need to write the ruby code that implements the driver in a new file inside the test_equipment folder. For Example: VATF/test_equipment/my_new_driver.rb
  2. Then you need to add a reference to the new driver in the file VATF/test_equipment/test_equipment.rb. For example:
require 'test_equipment/q_master'
require 'test_equipment/q_master_dll'
require 'test_equipment/spectra_lab_cli'
require 'test_equipment/apc_power_controller'
require 'test_equipment/video_clarity'
require 'test_equipment/my_new_driver'

How do I set site-specific information in VATF

Some site-specific information like e-mail server address, log files repository, etc must be specified in the site_info.rb file located in the vatf's root directory.

How do I point to a specific ruby version

Before you call /usr/local/staf/startSTAFProc.sh to start STAF, set PATH, GEM_HOME and GEM_PATH environment variables at the beginning of the /usr/local/staf/STAFEnv.sh file. For example:

PATH=/usr/local/staf/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/X11R6/bin:/home/bin
GEM_HOME=/var/lib/gems/1.9.1
GEM_PATH=/var/lib/gems/1.9.1
Personal tools