Bug 75029 - [Functionality] Test Execution and Agent Data Collection
Summary: [Functionality] Test Execution and Agent Data Collection
Status: CLOSED WONTFIX
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: TPTP (show other bugs)
Version: unspecified   Edit
Hardware: All All
: P2 major with 3 votes (vote)
Target Milestone: ---   Edit
Assignee: Paul Slauenwhite CLA
QA Contact:
URL:
Whiteboard: closed471
Keywords: api, Documentation, PII, ui
: 174218 (view as bug list)
Depends on: 74632 74633 79737 120404 120405 138736
Blocks: 78753
  Show dependency tree
 
Reported: 2004-09-25 10:14 EDT by Kent D Siefkes CLA
Modified: 2016-05-05 10:29 EDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Kent D Siefkes CLA 2004-09-25 10:14:22 EDT
Test Harness should be able to invoke user selectable agent data collectors 
when test is invoked on specified machines and associate the collected data 
results as with the test run.  These choices, including which data should be 
collected, needs to be persisted (with some naming scheme), so that subsequent 
test runs can re-use the same data collection choices (or easily edit them).

The initial requirement is to invoke agent data collectors which are 
independent of the test details itself (such as perfmon or other performance 
monitoring data collectors).
Comment 1 Joe Toomey CLA 2004-10-14 16:32:49 EDT
In addition, we need to enable concurrent test execution and profiling.  This 
may require collabortation with the toronto profiling folks to expose some of 
their code in a reusable fashion (so it can be consuemd by the test execution 
harness.)
Comment 2 Scott E. Schneider CLA 2004-11-16 12:35:19 EST
This enhancement request has been split into a new enhancement request to 
address "concurrent test execution and profiling" with this request only 
covering "data collectors being associated to a test, run with a test and then 
the data integrated with the test results".  Joe Toomey's comment on 2004-10-
14 16:32 (additional comment #1 below) has migrated to another enhancement 
request (likely be addressed in a later release such as 3.3).
Comment 3 Scott E. Schneider CLA 2004-12-01 11:56:40 EST
I'm attempting to get this feature re-targeted from 3.2i2 to 3.3.  This 
enhancement request is being deferred after discussion at 11/30/2004's weekly 
execution meeting.  There are two dependencies that were uncovered late in the 
iteration that made implementation of this feature very difficult to complete 
in 3.2 i2.  Current UI extensibility for launch configurations (added value 
such as having the ability to contribute additional configuration tabs for 
particular agent types (that were specific to each agent) is not easily 
possible without writing this code ourselves and also backend support for the 
discovery of installed agents and the overall facility for the general 
interaction and control is missing from the current agent controller 
implementation.  This should have been uncovered in the design phase but was 
not uncovered until the UI review and subsequent research while implementing 
certain parts of the code.
Comment 4 Harm Sluiman CLA 2005-04-13 14:56:02 EDT
Downstream products no longer require and have withdrawn request. We should 
review further to determine if needed in future release.
Comment 5 Ruth Lee CLA 2005-07-12 11:20:45 EDT
Changing to P1 as per the 4.1 official plan.
Comment 6 Scott E. Schneider CLA 2005-08-01 10:39:46 EDT
Pushed to a future release due to lack of resources in this release.
Comment 7 Kent D Siefkes CLA 2005-08-31 23:30:51 EDT
Changed Version from 4.1 to 4.2 for inclusion in TPTP 4.2 planning, given that 
this was scoped out of 4.1.
Comment 8 Christophe Telep CLA 2005-12-09 10:21:29 EST
proposed to be plan for 4.2 (plan keyword added)
Comment 9 Christophe Telep CLA 2005-12-09 12:18:59 EST
Target set to 4.2
Comment 10 Scott E. Schneider CLA 2005-12-12 12:04:52 EST
This enhancement request will be split into two entries for tracking purposes.
Comment 11 Scott E. Schneider CLA 2005-12-12 12:05:23 EST
This enhancement request will be split into two entries for tracking purposes.
Comment 12 Scott E. Schneider CLA 2005-12-12 12:08:58 EST
This defect is dependent on the new agent controller to be implemented the initially designed way -- there might be a lighter-weight solution that is specific to certain cases that will still meet the consumer's requirements.

Clarification on the new agent controller and its roll out to consumers in TPTP 4.2 needs to be obtained.  Without the new agent controller features that this item depends on a scaled down solution will have to be implemented.
Comment 13 Paul Slauenwhite CLA 2007-03-14 14:26:12 EDT
Updating target to future as requested by the PMC.  

Enhancements are targeted to future if not in plan for the current release.
Comment 14 Paul Slauenwhite CLA 2007-11-05 12:00:47 EST
Correcting priority since not a 4.5 candidate enhancement (see http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html).
Comment 15 Paul Slauenwhite CLA 2008-04-18 15:34:07 EDT
This feature also requires that when a test is executed in profiling or debug mode, the associated perspective is opened.  For example, for debugging:

//Attempt to open the Debug Perspective:
IWorkbench workbench = PlatformUI.getWorkbench();
IWorkbenchWindow activeWorkbenchWindow = workbench.getActiveWorkbenchWindow();

if (!activeWorkbenchWindow.getActivePage().getPerspective().getId().equals("org.eclipse.debug.ui.DebugPerspective")) { //$NON-NLS-1$
    workbench.showPerspective("org.eclipse.debug.ui.DebugPerspective", activeWorkbenchWindow); //$NON-NLS-1$
}	

This should be done in org.eclipse.hyades.execution.harness.TestExecutionHarnessExecutorStub.debugAndLaunch(IProgressMonitor) but since this TestExecutionHarnessExecutorStub is not aware of the workbench (or the UI), we need to create a lower-level TestExecutionHarnessExecutorStub in a test UI plug-in for opening the associated perspective when launching from the Eclipse workbench.
Comment 17 Paul Slauenwhite CLA 2008-04-18 15:50:30 EDT
Changing to a defect since this is function that should have been implemented with the org.eclipse.hyades.test.core.launchconfigLaunchableType extension point.
Comment 18 Paul Slauenwhite CLA 2008-05-28 11:19:19 EDT
*** Bug 174218 has been marked as a duplicate of this bug. ***
Comment 19 Paul Slauenwhite CLA 2008-05-28 11:20:16 EDT
In addition:

[Defect #174218]:
Launching a JUnit/Plug-in test in debug mode opens the Test perspective.

When running a debug launch configuration for a TPTP JUnit or TPTP JUnit
Plug-in test suite, the Test perspective is opened instead of the Debug
perspective.
Comment 20 Paul Slauenwhite CLA 2009-06-30 06:57:29 EDT
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. Since this defect is more than 2 years old, it may be no longer relevant. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this defect is resolved as WONTFIX. If this defect is still relevant and reproducible in the latest TPTP release (http://www.eclipse.org/tptp/home/downloads/), please re-open.
Comment 21 Paul Slauenwhite CLA 2009-07-03 07:05:47 EDT
Closing.
Comment 22 Paul Slauenwhite CLA 2009-07-03 07:28:26 EDT
Mistakenly closed for the originator.  Reopening for the originator to verify/close.
Comment 23 Paul Slauenwhite CLA 2009-07-03 07:29:49 EDT
Re-resolving as WONTIFX.
Comment 24 Kathy Chan CLA 2010-11-18 18:49:40 EST
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant enhancements/defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this enhancement/defect is verified/closed by the Project Lead since this enhancement/defect has been resolved and unverified for more than 1 year and considered to be fixed. If this enhancement/defect is still unresolved and reproducible in the latest TPTP release (http://www.eclipse.org/tptp/home/downloads/), please re-open.