Bug 74923 - [Usability] Provide immediate feedback on test execution
Summary: [Usability] Provide immediate feedback on test execution
Status: CLOSED WONTFIX
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: TPTP (show other bugs)
Version: unspecified   Edit
Hardware: All All
: P3 enhancement with 1 vote (vote)
Target Milestone: ---   Edit
Assignee: Paul Slauenwhite CLA
QA Contact:
URL:
Whiteboard: housecleaned460 closed461
Keywords: api, Documentation, PII, ui
: 80330 83124 (view as bug list)
Depends on: 92634
Blocks: 80330 110692
  Show dependency tree
 
Reported: 2004-09-24 01:44 EDT by Wayne Ho CLA
Modified: 2016-05-05 11:05 EDT (History)
7 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Wayne Ho CLA 2004-09-24 01:44:14 EDT
Users expect immmediate feedback as a test is executing.  Users want the ability
to see whether their test is running, some test results, to know if the test is
following the appropriate path (e.g., is it running the script properly, is the
test substituting data correctly?), etc.

Many users expected to see this feedback in a separate view during test
execution (e.g., at the bottom of the perspective).

It should also be noted that the majority of users during some usability studies
with performance testers, did not discover the execution log viewer.  It was not
obvious to users that they must locate the Execution object in the navigator,
then open it in order to see any Execution feedback.
Comment 1 Eugene Chan CLA 2004-09-24 15:44:17 EDT
Targeting this as future, but design should start in 3.2
Comment 2 Joe Toomey CLA 2005-01-13 15:38:28 EST
Interpreting this defect as a request to automatically open the execution
history of a testt is launched (thus provding the user with the viual feedback.)
 Combined with 76858, this will open to the events tab, which shows the run
progressing.
Comment 3 Wayne Ho CLA 2005-01-19 00:38:07 EST
My thoughts were more on providing lighter-weight feedback than the current
Execution History.

Users want to quickly be able to see that the test is indeed running, URL is
being invoked (where appropriate), datapool substitutions, etc. 

While the Execution History editor/view does provide this information, it is
displayed as an Editor that requires a significant amount of navigation to find
the required information.  

I had envisioned a small view similar to the Recorder Control view that displays
feedback while recording at the bottom of the Test Perspective or similar to the
Console view that is displayed when running a Java app in Eclipse (that has
console output).

There seems to be a number of possibilities:
1) providing a light-weight execution feedback view a the bottom of the Test
Perspective.
2) display the Execution History (but work to improve the usability of the
Execution History; does the Execution History view even update in real-time?)
3) Curtis, in Bug 83124, mentions the Eclipse jobs dialog to display feedback

If appropriate we can discuss this bug in the next TPTP UI meeting.
Comment 4 Curtis d'Entremont CLA 2005-01-19 10:56:18 EST
*** Bug 83124 has been marked as a duplicate of this bug. ***
Comment 5 Scott E. Schneider CLA 2005-01-19 16:10:40 EST
There is also a similar enhancement request with even more ideas/information 
(that I had entered in the past) [bugzilla_80330]
Comment 6 Scott E. Schneider CLA 2005-01-21 10:40:56 EST
*** Bug 80330 has been marked as a duplicate of this bug. ***
Comment 7 Scott E. Schneider CLA 2005-04-25 10:12:05 EDT
Request to deliver only in 4.0 and not 3.3.
Comment 8 Scott E. Schneider CLA 2005-04-25 12:59:22 EDT
[ sizing = 2 weeks ]
Comment 9 Scott E. Schneider CLA 2005-04-25 12:59:49 EDT
[ sizing = 3 weeks ]
Comment 10 Scott E. Schneider CLA 2005-04-25 16:13:19 EDT
Updated with dependency on defect that tracks the 3.3 partial progress view 
work associated with this.  The test execution monitor view parts of this 
enhancement is scheduled to be delivered in 4.0 instead of 3.3 (awaiting final 
approval, brought up at 4/25/2005 test project meeting) per request.
Comment 11 Scott E. Schneider CLA 2005-05-03 18:33:05 EDT
Requested move to 4.1 (consuming product and reporter agreed with this)
Comment 12 Ruth Lee CLA 2005-07-12 10:46:20 EDT
Deferring from 4.1 as per the official 4.1 enhancement plan.
http://eclipse.org/tptp/home/project_info/featureplans/features.php?source=All&project=All&release=4.1&file=TPTPFeatures_4.1.xml
Comment 13 Marius Slavescu CLA 2005-11-10 10:33:13 EST
You may take a look at how activity feedback is presented in live/import agent
scenarios in Profiling and Logging perspective.
In the import Log and Profiling file case we get feedback in the Progress view
and  also in the status bar, in the live connection cases we get only the status
bar info (there is no job created for profile and attach scenarios).

The status bar feedback is sensitive to the selected agent in the (Profile or
Log) Navigator (this cannot be done in Progress view), which allows to see how
much data and how many events have been processed on a specific agent (which is
currently collecting data).
Comment 14 Scott E. Schneider CLA 2005-12-02 12:32:13 EST
There was a lightweight solution implemented in TPTP 4.1 that does not yet use a new view ("Test Execution Monitor") but might suffice for TPTP 4.2.  I would suggest that greater support be pushed past TPTP 4.2 (just my opinion).
Comment 15 Scott E. Schneider CLA 2005-12-05 14:32:38 EST
Based on feedback from reporter and other appropriate parties, this should be pushed from TPTP 4.2 into TPTP 4.3.
Comment 16 Paul Slauenwhite CLA 2006-11-16 09:10:03 EST
*** Bug 83124 has been marked as a duplicate of this bug. ***
Comment 17 Paul Slauenwhite CLA 2007-02-12 12:36:09 EST
Correcting version for this enhancement (defaulting to the current release).  See http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html for more information.
Comment 18 Paul Slauenwhite CLA 2007-02-12 12:40:43 EST
Correcting version for this enhancement (defaulting to the current release).  See http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html for more information.
Comment 19 Paul Slauenwhite CLA 2007-02-12 13:04:45 EST
Correction: Future is a valid version for this enhancement based on http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html.  As such, the implicit assumption is that is enhancement is of a lower priority.  If incorrect, the originator should correct the version.
Comment 20 Paul Slauenwhite CLA 2007-03-14 14:28:10 EDT
Updating target to future as requested by the PMC.  

Enhancements are targeted to future if not in plan for the current release.
Comment 21 Paul Slauenwhite CLA 2007-11-05 12:00:52 EST
Correcting priority since not a 4.5 candidate enhancement (see http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html).
Comment 22 Paul Slauenwhite CLA 2009-06-30 06:29:54 EDT
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. As such, TPTP is not delivering enhancements. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this enhancement is resolved as WONTFIX. For this enhancement to be considered, please re-open with an attached patch including the Description Document (see http://www.eclipse.org/tptp/home/documents/process/development/description_documents.html), code (see http://www.eclipse.org/tptp/home/documents/resources/TPTPDevGuide.htm), and test cases (see http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy.html).
Comment 23 Paul Slauenwhite CLA 2009-06-30 06:58:11 EDT
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. As such, TPTP is not delivering enhancements. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this enhancement is resolved as WONTFIX. For this enhancement to be considered, please re-open with an attached patch including the Description Document (see http://www.eclipse.org/tptp/home/documents/process/development/description_documents.html), code (see http://www.eclipse.org/tptp/home/documents/resources/TPTPDevGuide.htm), and test cases (see http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy.html).
Comment 24 Paul Slauenwhite CLA 2009-09-24 15:00:45 EDT
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant enhancements/defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this enhancement/defect is verified/closed by the Project Lead since the originator of this enhancement/defect has an inactive Bugzilla account and considered to be fixed. If this enhancement/defect is still unresolved and reproducible in the latest TPTP release (http://www.eclipse.org/tptp/home/downloads/), please re-open.