Bug 201920 - [results] Performance tests with no error should be shown in fingerprints
Summary: [results] Performance tests with no error should be shown in fingerprints
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Releng (show other bugs)
Version: 3.3   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.5 M4   Edit
Assignee: Frederic Fusier CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on: 186549
Blocks:
  Show dependency tree
 
Reported: 2007-08-31 11:46 EDT by Frederic Fusier CLA
Modified: 2008-11-08 06:08 EST (History)
5 users (show)

See Also:

Attachments
Different possibilities to show this difference (146.54 KB, application/octet-stream)
2007-08-31 11:50 EDT, Frederic Fusier CLA 		no flags Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2007-08-31 11:46:29 EDT 
When bug 186549 will be fixed, fingerprints will show tests uncertainty zone of tests which have an error over the 3% threshold. However, tests which have only one measure does not have any valuable error and so would not have any uncertainty zone displayed in fingerprints.

I propose to show these tests in a different manner in fingerprints to let everybody knows that no uncertainty zone does not always mean that the test is reliable!
Comment 1 Frederic Fusier CLA 2007-08-31 11:50:58 EDT 
Created attachment 77473 [details]
Different possibilities to show this difference

This zip file contains some gif files showing different possibilities I'm thinking about to show this kind of test.
Comment 2 Frederic Fusier CLA 2007-08-31 11:54:44 EDT 
It would be great to have the feeling of all CC's on the proposed images...
TIA
Comment 3 Jerome Lanneluc CLA 2007-09-03 10:32:27 EDT 
My preference goes to the "vertical_lines" version (with even wider lines if possible). Second is the "light_colors" version.
Comment 4 Dani Megert CLA 2007-09-03 10:41:24 EDT 
Mmh. Do we really need yet another warning style? Couldn't we simply use yellow? Or can it be yellow with yellow lines? If so, several proposed solutions won't work.
Comment 5 Philipe Mulet CLA 2007-09-03 11:36:23 EDT 
Full yellow would look too harsh I think. For certain scenarii, there is no way to perform more than 1 repetition (would take too long). I wonder if solid green is not tolerable, maybe with a symbol meaning that there is some annotation about the only one repetition ? (similar to explanation for grey tests)
Comment 6 Philipe Mulet CLA 2008-05-23 04:29:12 EDT 
Please adjust the target milestone, so it does not point at a closed milestone in the past.
Comment 7 Frederic Fusier CLA 2008-11-08 06:08:42 EST 
Patch released for bug 186549 also fixed this bug...