Bug 201920

Summary: [results] Performance tests with no error should be shown in fingerprints
Product: [Eclipse Project] Platform Reporter: Frederic Fusier <frederic_fusier>
Component: RelengAssignee: Frederic Fusier <frederic_fusier>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: daniel_megert, jerome_lanneluc, kim.moir, philippe_mulet, sonia_dimitrov
Version: 3.3Keywords: performance, test
Target Milestone: 3.5 M4   
Hardware: PC   
OS: Windows XP   
Whiteboard:
Bug Depends on: 186549    
Bug Blocks:    
Attachments:
Description Flags
Different possibilities to show this difference none

Description Frederic Fusier CLA 2007-08-31 11:46:29 EDT 
When bug 186549 will be fixed, fingerprints will show tests uncertainty zone of tests which have an error over the 3% threshold. However, tests which have only one measure does not have any valuable error and so would not have any uncertainty zone displayed in fingerprints.

I propose to show these tests in a different manner in fingerprints to let everybody knows that no uncertainty zone does not always mean that the test is reliable!
Comment 1 Frederic Fusier CLA 2007-08-31 11:50:58 EDT 
Created attachment 77473 [details]
Different possibilities to show this difference

This zip file contains some gif files showing different possibilities I'm thinking about to show this kind of test.
Comment 2 Frederic Fusier CLA 2007-08-31 11:54:44 EDT 
It would be great to have the feeling of all CC's on the proposed images...
TIA
Comment 3 Jerome Lanneluc CLA 2007-09-03 10:32:27 EDT 
My preference goes to the "vertical_lines" version (with even wider lines if possible). Second is the "light_colors" version.
Comment 4 Dani Megert CLA 2007-09-03 10:41:24 EDT 
Mmh. Do we really need yet another warning style? Couldn't we simply use yellow? Or can it be yellow with yellow lines? If so, several proposed solutions won't work.
Comment 5 Philipe Mulet CLA 2007-09-03 11:36:23 EDT 
Full yellow would look too harsh I think. For certain scenarii, there is no way to perform more than 1 repetition (would take too long). I wonder if solid green is not tolerable, maybe with a symbol meaning that there is some annotation about the only one repetition ? (similar to explanation for grey tests)
Comment 6 Philipe Mulet CLA 2008-05-23 04:29:12 EDT 
Please adjust the target milestone, so it does not point at a closed milestone in the past.
Comment 7 Frederic Fusier CLA 2008-11-08 06:08:42 EST 
Patch released for bug 186549 also fixed this bug...