Bug 262754 - [perfs] "Servlet Read" performance test does not last enough
Summary: [perfs] "Servlet Read" performance test does not last enough
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: User Assistance (show other bugs)
Version: 3.5   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.5 M6   Edit
Assignee: Chris Goldthorpe CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks:
 
Reported: 2009-01-28 09:13 EST by Frederic Fusier CLA
Modified: 2009-02-11 11:49 EST (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2009-01-28 09:13:25 EST 
Looking at Platform/UA performance tests results, it looks like
"Servlet Read" tests does not last enough (between 16ms and 33ms for I20090127-0100).

I suggest either to increase test time duration or remove it from the fingerprints.
Comment 1 Chris Goldthorpe CLA 2009-01-28 15:02:27 EST 
I have increased the length of the test by 10x and have changed it's name. This will show up early in M6.
Comment 2 Frederic Fusier CLA 2009-02-11 10:07:40 EST 
Note that the new test currently shows a noticeable regression on:
 - RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM): [-7.9%, -10.1%]
 - Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM): [-4.2%, -5.2%]

But as it lasts around 100ms, not sure if I need to open a bug for this...
Comment 3 Chris Goldthorpe CLA 2009-02-11 11:49:58 EST 
I think it's pretty clear from looking at the graph that the performance is slower and it's not just sampling error. This matches the observations made on my own system. Do I need to bump up the number of reads in each loop to get a longer test time?