Bug 122833 - [performance tests] Improve PerformaceTest Automation
Summary: [performance tests] Improve PerformaceTest Automation
Status: CLOSED DUPLICATE of bug 197526
Alias: None
Product: WTP Releng
Classification: WebTools
Component: releng (show other bugs)
Version: 3.10   Edit
Hardware: PC Windows XP
: P2 normal (vote)
Target Milestone: ---   Edit
Assignee: John Lanuti CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks:
 
Reported: 2006-01-05 18:35 EST by Arthur Ryman CLA
Modified: 2018-06-29 15:07 EDT (History)
0 users

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Arthur Ryman CLA 2006-01-05 18:35:24 EST 
We need more frequent testing. This includes performance tests and tests on more configurations, including JDK 5 and Mac OS/X.

We should set up a notification system so that builds can trigger automated test runs on test machines. See David's note about using the RSS mechanisms. [1]

[1] http://dev.eclipse.org/mhonarc/lists/wtp-releng/msg02389.html
Comment 1 Jeffrey Liu CLA 2006-01-19 14:08:23 EST 
Target to look at this before the 2006-01-26 status meeting.
Comment 2 David Williams CLA 2006-02-15 08:51:01 EST 
I've changed the target since I don't think actually releasing 101 has anything to do with improving this. And, have raised priority from 3 to 2, to indicate its relative importance. (Feel free to correct if I'm in error).
Comment 3 Jeffrey Liu CLA 2006-02-23 10:00:45 EST 
I have automation working for API scans..... the only piece that is missing is auto uploading results to the Eclipse.org site. For some reason, sftp keep rejecting my id/pw..... I need to dig into why.

Automation for unit test and performance test will be similar to API scans. So stay tuned.
Comment 4 Jeffrey Liu CLA 2006-03-02 13:44:09 EST 
I got the upload working. I have setup a WinXP machine with the IBM 1.4.2 JDK. JUnit test results for some of the recent builds are now available. However, these results are not linked from the download page anywhere, I'll modify the download to link to these results. In the meantime, here are a couple of links to the results:

http://download.eclipse.org/webtools/downloads/drops/R-1.0.1-200602171228/testResults/WinXP_IBM1.4.2/results/html/org.eclipse.jst.server.tomcat.core.tests_.html

http://download.eclipse.org/webtools/downloads/drops/R-1.0.1-200602171228/testResults/WinXP_IBM1.4.2/results/consolelogs/wtptestlog.txt
Comment 5 Jeffrey Liu CLA 2006-03-10 10:53:06 EST 
Per 03/09 status meeting - need new machines to run the test/api/performance builds.
Comment 6 Jeffrey Liu CLA 2006-03-17 10:01:27 EST 
03/16 WTP status meeting - No update. Same as last week. Need machines to run those builds.
Comment 7 Jeffrey Liu CLA 2006-03-30 09:43:20 EST 
I'm closing this item out because all we are waiting for are machines.
Comment 8 Jeffrey Liu CLA 2006-03-30 09:43:29 EST 
Fixed.
Comment 9 Arthur Ryman CLA 2006-06-26 16:48:14 EDT 
What about the notification system? Are the tests triggered by an RSS feed?
Comment 10 Arthur Ryman CLA 2006-09-19 09:35:25 EDT 
Jeffrey, I am reopenning this because the performance tests do not seem to be run frequently. I checked the latest weekly build and the performance results were missing, i.e.

http://download.eclipse.org/webtools/downloads/drops/R1.5/M-1.5.1-200609150551/perfresults/graph/performance.php
Comment 11 Jeffrey Liu CLA 2006-11-29 15:55:40 EST 
John, over to you since you will be setting up new machines to run these performance tests.
Comment 12 John Lanuti CLA 2007-09-06 10:48:10 EDT 
We will track this with 197526

*** This bug has been marked as a duplicate of bug 197526 ***
Comment 13 John Lanuti CLA 2007-09-10 11:52:41 EDT 
Verified, closing.