Bug 122833

Summary:	[performance tests] Improve PerformaceTest Automation
Product:	[WebTools] WTP Releng	Reporter:	Arthur Ryman <ryman>
Component:	releng	Assignee:	John Lanuti <jlanuti>
Status:	CLOSED DUPLICATE	QA Contact:
Severity:	normal
Priority:	P2	Keywords:	performance, test
Version:	3.10
Target Milestone:	---
Hardware:	PC
OS:	Windows XP
Whiteboard:

Description Arthur Ryman

2006-01-05 18:35:24 EST

We need more frequent testing. This includes performance tests and tests on more configurations, including JDK 5 and Mac OS/X.

We should set up a notification system so that builds can trigger automated test runs on test machines. See David's note about using the RSS mechanisms. [1]

[1] http://dev.eclipse.org/mhonarc/lists/wtp-releng/msg02389.html

Comment 1 Jeffrey Liu

2006-01-19 14:08:23 EST

Target to look at this before the 2006-01-26 status meeting.

Comment 2 David Williams

2006-02-15 08:51:01 EST

I've changed the target since I don't think actually releasing 101 has anything to do with improving this. And, have raised priority from 3 to 2, to indicate its relative importance. (Feel free to correct if I'm in error).

Comment 3 Jeffrey Liu

2006-02-23 10:00:45 EST

I have automation working for API scans..... the only piece that is missing is auto uploading results to the Eclipse.org site. For some reason, sftp keep rejecting my id/pw..... I need to dig into why.

Automation for unit test and performance test will be similar to API scans. So stay tuned.

Comment 4 Jeffrey Liu

2006-03-02 13:44:09 EST

I got the upload working. I have setup a WinXP machine with the IBM 1.4.2 JDK. JUnit test results for some of the recent builds are now available. However, these results are not linked from the download page anywhere, I'll modify the download to link to these results. In the meantime, here are a couple of links to the results:

http://download.eclipse.org/webtools/downloads/drops/R-1.0.1-200602171228/testResults/WinXP_IBM1.4.2/results/html/org.eclipse.jst.server.tomcat.core.tests_.html

http://download.eclipse.org/webtools/downloads/drops/R-1.0.1-200602171228/testResults/WinXP_IBM1.4.2/results/consolelogs/wtptestlog.txt

Comment 5 Jeffrey Liu

2006-03-10 10:53:06 EST

Per 03/09 status meeting - need new machines to run the test/api/performance builds.

Comment 6 Jeffrey Liu

2006-03-17 10:01:27 EST

03/16 WTP status meeting - No update. Same as last week. Need machines to run those builds.

Comment 7 Jeffrey Liu

2006-03-30 09:43:20 EST

I'm closing this item out because all we are waiting for are machines.

Comment 8 Jeffrey Liu

2006-03-30 09:43:29 EST

Fixed.

Comment 9 Arthur Ryman

2006-06-26 16:48:14 EDT

What about the notification system? Are the tests triggered by an RSS feed?

Comment 10 Arthur Ryman

2006-09-19 09:35:25 EDT

Jeffrey, I am reopenning this because the performance tests do not seem to be run frequently. I checked the latest weekly build and the performance results were missing, i.e.

http://download.eclipse.org/webtools/downloads/drops/R1.5/M-1.5.1-200609150551/perfresults/graph/performance.php

Comment 11 Jeffrey Liu

2006-11-29 15:55:40 EST

John, over to you since you will be setting up new machines to run these performance tests.

Comment 12 John Lanuti

2007-09-06 10:48:10 EDT

We will track this with 197526

*** This bug has been marked as a duplicate of bug 197526 ***

Comment 13 John Lanuti

2007-09-10 11:52:41 EDT

Verified, closing.