Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [wtp-dev] API JUnit test coverage now support run time scanning


Hi Naci,

I tried turning on runtime scanning for wst.server and wst.common. It seems to add about < 5 minutes of overhead to the build. But the good news is it founded 10% more API test coverage than static scanning. I'm going to commit the changes. 5 minutes is small so you shouldn't notice any difference.

Thanks,

Jeffrey Liu
IBM Rational Software - Performance Analyst
IBM Toronto Lab.
8200 Warden Ave. Markham, Ontario, L6G 1C7
Internal mail: D3/R8V/8200/MKM (D3-268)
T/L: 969 3531
Tel: (905) 413 3531
Fax: (905) 413 4920
jeffliu@xxxxxxxxxx



Naci Dai <naci.dai@xxxxxxxxxxxxx>
Sent by: wtp-dev-bounces@xxxxxxxxxxx

05/15/2005 02:58 PM

Please respond to
naci.dai and "General discussion of project-wide or architectural issues."

To
"General discussion of project-wide or architectural issues." <wtp-dev@xxxxxxxxxxx>
cc
Subject
Re: [wtp-dev] API JUnit test coverage now support run time scanning





If anybody uses runtime scanning, can you inform me too.  I would like
to check how the build (time) is effected by it.

thanks

Jeffrey Liu wrote:

>
> In the past, the API test coverage report is generated based on static
> scanning. This means the scanner will read the physical .class files
> of the JUnit testcases and determine what APIs are being refereneced.
> This approach has limitation because it does not allow the parser to
> trace through the run time method invocations (methods called within a
> method). As a result, developers have to write extra code to bring the
> coverage up.
>
> After working with the TPTP folks, we now have a way to do run time
> scanning. Here's what you need to do:
>
> 1. In org.eclipse.wtp.releng/testScript/test.xml, instead of using the
> "runtests" target to run your JUnit tests, use the "runapitests"
> target. You need to supply an extra parameter called
> "package.includes". The value of "package.includes" is used to filter
> out packages that you are not interested in. This is a required
> parameter because run time scanning is time consuming, providing
> filters helps the scan process to complete faster. Here's an example
> (for the J2EE JUnit testcases):
>
> Before:
>
> <target name="jst-j2ee-core-tests" description="Runs the
> org.eclipse.jst.j2ee.core.tests test.xml">
>         <antcall target="runtests">
>                 <param name="testPlugin"
> value="${org.eclipse.jst.j2ee.core.tests}" />
>                 <param name="report"
> value="org.eclipse.jst.j2ee.core.tests" />
>         </antcall>
> </target>
>
> After:
>
> <target name="jst-j2ee-core-tests" description="Runs the
> org.eclipse.jst.j2ee.core.tests test.xml">
>         <antcall target="runapitests">
>                 <param name="testPlugin"
> value="${org.eclipse.jst.j2ee.core.tests}" />
>                 <param name="report"
> value="org.eclipse.jst.j2ee.core.tests" />
>                 <param name="package.includes"
> value="org.eclipse.jst.j2ee."/>
>         </antcall>
> </target>
>
> You can also specify multiple filters like so (space separated):
>
> <param name="package.includes" value="org.eclipse.wst.server.ui
> org.eclipse.wst.server.core"/>
>
> Don't go crazy on this because run time scanning will increase the
> time to run the JUnit testcases by quite a bit. Feel free to let me
> know if you have any questions. Now, there's no excuse on why you
> don't have full JUnit testcoverage :)
>
> Thanks,
>
> Jeffrey Liu
> IBM Rational Software - Performance Analyst
> IBM Toronto Lab.
> 8200 Warden Ave. Markham, Ontario, L6G 1C7
> Internal mail: D3/R8V/8200/MKM (D3-268)
> T/L: 969 3531
> Tel: (905) 413 3531
> Fax: (905) 413 4920
> jeffliu@xxxxxxxxxx
>
>------------------------------------------------------------------------
>
>_______________________________________________
>wtp-dev mailing list
>wtp-dev@xxxxxxxxxxx
>https://dev.eclipse.org/mailman/listinfo/wtp-dev
>  
>


--
Naci Dai,
eteration a.s.
Inonu cad. Sumer sok. Zitas D1-15
Kozyatagi, Istanbul 34742
+90 (533) 580 2393 (cell)
+90 (216) 361 5434 (phone)
+90 (216) 361 2034 (fax)
http://www.eteration.com/
mailto:nacidai@xxxxxxx
mailto:naci@xxxxxxxxxxxxx

_______________________________________________
wtp-dev mailing list
wtp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/wtp-dev


Back to the top