Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [p2-dev] Next week is test authoring week


At last count we have 450 automated tests with 50% method coverage and 43% block coverage.  This includes UI and publisher tests that are not yet hooked up to run with the build.

For the publisher tests, the current hurdle is that the tests require JUnit 4, which isn't yet supported by the platform test framework (see bug https://bugs.eclipse.org/bugs/show_bug.cgi?id=153429). We should probably just revert these tests to run with JUnit3 to expedite getting them into the build (the JUnit 4 bug has been open for over two years and not yet solved).





----- Forwarded by John Arthorne/Ottawa/IBM on 09/19/2008 04:51 PM -----
John Arthorne/Ottawa/IBM

09/12/2008 05:54 PM

To
P2 developer discussions <p2-dev@xxxxxxxxxxx>
cc
Subject
Re: [p2-dev] Next week is test authoring weekLink




We've made some progress already in 3.5 with 325 tests today from 276 tests in 3.4 (excluding to-be-released publisher tests).  One tool to help identify areas needing more testing is eclemma. It only takes a few minutes to install and instrument tests for running with eclemma. Here is a snapshot of the test coverage as of today:

http://www.eclipse.org/equinox/incubator/provisioning/p2-coverage-3.5m2.html

Of course a coverage tool only tells you that the code executed, not that it produced a correct result. Still, we can't be testing correctness of code that's not being run at all in our tests, so this coverage information is useful data.

John



Pascal Rapicault/Ottawa/IBM@IBMCA
Sent by: p2-dev-bounces@xxxxxxxxxxx

09/12/2008 04:00 PM

Please respond to
P2 developer discussions <p2-dev@xxxxxxxxxxx>

To
p2-dev@xxxxxxxxxxx
cc
Subject
[p2-dev] Next week is test authoring week





One of our 3.5 theme is robustness. As a team we will be taking next week to focus on writing unit tests.
Please join us in this effort to make p2 more dependable.

PaScaL
_______________________________________________
p2-dev mailing list
p2-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/p2-dev

Title: EMMA Coverage Report (generated Fri Sep 19 16:30:17 EDT 2008)
EMMA Coverage Report (generated Fri Sep 19 16:30:17 EDT 2008)
[all classes]

OVERALL COVERAGE SUMMARY

nameclass, %method, %block, %line, %
all classes56%  (473/852)50%  (2956/5909)43%  (71778/167386)44%  (15774.7/36071)

OVERALL STATS SUMMARY

total packages:85
total executable files:542
total classes:852
total methods:5909
total executable lines:36071

COVERAGE BREAKDOWN BY PACKAGE

nameclass, %method, %block, %line, %
org.eclipse.equinox.internal.p2.artifact.mirror0%   (0/2)0%   (0/9)0%   (0/334)0%   (0/69)
org.eclipse.equinox.internal.p2.console0%   (0/4)0%   (0/48)0%   (0/1728)0%   (0/379)
org.eclipse.equinox.internal.p2.jarprocessor.verifier0%   (0/3)0%   (0/13)0%   (0/330)0%   (0/85)
org.eclipse.equinox.internal.p2.metadata.mirror0%   (0/4)0%   (0/21)0%   (0/501)0%   (0/95)
org.eclipse.equinox.internal.p2.reconciler.dropins0%   (0/8)0%   (0/82)0%   (0/3657)0%   (0/807)
org.eclipse.equinox.internal.p2.touchpoint.natives.actions0%   (0/1)0%   (0/4)0%   (0/109)0%   (0/19)
org.eclipse.equinox.internal.p2.ui.dialogs0%   (0/41)0%   (0/189)0%   (0/4442)0%   (0/1008)
org.eclipse.equinox.internal.p2.ui.sdk.updates0%   (0/20)0%   (0/78)0%   (0/1499)0%   (0/356)
org.eclipse.equinox.internal.p2.ui.viewers0%   (0/7)0%   (0/32)0%   (0/584)0%   (0/139)
org.eclipse.equinox.internal.provisional.configuratormanipulator0%   (0/1)0%   (0/2)0%   (0/11)0%   (0/3)
org.eclipse.equinox.internal.provisional.p2.ui.actions0%   (0/10)0%   (0/51)0%   (0/1239)0%   (0/276)
org.eclipse.equinox.internal.provisional.p2.ui.dialogs0%   (0/41)0%   (0/151)0%   (0/3386)0%   (0/760)
org.eclipse.equinox.internal.provisional.p2.ui.sdk0%   (0/11)0%   (0/41)0%   (0/791)0%   (0/170)
org.eclipse.equinox.internal.provisional.p2.updatechecker0%   (0/1)0%   (0/3)0%   (0/15)0%   (0/6)
org.eclipse.equinox.p2.director.app.ant0%   (0/1)0%   (0/18)0%   (0/304)0%   (0/84)
org.eclipse.pde.internal.swt.tools0%   (0/27)0%   (0/139)0%   (0/7896)0%   (0/1559)
org.eclipse.equinox.internal.provisional.p2.ui.viewers8%   (1/13)1%   (1/69)1%   (12/1521)1%   (5/387)
org.eclipse.equinox.internal.p2.director.app50%  (2/4)21%  (7/34)5%   (69/1479)6%   (19/296)
org.eclipse.equinox.internal.p2.ui.model67%  (4/6)14%  (6/42)6%   (29/462)12%  (13/108)
org.eclipse.equinox.internal.provisional.p2.ui20%  (4/20)10%  (11/108)7%   (155/2306)7%   (36.6/534)
org.eclipse.equinox.internal.p2.ui.sdk.prefs15%  (2/13)10%  (4/40)7%   (98/1449)9%   (28/296)
org.eclipse.equinox.internal.p2.ui.sdk10%  (4/42)11%  (18/168)7%   (296/4085)7%   (58.4/877)
org.eclipse.equinox.internal.p2.updatechecker67%  (2/3)29%  (5/17)7%   (32/437)11%  (10/92)
org.eclipse.equinox.internal.simpleconfigurator.console50%  (1/2)29%  (2/7)7%   (11/148)12%  (5/42)
org.eclipse.equinox.internal.provisional.p2.core50%  (1/2)14%  (1/7)9%   (4/44)14%  (2/14)
org.eclipse.equinox.internal.provisional.p2.ui.model33%  (5/15)13%  (16/119)12%  (142/1150)14%  (42.6/306)
org.eclipse.equinox.internal.p2.jarprocessor64%  (7/11)37%  (27/73)21%  (584/2731)25%  (157.4/636)
org.eclipse.equinox.spi.p2.publisher80%  (4/5)39%  (27/69)22%  (939/4359)22%  (180.1/813)
org.eclipse.equinox.internal.frameworkadmin.utils100% (3/3)38%  (18/47)23%  (427/1882)25%  (101.6/404)
org.eclipse.equinox.internal.p2.touchpoint.natives46%  (6/13)34%  (23/67)23%  (368/1577)23%  (74.6/328)
org.eclipse.equinox.internal.simpleconfigurator.utils83%  (5/6)38%  (12/32)25%  (361/1425)27%  (76.3/287)
org.eclipse.equinox.internal.provisional.p2.ui.operations45%  (9/20)34%  (46/135)26%  (558/2111)29%  (121.3/414)
org.eclipse.equinox.internal.p2.publisher.eclipse71%  (5/7)43%  (54/127)28%  (1360/4889)29%  (307.3/1056)
org.eclipse.equinox.internal.provisional.p2.metadata.generator69%  (9/13)52%  (143/274)29%  (3095/10565)33%  (692.4/2090)
org.eclipse.equinox.internal.p2.metadata.generator.features56%  (5/9)36%  (64/177)33%  (1560/4712)36%  (411.3/1135)
org.eclipse.equinox.internal.p2.touchpoint.eclipse.actions92%  (23/25)42%  (35/84)40%  (1129/2799)38%  (219.9/579)
org.eclipse.equinox.internal.p2.ui43%  (3/7)45%  (14/31)41%  (243/599)53%  (70.3/132)
org.eclipse.equinox.internal.p2.extensionlocation88%  (7/8)45%  (39/87)42%  (815/1952)42%  (182.4/439)
org.eclipse.equinox.p2.publisher83%  (5/6)51%  (38/74)42%  (825/1973)40%  (161.1/404)
org.eclipse.equinox.internal.p2.publisher40%  (2/5)48%  (11/23)42%  (63/149)49%  (22/45)
org.eclipse.equinox.internal.provisional.frameworkadmin60%  (3/5)75%  (66/88)48%  (703/1478)59%  (192.2/324)
org.eclipse.equinox.internal.provisional.p2.ui.policy50%  (1/2)50%  (1/2)50%  (3/6)50%  (1/2)
org.eclipse.equinox.internal.p2.metadata.generator75%  (6/8)59%  (32/54)52%  (1086/2079)53%  (225.8/426)
org.eclipse.equinox.internal.p2.touchpoint.eclipse100% (10/10)69%  (68/99)53%  (1257/2392)53%  (295/556)
org.eclipse.equinox.internal.p2.update75%  (6/8)74%  (70/95)53%  (1051/1966)58%  (299.2/514)
org.eclipse.equinox.internal.provisional.p2.metadata.query75%  (3/4)62%  (10/16)56%  (124/221)56%  (37/66)
org.eclipse.equinox.internal.provisional.p2.ui.query52%  (11/21)64%  (58/91)58%  (1244/2157)61%  (286.5/471)
org.eclipse.equinox.internal.p2.updatesite78%  (14/18)69%  (135/195)58%  (3304/5666)62%  (794.4/1275)
org.eclipse.equinox.internal.p2.core.helpers73%  (11/15)57%  (59/104)60%  (1102/1835)60%  (248.2/412)
org.eclipse.internal.provisional.equinox.p2.jarprocessor100% (3/3)70%  (19/27)62%  (882/1425)64%  (211.7/330)
org.eclipse.equinox.p2.publisher.eclipse59%  (13/22)61%  (181/296)62%  (5517/8895)62%  (1124.8/1819)
org.eclipse.equinox.internal.simpleconfigurator100% (5/5)74%  (20/27)63%  (777/1228)61%  (167.3/273)
org.eclipse.equinox.internal.provisional.p2.metadata100% (11/11)79%  (83/105)66%  (961/1464)68%  (253.1/373)
org.eclipse.equinox.internal.frameworkadmin.equinox75%  (9/12)77%  (109/142)66%  (4219/6378)68%  (971.7/1426)
org.eclipse.equinox.internal.p2.artifact.repository93%  (14/15)85%  (93/109)66%  (2515/3789)68%  (555.7/819)
org.eclipse.equinox.internal.p2.persistence77%  (10/13)79%  (83/105)67%  (1258/1867)70%  (307/437)
org.eclipse.equinox.internal.provisional.p2.query67%  (2/3)71%  (10/14)69%  (106/154)65%  (24/37)
org.eclipse.equinox.internal.p2.garbagecollector88%  (7/8)80%  (28/35)69%  (515/747)69%  (119.4/173)
org.eclipse.equinox.internal.provisional.spi.p2.artifact.repository100% (2/2)46%  (6/13)69%  (254/366)66%  (58/88)
org.eclipse.equinox.internal.p2.artifact.repository.simple94%  (17/18)67%  (106/158)69%  (3900/5612)63%  (605.1/967)
org.eclipse.equinox.internal.provisional.spi.p2.metadata.repository100% (4/4)71%  (12/17)70%  (307/436)68%  (76.5/113)
org.eclipse.equinox.internal.provisional.p2.artifact.repository100% (1/1)90%  (19/21)71%  (267/378)69%  (63.2/91)
org.eclipse.equinox.internal.provisional.p2.directorywatcher100% (9/9)69%  (72/104)72%  (1304/1813)72%  (298.6/412)
org.eclipse.equinox.internal.simpleconfigurator.manipulator80%  (4/5)92%  (33/36)73%  (1216/1668)70%  (278/395)
org.eclipse.equinox.internal.provisional.p2.engine.phases100% (16/16)83%  (55/66)74%  (977/1322)74%  (207.6/281)
org.eclipse.equinox.internal.p2.director89%  (24/27)70%  (152/217)74%  (6158/8293)73%  (1202.4/1640)
org.eclipse.equinox.internal.p2.metadata.repository100% (17/17)89%  (117/132)74%  (3372/4530)74%  (737.4/996)
org.eclipse.equinox.internal.provisional.spi.p2.core.repository100% (1/1)71%  (10/14)76%  (82/108)73%  (22/30)
org.eclipse.equinox.internal.provisional.p2.artifact.repository.processing71%  (5/7)84%  (31/37)77%  (456/595)75%  (120.3/160)
org.eclipse.equinox.internal.p2.core100% (4/4)92%  (24/26)78%  (481/618)77%  (108.9/142)
org.eclipse.equinox.internal.p2.engine93%  (27/29)84%  (147/174)78%  (3317/4260)80%  (768.9/967)
org.eclipse.equinox.internal.provisional.p2.engine96%  (23/24)83%  (99/119)78%  (2279/2906)82%  (441.6/537)
org.eclipse.equinox.p2.publisher.actions89%  (8/9)85%  (33/39)79%  (1046/1332)76%  (227.1/299)
org.eclipse.equinox.internal.p2.artifact.processing100% (2/2)89%  (8/9)79%  (107/136)88%  (33.3/38)
org.eclipse.equinox.internal.frameworkadmin.equinox.utils100% (2/2)89%  (8/9)79%  (339/427)78%  (86.7/111)
org.eclipse.equinox.internal.p2.updatesite.metadata100% (1/1)75%  (6/8)79%  (139/175)78%  (32.7/42)
org.eclipse.equinox.internal.p2.metadata100% (7/7)85%  (89/105)80%  (947/1185)81%  (237.6/292)
org.eclipse.equinox.internal.p2.artifact.processors.pack200100% (1/1)100% (6/6)81%  (114/141)90%  (27.1/30)
org.eclipse.equinox.internal.p2.updatesite.artifact100% (1/1)83%  (5/6)81%  (174/215)80%  (37.7/47)
org.eclipse.equinox.internal.p2.metadata.repository.io93%  (26/28)89%  (81/91)85%  (2504/2961)86%  (492.7/575)
org.eclipse.equinox.internal.provisional.p2.core.repository50%  (1/2)83%  (5/6)87%  (26/30)82%  (9/11)
org.eclipse.equinox.internal.p2.rollback100% (3/3)62%  (16/26)87%  (807/926)86%  (161.8/189)
org.eclipse.equinox.internal.p2.resolution100% (4/4)90%  (28/31)88%  (801/909)89%  (168.9/190)
org.eclipse.equinox.internal.p2.exemplarysetup100% (1/1)100% (15/15)89%  (195/219)98%  (55.2/56)
org.eclipse.equinox.internal.provisional.p2.director100% (4/4)93%  (26/28)92%  (410/448)95%  (104.7/110)

[all classes]
EMMA 2.0.5312 EclEmma Fix 1 (C) Vladimir Roubtsov

Back to the top