[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [p2-dev] Next week is test authoring week


At last count we have 450 automated tests with 50% method coverage and 43% block coverage.  This includes UI and publisher tests that are not yet hooked up to run with the build.

For the publisher tests, the current hurdle is that the tests require JUnit 4, which isn't yet supported by the platform test framework (see bug https://bugs.eclipse.org/bugs/show_bug.cgi?id=153429). We should probably just revert these tests to run with JUnit3 to expedite getting them into the build (the JUnit 4 bug has been open for over two years and not yet solved).





----- Forwarded by John Arthorne/Ottawa/IBM on 09/19/2008 04:51 PM -----
John Arthorne/Ottawa/IBM

09/12/2008 05:54 PM

To
P2 developer discussions <p2-dev@xxxxxxxxxxx>
cc
Subject
Re: [p2-dev] Next week is test authoring weekLink




We've made some progress already in 3.5 with 325 tests today from 276 tests in 3.4 (excluding to-be-released publisher tests).  One tool to help identify areas needing more testing is eclemma. It only takes a few minutes to install and instrument tests for running with eclemma. Here is a snapshot of the test coverage as of today:

http://www.eclipse.org/equinox/incubator/provisioning/p2-coverage-3.5m2.html

Of course a coverage tool only tells you that the code executed, not that it produced a correct result. Still, we can't be testing correctness of code that's not being run at all in our tests, so this coverage information is useful data.

John



Pascal Rapicault/Ottawa/IBM@IBMCA
Sent by: p2-dev-bounces@xxxxxxxxxxx

09/12/2008 04:00 PM

Please respond to
P2 developer discussions <p2-dev@xxxxxxxxxxx>

To
p2-dev@xxxxxxxxxxx
cc
Subject
[p2-dev] Next week is test authoring week





One of our 3.5 theme is robustness. As a team we will be taking next week to focus on writing unit tests.
Please join us in this effort to make p2 more dependable.

PaScaL
_______________________________________________
p2-dev mailing list
p2-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/p2-dev

Title: EMMA Coverage Report (generated Fri Sep 19 16:30:17 EDT 2008)
EMMA  Coverage  Report  (generated  Fri  Sep  19  16:30:17  EDT  2008)
[all  classes]

OVERALL  COVERAGE  SUMMARY

nameclass,  %method,  %block,  %line,  %
all  classes56%    (473/852)50%    (2956/5909)43%    (71778/167386)44%    (15774.7/36071)

OVERALL  STATS  SUMMARY

total  packages:85
total  executable  files:542
total  classes:852
total  methods:5909
total  executable  lines:36071

COVERAGE  BREAKDOWN  BY  PACKAGE

nameclass,  %method,  %block,  %line,  %
org.eclipse.equinox.internal.p2.artifact.mirror0%      (0/2)0%      (0/9)0%      (0/334)0%      (0/69)
org.eclipse.equinox.internal.p2.console0%      (0/4)0%      (0/48)0%      (0/1728)0%      (0/379)
org.eclipse.equinox.internal.p2.jarprocessor.verifier0%      (0/3)0%      (0/13)0%      (0/330)0%      (0/85)
org.eclipse.equinox.internal.p2.metadata.mirror0%      (0/4)0%      (0/21)0%      (0/501)0%      (0/95)
org.eclipse.equinox.internal.p2.reconciler.dropins0%      (0/8)0%      (0/82)0%      (0/3657)0%      (0/807)
org.eclipse.equinox.internal.p2.touchpoint.natives.actions0%      (0/1)0%      (0/4)0%      (0/109)0%      (0/19)
org.eclipse.equinox.internal.p2.ui.dialogs0%      (0/41)0%      (0/189)0%      (0/4442)0%      (0/1008)
org.eclipse.equinox.internal.p2.ui.sdk.updates0%      (0/20)0%      (0/78)0%      (0/1499)0%      (0/356)
org.eclipse.equinox.internal.p2.ui.viewers0%      (0/7)0%      (0/32)0%      (0/584)0%      (0/139)
org.eclipse.equinox.internal.provisional.configuratormanipulator0%      (0/1)0%      (0/2)0%      (0/11)0%      (0/3)
org.eclipse.equinox.internal.provisional.p2.ui.actions0%      (0/10)0%      (0/51)0%      (0/1239)0%      (0/276)
org.eclipse.equinox.internal.provisional.p2.ui.dialogs0%      (0/41)0%      (0/151)0%      (0/3386)0%      (0/760)
org.eclipse.equinox.internal.provisional.p2.ui.sdk0%      (0/11)0%      (0/41)0%      (0/791)0%      (0/170)
org.eclipse.equinox.internal.provisional.p2.updatechecker0%      (0/1)0%      (0/3)0%      (0/15)0%      (0/6)
org.eclipse.equinox.p2.director.app.ant0%      (0/1)0%      (0/18)0%      (0/304)0%      (0/84)
org.eclipse.pde.internal.swt.tools0%      (0/27)0%      (0/139)0%      (0/7896)0%      (0/1559)
org.eclipse.equinox.internal.provisional.p2.ui.viewers8%      (1/13)1%      (1/69)1%      (12/1521)1%      (5/387)
org.eclipse.equinox.internal.p2.director.app50%    (2/4)21%    (7/34)5%      (69/1479)6%      (19/296)
org.eclipse.equinox.internal.p2.ui.model67%    (4/6)14%    (6/42)6%      (29/462)12%    (13/108)
org.eclipse.equinox.internal.provisional.p2.ui20%    (4/20)10%    (11/108)7%      (155/2306)7%      (36.6/534)
org.eclipse.equinox.internal.p2.ui.sdk.prefs15%    (2/13)10%    (4/40)7%      (98/1449)9%      (28/296)
org.eclipse.equinox.internal.p2.ui.sdk10%    (4/42)11%    (18/168)7%      (296/4085)7%      (58.4/877)
org.eclipse.equinox.internal.p2.updatechecker67%    (2/3)29%    (5/17)7%      (32/437)11%    (10/92)
org.eclipse.equinox.internal.simpleconfigurator.console50%    (1/2)29%    (2/7)7%      (11/148)12%    (5/42)
org.eclipse.equinox.internal.provisional.p2.core50%    (1/2)14%    (1/7)9%      (4/44)14%    (2/14)
org.eclipse.equinox.internal.provisional.p2.ui.model33%    (5/15)13%    (16/119)12%    (142/1150)14%    (42.6/306)
org.eclipse.equinox.internal.p2.jarprocessor64%    (7/11)37%    (27/73)21%    (584/2731)25%    (157.4/636)
org.eclipse.equinox.spi.p2.publisher80%    (4/5)39%    (27/69)22%    (939/4359)22%    (180.1/813)
org.eclipse.equinox.internal.frameworkadmin.utils100%  (3/3)38%    (18/47)23%    (427/1882)25%    (101.6/404)
org.eclipse.equinox.internal.p2.touchpoint.natives46%    (6/13)34%    (23/67)23%    (368/1577)23%    (74.6/328)
org.eclipse.equinox.internal.simpleconfigurator.utils83%    (5/6)38%    (12/32)25%    (361/1425)27%    (76.3/287)
org.eclipse.equinox.internal.provisional.p2.ui.operations45%    (9/20)34%    (46/135)26%    (558/2111)29%    (121.3/414)
org.eclipse.equinox.internal.p2.publisher.eclipse71%    (5/7)43%    (54/127)28%    (1360/4889)29%    (307.3/1056)
org.eclipse.equinox.internal.provisional.p2.metadata.generator69%    (9/13)52%    (143/274)29%    (3095/10565)33%    (692.4/2090)
org.eclipse.equinox.internal.p2.metadata.generator.features56%    (5/9)36%    (64/177)33%    (1560/4712)36%    (411.3/1135)
org.eclipse.equinox.internal.p2.touchpoint.eclipse.actions92%    (23/25)42%    (35/84)40%    (1129/2799)38%    (219.9/579)
org.eclipse.equinox.internal.p2.ui43%    (3/7)45%    (14/31)41%    (243/599)53%    (70.3/132)
org.eclipse.equinox.internal.p2.extensionlocation88%    (7/8)45%    (39/87)42%    (815/1952)42%    (182.4/439)
org.eclipse.equinox.p2.publisher83%    (5/6)51%    (38/74)42%    (825/1973)40%    (161.1/404)
org.eclipse.equinox.internal.p2.publisher40%    (2/5)48%    (11/23)42%    (63/149)49%    (22/45)
org.eclipse.equinox.internal.provisional.frameworkadmin60%    (3/5)75%    (66/88)48%    (703/1478)59%    (192.2/324)
org.eclipse.equinox.internal.provisional.p2.ui.policy50%    (1/2)50%    (1/2)50%    (3/6)50%    (1/2)
org.eclipse.equinox.internal.p2.metadata.generator75%    (6/8)59%    (32/54)52%    (1086/2079)53%    (225.8/426)
org.eclipse.equinox.internal.p2.touchpoint.eclipse100%  (10/10)69%    (68/99)53%    (1257/2392)53%    (295/556)
org.eclipse.equinox.internal.p2.update75%    (6/8)74%    (70/95)53%    (1051/1966)58%    (299.2/514)
org.eclipse.equinox.internal.provisional.p2.metadata.query75%    (3/4)62%    (10/16)56%    (124/221)56%    (37/66)
org.eclipse.equinox.internal.provisional.p2.ui.query52%    (11/21)64%    (58/91)58%    (1244/2157)61%    (286.5/471)
org.eclipse.equinox.internal.p2.updatesite78%    (14/18)69%    (135/195)58%    (3304/5666)62%    (794.4/1275)
org.eclipse.equinox.internal.p2.core.helpers73%    (11/15)57%    (59/104)60%    (1102/1835)60%    (248.2/412)
org.eclipse.internal.provisional.equinox.p2.jarprocessor100%  (3/3)70%    (19/27)62%    (882/1425)64%    (211.7/330)
org.eclipse.equinox.p2.publisher.eclipse59%    (13/22)61%    (181/296)62%    (5517/8895)62%    (1124.8/1819)
org.eclipse.equinox.internal.simpleconfigurator100%  (5/5)74%    (20/27)63%    (777/1228)61%    (167.3/273)
org.eclipse.equinox.internal.provisional.p2.metadata100%  (11/11)79%    (83/105)66%    (961/1464)68%    (253.1/373)
org.eclipse.equinox.internal.frameworkadmin.equinox75%    (9/12)77%    (109/142)66%    (4219/6378)68%    (971.7/1426)
org.eclipse.equinox.internal.p2.artifact.repository93%    (14/15)85%    (93/109)66%    (2515/3789)68%    (555.7/819)
org.eclipse.equinox.internal.p2.persistence77%    (10/13)79%    (83/105)67%    (1258/1867)70%    (307/437)
org.eclipse.equinox.internal.provisional.p2.query67%    (2/3)71%    (10/14)69%    (106/154)65%    (24/37)
org.eclipse.equinox.internal.p2.garbagecollector88%    (7/8)80%    (28/35)69%    (515/747)69%    (119.4/173)
org.eclipse.equinox.internal.provisional.spi.p2.artifact.repository100%  (2/2)46%    (6/13)69%    (254/366)66%    (58/88)
org.eclipse.equinox.internal.p2.artifact.repository.simple94%    (17/18)67%    (106/158)69%    (3900/5612)63%    (605.1/967)
org.eclipse.equinox.internal.provisional.spi.p2.metadata.repository100%  (4/4)71%    (12/17)70%    (307/436)68%    (76.5/113)
org.eclipse.equinox.internal.provisional.p2.artifact.repository100%  (1/1)90%    (19/21)71%    (267/378)69%    (63.2/91)
org.eclipse.equinox.internal.provisional.p2.directorywatcher100%  (9/9)69%    (72/104)72%    (1304/1813)72%    (298.6/412)
org.eclipse.equinox.internal.simpleconfigurator.manipulator80%    (4/5)92%    (33/36)73%    (1216/1668)70%    (278/395)
org.eclipse.equinox.internal.provisional.p2.engine.phases100%  (16/16)83%    (55/66)74%    (977/1322)74%    (207.6/281)
org.eclipse.equinox.internal.p2.director89%    (24/27)70%    (152/217)74%    (6158/8293)73%    (1202.4/1640)
org.eclipse.equinox.internal.p2.metadata.repository100%  (17/17)89%    (117/132)74%    (3372/4530)74%    (737.4/996)
org.eclipse.equinox.internal.provisional.spi.p2.core.repository100%  (1/1)71%    (10/14)76%    (82/108)73%    (22/30)
org.eclipse.equinox.internal.provisional.p2.artifact.repository.processing71%    (5/7)84%    (31/37)77%    (456/595)75%    (120.3/160)
org.eclipse.equinox.internal.p2.core100%  (4/4)92%    (24/26)78%    (481/618)77%    (108.9/142)
org.eclipse.equinox.internal.p2.engine93%    (27/29)84%    (147/174)78%    (3317/4260)80%    (768.9/967)
org.eclipse.equinox.internal.provisional.p2.engine96%    (23/24)83%    (99/119)78%    (2279/2906)82%    (441.6/537)
org.eclipse.equinox.p2.publisher.actions89%    (8/9)85%    (33/39)79%    (1046/1332)76%    (227.1/299)
org.eclipse.equinox.internal.p2.artifact.processing100%  (2/2)89%    (8/9)79%    (107/136)88%    (33.3/38)
org.eclipse.equinox.internal.frameworkadmin.equinox.utils100%  (2/2)89%    (8/9)79%    (339/427)78%    (86.7/111)
org.eclipse.equinox.internal.p2.updatesite.metadata100%  (1/1)75%    (6/8)79%    (139/175)78%    (32.7/42)
org.eclipse.equinox.internal.p2.metadata100%  (7/7)85%    (89/105)80%    (947/1185)81%    (237.6/292)
org.eclipse.equinox.internal.p2.artifact.processors.pack200100%  (1/1)100%  (6/6)81%    (114/141)90%    (27.1/30)
org.eclipse.equinox.internal.p2.updatesite.artifact100%  (1/1)83%    (5/6)81%    (174/215)80%    (37.7/47)
org.eclipse.equinox.internal.p2.metadata.repository.io93%    (26/28)89%    (81/91)85%    (2504/2961)86%    (492.7/575)
org.eclipse.equinox.internal.provisional.p2.core.repository50%    (1/2)83%    (5/6)87%    (26/30)82%    (9/11)
org.eclipse.equinox.internal.p2.rollback100%  (3/3)62%    (16/26)87%    (807/926)86%    (161.8/189)
org.eclipse.equinox.internal.p2.resolution100%  (4/4)90%    (28/31)88%    (801/909)89%    (168.9/190)
org.eclipse.equinox.internal.p2.exemplarysetup100%  (1/1)100%  (15/15)89%    (195/219)98%    (55.2/56)
org.eclipse.equinox.internal.provisional.p2.director100%  (4/4)93%    (26/28)92%    (410/448)95%    (104.7/110)

[all  classes]
EMMA  2.0.5312  EclEmma  Fix  1  (C)  Vladimir  Roubtsov
=