platform-vcm-home/2_1_testing.html

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.2 - (view) (download) (as text)

1 : mvalenta 1.1 <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
2 :     <html>
3 :     <head>
4 :    
5 :     <link rel="stylesheet" href="http://dev.eclipse.org/default_style.css" type="text/css">
6 :     <title>Team Testing Roadmap</title>
7 :    
8 :     <meta name="author" content="OTI Employee">
9 :    
10 :     <meta content="text/html; charset=iso-8859-1" http-equiv="Content-Type">
11 :     </head>
12 :    
13 :     <body>
14 :    
15 :     <h1>Section 1: General CVS Tests</h1>
16 :    
17 :     <h2>CVS Repositories View</h2>
18 :    
19 :     <h3>Adding and Discarding Locations</h3>
20 :     These test require an existing repository which contains projects.
21 :     <ol>
22 :     <li>Add a location to the view.</li>
23 :     <li>Ensure that invalid location information is handled properly in the New Location Wizard.</li>
24 :     <li>View location properties page and ensure that information is correct and can be changed.</li>
25 :     <li>Also change property values when local projects are shared with the location and ensure
26 :     the project's sharing information is changed when the location's properties are changed.
27 :     <li>Discard a location and ensure it is removed. Also ensure that discarding is not permitted when
28 :     projects in the local workspace are shared with the location.</li>
29 :     </ol>
30 :    
31 :     <h3>Project Checkout</h3>
32 :     These test require an existing repository which contains projects, at least one of which
33 :     does not contain a .project file. Ensure that repeating each operation results in the proper overwrite prompting.
34 :     <ol>
35 :     <li>Perform "Checkout as Project" on a single project. Ensure that repeating results in overwrite prompt.</li>
36 :     <li>Perform "Checkout as Project" on multiple projects.</li>
37 :     <li>Perform "Checkout as..." on a single project (that contains a .project file) and enter custom name and/or custom location.</li>
38 :     <li>Perform "Checkout as..." on a single remote project that does not have a .project file and
39 :     ensure that the user is prompted for the project type to create.</li>
40 :     <li>Perform "Checkout as..." on multipe projects and enter a custom parent location.</li>
41 :     </ol>
42 :    
43 :     <h3>Browsing Tags</h3>
44 :     These test require an existing repository which contains projects that have been tagged with both
45 :     version and branch tags.
46 :     <h4>Refresh Branches and Versions</h4>
47 :     <ol>
48 :     <li>Select a repository location and perform "Refresh Branches and Versions...".
49 :     <li>Select one or more projects that contain a .project file and have been tagged with branch and version tags and click finish.</li>
50 :     <li>Expand the respository entry to view ...
51 :     <ul>
52 :     <li>projects in HEAD,</li>
53 :     <li>branches and projects in BRANCHES,</li>
54 :     <li>projects and versions in VERSIONS.</li>
55 :     </ul>
56 :     </ol>
57 :    
58 :     <h4>Configure Branches and Versions</h4>
59 :     <ol>
60 :     <li>Select a project in the repositories view and perform "Configure Branches and Versions...".
61 :     <li>Select some branch and version tags to be remembered.</li>
62 :     <li>Expand the respository entry to view ...
63 :     <ul>
64 :     <li>projects in HEAD,</li>
65 :     <li>branches and projects in BRANCHES,</li>
66 :     <li>projects and versions in VERSIONS.</li>
67 :     </ul>
68 :     </ol>
69 :    
70 :     <h3>Working with modules</h3>
71 :     These tests require a CVSROOT/modules file on the server that contains valid module definitions.
72 :     <ol>
73 :     <li>Switch the Repositories View and ensure that the modules are displayed properly.</li>
74 :     <li>Perform "Checkout as Module" and ensure that the module is checkout out properly.
75 :     Also ensure that repeating results in overwrite prompt.</li>
76 :     <li>Perform a "Configure Branches and Versions" on the module, set the autorefresh file and add some tags.
77 :     Ensure that the module now appears properly in association with those tags.</li>
78 :     </ol>
79 :    
80 :     <h2>Project Sharing</h2>
81 :    
82 :     <h3>Project sharing and disconnecting</h3>
83 :     <ol>
84 :     <li>Sharing with no CVS folders against existing project</li>
85 :     <li>Sharing with CVS folders</li>
86 :     <li>Sharing new project with no CVS folders</li>
87 :     <li>Disconnect: keeping and deleting CVS folders, reconnecting (as above)</li>
88 :     </ol>
89 :    
90 :     <h3>Project sets</h3>
91 :     <ol>
92 :     <li>Create one, delete projects, load set and ensure got projects back</li>
93 :     <li>Test against HEAD, project on branch/version.</li>
94 :     </ol>
95 :    
96 :     <h2>CVS workflow</h2>
97 :    
98 :     <h3>Common workflows</h3>
99 :    
100 :     To perform the tests properly, check out the same remote project into two local projects.
101 :    
102 :     <ol>
103 :     <li>Commit and Update with incomming, outgoing and conflicting changes and ensure proper behavior.</i>
104 :     <li>Update/commit with very large files (&gt; 8 meg)</li>
105 :     <li>Replace with (latest, base, branch, version, revision)</li>
106 :     <li>Compare with (latest, base, branch, version, revision)</li>
107 :     <li>Ensure you are prompted for unsaved changes before performing a CVS action</li>
108 :     <li>Tag as Version and ensure that remote is tagged properly.</li>
109 :     <li>Tag as Version with dirty local resources and ensure proper prompting.</li>
110 :     <li>Change ASCII/Binary Property on projects and resources and ensure proper behavior.</li>
111 :     </ol>
112 :    
113 :     <h3>Ignoring resources</h3>
114 :     <ol>
115 :     <li>Ignoring resources</li>
116 :     <li>&#8220;Add to .cvsignore&#8221;</li>
117 :     <li>Add to global ignore list, ensure its now ignored</li>
118 :     </ol>
119 :    
120 :     <h3>Global Actions</h3>
121 :     Test the following CVS global actions in the CVS Repository Exploring perspective.
122 :     <ol>
123 :     <li>Synchronize All</li>
124 :     <li>New Repository Location</li>
125 :     </ol>
126 :    
127 :     <h3>Decorators</h3>
128 :     <ol>
129 :     <li>Change all the options, apply, see them redraw correctly</li>
130 :     <li>Add/remove items, ensure dirty markers update</li>
131 :     <li>Add to version control and see decorator change</li>
132 :     <li>Performance with large trees expanded</li>
133 :     <li>Collapse large tree, exit workspace, restart (should not be as expensive
134 :     as if tree had been left expanded)</li>
135 : mvalenta 1.2 <li>Close a decorated project and then open it.
136 : mvalenta 1.1 </ol>
137 :    
138 :     <h3>Patching</h3>
139 :     Creating patches and then comparing with them. In particular,
140 :     <ol>
141 :     <li>added files</li>
142 :     <li>deleted files</li>
143 :     <li>added or deleted folders with added or deleted files in them</li>
144 :     <li>binary files</li>
145 :     </ol>
146 :    
147 :     <h3>Watch/Edit</h3>
148 :     <ol>
149 :     <li>Turn on watch/edit in preferences (Team/CVS/Watch/Edit)</li>
150 :     <li>Turn on the CVS decorators
151 :     <li>Check out a project and ensure all files are read-only</li>
152 :     <li>Open a file in an editor and start typing. Ensure that decorator an file changes and file is no longer read-only.</li>
153 :     <li>Perform a Team/Show CVS Editors on the file and/or project.</li>
154 :     <li>Perform a Team/Unedit on the file to ensure that file is returned to base contents and is read-only.
155 :     (or perform a Team/Commit and ensure the file is returned to being read-only).</li>
156 :     </ol>
157 :    
158 :     <h3>Working with Modules</h3>
159 :     These test require valid moduel definitions in the CVSROOT/modules file of the repository
160 :     <ol>
161 :     <li>Checkout a module and ensure success.</li>
162 :     <li>Perform other CVS tests on the local project as if it were a regular project.</li>
163 :     </ol>
164 :    
165 :     <h3>Misc</h3>
166 :     <ol>
167 :     <li>Mixing tags within a project.</li>
168 :     <li>Properties pages for projects, folders and files.</li>
169 :     <li>CVS Console: ensure written to</li>
170 :     <li>Check canceling everywhere there's a progress monitor</li>
171 :     <li>Does it cancel in reasonable time?</li>
172 :     <li>Is the workspace in an ok state after?</li>
173 :     <li>Compression switches, ensure data transfered ok (commit, update)</li>
174 :     </ol>
175 :    
176 :     <h1>Section 2: CVS Synchronize View</h1>
177 :     <table height="124" border="1" width="99%">
178 :     <tbody>
179 :     <tr>
180 :     <td width="25%"><b>Change Type</b></td>
181 :     <td width="25%"><b>Action</b></td>
182 :     <td width="50%"><b>Result</b></td>
183 :     </tr>
184 :     <tr>
185 :     <td width="25%"><b>Incoming File Change</b></td>
186 :     <td width="25%">Update</td>
187 :     <td width="50%">Remote contents become local. Try with both Text and
188 :     Binary files.</td>
189 :     </tr>
190 :     <tr>
191 :     <td width="25%"><b>Incoming File Change</b></td>
192 :     <td width="25%">Override and Commit</td>
193 :     <td width="50%">Only in Both mode. Prompt for release comment. Cancel
194 :     aborts, OK commits local file to server.</td>
195 :     </tr>
196 :     <tr>
197 :     <td width="25%"><b>Incoming File Addition</b></td>
198 :     <td width="25%">Update</td>
199 :     <td width="50%">Remote contents become local. Try with both Text and
200 :     Binary files.</td>
201 :     </tr>
202 :     <tr>
203 :     <td width="25%"><b>Incoming File Addition</b></td>
204 :     <td width="25%">Override and Commit</td>
205 :     <td width="50%">Only in Both mode. Prompt for release comment. Cancel
206 :     aborts, OK commits deletion to server.</td>
207 :     </tr>
208 :     <tr>
209 :     <td width="25%"><b>Incoming File Deletion</b></td>
210 :     <td width="25%">Update</td>
211 :     <td width="50%">Local file is deleted.</td>
212 :     </tr>
213 :     <tr>
214 :     <td width="25%"><b>Incoming File Deletion</b></td>
215 :     <td width="25%">Override and Commit</td>
216 :     <td width="50%">Only in Both mode. Prompt for release comment. Cancel
217 :     aborts, OK commits local file to server.</td>
218 :     </tr>
219 :     <tr>
220 :     <td width="25%"><b>Outgoing File Change</b></td>
221 :     <td width="25%">Commit</td>
222 :     <td width="50%">Prompt for release comment. Cancel aborts, OK commits
223 :     local file to server.</td>
224 :     </tr>
225 :     <tr>
226 :     <td width="25%"><b>Outgoing File Change</b></td>
227 :     <td width="25%">Override and Update</td>
228 :     <td width="50%">Only in Both mode. Remote contents become local. Try
229 :     with both Text and Binary files.</td>
230 :     </tr>
231 :     <tr>
232 :     <td width="25%"><b>Outgoing File Addition</b></td>
233 :     <td width="25%">Add to Version Control</td>
234 :     <td width="50%">Adds the file to version control. The icon should change
235 :     in the sync view, and Commit should now be enabled.</td>
236 :     </tr>
237 :     <tr>
238 :     <td width="25%"><b>Outgoing File Addition</b></td>
239 :     <td width="25%">Add to .cvsignore</td>
240 :     <td width="50%">Adds the file to .cvsignore. The file should disappear
241 :     from the sync view. The .cvsignore file should appear (if it wasn't visible
242 :     already). The file should not appear in subsequent syncs.</td>
243 :     </tr>
244 :     <tr>
245 :     <td width="25%"><b>Outgoing File Addition</b></td>
246 :     <td width="25%">Commit</td>
247 :     <td width="50%">Commit is only enabled on an outgoing addition if it
248 :     has first been added to version control. Prompt for release comment. Cancel
249 :     aborts, OK commits local file to server.</td>
250 :     </tr>
251 :     <tr>
252 :     <td width="25%"><b>Outgoing File Addition</b></td>
253 :     <td width="25%">Override and Update</td>
254 :     <td width="50%">Only in Both mode. Local file is deleted.</td>
255 :     </tr>
256 :     <tr>
257 :     <td width="25%"><b>Outgoing File Deletion</b></td>
258 :     <td width="25%">Commit</td>
259 :     <td width="50%">Prompt for release comment. Cancel aborts, OK commits
260 :     deletion to server.</td>
261 :     </tr>
262 :     <tr>
263 :     <td width="25%"><b>Outgoing File Deletion</b></td>
264 :     <td width="25%">Override and Update</td>
265 :     <td width="50%">Only in Both mode. File is re-created, remote contents
266 :     become local.</td>
267 :     </tr>
268 :     <tr>
269 :     <td width="25%"><b>Conflicting File Change</b></td>
270 :     <td width="25%">Override and Commit</td>
271 :     <td width="50%">Prompt for release comment. Cancel aborts, OK commits
272 :     local file to server. Applies to both auto-mergeable and non-mergeable conflicts.</td>
273 :     </tr>
274 :     <tr>
275 :     <td width="25%"><b>Auto-mergeable Conflicting File Change</b></td>
276 :     <td width="25%">Override and Update</td>
277 :     <td width="50%">Auto-mergeable conflicts have a two-way red/green arrow.
278 :     Dialog prompts user to either auto-merge or replace. If user chooses auto-merge,
279 :     then remote changes are merged in with local changes. File should still
280 :     be dirty, local changes should still be present, CVS markup should not be
281 :     present, and no .# files should have been created. If user chooses replace,
282 :     then local changes are discarded and remote contents replace local. No .#
283 :     files created, no CVS markup, and the file is not dirty as a result. If
284 :     the user chooses cancel nothing happens.</td>
285 :     </tr>
286 :     <tr>
287 :     <td width="25%"><b>Non-mergeable Conflicting File Change</b></td>
288 :     <td width="25%">Override and Update</td>
289 :     <td width="50%">Dialog prompts user to replace local changes. If user
290 :     cancels nothing happens. If user chooses OK, then local changes are discarded
291 :     and remote contents replace local. No .# files created, no CVS markup, and
292 :     the file is not dirty as a result.</td>
293 :     </tr>
294 :     <tr>
295 :     <td width="25%"><b>Conflicting File Addition</b></td>
296 :     <td width="25%">Add to Version Control</td>
297 :     <td width="50%">Adds the file to version control. The icon should change
298 :     in the sync view, and Override and Commit should now be enabled.</td>
299 :     </tr>
300 :     <tr>
301 :     <td width="25%"><b>Conflicting File Addition</b></td>
302 :     <td width="25%">Override and Commit</td>
303 :     <td width="50%">Override and Commit is only enabled on an outgoing addition
304 :     if it has first been added to version control. Prompt to warn of conflicting
305 :     changes. If OK, prompt for release comment. Cancel aborts either dialog.
306 :     OK commits local file to server.</td>
307 :     </tr>
308 :     <tr>
309 :     <td width="25%"><b>Conflicting File Addition</b></td>
310 :     <td width="25%">Override and Update</td>
311 :     <td width="50%">Remote contents become local.</td>
312 :     </tr>
313 :     </tbody>
314 :     </table>
315 :     <h2>Variations</h2>
316 :     <h3>Container Selection</h3>
317 :     <p>Normally, selecting a folder is the same as selecting all of the individual
318 :     files underneath it. (The exception to this is if the folder itself is changed,
319 :     such as a conflicting addition). Performing any of the above operations
320 :     on a folder should behave as if the files underneath it were selected.</p>
321 :     <p>Note that if an action is not specified for a change type, it does not
322 :     apply to that change type. This is important in container selection.</p>
323 :     <p>For example: Commit does not apply to conflicting changes. If you select
324 :     a folder with an Outgoing Change and a Conflicting Change in it, Commit
325 :     will apply to the Outgoing Change but not to the Conflicting Change.</p>
326 :     <h3>Multi-Selection</h3>
327 :     <p>If multiple resources are selected, an action is enabled if it applies
328 :     to any one or more of the selected resources. Choosing that action will
329 :     apply the action only to those resources for which it is applicable.</p>
330 :     <p>For example: Commit does not apply to conflicting changes. Selecting an
331 :     Outgoing Change and a Conflicting Change will result in Commit being enabled.
332 :     Choosing Commit will apply to the Outgoing Change but not to the Conflicting
333 :     Change.</p>
334 :     <p>Multi-Selection and Container Selection may be used in any combination
335 :     with predictable results.</p>
336 :     <h2>Specific Scenaria</h2>
337 :     <h3>Making Manual Changes</h3>
338 :     <p>Create a conflicting file change. Manually edit the left source pane in
339 :     the sync view. Hit "Save" on the popup menu. The file should remain a Conflict;
340 :     you should get a prompt telling you to Mark as Merged when finished. Choose
341 :     Mark as Merged in the popup menu of the tree. The file should change to
342 :     an outgoing change. Commit the outgoing change.</p>
343 :     <h3>Merging Conflicts</h3>
344 :     <p>Try Override and Update with different combinations of Auto-Mergeable
345 :     and Non-Mergeable conflicts in the selection. If all conflicts are Non-Mergeable,
346 :     then the only choice is to replace with remote or cancel. If one or more
347 :     conflicts are Auto-Mergeable, the choices are (a) Auto-Merge any applicable
348 :     files, and replace the rest with remote, (b) Replace all files with remote
349 :     or (c) Cancel.</p>
350 :     <h3>Removing from View</h3>
351 :     <p>Choose Remove from View. Selected nodes should disappear. Refresh the
352 :     view. The nodes should reappear.</p>
353 :     <h3>Synchronize Outgoing Changes</h3>
354 :     <p>If you choose Synchronize Outgoing Changes from the navigator, the sync
355 :     view should be populated with <b>only the Outgoing Changes and Conflicts</b>
356 :     . This operation should be significantly faster in many cases. In this
357 :     case, ensure that Refresh does not cause Incoming Changes to appear.</p>
358 :     <h3>Working with Branches</h3>
359 :     <p>Try any and all of the above, but use a branch instead of HEAD. Behaviour
360 :     should be identical. The sync view decorator should show you the name of
361 :     the branch.</p>
362 :     <h3>Using Mixed Tags</h3>
363 :     <p>Using Team-&gt;Branch, Replace With-&gt;Branch or Version, and Team-&gt;Tag
364 :     as Version, you can create a project which has different tags mixed into
365 :     it. For example, one folder may be shared as V2_0, a single file may be attached
366 :     to the branch NEW_FEATURE_BRANCH, and the root of the project may be attached
367 :     to HEAD. We need to test usage of these projects in the sync view. For example,
368 :     if developer 1 has project P shared with HEAD, and folder P/F is shared
369 :     with branch B, have developer 2 release a change to folder F in HEAD, and
370 :     have developer 1 perform a sync. In this case developer 1 should not see
371 :     the incoming change.</p>
372 :    
373 :     <h1>Section 4: Branching and Merging</h1>
374 :     <h2>Main branching scenario</h2>
375 :     Here's the main sequence of steps performed over the life cycle of a simple
376 :     branch.<br>
377 :     <ol>
378 :     <li>Load or create a shared project with shared content</li>
379 :     <li>Perform a Team/Branch...</li>
380 :     <li>Ensure that the tag on the local resources has been updated (either
381 :     using the CVS decorators or resource properties)</li>
382 :     <li>Make some changes to local resources and commit them (working in a branch
383 :     is similar to working in HEAD. See the Synchronize test plan for detaits).</li>
384 :     <li>Load HEAD</li>
385 :     <li>Optionaly, make some changes to HEAD (may or may not be committed)</li>
386 :     <li>Perform a Team/Merge... to merge the branch with HEAD. Merging is similar
387 :     to synchronizing but only incoming and conflicting changes are shown. See
388 :     the Synchronize test plan for detaits</li>
389 :     </ol>
390 :     <h2>Variations</h2>
391 :     <h3>Comparing branch, root version and HEAD</h3>
392 :     After any of the above steps that modify the local content or the remote
393 :     content, the success of the operation can ne validated by comparing the local
394 :     workspace copy with either HEAD, the branch or the root version specified
395 :     when creating the branch.
396 :     <h3>Branch with local changes</h3>
397 :     Before branching, make some local changes but do not commit them. Changes
398 :     can include additions and deletions. After branches ensure that the changes
399 :     are still there. On merging ensure that any created or deleted resources
400 :     appear properly in the merge editor.
401 :     <h3>Don't start working in the branch</h3>
402 :     When the branch is created, do not start working in the branch. Ensure
403 :     that the workspace was not modified but that the branch and root version
404 :     exists remotely (using Comapre With/Branch or Version...)
405 :     <h3>Branch on a folder or file</h3>
406 :     Branching can also be performed on a folder or file.
407 :     <h3>Merge from Head to a branch</h3>
408 :     Make some changes to a branch and to HEAD. Merge the changes from HEAD
409 :     into the branch before merging the branch with HEAD.
410 : mvalenta 1.2
411 :    
412 :     <h1>Section 3: Migration from 2.0 to 2.1</h1>
413 :     The below tests require a workspace created using 2.0 which contains
414 :     projects checked out from a CVS repository.<br>
415 :     <h3>Migrating a workspace project created using 2.0 to 2.1</h3>
416 :     <ol>
417 :     <li>Start Eclipse 2.1 on top of a workspace from 2.0</li>
418 :     <li>Select a project that was shared with a CVS repository and chose Team/Share
419 :     Project&#8230;</li>
420 :     <li>Select the Repository location to share with or enter it if it does
421 :     not appear in the list.</li>
422 :     <li>Upon finish, the user will be prompted to select either HEAD or the
423 :     branch to compare against. </li>
424 :     <li>The Synchronize view will then be opened and all files will appear
425 :     as incoming, outgoing or conflicting additions.</li>
426 :     <li>To see the real conflicts, enable &#8220;Compare File Contents&#8221; available
427 :     from the drop down menu in the title bar of the Synchronize View.</li>
428 :     <li>Resolve the real incoming, outgoing additions &nbsp;and conflicts as
429 :     appropriate (see sync view test plan for a description of sync state resolution)</li>
430 :     <li>When all conflicts are resolved, disable &#8220;Compare File Contents&#8221; and
431 :     perform an &#8220;Override and Update&#8221; on the remaining conflicting additions to
432 :     update the sync info of the local resources.</li>
433 :     <li>Ensure local copy contains the proper contents (can use Compare With/Latest
434 :     from Repository)<br>
435 :     </li>
436 :     </ol>
437 :    
438 : mvalenta 1.1 </body>
439 :     </html>