platform-text-home/3.1/performance_scenarios.html

Parent Directory Parent Directory | Revision Log Revision Log

Revision 1.19 - (view) (download) (as text)

1 : kmaetzel 1.1 <html>
2 :     <head>
3 :     <title>Performance Scenarios</title>
4 :     <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
5 :     </head>
6 :    
7 :     <body bgcolor="#FFFFFF" text="#000000">
8 :     <p>The following set of scenarios contains all those scenarios that we think are
9 :     important for the overall perception of text related performance by the users.
10 :     We distinguish between user's first contact, permanent user activities, and
11 :     rare user activities. User's first contact describes the setup and the activities
12 :     that reflect the situation when a user starts the system and pursues certain
13 :     actions for the fist time during that session. Permanent user activities describes
14 :     the setup and the activities that reflect the situation that the user faces
15 :     when continuously working with the system. Rare user activities describe the
16 :     setup and the activities that reflect the situation that the user faces only
17 :     infrequently but may hamper the user's trust into the system. The numbers behind
18 :     the subject indicate the importance of the scenario. E.g., typing speed is more
19 :     important than speed in which the selection can semantically be expanded.</p>
20 :     <h3>User's first contact</h3>
21 :     <ul>
22 :     <li><b> Open editor (1)</b></li>
23 :     <ul>
24 : cmarti 1.5 <li><img src="ok.gif" height=10 width=10 /> Open first text editor in the resource perspective. Measure time until
25 : kmaetzel 1.1 the first user interaction with the newly opened editor is possible.</li>
26 : cmarti 1.2 <li><img src="ok.gif" height=10 width=10 /> Open first Java editor in the Java perspective. Measure time until the
27 : kmaetzel 1.1 first user interaction with the newly opened editor is possible.</li>
28 : cmarti 1.7 <li><img src="ok.gif" height=10 width=10 /> Restart workbench with an open Text editor in the resource perspective.</li>
29 :     <li><img src="ok.gif" height=10 width=10 /> Restart workbench with an open Java editor in the Java perspective.</li>
30 : kmaetzel 1.1 </ul>
31 :     <li><b>Open Quick Outline (2) </b>
32 :     <ul>
33 : cmarti 1.2 <li><img src="ok.gif" height=10 width=10 /> Open Quick Outline for a large Java file for the first time. Measure
34 : kmaetzel 1.1 time until the outline pops up.</li>
35 :     </ul>
36 :     </li>
37 :     </ul>
38 :     <p></p>
39 :     <h3>Permanent user activities</h3>
40 :     <ul>
41 :     <li> <b>Typing (1) </b>
42 :     <ul>
43 : cmarti 1.3 <li><img src="ok.gif" height=10 width=10 /> Typing speed in the Text editor at the end of a large file.</li>
44 : cmarti 1.2 <li><img src="ok.gif" height=10 width=10 /> Typing speed in the Java editor at the end of a large file.</li>
45 : cmarti 1.8 <li><img src="ok.gif" height=10 width=10 /> Smart paste at the end of a large Java file in the middle of a method (default content type)</li>
46 : cmarti 1.9 <li><img src="ok.gif" height=10 width=10 /> Autoedit when pressing enter after /** right in front of the declaration
47 : kmaetzel 1.1 of a complex method (return value, number of args, thrown exceptions)</li>
48 :     </ul>
49 :     </li>
50 :     <li> <b>Painting (1) </b>
51 :     <ul>
52 : cmarti 1.16 <li><img src="ok.gif" height=10 width=10 /> Painting annotations in text with squiggle lines when typing.
53 : cmarti 1.2 <ul>
54 :     <li>Measure number of repaints</li>
55 :     </ul>
56 :     </li>
57 : cmarti 1.4 <li><img src="progress.gif" height=5 width=14 /> Painting annotations in text with squiggle lines when scrolling with the mouse using the scrollbar. (depends on <a href="https://bugs.eclipse.org/bugs/show_bug.cgi?id=72244">bug 72244</a>)
58 : kmaetzel 1.1 <ul>
59 :     <li>Measure number of repaints</li>
60 :     </ul>
61 :     </li>
62 :     </ul>
63 :     </li>
64 :     <li> <b>Open editor (1) </b>
65 :     <ul>
66 : cmarti 1.10 <li><img src="ok.gif" height=10 width=10 /> Open Text editor for a large file after a warm-up of opening and closing
67 : kmaetzel 1.1 the same file 10 times.</li>
68 : cmarti 1.15 <li><img src="ok.gif" height=10 width=10 /> Open Java editor for a large file after a warm-up of opening and closing
69 : kmaetzel 1.1 the same file 10 times.
70 :     <ul>
71 :     <li>Configurations
72 :     <ul>
73 : cmarti 1.10 <li><img src="ok.gif" height=10 width=10 /> with/without Outliner as part of the perspective</li>
74 :     <li><img src="ok.gif" height=10 width=10 /> with code folding enabled/disabled</li>
75 : kmaetzel 1.1 </ul>
76 :     </li>
77 : cmarti 1.10 <li><img src="ok.gif" height=10 width=10 /> Measure time until the first user interaction with the newly opened
78 : kmaetzel 1.1 editor is possible.</li>
79 : cmarti 1.15 <li><img src="ok.gif" height=10 width=10 /> Measure number of computed TextPresentations.</li>
80 : kmaetzel 1.1 </ul>
81 :     </li>
82 : cmarti 1.11 <li><img src="ok.gif" height=10 width=10 /> Switching between open editors</li>
83 : kmaetzel 1.1 </ul>
84 :     </li>
85 :     <li><b>Content assist (2)</b>
86 :     <ul>
87 : cmarti 1.12 <li><img src="ok.gif" height=10 width=10 /> Request content assist in the middle of a method. Measure time until
88 : kmaetzel 1.1 the popup is visible.</li>
89 :     </ul>
90 :     </li>
91 :     <li><b>Save (3)</b>
92 :     <ul>
93 : cmarti 1.13 <li><img src="ok.gif" height=10 width=10 /> Save a large file in the Text editor.</li>
94 :     <li><img src="ok.gif" height=10 width=10 /> Save a large file in the Java editor.</li>
95 : kmaetzel 1.1 </ul>
96 :     </li>
97 :     <li><b>Compound changes (4)</b>
98 :     <ul>
99 : cmarti 1.17 <li><img src="ok.gif" height=10 width=10 /> Format a large compilation unit including Javadoc comments.</li>
100 : cmarti 1.14 <li><img src="ok.gif" height=10 width=10 /> Revert Text/Java editor with folding enabled/disabled.</li>
101 : cmarti 1.2 <li><img src="ok.gif" height=10 width=10 /> Undo shifting a large compilation unit to the right.</li>
102 : cmarti 1.18 <li><img src="ok.gif" height=10 width=10 /> Move a single line in a large compilation unit.</li>
103 : kmaetzel 1.1 </ul>
104 :     </li>
105 :     <li><b>Navigation (5) </b>
106 :     <ul>
107 : cmarti 1.19 <li><img src="ok.gif" height=10 width=10 /> In the Java editor, in a method of a large compilation unit, semantically expand selection.</li>
108 : kmaetzel 1.1 </ul>
109 :     </li>
110 :     <li><b>QuickDiff (6)</b>
111 :     <ul>
112 :     <li> Measure memory consumption of Quick diff while initializing. The large
113 :     compilation unit is widely changed compared to the reference.</li>
114 :     </ul>
115 :     </li>
116 :     </ul>
117 :     <h3>Rare user actions</h3>
118 :     <ul>
119 :     <li><b>Compound changes (4)</b>
120 :     <ul>
121 :     <li>Replace all occurrences of a string in a large compilation unit.</li>
122 :     <li>Convert line delimiter of a project</li>
123 :     <li>Format a project</li>
124 :     </ul>
125 :     </li>
126 :     </ul>
127 :     </body>
128 :     </html>