31191 – Excessive file operations on shutdown

Bug 31191 - Excessive file operations on shutdown

Summary: Excessive file operations on shutdown

Status:	RESOLVED DUPLICATE of bug 78099

Alias:	None

Product:	Platform
Classification:	Eclipse Project
Component:	Resources (show other bugs)
Version:	2.1
Hardware:	PC Windows XP

Importance:	P3 normal with 1 vote (vote)
Target Milestone:	---
Assignee:	Platform-Resources-Inbox
QA Contact:

URL:
Whiteboard:
Keywords:

Depends on:
Blocks:

Reported:	2003-02-06 20:47 EST by Ed Burnette
Modified:	2004-11-08 16:46 EST (History)
CC List:	2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Ed Burnette

2003-02-06 20:47:42 EST

I20030129 was taking a while to shut down so I started up the sysinternals 
file monitor on Windows XP. The biggest block of file operations was 
approximately 23,000 lines like the following. Does anyone understand what 
it's doing here, or have looked into cutting down on it? It took about a 
minute to shut down completely.

(I had NOT been doing a lot of copying/moving/renaming/etc. of files, however 
the session had been up for a few days. The JVM's memory was up to about 170MB 
(max was set to 256MB).)

0.00061820  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  Attributes: Any Options: Open    
0.00000071  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
FAILURE     
0.00047476  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  FileBasicInformation 
0.00002434  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00003968  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00057106  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  Attributes: Any Options: Open Directory   
0.01838921  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  FileBothDirectoryInformation: *  
0.00007780  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  FileBothDirectoryInformation  
0.00002958  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  NO 
MORE FILES  FileBothDirectoryInformation  
0.00002620  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS     
0.00004617  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS     
0.01530094  javaw.exe:1104 IRP_MJ_READ*   C:\Program 
Files\eclipse\plugins\org.eclipse.core.resources.win32_2.1.0\os\win32\x86
\core_2_0_5.dll   SUCCESS  Offset: 0 Length: 4096  
0.00086700  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00000082  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   FAILURE     
0.00049059  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileBasicInformation 
0.00004695  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00004647  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00077375  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00041744  javaw.exe:1104 IRP_MJ_SET_INFORMATION  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileBasicInformation 
0.00003948  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00032040  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00064810  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00037581  javaw.exe:1104 IRP_MJ_SET_INFORMATION  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileBasicInformation 
0.00003680  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00030868  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00060692  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00000081  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   FAILURE     
0.00047556  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileBasicInformation 
0.00004308  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00004047  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00061643  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00004107  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileObjectIdInformation 
0.00068821  javaw.exe:1104 IRP_MJ_SET_INFORMATION  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS  FileDispositionInformation 
0.00004274  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00007498  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\508489770
934001711c4910148426ea7   SUCCESS     
0.00064412  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  Attributes: Any Options: Open    
0.00000097  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
FAILURE     
0.00043663  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  FileBasicInformation 
0.00003203  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00003902  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00057907  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  Attributes: Any Options: Open    
0.00000071  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
FAILURE     
0.00043311  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS  FileBasicInformation 
0.00002280  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00004668  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea   
SUCCESS     
0.00057809  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  Attributes: Any Options: Open Directory   
0.00065270  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  FileBothDirectoryInformation: *  
0.00004272  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS  FileBothDirectoryInformation  
0.00002972  javaw.exe:1104 IRP_MJ_DIRECTORY_CONTROL   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  NO 
MORE FILES  FileBothDirectoryInformation  
0.00002426  javaw.exe:1104 IRP_MJ_CLEANUP 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS     
0.00004028  javaw.exe:1104 IRP_MJ_CLOSE   
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\  
SUCCESS     
0.00065253  javaw.exe:1104 IRP_MJ_CREATE  
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\50b8157b0
934001711c4910148426ea7   SUCCESS  Attributes: Any Options: Open    
0.00000121  javaw.exe:1104 FASTIO_QUERY_BASIC_INFO 
U:\workspace.metadata\.plugins\org.eclipse.core.resources\.history\ea\50b8157b0
934001711c4910148426ea7   FAILURE     
... etc ...
0.00128445  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000251  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00040625  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00125257  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000156  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00033476  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00124957  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 82944 Length: 8192 
0.00000113  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00032929  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00123545  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000091  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00034110  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00123875  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000104  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00033853  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00170295  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000105  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00035747  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00123898  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000128  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00034304  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00126726  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
0.00000306  javaw.exe:1104 FASTIO_QUERY_STANDARD_INFO 
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
FAILURE     
0.00037674  javaw.exe:1104 IRP_MJ_QUERY_INFORMATION   
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  FileStandardInformation 
0.00124928  javaw.exe:1104 IRP_MJ_READ    
U:\workspace\.metadata\.plugins\org.eclipse.core.resources\.history\.index   
SUCCESS  Offset: 66560 Length: 8192 
... etc ...

Comment 1 DJ Houghton

2003-02-07 16:32:49 EST

Do you get the same long shutdown times when you start Eclipse and shut it down 
either right away or after using it for a couple of hours?

Do you know how to interpret the log above? (I don't)
Thanks.

Comment 2 Ed Burnette

2003-02-07 17:19:15 EST

Nope, if I bring it up and immediately back down it takes about 6 seconds to 
shut down. Roughly, the longer I use it, the longer it takes to shut down.

I don't know a whole lot about the format produced by the tool, but for the 
most part it seems self explanatory (create, read, write, etc.). Looks like 
bugzilla split the long lines on several separate lines which is making it 
harder to read. Each line should start with a number like 0.00086700, which is 
the number of seconds the operation took. Then it has the process name and 
number, the file system operation, the path name, success or failure, and 
finally any extra information like offset and length. It looks easier to read 
on the screen if you download and run the (free) tool.

If you want to know more, there is some help at 
http://www.sysinternals.com/ntw2k/source/filemon.shtml that says "On Windows 
NT the heart of Filemon is a file system driver that creates and attaches 
filter device objects to target file system device objects so that Filemon 
will see all IRPs and FastIO requests directed at drives. "

Digging deeper, the IRP_xx codes are from kernel-mode device driver codes and 
are doc'd at:
http://msdn.microsoft.com/library/default.asp?url=/library/en-
us/kmarch/hh/kmarch/k113_6egi.asp

The FASTIO_xx stuff seems to refer to some shortcut kernel dispatch table. I 
saw a mention of it in:
http://msdn.microsoft.com/library/default.asp?url=/library/en-
us/stream/hh/stream/ksfunc_3rg3.asp

Hope this helps.

Comment 3 Debbie Wilson

2003-02-11 15:32:00 EST

Ed, Did you have anything unusual set in your "local history" preferences?  
You can find these from Window->Preferences->Workbench->Local History.  The 
defaults are to keep files for 7 days, keep 50 entries per file and a maximum 
of 1MB file size.

Comment 4 Ed Burnette

2003-02-11 15:42:25 EST

No, I use the defaults for all those.

Comment 5 John Arthorne

2004-11-08 16:46:29 EST


*** This bug has been marked as a duplicate of 78099 ***