Bug 281387 - New Feature: Exclude directories from refresh
Summary: New Feature: Exclude directories from refresh
Status: NEW
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Resources (show other bugs)
Version: 4.0   Edit
Hardware: All Windows XP
: P3 enhancement with 3 votes (vote)
Target Milestone: ---   Edit
Assignee: Platform-Resources-Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-06-24 14:25 EDT by Vittorio Castelli CLA
Modified: 2021-02-22 15:24 EST (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Vittorio Castelli CLA 2009-06-24 14:25:21 EDT
A useful feature would be the ability to turn off refresh on specific directories within a project, without having to turn off automatic refresh.
This could be used to prevent Eclipse from unnecessarily trying to refresh, say, local temporary directories, or large data collections if there is a symlink to those within the project directory structure.
Comment 1 John Arthorne CLA 2009-06-24 16:43:37 EDT
Similar to bug 244979.
Comment 2 John Arthorne CLA 2010-01-07 10:03:54 EST
In 3.6 you can now specify filters to exclude sub-trees from the workspace, based on name or some pattern. Is this what you are looking for? Including a folder but disabling refresh seems dangerous because we would end up showing a structure that doesn't match at all what's in the file system.
Comment 3 David Kyle CLA 2010-01-07 10:39:46 EST
(In reply to comment #2)
> In 3.6 you can now specify filters to exclude sub-trees from the workspace,
> based on name or some pattern. Is this what you are looking for?

It is what we are looking for to prevent multi hour refreshes.

We implemented our own FileSystem class as a short term fix. We are scaling our RCP based 3D processing system to handle extremely large data volumes. It will be common to see a +100,000 files in a single folder and have a workspace consume 20 TB of data.

http://richclientplatform.blogspot.com/2007/12/oil-and-gas-industry-using-eclipse.html
Comment 4 Szymon Brandys CLA 2010-01-08 09:17:37 EST
(In reply to comment #3)
> (In reply to comment #2)
> > In 3.6 you can now specify filters to exclude sub-trees from the workspace,
> > based on name or some pattern. Is this what you are looking for?
> 
> It is what we are looking for to prevent multi hour refreshes.

So the new feature satisfy you, right? Or there is something more you need?
Comment 5 David Kyle CLA 2010-01-08 12:06:01 EST
> So the new feature satisfy you, right? 

Yes. 

> Or there is something more you need?

No. 

Setting one or more patterns so the FileSystem will not return the contents of the folder. I have no problem with the folder appearing in the workspace since there are already features to filter out the IResource.

Our current 'fix' will return the name of the folder but not its contents. This is done in our implementation of FileSystem#childNames(int, IProgressMonitor).
Comment 6 David Kyle CLA 2010-01-08 12:16:11 EST
> So the new feature satisfy you, right? 

Sorry, I answered to quickly. I'm downloading Eclipse 3.6M4 right now and I will look at the code and get back to you as quick as I can.
Comment 7 David Kyle CLA 2010-01-08 16:49:09 EST
(In reply to comment #6)
> > So the new feature satisfy you, right? 
> Sorry, I answered to quickly. I'm downloading Eclipse 3.6M4 right now and I
> will look at the code and get back to you as quick as I can.

The existing Eclipse 3.6M4 does not work for us. 

The new feature, nice as it is, still allows the workspace to find out how many files the hidden folder contains. Create a folder with 100,000 files and you will see LocalFile.childNames(int, IProgressMonitor) is still calling File.list(). Scale up the workspace to a tens of millions of files and the workspace becomes unusable.

We need to be able to filter a group of folders and their sub folders from the workspace. 

For the curious, we use a light weight database to manage these hidden folders and files. The hidden files are opened as if they are external files to the workspace. It works extremely well and avoids the three to four hour refresh consuming +2 GB of memory.
Comment 8 Eclipse Webmaster CLA 2019-09-06 15:31:15 EDT
This bug hasn't had any activity in quite some time. Maybe the problem got resolved, was a duplicate of something else, or became less pressing for some reason - or maybe it's still relevant but just hasn't been looked at yet.

If you have further information on the current state of the bug, please add it. The information can be, for example, that the problem still occurs, that you still want the feature, that more information is needed, or that the bug is (for whatever reason) no longer relevant.
Comment 9 Chad Meadows CLA 2021-02-22 15:24:19 EST
This bug still seems relevant.  Doing JS development in Eclipse is very painful.  Doing a JS build results in Eclipse running at 100% for minutes.
Filtering out the build files has no effect.