[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [platform-help-dev] Assembling a single searchable Lucene index from multiple Eclipse instances?
|
Hi,
You are all correct.
In Erik's approach, you need to make sure that indexes were created with
the same version of Lucene and analyzers, and take care to merge indexed_*
files that help writes to the same directory as Lucene index.
Konrad Kolosowski
Eclipse Help System
Jamie
Roberts/Toronto/I
BM@IBMCA To
Sent by: platform-help-dev@xxxxxxxxxxx
platform-help-dev cc
-admin@xxxxxxxxxx
g Subject
Re: [platform-help-dev] Assembling
a single searchable Lucene index
10/29/2003 12:29 from multiple Eclipse instances?
PM
Please respond to
platform-help-dev
Hey everyone,
Just to clarify (for me, of course :))...
Erik is asking about developing federating search. I'm assuming the scope
of federation is within a "local" machine or across networked machines with
full access rights, and not on a local machine where you have no access to
the linked instances, or across a network where you have very limited
access rights (like a typical web architecture) .
So, in the (elegant!) .link file solution below, Dorian wrote:
If you have control over how the other eclipse instances are installed, you
can get everything for free:
- install all the documentation plugins in each eclipse as a product
extension (using the .link files)
- install your master eclipse by having a .link file pointing to all the
other documentation extensions.
- when you search from the master eclipse, the index of all plugins will be
installed (it may take some time :-), but then you don't have to write any
code.
I'm assuming that Dorian's solution implies you have direct access to the
linked plugin environments--either locally, or by full network access with
permissions to the linked data.
In other words, there's no way, currently, to federate search through
linking a master instance to other instances by some special URLs
identifier, right? Please correct me if I'm wrong :)
Erik, you probably know this, too, but you *can* query an individual IC
through a URL search and get a list of results:
http://server_IC_instance/search?searchWord=term
where the "server_IC_instance" is the actual hosted IC URL and "term" is a
query. This will return a list of XML objects that you can display as you
see fit with some sort of style applied.
For federation using this technique, Erik would still have to apply some
sort of inter-ranking algorithm--or apply some understandable context to
the different queries--and then display the almagamation of the results.
Jamie
**************************
James H. (Jamie) Roberts
IBM
robertsj@xxxxxxxxxx
Dorian
Birsan/Toronto/IBM@ To: platform-help-dev@xxxxxxxxxxx
IBMCA cc:
Sent by: Subject: Re: [platform-help-dev]
platform-help-dev-a Assembling a single searchable Lucene index from
dmin@xxxxxxxxxxx multiple Eclipse instances?
10/29/2003 10:09 AM
Please respond to
platform-help-dev
Hi Erik,
That sounds like a good plan, and I think it is very doable. As long as the
other eclipse's are static (no plugin changes), this approach should work
well.
You can also do a distributed search across all the indexes, so you don't
need to maintain a merged index. Here some info (some sequence diagrams for
how to do it) : http://home.clara.net/markharwood/lucene/
If you have control over how the other eclipse instances are installed, you
can get everything for free:
- install all the documentation plugins in each eclipse as a product
extension (using the .link files)
- install your master eclipse by having a .link file pointing to all the
other documentation extensions.
- when you search from the master eclipse, the index of all plugins will be
installed (it may take some time :-), but then you don't have to write any
code.
-Dorian
Erik Hennum
<ehennum@xxxxxxxxxx>
Sent by:
platform-help-dev-admi To
n@xxxxxxxxxxx platform-help-dev@xxxxxxxxxxx
cc
10/28/2003 10:08 PM Subject
[platform-help-dev] Assembling a
single searchable Lucene index from
Please respond to multiple Eclipse instances?
platform-help-dev
Hi, Inventive Help Developers:
Assume that I have a number of documentation plugins spread across several
Eclipse instances. Each plugin ID is unique across all of the Eclipse
instances.
So now I want a federated search across my Eclipse instances. That is, I
want to run a search against all of my Eclipse instances and to be able to
open a match in the appropriate Eclipse instance.
It looks like I can write a very simple Java application that executes
org.apache.lucene.index.IndexWriter.addIndexes() to merge the indexes from
the Eclipse instances to create one large index. If the application also
harvests a mapping of plugin IDs to Eclipse instances, the application
could then construct a URL for a matched topic in the appropriate Eclipse
instance.
Based on the Eclipse use of Lucene, does that approach seem plausible and
straightforward?
Thanks in advance for any insights,
Erik Hennum
ehennum AT us DOT ibm DOT com
_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev
