Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [platform-help-dev] Search indexes



Some questions about indexing:

  1.  If you have some plugins with pre-built indexes and others without, I
assume
       that it will only index the ones without a pre-built index.  Will
eclipse ever
       re-index a plugin that already has a pre-built index?

  2.  Since the InfoCenter version only allows filtering the search at the
top
       most level,  do we have to pre-build indexes at that level, or can
we
       prebuild them at the secondary plugin level?

  3.  If the secondary plugins are related to the primary by an anchor,
rather than
       specifically named in the primary plugins xml toc, will the search
find the
       pre-built indexes?


                                      ---------------------------------
Bob Turek





                                                                                                                      
                      konradk@xxxxxxxxxx                                                                              
                      Sent by:                        To:       platform-help-dev@xxxxxxxxxxx                         
                      platform-help-dev-admin@        cc:                                                             
                      eclipse.org                     Subject:  Re: [platform-help-dev] Search indexes                
                                                                                                                      
                                                                                                                      
                      02/18/2003 04:08 PM                                                                             
                      Please respond to                                                                               
                      platform-help-dev                                                                               
                                                                                                                      
                                                                                                                      




Thank you for spotting problems in the docs.  I have made corrections.

In 2.1, search filtering functionality in the infocenter does not match
this of the workbench or stand-alone help.  It is virtually the same as in
2.0.x. - there no way to predefine working sets on the server.  We are
considering adding functionality for persisted working sets or predefined
working sets (or both) in version 2.2.

Konrad Kolosowski
Eclipse Help System




                      Robert Turek/Santa

                      Teresa/IBM@IBMUS                To:
platform-help-dev@xxxxxxxxxxx

                      Sent by:                        cc:

                      platform-help-dev-admin@        Subject:  Re:
[platform-help-dev] Search indexes
                      eclipse.org



                      02/18/2003 05:26 PM

                      Please respond to

                      platform-help-dev










On the pre-built index.

Minor: The documentation may need to be  updated.  In the topic "Pre-built
   documentation index", under "Building index for a product" (probably
should
   be "an index"), the syntax uses the flag:
          -DoutputDir=outputDirectory

   But it should be -DindexOutput=, as in the example lower down.


Question:
    When running an infoCenter version of eclipse, is there a way to set up
    pre-defined search sets, similar to those you can set up when running
    standalone Help?  These would have to be defined on the server.   Right
    now Advanced search only allows the user to choose the top-level
    (primary) topics for the infoCenter version.  For standalone, you can
    choose subsets of the top-level topics.





                      konradk@xxxxxxxxxx

                      Sent by:                        To:
platform-help-dev@xxxxxxxxxxx
                      platform-help-dev-admin@        cc:

                      eclipse.org                     Subject:  Re:
[platform-help-dev] Search indexer fails


                      02/18/2003 12:52 PM

                      Please respond to

                      platform-help-dev






Prebuilt index in in M5.  http://dev.eclipse.org/bugs/show_bug.cgi?id=16194
Search on-line docs for pre-built index.

Konrad Kolosowski
Eclipse Help System




                      Robert Turek/Santa

                      Teresa/IBM@IBMUS                To:
platform-help-dev@xxxxxxxxxxx

                      Sent by:                        cc:

                      platform-help-dev-admin@        Subject:  Re:
[platform-help-dev] Search indexer fails
                      eclipse.org



                      02/18/2003 03:31 PM

                      Please respond to

                      platform-help-dev











Thanks . . . .

I understand that the problem is likely not in the eclipse code, but
in some congruence of eclipse, Java, and the zip tool.  Having the
indexing done on a user's machine, however, means that it's all the
more important that it works reliably.

eclipse 2.1 is supposed to support delivering pre-built indexes.  How
does this work and is it implemented in M5?






                      konradk@xxxxxxxxxx

                      Sent by:                        To:
platform-help-dev@xxxxxxxxxxx
                      platform-help-dev-admin@        cc:

                      eclipse.org                     Subject:  Re:
[platform-help-dev] Search indexer fails


                      02/18/2003 10:08 AM

                      Please respond to

                      platform-help-dev







Java 1.4 is supported, but what you are reporting is clearly a bug in the
jdk, not a problem with specification or help code.  You can complain to
jdk vendors, but we cannot help here as we have no reproducible test case.

I have not heard of crashes when indexing only Eclipse documentation.  The
doc.zip files in Eclipse are produced using ant, that in turn uses classes
from java.util.zip that comes with the jdk.  You may also try Info-Zip, and
see if it helps.  In the worst case, you may lay down the files flat in the
plug-in and not have doc.zip at all.

Konrad Kolosowski
Eclipse Help System




                      Robert Turek/Santa

                      Teresa/IBM@IBMUS                To:
platform-help-dev@xxxxxxxxxxx

                      Sent by:                        cc:

                      platform-help-dev-admin@        Subject:  Re:
[platform-help-dev] Search indexer fails
                      eclipse.org



                      02/18/2003 12:25 PM

                      Please respond to

                      platform-help-dev










Thanks . . . .

 I was able to get it to index.   It works if I use IBM JRE or SDK 1.3; it
fails if I use
SUN JDK 1.4 or IBM JRE 1.4.  I thought Java 1.4 was supported.

On the zip tool --- I'm using PKZip 2.6.  What are the supported zip tools
and levels?


-------------------------  Bob Turek




                      konradk@xxxxxxxxxx

                      Sent by:                        To:
platform-help-dev@xxxxxxxxxxx
                      platform-help-dev-admin@        cc:

                      eclipse.org                     Subject:  Re:
[platform-help-dev] Search indexer fails


                      02/17/2003 01:55 PM

                      Please respond to

                      platform-help-dev







As seen from the dump, the problem is in zip.dll that comes with the JDK.
There also have been several messages on the eclipse.tools news group
regarding eclipse crashes in zip.dll, not necessary when using help.

The solution is: get a newer JDK version or IBM JDK.  If you really need to
use that version of JDK, you can experiment with different tool for
creating doc.zip files.

Konrad Kolosowski
Eclipse Help System




                      Robert Turek/Santa

                      Teresa/IBM@IBMUS                To:
platform-help-dev@xxxxxxxxxxx

                      Sent by:                        cc:

                      platform-help-dev-admin@        Subject:  Re:
[platform-help-dev] Search indexer fails
                      eclipse.org



                      02/17/2003 04:30 PM

                      Please respond to

                      platform-help-dev










Tried setting the memeory; doesn't seem to matter. . .  It still fails.

I don't know how may files as I didn't create all the plugins.  I'm guess
several thousand.

____________________________________  The Bobster




                      birsan@xxxxxxxxxx

                      Sent by:                        To:
platform-help-dev@xxxxxxxxxxx
                      platform-help-dev-admin@        cc:

                      eclipse.org                     Subject:  Re:
[platform-help-dev] Search indexer fails


                      02/17/2003 01:14 PM

                      Please respond to

                      platform-help-dev







Could there be an out memory problem? Try running eclipse with -Xmx256M or
more.
How many files are you indexing? Maybe the os is running out of file
handlers.

-Dorian



|---------+----------------------------------->
|         |           Robert Turek/Santa      |
|         |           Teresa/IBM@IBMUS        |
|         |           Sent by:                |
|         |           platform-help-dev-admin@|
|         |           eclipse.org             |
|         |                                   |
|         |                                   |
|         |           02/17/2003 03:21 PM     |
|         |           Please respond to       |
|         |           platform-help-dev       |
|         |                                   |
|---------+----------------------------------->

>
-------------------------------------------------------------------------------------------------------------|









  |
|
  |       To:       platform-help-dev@xxxxxxxxxxx
|
  |       cc:
|
  |       Subject:  [platform-help-dev] Search indexer fails
|
  |
|
  |
|

>
-------------------------------------------------------------------------------------------------------------|
















I am continuing to have problems with the indexer crashing during indexing
and taking out eclipse.  This does not happen on all machines; the same
plugins may run O.K. on a different machine (same level of Java and
eclipse).  I don't
seem to be able to track down where  exactly it's failing or what it's
encountering that it
doesn't like.

                                         ------------------------  Bob
Turek

================================================================
An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : EXCEPTION_ACCESS_VIOLATION occurred at PC=0x6D327946
Function=ZIP_Open+0x369
Library=C:\Program Files\Java\j2re1.4.0\bin\zip.dll

Current Java thread:
        at java.util.zip.ZipFile.getEntry(Native Method)
        at java.util.zip.ZipFile.getEntry(Unknown Source)
        at java.util.jar.JarFile.getEntry(Unknown Source)
        at sun.net.www.protocol.jar.URLJarFile.getEntry(Unknown Source)
        at sun.net.www.protocol.jar.JarURLConnection.connect(Unknown
Source)
        at sun.net.www.protocol.jar.JarURLConnection.getInputStream(Unknown
Sou
ce)
        at
org.eclipse.help.internal.util.ResourceLocator.doOpenFromZip(Resourc
Locator.java:94)
        at
org.eclipse.help.internal.util.ResourceLocator.openFromZip(ResourceL
cator.java:54)
        at
org.eclipse.help.internal.protocols.PluginURL.openStream(PluginURL.j
va:81)
        at
org.eclipse.help.internal.protocols.HelpURLConnection.getInputStream
HelpURLConnection.java:31)
        at java.net.URL.openStream(Unknown Source)
        at
org.eclipse.help.internal.search.HTMLDocParser.openDocument(HTMLDocP
rser.java:52)
        at
org.eclipse.help.internal.search.SearchIndex.addDocument(SearchIndex
java:93)
        at
org.eclipse.help.internal.search.IndexingOperation.addDocuments(Inde
ingOperation.java:101)
        at
org.eclipse.help.internal.search.IndexingOperation.execute(IndexingO
eration.java:82)
        at
org.eclipse.help.internal.search.SearchManager.updateIndex(SearchMan
ger.java:138)
        - locked <033843E8> (a
org.eclipse.help.internal.search.SearchManager)
        at
org.eclipse.help.internal.search.SearchManager.search(SearchManager.
ava:81)
        at
org.eclipse.help.internal.search.SearchProgressMonitor$2.run(SearchP
ogressMonitor.java:137)
        at java.lang.Thread.run(Unknown Source)

Dynamic libraries:
0x00400000 - 0x00406000         C:\Program Files\Java\j2re1.4.0
\bin\javaw.exe
0x77F80000 - 0x77FFB000         C:\WINNT\System32\ntdll.dll
0x77DB0000 - 0x77E0C000         C:\WINNT\system32\ADVAPI32.dll
0x77E80000 - 0x77F35000         C:\WINNT\system32\KERNEL32.DLL
0x77D40000 - 0x77DB0000         C:\WINNT\system32\RPCRT4.DLL
0x77E10000 - 0x77E74000         C:\WINNT\system32\USER32.dll
0x77F40000 - 0x77F7C000         C:\WINNT\system32\GDI32.DLL
0x78000000 - 0x78046000         C:\WINNT\system32\MSVCRT.dll
0x75E60000 - 0x75E7A000         C:\WINNT\System32\IMM32.DLL
0x6CA60000 - 0x6CA68000         C:\WINNT\System32\LPK.DLL
0x66650000 - 0x666A4000         C:\WINNT\System32\USP10.dll
0x6D330000 - 0x6D445000         C:\Program Files\Java\j2re1.4.0
\bin\client\jvm.
ll
0x77570000 - 0x775A0000         C:\WINNT\System32\WINMM.dll
0x6D1D0000 - 0x6D1D7000         C:\Program Files\Java\j2re1.4.0\bin\hpi.dll
0x6D300000 - 0x6D30D000         C:\Program Files\Java\j2re1.4.0
\bin\verify.dll
0x6D210000 - 0x6D228000         C:\Program Files\Java\j2re1.4.0
\bin\java.dll
0x6D320000 - 0x6D32D000         C:\Program Files\Java\j2re1.4.0\bin\zip.dll
0x6D2D0000 - 0x6D2DD000         C:\Program Files\Java\j2re1.4.0\bin\net.dll
0x75050000 - 0x75058000         C:\WINNT\System32\WSOCK32.dll
0x75030000 - 0x75043000         C:\WINNT\System32\WS2_32.DLL
0x75020000 - 0x75028000         C:\WINNT\System32\WS2HELP.DLL
0x10000000 - 0x1001C000         C:\WINNT\System32\hclsock5.dll
0x74FD0000 - 0x74FEF000         C:\WINNT\system32\msafd.dll
0x75010000 - 0x75017000         C:\WINNT\System32\wshtcpip.dll
0x77920000 - 0x77943000         C:\WINNT\system32\imagehlp.dll
0x72A00000 - 0x72A2D000         C:\WINNT\system32\DBGHELP.dll
0x690A0000 - 0x690AB000         C:\WINNT\System32\PSAPI.DLL

Local Time = Mon Feb 17 12:08:18 2003
Elapsed Time = 93
#
# The exception above was detected in native code outside the VM
#
# Java VM: Java HotSpot(TM) Client VM (1.4.0_01-b03 mixed mode)
#
# An error report file has been saved as hs_err_pid1976.log.
# Please refer to the file for further information.

_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev



_______________________________________________
platform-help-dev mailing list
platform-help-dev@xxxxxxxxxxx
http://dev.eclipse.org/mailman/listinfo/platform-help-dev





Back to the top