BEWARE - I have done extensive testing of this process, and it goes SLOWER split apart than all together serial.  We have about a 4 hour total re-index time, and I tried splitting the indexing up to run the larger sets together on an 8 processor 997, and it actually took close to 7 hours !  I tried several tests with different configurations with the same results.

Wyell Grunwald

>>> "Leonard S. Berkowitz" <[log in to unmask]> Monday, November 10, 2003 11:42:40 AM >>>
Craig,

That's an interesting idea. It had not occurred to me. We now have a SERIES e3000/N4000-400-75, so I
guess we could index four datasets at a time. In practice, we could set up the two long-running
datasets in separate jobs and all of the rest, that are trivial in duration in a third job.

In fact, we try to avoid complete reindexing and index only what is necessary.

Please amplify the use of opening the data base in READONLY. I understand the DBUTIL command for SET
SUBSYSTEMS (haven't used it for a long time) that is only good for subsystems that both to check
this flag -- QUERY and SUPRTOOL to my knowledge, but I do not see anything comparable in DBINSTAL:

Cmd: HELP

DBINSTAL Commands:

   'B[;buf=n][;nomr][;status]' { n = 2-1024 MBytes } to build indexes
   'E' or '/' to exit to the data base prompt
   'H' or '?' for help
   'I' to install
   'INDEX' (same as 'B' cmd)
   'L' to list a range of keys to the screen or a file
   'QUIT' to immediately exit this program at any time
   'Set TPI {ON|OFF}' to enable/disable IMAGE Third Party Indexing
   'T' to load a new translation table
   'V' for the software version
   'X[!]' to load (if '!' clear) the excluded words list
   'Z[!]' to zap (erase or if '!', purge) the indexes
   ':<Command>' to execute any system command

Leonard
--
Leonard S. Berkowitz
Perot Health Care Systems
(Harvard Pilgrim Health Care account)
voice: 617-509-1212
fax: 617-509-1955
pager: 781-226-2431



                      Craig Lalley
                      <[log in to unmask]        To:       [log in to unmask], [log in to unmask] 
                      com>                     cc:
                                               Subject:  Re: image database omnidex error msg
                      11/10/2003 11:20
                      AM







--- "Leonard S. Berkowitz" <[log in to unmask]> wrote:
> "The nice thing about OMNIDEX is you can just re-execute your install job,
> which will tidy things up a bit, then reindex."
>
> Yes, if you have a small number of records. We have one dataset, the indexing
> of which, took seven hours on a 997-1200.

Ah, but there is a trick that can be done, it won't help you shorten the "seven
hours" but...

Re-indexing is by default a serial threaded process.  It does not have to be.
If you have enough memory and disc resources, each processor can re-index one
data set.  Use DBINSTAL instead of DBUTIL, open the database in READONLY and
viola.

-Craig


__________________________________
Do you Yahoo!?
Protect your identity with Yahoo! Mail AddressGuard
http://antispam.yahoo.com/whatsnewfree 

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *