HP3000-L Archives

June 2004, Week 5

HP3000-L@RAVEN.UTC.EDU

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
donna garverick <[log in to unmask]>
Reply To:
Date:
Wed, 30 Jun 2004 09:47:48 -0700
Content-Type:
text/plain
Parts/Attachments:
text/plain (93 lines)
--- Bruce Collins <[log in to unmask]> wrote:
> If I recall, it isn't just the number of files that are built, but
> how they are added to the directory structure that determines when
the
> directory is "full". Generally you can add more files to the
> directory if they are being added in alphabetical order.

yes, iirc, there is an issue with 'localization'...kinda like with
image.  if you have a cluster of files with similar names (like every
file begins with the letter) you're more likely to encounter problems
more quickly.

> The limit is usually somewhere around 35,000 - 40,000 files according
> to small-d donna's post (Re: [HP3000-L] XM Logfile size and XM
logging
> of Powerhouse subfiles) of June 28th, and who am I to question her.

hehehehehe (thanks :-)

yeah the limit is around there some place.  it's not a hard/fast number
because so many things can factor in.  repeat after me -- it's not the
size of these files....it the count.  take after folks with your
beating stick if they give you any guff about there being plenty of
disc space.

how i do my monitoring is...using the filecnt script (on jazz), i have
a threshhold of 20k files set up in my job.  at 25k, i start letting
programmers know that something is amiss.  at 30k, they need to start
explaining why they got so many files.  at 35k, i start purging files.
they're on a backup....and the integrity of the system out-weighs their
inability to properly manage their application.

and obtw -- for folks running job rescue (probably on big busy boxes
only) -- do keep track of the number of $stdlists you're retaining.
the nsd directories can get you in trouble if you're not careful!

do talk these things over with your developers.  explain to them that
groups are their friends...or even directories.  with the power that ci
scripting provides, it's very simple to devise some method to get files
spread out.

it might be appropriate to ask (at this point) if anyone has a NON-mpex
script that can report listfile-able file-sets based on create,
modified and access date.  that is -- show me all the files in .foo.bar
that haven't been accessed in a month.  of course, if you do have
mpex..well...just be thankful :-)

> ----- Original Message -----
> From: "Tony Summers" <[log in to unmask]>
>
> > Try adapting the following script to see when MPE gives up.
> >
> > %setvar swcurr 1
> > %WHILE  SWCURR < 1000000
> > %CONTINUE
> > %BUILD S!SWCURR
> > %SETVAR SWCURR SWCURR + 1
> > %ENDWHILE

oh...i don't know...this is scary.  i can't recommend this.  see my
above comments about localization!  also....if you do this...you may
not be able to say ":purge s@".  well...you can...but you'll likely
crash your machine :-(  like i said the other day, you may be faced
with having to purge your group/directory just to get rid of these
files.  and obtw again -- if you are right on the edge (say 25k files)
-- you might be able to purge the files in REVERSE alphabetical
order...maybe.

hth         - d

=====
Donna Garverick     Sr. System Programmer
dgarverick -at- longs -dot- com
925-210-6631        Longs Drug Stores

Come, my friends, 'Tis not too late to seek a newer world.
Tho' much is taken, much abides; and tho'
We are not now that strength which in old days
Moved earth and heaven, that which we are, we are.
"Ulysses", A. Tennyson

>>>MY opinions, not Longs Drug Stores'<<<



__________________________________
Do you Yahoo!?
Yahoo! Mail Address AutoComplete - You start. We finish.
http://promotions.yahoo.com/new_mail

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

ATOM RSS1 RSS2