HP3000-L Archives

August 2007, Week 1

HP3000-L@RAVEN.UTC.EDU

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
"Legault, Raymond D" <[log in to unmask]>
Reply To:
Legault, Raymond D
Date:
Wed, 1 Aug 2007 07:20:19 -0700
Content-Type:
text/plain
Parts/Attachments:
text/plain (355 lines)
indexing
(TPI) are the most likely to see this problem.

Stalled transaction: EXCEEDED ACCUMULATED LOG DATA THRESHOLD

 Warning: One or more entries on the error stack have been overwritten
HPE error management message 205
 Warning: Message set 185, error number 1030 was not found in  system
catalog.
 Intrinsic layer: An access violation occurred  File system message 3


RESOLUTION
The Transaction Manager(XM) message occurs because the length of the
transaction defined by dbxbegin and dbxend exceeded the allowable limit.
If you use TPI (Third Party Indexing) the reason for the stall may be a
large number of deletes to a dataset.

TPI by Omnidex does the DBPUT as follows:

The DBPUT uses empty records from delete chain, than a reshuffle of the
index records is done in order to keep the RRNs in sorted order.  This
can apparently take up lots of XM buffer space.

XM Transaction size:
Pre-6.0 the allowable limit per TURBOIMAGE transaction is 1 megabyte.
(There is no accurate way to estimate how much of that 1 meg each
transaction will take.)  As of 6.5 XM transactions have been increased
to 128 megabytes (SR|1653291559).

TPI Solution:

Omnidex suggests that customers do a REPACK of detail set and REINDEX.
If the delete rate is high a REPACK of the detail set and REINDEX should
be done often. Contact this 3rd party if you have more questions.  

Workaround: Disable TPI XM:

Turn off XM for TPI (Omnidex)

RUN DBINSTAL.PUB.DISC
Data base name: mydb
Cmd: SET TPI NOXM


Image/Sql Stalled Transactions Solution:

>SET AUTOCOMMIT ON;
>SET AUTOSAVE 100; set the number of rows to commit on

This will force a commit work more often, which should decrease the
amount of XM buffer space used.

Other SRs on the subject:

 SR#5003028662  TurboIMAGE intrinsics should provide optional control

Lab Text: XM has the 1 MB transaction limit and the XM rollover
maximum.Since this is a feature that was within the original design,
TurboIMAGE has no control and cannot intercept the XM error.XM will need
to return a new error status to TurboIMAGE, whichenables TurboIMAGE
intrinsics to return a new error conditionto the application program.
This SR is indeed a complicatedrequest which requires resolution of
several issues betweenXM and TurboIMAGE, and also, requires redesigning
and recoding.Overall, this does not seem like a big payback for XM
andTurboIMAGE. In reality, there may be a problem with thedesign of the
application program itself when the application program allows for a
DBXBEGIN/DBXEND that loops thru codewhich does 630 DBPUTs and 629
DBUPDATEs.

SR# 1643024158 Request for larger TurboIMAGE Dynamic Transactions

Enhance Dynamic Rollback feature such that the users are not restricted
to use only DBXUNDO or DBCLOSE after an unsuccessful intrinsic call
(non-zero status).
Based on the status condition, theuser would like flexibility and take
appropriate steps so that the whole transaction does not have to be
rolled back.


6.5 transaction manager changes: 

The checkpoint improvement feature added in on 6.0 using ALTERCHKPTSTAT
was intended to reduce the lock time on the memory management semaphore
while posting out files attached to the XM user log.  In 6.5 and later,
two changes have occurred that resulted in removal of this feature.

1.  The memory management semaphore strategy has been entirely
    redesigned to eliminate the single, system-wide resource.

2.  The maximum file size of a file that is attached to the XM user
    log increased to 128 gb.

Change #1 reduced the need for the ALTERCHKPTSTAT feature.  Change #2
caused the bitmap that was kept in the GUFD to grow too large for the
GUFD structure.  As a result, the code that would have been executed if
ALTERCHKPTSTAT was enabled was removed with the $skip_text on$ and
$skip_text off$ compiler options.

============================================= END
==========================

From Omnidex-----

Also, TPI settings apply only to Omnidex enhanced (Installed) Databases.
I see here that you were using the command on a non-Omnidex enhanced
database.

Cmd: set tpi noxm
TPI will be enabled during installation

The statement above that "TPI will be enabled during installation" only
applies to the current session within dbinstal.  That means that if you
install as I do below, TPI will be set at the end of the Omnidex
installation.  It is more common to SET TPI {ON|OFF|NOXM} on a currently
Omnidex enhanced database.

HPIX3> [DMDDEV.DMD]:run dbinstal.pub.disc308


OMNIDEX DBInstal, Release 3.8.14   Tue Dec  5 2006 09:27:42
(c) Copyright 1981-1998 Dynamic Information Systems Corporation

Database or Environment: sales.demodb

Cmd: set tpi noxm
TPI will be enabled during installation

Cmd: i

** OMNIDEX MultiDimensional/Keyword (MDK) Index Installation **

Enter Tables (Data Sets) and Columns (Data Items) to be indexed

To create an index comprised of all or parts of one or more columns,
enter an Index Name followed by '!' at the Column prompt

Enter '?' for a list of Tables or Columns, '/' to exit the current
prompt

Table name? customers
Column name: contact
Column name: /
Table name? /

Specification of MDK indexes is complete

** OMNIDEX Aggregation/Sorted_Key (ASK) Index Installation **

Table name? /

Proceed with installation? [Y] 

Use the Build command to load the following indexes:

CUSTOMERS (Omnidex MDK)
TurboIMAGE TPI enabled

Rootfile lgth = 4096 bytes.  Installation complete.

Cmd: quit

END OF PROGRAM
HPIX3> [DMDDEV.DMD]:

Thanks,

Derek

-----Original Message-----
Subject: RE: TPI NOXM what cmd turns it back on

Ray, 

Set tpi off  - turns tpi off no matter how it was turned on.

Set tpi on - turns on tpi with transaction management on the indexes.

Set tpi noxm - turns on tpi with no transaction management on the
indexes.

Thanks
Jeff

-----Original Message-----

Subject: TPI NOXM what cmd turns it back on

Cmd: set tpi noxm
TPI will be enabled during installation

Cmd: set tpi xm
Expecting ON or OFF

Cmd: redo
Unrecognized command.  Try Help

Cmd:     

Cmd: set tpi xmon
Expecting ON or OFF

Cmd: set tpi xm on
Expecting ON or OFF

  

-----Original Message-----
From: Rao, Raghu [mailto:[log in to unmask]] 
Sent: Tuesday, July 31, 2007 6:09 PM
Subject: STALLED TRANSACTION: EXCEEDED ACCUMULATED LOG DATA THRESHOLD

Any help is really appreciated.. Thanks..  


    600   :RUN  BCP0100.PROGXL.!HPACCOUNT;XL="!QXLINFO";NMSTACK=1300000
    601   
    602    
    603   **  BCP0100  VERSION  11.01.08.04 02/27/2004  01:02 AM  **
    604   **  Copyright AMISYS, LLC                               **
    605   **  1990-2003 All Rights Reserved                       **
    606    
    607    
    608   Enter the Mode             : 1
    609    
    610   Enter the Batch/Operator   : @
    611    
    612   Enter the Claim Type       : @
    613    
    614   Enter the Effective Date   : 19000101
    615    
    616   Enter the End date         : 99991231
    617    
    618   Enter the Action Trigger   :
    619    
    620   Enter the User Op#         : *SYS
    621    
    622   Enter the Load EX-Code flag: N
    624    
    625   **** STALLED TRANSACTION: EXCEEDED ACCUMULATED LOG DATA
THRESHOLD
          
    627   WARNING ** One or more entries on the error stack have been
overwritten.
    628   
    629   HPE Error Management message 205
    630   
    631   WARNING ** Message set 185, Error number 1030 was not found in
the syste
    632   m catalog.
    633   
    634   Intrinsic layer; an access violation occurred.
    635   
    636   File System message 3
    637   
    638   Intrinsic layer; an access violation occurred.
    639   
    640   File System message 3
    641   
    642   Intrinsic layer; an access violation occurred.
    643   
    644   File System message 3
    645   
    646   Intrinsic layer; an access violation occurred.
    647   
    648   File System message 3
    649   
    650   Intrinsic layer; an access violation occurred.
    651   
    652   File System message 3
    653   
    654   Intrinsic layer; an access violation occurred.
    655   
    656   File System message 3
    657   
    658   Intrinsic layer; an access violation occurred.
    659   
    660   File System message 3
    661   
    662   Specifying the LONG MAPPED OPTION (item# 21) for this file
type is inval
    663   id.
    664   (FILE OPEN ERROR -299)
    665   
    666   File System message 299
    667   
    668   Specifying the LONG MAPPED OPTION (item# 21) for this file
type is inval
    669   id.
    670   (FILE OPEN ERROR -299)
    671   
    672   File System message 299
    673   
    674   Intrinsic layer; an access violation occurred.
    675   
    676   File System message 3
    677   
    678   Intrinsic layer; an access violation occurred.
    679   
    680   File System message 3
    681   
    682   Intrinsic layer; an access violation occurred.
    683   
    684   File System message 3
    685   
    686   Intrinsic layer; an access violation occurred.
    687   
    688   File System message 3
    689   
    690   Intrinsic layer; the operation could not be completed because
a nonexist
    691   ent
    692   file was specified.
    693   
    694   File System message 38
    695   
    696   FLABELINFO intrinsic.
    697   
    698   SUBSYS_INTRIN_ID message 25
    699   ABORT: BCP0100.PROGXL.AMISYS
    700   NM SYS   a.00fdbf70 dbg_abort_trace+$28
    701   NM USER  1a0.00d57d94 PROC'EXIT000445+$78
    702   NM PROG  357.00074544 bcp0100$006$+$3aac
    704   
    705   RUN
BCP0100.PROGXL.AMISYS;XL="XL.PUB.AMISYS,XL.OW.DISC3,xl0707c2.pub.hss,PHL
IBXLS.PH839C.COGNOS,XLOMNIDX.PUB.SYS,ST2XL.PU
    706   LAMISYS.PUB.SYS";NMSTACK=1300000
    707   Program terminated in an error state. (CIERR 976)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^


Raghu Rao
Preferred Care - Senior Systems Analyst
259 Monroe Ave.
Rochester, NY  14607
585.327.5755

Confidentiality Notice:
The information contained in this electronic message is intended for the
exclusive use of the individual or entity named above and may contain
privileged or confidential information.  If the reader of this message
is not the intended recipient or the employee or agent responsible to
deliver it to the intended recipient, you are hereby notified that
dissemination, distribution or copying of this information is
prohibited.  If you have received this communication in error, please
notify the sender immediately by telephone and destroy the copies you
received.

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

ATOM RSS1 RSS2