Consultor Eletrônico



Kbase P11630: Out of memory errors when manipulating large XML files
Autor   Progress Software Corporation - Progress
Acesso   Público
Publicação   24/02/2010
Status: Verified

SYMPTOM(s):

Out of memory errors when manipulating large XML files

Getting out of memory errors when generating XML files

Getting out of memory errors when loading XML files

Not enough memory. (3205)

SYSTEM ERROR: Memory violation. (49)

X-NODEREF or X-DOCUMENT <method-name> got an error: <xml-exception>. (9082)

X-NODEREF or X-DOCUMENT LOAD got an error: FATAL ERROR: file 'test.xml', line '18707', column '642', message 'An exception occurred! Type:RuntimeException, Message:operator new fails. Possibly running Of memory'. (9082)

READ-XML encountered an error while parsing the XML Document: <error>. (13064)

READ-XML encountered an error while parsing the XML Document: FATAL ERROR: file '/test.xml', line '904196', column '19', message 'An exception occurred! Type:RuntimeException, Message:operator new fails. Possibly running Of memory'. (13064)


FACT(s) (Environment):

Generating extremely large XML files (80 to 100 MB in size)
Loading extremely large XML files
XML files have many small nodes
Using the DOM interface
All Supported Operating Systems
Progress 9.1x
OpenEdge 10.x

CAUSE:

The application is literally out of memory. Each XML node will take up to 12 times the memory of the data in the node because of XML overhead.

FIX:

Increase available memory (physical and virtual).
When processing large XML file, consider using the SAX parser instead of the DOM interface. The SAX parser does not require loading the whole document into memory to process it.