I needed to parse large (1-3gb) XML documents with hundreds of thousands of records recently. My first attempt was using SweetXML and XPath but the memory consumption was very high, so I switched to ultimately switched to Saxy successfully. It was a bit confusing to get started, dealing with pretty complex XML files, but my solution ended up working well.
I’d be happy to go into greater detail if anyone’s interested, but just wanted to second using Saxy.
SweetXML was great for a smaller set of data, it just got unwieldy.
