I'm having exactly the same problem as yours :). I actually split my huge
file into 25 small files each with 4 to 5 MB size.
We are using correlation inside the orchestration that process one file at
a
time. If i drop all the 25 files at the same time in the receive location,
BizTalk processes the file one by one. But after processing around 20
files,
i'm again getting out of memory exceptions.
I figured out that the memory usage of the host increases to around 1.3 GB
(even for split approach) and then it is throwing the error. If i restart
the
host service, i can able to process the remaining files.
Wrt to my process, this is a very ***bersome excercise for me. I'm
thinking
of adding more host instances to the host so that the load will be shared
between the instances.
Are you dropping the one file, wait for it to complete and dropping
another
file manually?? Are you using multiple host instances for your host?
Please
share your experience.
"EAI" wrote:
> Zaero,
>
> I am processing files one after the other. I did not dare trying 230 MB
file
> after my prior experiences with BizTalk and huge files.
>
> I guess BizTalk is more of a Business Process tool. It does a terrible
job
> at data processing and unfortunately I am using BizTalk for data
processing
> (X12).
>
> Any simpler alternatives ? :(
>
>
> "Zaero" <Zaero@[EMAIL PROTECTED]
> wrote in message
> news:7E3B5D05-6CC5-4F94-92D4-8EDE7BE16090@[EMAIL PROTECTED]
> > Are you processing an EDI X12 file or a proprietary file? How is your
> > memory
> > usage while processing the 230MB file? I'm just trying to match my
> > scenario
> > with yours.
> >
> > I still couldn't understand why BizTalk 2004 is throwing out of memory
> > exception even in a machine with 8GB RAM (It uses only 1.1 GB after
that
> > it
> > is giving the out of memory exception for a 130MB file)
> >
> > Incase of splitting the files before processing, are you processing
all
> > the
> > split files at once or are you processing it one by one.
> >
> >
> >
>
>
>
|
