In situations such as this you will have to use R/3 flow.
My data flow was pulling data directly from a SAP table. So it could commit only those records which it could hold in the cache/buffer.
When i ran the job using R/3 flow it worked fine.
As an alternative you may increase the buffer size / memory of al_engine, I am not sure how that is done.