importing leads or accounts from CSV stops after 100 records and crashes with Error: 500 - Internal Server Error

💬 General Discussion
1

When importing leads or accounts from CSV (around 800 records each) the import process crashes.
I can’t tell from the error records in …\upload\import…and sugarcrm.log just shows:
12/09/14 14:39:58 [3172][ae49d36b-79a2-5c1e-4ecc-5486e338b967][FATAL] Caught error: stat(): stat failed for upload/import/status_ae49d36b-79a2-5c1e-4ecc-5486e338b967.csv
12/09/14 14:39:58 [3172][ae49d36b-79a2-5c1e-4ecc-5486e338b967][FATAL] Caught error: touch(): Unable to create file upload://import/status_ae49d36b-79a2-5c1e-4ecc-5486e338b967.csv because Invalid argument

Any ideas?

Thanks for your help

2

I am using suiteCRM v 7.1.4 Sales with PHP 5.3.28

Having played around with it some more, it seems to be slightly better at importing the data when the source CSV file has no headers…but this could just be a random coincidence…

3

After further investigation I noticed something in the files created in the ‘upload’ folder e.g.
IMPORT_Lead_ae49d36b-79a2-5c1e-4ecc-5486e338b967
IMPORT_Lead_ae49d36b-79a2-5c1e-4ecc-5486e338b967-0
IMPORT_Lead_ae49d36b-79a2-5c1e-4ecc-5486e338b967-1
IMPORT_Lead_ae49d36b-79a2-5c1e-4ecc-5486e338b967-2
etc…

The main file contains a full list of all the records I’m trying to upload, but the first record in this file is not contained in any of the smaller files (-0,.-1,-2 etc).

I am not ticking the ‘contains headers’ tick-box, so I’m not sure why this is the case…could this be causing the errors I’m seeing?

Thanks

4

final update:

When importing less than 100 records, it works fine but ignores the first record
When importing 100-200 records, it errors out but does import everything apart from the first record

The CSV source has no header row

5

Looks suspiciously similar to this post:
https://suitecrm.com/forum/bug-tracker/2974-importing-leads-or-accounts-from-csv-stops-after-100-records-and-crashes-with-error-500-internal-server-error

6

We could really do with a potential fix for this, if anyone has any ideas they would be very welcome!

Thanks

7

why are there so many issues doing some of the most basic actions… i cant import 100 out of 80,000 records at a time … why cant i just import the data from my csv file?

8

We have a client with this import issue currently. I’d recommend breaking down the CSV in batches of 100’s. Does it all import, or does it break on a specific set of data?

9

I’d recommend breaking down the CSV in batches of 100’s. Does it all import, or does it break on a specific set of data?

10

Heavens…!!
Breaking down to batches of 100. I have a file of 269 000 lines. That would mean importing 2690 files and would take a week or two of work.
Last year I broke it down to two files 134 500 lines. This year I’m doing this again and have a problem with files of 10 000 lines.
It seems to me that import fail occure faster if browser window (tab) in not THE TOP window e.g. is not active wwindow.
Anyone else observed this also?