Importing Leads - Internal Server Error

šŸ’¬ General Discussion
1

I can import a small number of leads without an error but Iā€™m trying to import 2700 records and I get the following error:

==
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

The SuiteCRM log shows this:

==
Mon Aug 8 15:49:39 2016 [22168][1][FATAL] Loading import map properties.
Mon Aug 8 15:50:00 2016 [22168][1][FATAL] Caught error: Accessing static property ImportFieldSanitize::$createdBeans as non static
Mon Aug 8 15:50:00 2016 [22168][1][FATAL] Caught error: stat(): stat failed for upload/import/error_1.csv
Mon Aug 8 15:50:00 2016 [22168][1][FATAL] Caught error: touch(): UploadStream::stream_metadata is not implemented!
Mon Aug 8 15:50:00 2016 [22168][1][FATAL] Caught error: Accessing static property ImportFieldSanitize::$createdBeans as non static

Any suggestions on how to make this work with more records?

2

Iā€™ve imported more records than that at once so I know the system is definitely capable of it.

If youā€™d said you were having issues importing large amounts of data without providing an error message I would have suggested you check your php.ini settings for maximum file size you can upload and how long a script can spend executing. Whilst it may still be worth editing these settings to see if it makes a difference going by the error message Iā€™m not convinced that is the problem.

Just wondering if you look at the first record that isnā€™t imported when it crashes if you can see anything unusual about it that may be causing the issue. Also are you trying to import relationships? If some of the leads are related to accounts or contacts you will need to make sure youā€™ve imported the relevant contacts/accounts before you import the leads

3

Thanks for looking at this with me, ewanmcrobert.

I read the error_1.csv which was giving a duplicate value error on the ID field which I was mapping from the import ID. There were no duplicate values in the source file which were zoho generated IDsā€¦ and I need those imported IDs for relationships between Accounts, Contacts, and Opportunities - none of the leads are converted and have no relationships with other modules.

To troubleshoot I tried an import without mapping the ID field to see the result and still got these errors in the suitecrm log:

Tue Aug 9 07:28:20 2016 [5014][1][FATAL] Loading import map properties.
Tue Aug 9 07:29:51 2016 [5084][1][FATAL] Caught error: Accessing static property ImportFieldSanitize::$createdBeans as non static

==

For reference, the php and config settings are:

PHP.ini

memory_limit: 1G
max_execution_time: 18000
max_input_time: 18000
post_max_size: 128M
upload_max_filesize: 128M

ā€“

SuiteCRM config.php

ā€˜import_max_execution_timeā€™ => 3600,
ā€˜import_max_records_per_fileā€™ => 10000,
ā€˜import_max_records_total_limitā€™ => ā€˜ā€™,

ā€˜default_limitā€™ => 10000,

==

Also attached is the PHP error_log.txt

==

Thanks again for looking at this. Any help is really appreciated.

4

In SuiteCRM config.php I increased import_max settings as follows:

ā€˜import_max_execution_timeā€™ => 360000,
ā€˜import_max_records_per_fileā€™ => 100000,
ā€˜import_max_records_total_limitā€™ => ā€˜ā€™,

ā€˜default_limitā€™ => 100000,

===

But still got in-browser error:

===
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

And suitecrm.log errors below

Tue Aug 9 09:58:48 2016 [9920][1][FATAL] Loading import map properties.
Tue Aug 9 09:59:15 2016 [9920][1][FATAL] Caught error: Accessing static property ImportFieldSanitize::$createdBeans as non static
Tue Aug 9 09:59:15 2016 [9920][1][FATAL] Caught error: stat(): stat failed for upload/import/error_1.csv
Tue Aug 9 09:59:15 2016 [9920][1][FATAL] Caught error: touch(): UploadStream::stream_metadata is not implemented!
Tue Aug 9 09:59:15 2016 [9920][1][FATAL] Caught error: Accessing static property ImportFieldSanitize::$createdBeans as non static

===

Plus ā€œID already exists in this tableā€ errors on 205 records for IDs which have unique values, not duplicates. A few row samples from error_1.csv below

ID already exists in this table ID 1765831 1
ID already exists in this table ID 1765916 2
ID already exists in this table ID 1776137 3
ID already exists in this table ID 1776163 4
ID already exists in this table ID 1776213 5
ID already exists in this table ID 1776223 6
ID already exists in this table ID 1776307 7
ID already exists in this table ID 1777600 8
ID already exists in this table ID 1777609 9
ID already exists in this table ID 1777615 10
ID already exists in this table ID 1779042 11

===

Not sure what to do. Please let me know what you think.

Thanks.