Nightly Import of data

Can anyone suggest a way/the best way to batch import data into Suite that would then be searchable via the usual search facilities in the crm system.

We have some data fields that are updated in other systems that I’d like to take a nightly copy of for reporting and target list creation purposes.

I realise that there is the REST API that allows me to update individual records but for 10,000s of records each night seems very inefficient.

I’ve thought about just dumping the data via a SQL batch job but this approach is usually frowned upon and probably would bypass the indexing leaving it unsearchable.

How have other approached this type of problem.

Many thanks,

Tim

Hi I am designing a similar system running on Linux.

The REST API is pretty inefficient for moving large chunks of data, so I am using cron to schedule a script to poll my source database for updates.
Then I do all my formatting or parsing, or whatever needs done, and I insert directly into my SuiteCRM database using SQL queries.

I use php and its mysqli extension to accomplish this, and it works quite well, if a little annoying to maintain.

Yeah, this is probably frowned upon, but unless your data system has automatic import features, I’m not sure how else to do it. It seems to search correctly as well, although SuiteCRM’s native search functionality it a little lacking as far as I can tell.

Patrick

1 Like