Perform Lucene Index taking long to run and using alot of CPU

💬 General Discussion
1

Since I upgrade from SugarCRM CE 6.5 to SuiteCRM 7.1 tow days ago there has been very high CPU usage taken up by php

sone@prod.sugarcrm.ib4t.co[192.168.175.243] /var/www/html/sugarcrm.ib4t.co.nz [master]32c2713 Live database save for Wednesday

$ ps aux | grep php
apache 12566 0.0 0.0 106096 1180 ? Ss 09:13 0:00 /bin/sh -c cd /var/www/html/sugarcrm.ib4t.co.nz; php -f cron.php > /dev/null 2>&1
apache 12567 53.0 2.2 464816 87648 ? D 09:13 31:31 php -f cron.php
sone 14635 0.0 0.0 103252 820 pts/5 S+ 10:12 0:00 grep php
sone@prod.sugarcrm.ib4t.co[192.168.175.243] /var/www/html/sugarcrm.ib4t.co.nz [master]32c2713 Live database save for Wednesday
$ date
Wed Oct 1 10:12:35 NZDT 2014

How long is this schedule job suppose to run for?

it seems to be taking up very large amounts of cpu time and never seems to complete. I’ve had a guy who looks after Nagios inform me of CPU usage over the last 3 days since upgrade went and its pretty much taken up all cpu usage since the upgrade.

Search works but I would really like to get to the bottom of this

2

I have the same problem, “Perform Lucene Index” always running and never been done. Same thing with Optimise AOD index.

Can someone help me with this? Other jobs running and complete to done, but this two newer complete to done.

In SuiteCRM logs i have this errors:

Thu Oct 16 08:30:01 2014 [7288][1][FATAL] Job 66f60abd-4839-bc52-f5cd-543fc145554d (Optimise AOD Index) failed in CRON run
Thu Oct 16 08:49:02 2014 [6209][1][FATAL] Job 122eb308-e91b-e709-dff9-543fcc1a37b1 (Perform Lucene Index) failed in CRON run
Thu Oct 16 08:50:01 2014 [8548][1][FATAL] Job 58f2201b-7b8f-fd36-5690-543fcc489d44 (Optimise AOD Index) failed in CRON run
Thu Oct 16 08:50:01 2014 [8548][1][FATAL] Could not connect to DB server localhost as mycrmdbname. port : Can’t create UNIX socket (24)
Thu Oct 16 08:50:01 2014 [8548][1][FATAL] Query Failed: SELECT * FROM fields_meta_data WHERE custom_module=‘Currencies’ AND deleted = 0: Database Is Not Connected

3

Hi,

Is there any PHP errors in the server logs? If you change the log level in settings is there any other log entries related to the scheduler?

Thanks,
Jim

4

Can you login to my instance to make checks? How I can send you login details?

I also have this problem https://suitecrm.com/index.php?option=com_kunena&view=topic&catid=10&id=2466&Itemid=1136#9975

I think that this is related to this problem

5

Sorry but I can’t access your instance to check. The server logs will vary depending on your OS/Webserver but for apache under Ubuntu these can be found in:

/var/log/apache2/error.log
6

I am on shared hosting and i don not know how to find this /var/log/apache2/error.log

7

I asked hosting support to do check how you suggested and they said this:

I have checked the log suggested in the thread and I found the following entries in it:

Code:
[Thu Oct 16 09:15:44 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php?action=ajaxui
[Thu Oct 16 09:21:28 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 09:23:02 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 09:25:47 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 09:26:09 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 09:27:46 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 09:37:04 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 10:08:02 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 10:08:02 2014] [error] [client IP address] File does not exist: /home/mydomain/crm/favicon.ico
[Thu Oct 16 10:08:02 2014] [error] [client IP address] File does not exist: /home/mydomain/crm/favicon.ico
[Thu Oct 16 10:11:21 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php
[Thu Oct 16 11:57:27 2014] [error] [client IP address] PHP Fatal error: Class ‘AssignGroups’ not found in /home/mydomain/crm/include/utils/LogicHook.php on line 245, referer: http://mydomain/index.php

It appears that the problem is with the with the script at mydomain/index.php as it is calling a non declared class in the file /home/mydomain/crm/include/utils/LogicHook.php. I am afraid that such problems are out of the scope of the technical service we provide, so you could try seeking help further in the thread or alternatively consult with a professional developer which should be able to investigate the case and troubleshoot it.

Do you think that this problem with jobs always running and never been done is related to my other treat https://suitecrm.com/index.php?option=com_kunena&view=topic&catid=10&id=2466&Itemid=1136

Please help me

8

Hi,

Similarly to the other thread this is an AOD bug. We’ll investigate and have a fix in a future version. In the meantime disabling AOD should solve the issue.

Thanks,
Jim

9

When I try to delete user in SuiteCRM I also received this error:

Fatal error: require_once() [function.require]: Failed opening required ‘modules/EAPM/EAPM.php’ (include_path=’/home/mydomain/crm:/home/mydomain/crm/include/HTMLPurifier/standalone:/home/mydomain/crm/include/…:.:/usr/local/php53/pear:modules/AOD_Index/Lib’) in /home/mydomain/crm/include/MVC/SugarModule.php on line 110

This is not good, please fix this problems asap

Thanks

10

Please, can you check this?

There is so many errors. This must be bug. Please resolve this bugs.

11

Does this issue still occur after disabling AOD?

12

Cron jobs are fine now but this error still occur:

When I try to delete user in SuiteCRM I also received this error (blank page):

Fatal error: require_once() [function.require]: Failed opening required ‘modules/EAPM/EAPM.php’ (include_path=’/home/mydomain/crm:/home/mydomain/crm/include/HTMLPurifier/standalone:/home/mydomain/crm/include/…:.:/usr/local/php53/pear:modules/AOD_Index/Lib’) in /home/mydomain/crm/include/MVC/SugarModule.php on line 110

Also, when I delete Employee I have this log error:

Fri Oct 24 03:05:30 2014 [23778][a2cc3e71-e86b-c13d-8800-543fbbaa0a18][FATAL] holidays for users_holidays failed to load

Fri Oct 24 03:05:30 2014 [23778][a2cc3e71-e86b-c13d-8800-543fbbaa0a18][FATAL] error loading relationship holidays
Fri Oct 24 03:05:30 2014 [23778][a2cc3e71-e86b-c13d-8800-543fbbaa0a18][FATAL] project_resource for projects_users_resources failed to load

Fri Oct 24 03:05:30 2014 [23778][a2cc3e71-e86b-c13d-8800-543fbbaa0a18][FATAL] error loading relationship project_resource

13

Holidays is not a standard SuiteCRM module so I’m unable to help you with that. For the deletion of users does the file mentioned exist in:

/home/mydomain/crm/modules/EAPM/EAPM.php

Can you also check the permissions for the above and for the folders that it is in?

14

But what then is holidays module? I did not install any modules with that name…

I will check permissions and answer here today.

Please, can you tell me what is the general permissions (folders/files) instructions for SuiteCRM?

15

I’d suggest 755 for all files except the following:
cache custom modules themes data upload config_override.php

Which should be 775.

Thanks,
Jim

16

Ok, folders also 755?

17

I.e using:


    cd /path/to/your/suitecrm
    sudo chown -R www-data:www-data .
    sudo chmod -R 755 .
    sudo chmod -R 775 cache custom modules themes data upload config_override.php

(This assumes your web server user is www-data.

18

I set permissions like you said but I still have this plank page error when I delete user in User Management:

Fatal error: require_once() [function.require]: Failed opening required ‘modules/EAPM/EAPM.php’ (include_path=’/home/mybpcrm0/crm:/home/mybpcrm0/crm/include/HTMLPurifier/standalone:/home/mydomain/crm/include/…:.:/usr/local/php53/pear:modules/AOD_Index/Lib’) in /home/mydomain/crm/include/MVC/SugarModule.php on line 110

Please help me

19

First of all: Thank you for SuiteCRM and that you put it OpenSource!

I’m also hit by this bug on a test instance. Are there any news on this?

I’m very familiar with Lucene in Java, and maybe I can help finding a solution. As mentioned in other forum threads, there are some warnings and notices in Apaches error log, but I found no error.

Is there a more technical bug report available? If you can provide me with some additional infos (e.g. which php file causes the behavior, what is known about this issue until now)

best
Sebastian

20

Has this been addressed? I am working on a clean install of 7.2 and getting similar errors when chron runs

Sat Mar 21 00:00:04 2015 [10626][1][FATAL] Job dd39105e-af6d-15c2-36fe-550d089c934a (Optimise AOD Index) failed in CRON run
Sat Mar 21 01:00:03 2015 [12470][1][FATAL] Job 73700413-dbe3-04ed-c899-550d08238369 (Run Scheduled Reports) failed in CRON run
Sat Mar 21 01:00:04 2015 [12470][1][FATAL] Job 881406bd-56b9-707a-77ed-550d1645d8d6 (Perform Lucene Index) failed in CRON run
Sat Mar 21 02:00:04 2015 [22037][1][FATAL] Job ba0393e6-42cd-6571-96ed-550d25daf3f8 (Optimise AOD Index) failed in CRON run
Sat Mar 21 03:00:05 2015 [4622][1][FATAL] Job 6d3e53d4-ad01-33a5-7674-550d33c571f2 (Perform Lucene Index) failed in CRON run