Purging Scheduler Job Logs

šŸ’¬ General Discussion
1

Hi there,

Does anyone have an idea of how to purge/clean the job logs in the scheduler?

Clean Jobs Queue did triggered this morning but the job logs in the other schedulers are still there.

Any help would be appreciatedā€¦

Calvin

2

go into the database,

The Clean Jobs Queue clears any jobs that may have gotten stuck in the queue it doesnā€™t clear the job logs.

run the query

update schedulers_times set deleted = 1;

This will remove all the job logs.

Thanks
Lewis

1 Like
3

Hi Lewis,

Thatā€™s weird, I donā€™t have such a table in my database?

There is a link reference to this issue and yet I couldnā€™t find the mentioned function in Scheduler.php.

http://forums.sugarcrm.com/f3/schedulers_times-table-getting-pretty-big-9045/

Calvin

4

Appologies,

The table is job_queue.

update job_queue set deleted = 1 where status = ā€˜doneā€™;

Thanks
Lewis

5

Hi Lewis,

When I select the job_queue table, it shows an empty result set. (Empty table)

Attached is a snapshot from MySQL.

The other snapshot is from the Run Email Reminder Notification.

Thanks
Calvin

6

Hi Lewis,

Okay, I tried it with my actual CRM server and it works. By setting deleted = 1, you wonā€™t see the job log in SuiteCRM but the records are still in MySQL table. Would manually deleting these records from the table cause any fatal results?

Calvin

7

Hi Calvin and anyone who could help me.,

I have the same problem here. Did you finally manually deleted records from the job_queue table in phpmyadmin? did you have any problems if you did it?

Thank you very very much.

Regards.

8

Got exactly the same question.

In under 1 week the table got 17k of lineā€¦

Iā€™ve dropped everything with : DELETE FROM job_queue

Hope someone can help us ā€¦

9

I donā€™t recommend a simple ā€œDELETEā€ like that, itā€™s better to use that clause ā€œWHERE status = ā€˜doneā€™;ā€ or even add a clause to delete just stuff older than a week, for example.

If your problem is that the lines are still getting added at a fast pace, then check the content of the lines to see exactly which job is creating the lines, so you can examine it.

10

I can maybe do a view that execute every week to delete log that are older than 1 week, maybe ā€¦

11

Yes, you can.

But if youā€™re really getting 17k rows added every week, you should try to stop the issue at its source. Otherwise your system will be doing quite a lot of useless workā€¦

12

That was because every minute those 4 schedulers made a line in the log :

  • Process Workflow Tasks
  • Run Report Generation Scheduled Tasks
  • Check Inbound Mailboxes
  • Run Email Reminder Notifications

Iā€™ve desactivate some, Iā€™ve made to every 6 hours some otherā€¦

13

Note that the default Scheduler jobs configuration should work well, and is not a problem for your server. Itā€™s ok to have jobs running every minute (theyā€™re not really doing anything complicated most of the time, just checking that they have no work to do and exiting). Itā€™s also ok to have lots of stuff in the logs.

What is not normal, and what you should be focusing on, is getting a huge number of stuff on the job queue. I am guessing you have a rogue Wrokflow process or something causing problems. So I repeat my advice, let it fill the job_queue with stuff for a while, and then diagnose the content of the rows in job_queue table. Then you will know what your problem is.