Koha-clms/Koha/BackgroundJob
Nick Clemens aba2453ad6
Bug 32594: Add a dedicated Elasticsearch biblio indexing background queue
Currently we generate large numebrs if single record reindex for circulation and other
actions. It can take a long time to process these as we need to load the ES settings for each.

This patch updates the Elasticsearch background jobs to throw records into a new queue
that can be processed by it's own worker and adds a dedicated worker that batches the jobs
every 1 second.

To test:
1 - Apply patches, set SearchEngine system preference to 'Elasticsearch'
2 - perl misc/search_tools/es_indexer_daemon.pl
3 - Leave the running in terminal and perform actions in staff interface:
    - Checking out a bib
    - Returning a bib
    - Editing a single bib
    - Editing a single item
    - Batch editing bibs
    - Batch editing items
4 - Confirm for each action that records are updated in search/search results
5 - Stop the script
6 - set SearchEngine system preference to 'Zebra'
7 - perl misc/search_tools/es_indexer_daemon.pl
8 - Script dies as Elasticsearch not enabled

Signed-off-by: David Nind <david@davidnind.com>
Signed-off-by: Emily Lamancusa <emily.lamancusa@montgomerycountymd.gov>

Bug 32594: (follow-up) Adjust logging per bug 32612

JD amended patch: tidy! There were tabs here...

Signed-off-by: Jonathan Druart <jonathan.druart@bugs.koha-community.org>
Signed-off-by: Tomas Cohen Arazi <tomascohen@theke.io>
2023-02-24 17:52:20 -03:00
..
BatchCancelHold.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchDeleteAuthority.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchDeleteBiblio.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchDeleteItem.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchUpdateAuthority.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchUpdateBiblio.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
BatchUpdateBiblioHoldsQueue.pm Bug 31351: (QA follow-up) Use $self->json in Background modules 2022-09-07 13:59:03 -07:00
BatchUpdateItem.pm Bug 32019: Add option to mark items returned via batch modification 2023-02-20 09:54:20 -03:00
CreateEHoldingsFromBiblios.pm Bug 32779: ERM - Fix import from list 2023-02-02 11:59:26 -03:00
MARCImportCommitBatch.pm Bug 15869: Change framework on overlay 2023-02-07 10:32:22 -03:00
MARCImportRevertBatch.pm Bug 32394: Restore long tasks queue 2022-12-14 14:32:27 -03:00
StageMARCForImport.pm Bug 32394: (follow-up) Add param for Koha::BackgroundJob::StageMARCForImport->enqueue 2022-12-16 09:00:45 -03:00
UpdateElasticIndex.pm Bug 32594: Add a dedicated Elasticsearch biblio indexing background queue 2023-02-24 17:52:20 -03:00