[Archivesspace_Users_Group] v2.1.2 indexing woes

[Noah Huffman]

Hi all,

We upgraded to version 2.1.2 last week and have since been experiencing some fairly severe indexing issues.  For example, when creating or editing new records it often takes 20-30 minutes for those changes to index and become visible in the staff UI. Also, deleted records still persist in searches and browses, sometimes indefinitely, even though the records themselves have been deleted from the underlying database.  The SOLR admin site also reports that the indexer is consuming almost all of the available memory (12GB RAM).

I've read all the previous posts about indexing issues and we don't seem to have any orphaned records or other previously reported issues that might cause this.

The log file does indicate some problem, but I can't interpret what's going on.

Here's a gist with a snapshot of the log file showing the error that is repeating over and over, usually followed by thousands of rows that indicate some kind of delete action. I'm definitely not deleting this many documents...

https://gist.github.com/noahgh221/2a274def65c858662c64e4cd2c5b0de4

My hunch is that ASpace is stuck in some sort of loop trying to delete (unsuccessfully) the same set of records over and over.  We've shut the application down and triggered a re-index, but the problem still persists. The initial re-index completes without any issues but then the periodic indexer starts throwing these errors and reporting the deletions.

Thanks for any advice,
-Noah

================
Noah Huffman
Archivist for Metadata, Systems, and Digital Records
David M. Rubenstein Rare Book & Manuscript Library
Duke University | 919-660-5982
http://library.duke.edu/rubenstein/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20171017/2d3953fc/attachment.html>