[Archivesspace_Users_Group] indexing problem?

[Wisner, Melissa]

Hello,

Our AS users have reported they were unable to search/retrieve data they just added to ArchivesSpace. We assume this is a problem with the index, if after even several hours a record cannot be retrieved by a barcode.

Scenario 1: over 2 -3 days a newly added record could not be retrieved by barcode. When staff would try and create a new record with the same barcode, AS would tell them barcode already exists.  After the 3rd day it could be retrieved through a barcode search.

Scenario 2: same report came in Thursday morning. Newly added record could not be retrieved by barcode. Today it still can't. But I can retrieve it by the top container number highlighted below in yellow.

This behavior is very odd. The reported issue from Thursday morning is shown in this snippet from the log files. There appears to be an error message at the end of this regarding End of File/EOF. I do not know if that is the problem, or what that error means.

Additionally, the config file for our production AS does not include certain entries that are shown here as defaults: https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb

Specifically- AppConfig[:solr_indexing_frequency_seconds] = 30 and  AppConfig[:indexer_solr_timeout_seconds] = 300

If these are not defined, does the default still apply? A default of 30 seconds seems reasonable, and if it is a default even if not defined, why would we see such delays with our index?

This is a major problem, as staff cannot do their work when they can't find the records they've been working on.


Started GET "/resolve/edit?uri=%2Frepositories%2F12%2Ftop_containers%2F224618" for 130.132.143.66 at 2015-08-06 11:18:07 -0400
Processing by ResolverController#resolve_edit as HTML
  Parameters: {"uri"=>"/repositories/12/top_containers/224618"}
Redirected to http://aspace.library.yale.edu/plugins/top_containers/224618/edit
Completed 302 Found in 176.0ms
Started GET "/plugins/top_containers/224618/edit" for 130.132.143.66 at 2015-08-06 11:18:07 -0400
Processing by TopContainersController#edit as HTML
  Parameters: {"id"=>"224618"}
Started POST "/update_monitor/poll" for 130.132.143.66 at 2015-08-06 11:18:09 -0400
Processing by UpdateMonitorController#poll as JSON
  Parameters: {"lock_version"=>"0", "uri"=>"/repositories/12/archival_objects/2104298"}
Completed 200 OK in 204.0ms (Views: 2.0ms)
  Rendered shared/_breadcrumb.html.erb (26.0ms)
  Rendered shared/_sidebar.html.erb (3.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (6.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (29.0ms)
  Rendered shared/_flash_messages.html.erb (0.0ms)
  Rendered shared/_form_messages.html.erb (4.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (11.0ms)
  Rendered container_locations/_template.html.erb (0.0ms)
  Rendered shared/_subrecord_form.html.erb (15.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (57.0ms)
  Rendered shared/_sidebar.html.erb (5.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (13.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (42.0ms)
  Rendered shared/_flash_messages.html.erb (0.0ms)
  Rendered shared/_form_messages.html.erb (7.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (23.0ms)
  Rendered container_locations/_template.html.erb (1.0ms)
  Rendered shared/_subrecord_form.html.erb (16.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (101.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (25.0ms)
  Rendered container_locations/_template.html.erb (1.0ms)
  Rendered shared/_subrecord_form.html.erb (14.0ms)
  Rendered locations/_linker.html.erb (12.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/edit.html.erb within layouts/application (523.0ms)
  Rendered /archivesspace/plugins/container_management/frontend/views/layout_head.html.erb (7.0ms)
  Rendered /archivesspace/plugins/oclc/frontend/views/layout_head.html.erb (1.0ms)
  Rendered /archivesspace/plugins/yale_accessions/frontend/views/layout_head.html.erb (4.0ms)
  Rendered shared/_browser_support.html.erb (0.0ms)
  Rendered shared/_header_user.html.erb (71.0ms)
  Rendered shared/_header_global.html.erb (87.0ms)
  Rendered site/_branding.html.erb (2.0ms)
  Rendered shared/_advanced_search.html.erb (404.0ms)
  Rendered shared/_header_repository.html.erb (497.0ms)
  Rendered site/_footer.html.erb (0.0ms)
  Rendered shared/_templates.html.erb (17.0ms)
Completed 200 OK in 3774.0ms (Views: 1299.0ms)
Aug 06, 2015 11:18:14 AM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp= path=/select params={facet=true&pf=four_part_id^4&sort=&start=0&q=ms+*&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&facet.field=primary_type&facet.field=creators&facet.field=subjects&wt=json&fq=repository:"/repositories/12"+OR+repository:global&fq=types:("resource")&fq=-exclude_by_default:true&rows=10&defType=edismax} hits=3381 status=0 QTime=41654
Completed 200 OK in 44280.0ms (Views: 370.0ms)
2015-08-06 11:18:17 -0400: Running index round
#<EOFError: End of file reached>

Melissa Wisner
Yale Library IT
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20150807/c3ccd063/attachment.html>