<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Lucida Console";
panose-1:2 11 6 9 4 5 4 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Thank you Chris, we’ll check this and confirm the other questions.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Melissa<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> archivesspace_users_group-bounces@lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org]
<b>On Behalf Of </b>Chris Fitzpatrick<br>
<b>Sent:</b> Monday, August 10, 2015 8:58 AM<br>
<b>To:</b> archivesspace_users_group@lyralists.lyrasis.org<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] indexing problem?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div id="divtagdefaultwrapper">
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">Hi Melissa,<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">It might be a little tricky for you all, since your Aspace has a lot of customizations and plugins installed that modify a lot of the core ( like top_containers and things
having to do with barcodes). <o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">But, to answer the question of configuration, yes the defaults are enabled by default. Your config.rb file can be empty, and the values found in
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_archivesspace_archivesspace_blob_master_common_config_config-2Ddefaults.rb&d=AwMF-g&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=hZ2NgbpBpYrVGDxkdkF51g3GQgQXAv3xnKDZbIHkbFs&m=TrFnsrdmFufBFCzQolHKFtUM9Dcgf9FDiY5KwXE4-n4&s=7ILoNJDQhtEZNtV2f-TAFi1EYe5f4-3QxidaL125OTs&e=" title="Cmd+Click or tap to follow the link">
config-defaults.r</a>b would be used. ASpace ships with a config.rb file that has the config-defaults.rb files commented out just to show what those defaults are. <o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">I've seen the EOF error happen on some random cases where the indexer has nothing to index. What's happening is it's reading a indexer state file that is empty, which it
is not expecting. I've found this to be usually be benign. But you can remove this pretty easily...
<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">To check this, see if there are any empty files in the indexer_state directory:<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">$ find data/indexer_state/ -type f -empty<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">You can delete those:
<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">$ find data/indexer_state/ -type f -empty -exec rm {} \;<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">When the indexer runs next, it will recreate that any files it needs to track the indexer state. If this keeps recurring, then we'll have to figure out why. <o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">Also, EOF can in some situations be sent for a HTTP request.<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"> First question is if you have the backend on a SSL connection, possibly with a self-signed cert?
<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">Also, do you have a proxy in front of the backend? <o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">You can try and install this to you plugins/local/indexer directory, restart aspace, and see where the EOF error is happening. <o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black">b,chris
<o:p></o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<div id="Signature">
<div name="divtagdefaultwrapper">
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">Chris Fitzpatrick | Developer, ArchivesSpace<br>
Skype: chrisfitzpat | Phone: 918.236.6048<br>
<a href="http://archivesspace.org/">http://archivesspace.org/</a><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt;background:white"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<div>
<div class="MsoNormal" align="center" style="text-align:center;background:white">
<span style="font-family:"Calibri",sans-serif;color:black">
<hr size="2" width="98%" align="center">
</span></div>
<div id="divRplyFwdMsg">
<p class="MsoNormal" style="background:white"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">
<a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a> <<a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>>
on behalf of Wisner, Melissa <<a href="mailto:melissa.wisner@yale.edu">melissa.wisner@yale.edu</a>><br>
<b>Sent:</b> Friday, August 7, 2015 4:48 PM<br>
<b>To:</b> <a href="mailto:archivesspace_users_group@lyralists.lyrasis.org">archivesspace_users_group@lyralists.lyrasis.org</a><br>
<b>Subject:</b> [Archivesspace_Users_Group] indexing problem?</span><span style="font-family:"Calibri",sans-serif;color:black">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Hello,<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Our AS users have reported they were unable to search/retrieve data they just added to ArchivesSpace. We assume this is a problem with the index, if after
even several hours a record cannot be retrieved by a barcode. <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Scenario 1:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> over 2 -3 days a newly added record could not be retrieved
by barcode. When staff would try and create a new record with the same barcode, AS would tell them barcode already exists. After the 3<sup>rd</sup> day it could be retrieved through a barcode search.<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Scenario 2:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> same report came in Thursday morning. Newly added record
could not be retrieved by barcode. Today it still can’t. But I can retrieve it by the top container number highlighted below in yellow.
<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">This behavior is very odd. The reported issue from Thursday morning is shown in this snippet from the log files. There appears to be an error message at
the end of this regarding End of File/EOF. I do not know if that is the problem, or what that error means.<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Additionally, the config file for our production AS does not include certain entries that are shown here as defaults:
</span><span style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_archivesspace_archivesspace_blob_master_common_config_config-2Ddefaults.rb&d=AwMF-g&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=hZ2NgbpBpYrVGDxkdkF51g3GQgQXAv3xnKDZbIHkbFs&m=TrFnsrdmFufBFCzQolHKFtUM9Dcgf9FDiY5KwXE4-n4&s=7ILoNJDQhtEZNtV2f-TAFi1EYe5f4-3QxidaL125OTs&e="><span style="color:#0563C1">https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb</span></a></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<p style="background:white"><span style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Specifically-</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0086B3">
</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0">AppConfig<span style="background:white">[</span>:solr_indexing_frequency_seconds<span style="background:white">]
</span>=<span style="background:white"> </span>30 and AppConfig<span style="background:white">[</span>:indexer_solr_timeout_seconds<span style="background:white">]
</span>=<span style="background:white"> </span>300</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#0070C0"> </span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">If these are not defined, does the default still apply? A default of 30 seconds seems reasonable, and if it is a default even if not defined, why would we
see such delays with our index?<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">This is a major problem, as staff cannot do their work when they can’t find the records they’ve been working on.
<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black">Started GET "/resolve/edit?uri=%2Frepositories%2F12%2Ftop_containers%2F<u><span style="background:yellow">224618</span></u>" for 130.132.143.66 at 2015-08-06
11:18:07 -0400<br>
Processing by ResolverController#resolve_edit as HTML<br>
Parameters: {"uri"=>"/repositories/12/top_containers/<u><span style="background:yellow">224618</span></u>"}<br>
Redirected to <a href="http://aspace.library.yale.edu/plugins/top_containers/224618/edit">
<span style="color:#0563C1">http://aspace.library.yale.edu/plugins/top_containers/<span style="background:yellow">224618</span>/edit</span></a><br>
Completed 302 Found in 176.0ms<br>
Started GET "/plugins/top_containers/<u><span style="background:yellow">224618</span></u>/edit" for 130.132.143.66 at 2015-08-06 11:18:07 -0400<br>
Processing by TopContainersController#edit as HTML<br>
Parameters: {"id"=>"<u><span style="background:yellow">224618</span></u>"}<br>
Started POST "/update_monitor/poll" for 130.132.143.66 at 2015-08-06 11:18:09 -0400<br>
Processing by UpdateMonitorController#poll as JSON<br>
Parameters: {"lock_version"=>"0", "uri"=>"/repositories/12/archival_objects/2104298"}<br>
Completed 200 OK in 204.0ms (Views: 2.0ms)<br>
Rendered shared/_breadcrumb.html.erb (26.0ms)<br>
Rendered shared/_sidebar.html.erb (3.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (6.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (29.0ms)<br>
Rendered shared/_flash_messages.html.erb (0.0ms)<br>
Rendered shared/_form_messages.html.erb (4.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (11.0ms)<br>
Rendered container_locations/_template.html.erb (0.0ms)<br>
Rendered shared/_subrecord_form.html.erb (15.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (57.0ms)<br>
Rendered shared/_sidebar.html.erb (5.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (13.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (42.0ms)<br>
Rendered shared/_flash_messages.html.erb (0.0ms)<br>
Rendered shared/_form_messages.html.erb (7.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (23.0ms)<br>
Rendered container_locations/_template.html.erb (1.0ms)<br>
Rendered shared/_subrecord_form.html.erb (16.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (101.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (25.0ms)<br>
Rendered container_locations/_template.html.erb (1.0ms)<br>
Rendered shared/_subrecord_form.html.erb (14.0ms)<br>
Rendered locations/_linker.html.erb (12.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/edit.html.erb within layouts/application (523.0ms)<br>
Rendered /archivesspace/plugins/container_management/frontend/views/layout_head.html.erb (7.0ms)<br>
Rendered /archivesspace/plugins/oclc/frontend/views/layout_head.html.erb (1.0ms)<br>
Rendered /archivesspace/plugins/yale_accessions/frontend/views/layout_head.html.erb (4.0ms)<br>
Rendered shared/_browser_support.html.erb (0.0ms)<br>
Rendered shared/_header_user.html.erb (71.0ms)<br>
Rendered shared/_header_global.html.erb (87.0ms)<br>
Rendered site/_branding.html.erb (2.0ms)<br>
Rendered shared/_advanced_search.html.erb (404.0ms)<br>
Rendered shared/_header_repository.html.erb (497.0ms)<br>
Rendered site/_footer.html.erb (0.0ms)<br>
Rendered shared/_templates.html.erb (17.0ms)<br>
<span style="background:red">Completed 200 OK in 3774.0ms (Views: 1299.0ms)<br>
Aug 06, 2015 11:18:14 AM org.apache.solr.core.SolrCore execute<br>
INFO: [collection1] webapp= path=/select params={facet=true&pf=four_part_id^4&sort=&start=0&q=ms+*&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&facet.field=primary_type&facet.field=creators&facet.field=subjects&wt=json&fq=repository:"/repositories/12"+OR+repository:global&fq=types:("resource")&fq=-exclude_by_default:true&rows=10&defType=edismax}
hits=3381 status=0 QTime=41654 <br>
Completed 200 OK in 44280.0ms (Views: 370.0ms)<br>
2015-08-06 11:18:17 -0400: Running index round<br>
#<EOFError: End of file reached></span></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Melissa Wisner<o:p></o:p></span></p>
<p style="background:white"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">Yale Library IT<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>