<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
<p>Not knowing which version you are using I cannot be absolutely
sure, but for versions released in recent years deleting the <i>indexer_state</i>
and <i>indexer_pui_state</i> subfolders inside the <i>data</i>
directory will not cause downtime or missing records for PUI users
(nor staff.)<br>
</p>
<p><br>
</p>
<p>If you are re-indexing because you've made changes to config.rb
it will require an application restart to put the change into
effect. Delete those state folders immediately after running the
restart command, and the indexer will begin refreshing records in
batches once it is back up and running. If the changes you've made
affect how certain records are indexed (e.g. inherited_fields for
archival_objects) then there will be some inconsistency until
every record has been overwritten in Solr's memory by the
ArchivesSpace indexer. But it is unlikely any end user will
notice.<br>
</p>
<p><br>
</p>
<p>If you do decide to block user access during the re-index, you
should note it is possible for the indexer to go into a loop when
doing a full re-index, and never finish. But only if you've got
lots of complex records in a single repository. That is because
the last step in re-indexing each repository is to send an
instruction to Solr to commit all changes in memory to disk.
Depending on the speed of whatever storage layer your system uses
that can take longer than 5 minutes, in which case the indexer
will start again from scratch. We've set
AppConfig[:indexer_solr_timeout_seconds] to 1800 to give it half
an hour, to avoid this.<br>
</p>
<p><br>
</p>
<p>Andrew.</p>
<p><br>
</p>
<p><br>
</p>
<div class="moz-cite-prefix">On 27/04/2020 21:00, Joshua D. Shaw
wrote:<br>
</div>
<blockquote type="cite" cite="mid:BL0PR03MB4292DE2E39C40857BC71CA67ABAF0@BL0PR03MB4292.namprd03.prod.outlook.com">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Hey Blake-</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
I usually empty the indexer states directories and the
data/solr_index/index directory when I do a fresh index run, but
this is the first time I've had to do a re-index while the PUI
is live. Staff I can give a heads up and they typically don't
work weekends anyway. But students & faculty are a different
ballgame!<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Do you inform users of the PUI that its down? Or do your stats
indicate that the use on weekends is low enough not to warrant
that step? I'm loathe to completely take down an online resource
- especially now when Dartmouth is in the middle of its spring
quarter.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
I guess I'll try a couple of different approaches on our dev
site and see which turns out to be best. If none of those work,
postponing the update till early June is probably the best
option for us (when classes and finals end).<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Thanks!</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Joshua<br>
</div>
<div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b>
<a class="moz-txt-link-abbreviated" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
<a class="moz-txt-link-rfc2396E" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org"><archivesspace_users_group-bounces@lyralists.lyrasis.org></a>
on behalf of Blake Carver <a class="moz-txt-link-rfc2396E" href="mailto:blake.carver@lyrasis.org"><blake.carver@lyrasis.org></a><br>
<b>Sent:</b> Monday, April 27, 2020 2:47 PM<br>
<b>To:</b> Archivesspace Users Group
<a class="moz-txt-link-rfc2396E" href="mailto:archivesspace_users_group@lyralists.lyrasis.org"><archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] Best Way to
Reindex with PUI Live?</font>
<div> </div>
</div>
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif;
background-color:rgb(255,255,255);
display:inline!important">Theoretically another way to do
it is to update system_mtime on everything as well.</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgist.github.com%2FBlake-%2F538c8d7cc7ade39efc372a3e3e190873&data=02%7C01%7Cjoshua.d.shaw%40dartmouth.edu%7C36c6220876864dc281b208d7eadb760e%7C995b093648d640e5a31ebf689ec9446f%7C0%7C0%7C637236100609796629&sdata=kvx17mtZbxsEiMT8nQPVJkLvY9sMvWAGe1bnTNcYqEw%3D&reserved=0" originalsrc="https://gist.github.com/Blake-/538c8d7cc7ade39efc372a3e3e190873" shash="HYvcgUp8yL8Qj8p/KMHdbLiP9WXx/eV9EzjJDWZveouJCcOVH6AtEJLV6nbcjc5toH1nL+3Phek9W3vRN+9DnYtfRzMQf3xPHQD9oYjx/SzLhZt7zjZDQ+x+ufSUYDd7TmOgbuRHc+I06u95ZffWDHV/lgRHIwoX/IcECux8pQ8=" moz-do-not-send="true">https://gist.github.com/Blake-/538c8d7cc7ade39efc372a3e3e190873</a><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Someplace in the official solr docs they say the best way to
do it is to wipe everything. I've found it best to empty
/data/.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
We'll usually do the full reindexes on a Friday night, most
sites will have finished up by Monday.</div>
<div>
<div id="x_Signature">
<div id="x_divtagdefaultwrapper" dir="ltr" style="color:rgb(0,0,0);
background-color:rgb(255,255,255)">
</div>
</div>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b>
<a class="moz-txt-link-abbreviated" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
<a class="moz-txt-link-rfc2396E" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org"><archivesspace_users_group-bounces@lyralists.lyrasis.org></a>
on behalf of Joshua D. Shaw
<a class="moz-txt-link-rfc2396E" href="mailto:Joshua.D.Shaw@dartmouth.edu"><Joshua.D.Shaw@dartmouth.edu></a><br>
<b>Sent:</b> Monday, April 27, 2020 1:01 PM<br>
<b>To:</b> Archivesspace Users Group
<a class="moz-txt-link-rfc2396E" href="mailto:archivesspace_users_group@lyralists.lyrasis.org"><archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> [Archivesspace_Users_Group] Best Way to
Reindex with PUI Live?</font>
<div> </div>
</div>
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Hi all-</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Just wondering what people have been doing when they need
to do a total reindex and they have a live PUI? Our
reindex takes about 4-6 hours typically and I'm looking to
avoid 4-6 hours of PUI downtime if at all possible.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
I'm planning to just wipe the indexer_state files and
leave the index itself in place while the re-index occurs,
but I'm wondering if there are better/alternate methods?
Theoretically the PUI should still be functional while the
reindex takes place if only the indexer_state files are
wiped.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Thanks!</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Joshua<br>
</div>
<div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_x_Signature">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
___________________</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Joshua Shaw (he, him)<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Technology Coordinator</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Rauner Special Collections Library & Digital
Library Technologies Group<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
Dartmouth College<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;
font-size:12pt; color:rgb(0,0,0)">
603.646.0405<br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Archivesspace_Users_Group mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a>
<a class="moz-txt-link-freetext" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a>
</pre>
</blockquote>
</body>
</html>