<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Sorry, the download link has been removed. Christine, you will
receive a new download link in your own email.</p>
<p><br>
</p>
<p>Mang<br>
</p>
<br>
<div class="moz-cite-prefix">On 9/15/2016 12:14 PM, Mang Sun wrote:<br>
</div>
<blockquote cite="mid:811d04fe-6c7c-1976-4df3-fa15986f66f8@rice.edu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<p>Christine,</p>
<p>I completely missed your email but I find it and read it now.
Sorry for my negligence. Actually, yesterday, Jason Loeffler
contacted me offline to show his willingness to take a look at
the problem.</p>
<p>I shared with him the download link for our 1.4.2 database dump
and 1.5.1 database dump. Below is the download link :</p>
<p><a moz-do-not-send="true" class="moz-txt-link-freetext"
href="https://rice.box.com/s/9y8zqbygx23tqbm5wpl3d47ke34p4pma">https://rice.box.com/s/9y8zqbygx23tqbm5wpl3d47ke34p4pma</a>
<br>
</p>
<p><br>
</p>
<p>Thank you very much.</p>
<p>Mang<br>
</p>
<p><br>
</p>
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 9/15/2016 11:47 AM, Christine Di
Bella wrote:<br>
</div>
<blockquote
cite="mid:CY1PR0801MB084261728DD54D78B02394B3F1F00@CY1PR0801MB0842.namprd08.prod.outlook.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New",serif;
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma",sans-serif;
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma",sans-serif;
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle25
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle26
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Mang,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">After
your report on Monday that you didn’t see a change over
the weekend, I requested the folks at LYRASIS Digital
Technology Services that have been helping with these
kinds of inquiries to look into this with you and work
with you directly to try to get a resolution. I copied you
on that request and they got in touch with you, but as of
yesterday had not yet heard back from you. It’s not clear
from this thread yesterday and today whether you are aware
that’s the mechanism we’ve been pursuing to help you.
Because your situation seems like it may be due to some
local factors in your data or your migration, we wanted to
get more details and troubleshoot it directly. Would you
please let us know if you’ve seen these messages?<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">(And
thanks to everyone who’s been pitching in and sharing
their knowledge on the move from 1.4.2 to 1.5.1!)<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Christine<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Mang Sun<br>
<b>Sent:</b> Thursday, September 15, 2016 11:54 AM<br>
<b>To:</b> Archivesspace Users Group <a
moz-do-not-send="true" class="moz-txt-link-rfc2396E"
href="mailto:archivesspace_users_group@lyralists.lyrasis.org"><archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP -
No record found after test migration from v1.4.2 to
1.5.0<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p>Patrick,<o:p></o:p></p>
<p>I did test with 1.5.0 and 1.5.1 and ran into the same
problem.<o:p></o:p></p>
<p><o:p> </o:p></p>
<p>Mang<o:p></o:p></p>
<p><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 9/15/2016 10:39 AM, Galligan,
Patrick wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rachel,</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">It
was a known issue that 1.5.0 had indexing problems.
These have generally been fixed in 1.5.1. I’d suggest
using that version for your test migration.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Patrick
Galligan</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rockefeller
Archive Center</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Assistant
Digital Archivist</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">914-366-6386</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Maderik, Rachel A<br>
<b>Sent:</b> Thursday, September 15, 2016 11:30 AM<br>
<b>To:</b> 'Archivesspace Users Group'<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP
- No record found after test migration from v1.4.2
to 1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">I
was able to replicate this problem using Rice’s data. I
set up a fresh instance running 1.4.2 using their
database dump from that version, and it built the index
fine (took 10-15 minutes). When I migrated it to 1.5,
the indexer seems to get hung up after indexing the top
containers (which finished about 2 hrs ago). Below is an
error message that appears right after it finishes the
top containers (and continues to appear repeatedly in
the log file). It seems to be related to indexing
archival objects, though I can’t say I understand
anything more than that:</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~
Indexed 12884 top_container records in 600 seconds ~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Sep
15, 2016 9:33:57 AM
org.eclipse.jetty.server.handler.ContextHandler$Context
log</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">INFO:
DEBUG: resetting rack response due exception</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Failure
in periodic indexer worker thread: <!DOCTYPE HTML
PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "<a
moz-do-not-send="true"
href="http://www.w3.org/TR/html4/loose.dtd">http://www.w3.org/TR/html4/loose.dtd</a>"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">…</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><body></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="summary"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<h1>Internal Server Error
<span>(500)</span></h1></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<table class="meta"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<th>Request Method:</th></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<td>GET</td></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<th>Request <a moz-do-not-send="true"
href="URL:%3c/th">URL:</th</a>></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<td><a moz-do-not-send="true"
href="http:////localhost:8089/repositories/2/archival_objects?id_set=1%2C2%2C3%2C4%2C5%2C6%2C7%2C8%2C9%2C10%2C11%2C12%2C13%2C14%2C15%2C16%2C17%2C18%2C19%2C20%2C21%2C22%2C23%2C24%2C25&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object">http://localhost:8089/repositories/2/archival_objects?id_set=1%2C2%2C3%2C4%2C5%2C6%2C7%2C8%2C9%2C10%2C11%2C12%2C13%2C14%2C15%2C16%2C17%2C18%2C19%2C20%2C21%2C22%2C23%2C24%2C25&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object</a></td></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</table></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="info"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<p>(NoMethodError) undefined method
`related_records' for nil:NilClass</p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="explanation"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
You're seeing this error because you use
<code>JRuby::Rack::ErrorApp::ShowStatus</code>.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"></body></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rachel
Maderik</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Systems
and Technology Librarian</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">501D
Preston Library</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Virginia
Military Institute</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Lexington,
VA 24450</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">540-464-7572</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Mang Sun<br>
<b>Sent:</b> Wednesday, September 14, 2016 3:00 PM<br>
<b>To:</b> Archivesspace Users Group <<a
moz-do-not-send="true"
href="mailto:archivesspace_users_group@lyralists.lyrasis.org">archivesspace_users_group@lyralists.lyrasis.org</a>><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP
- No record found after test migration from v1.4.2
to 1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p>Christine and other AS community members who have
successfully migrated AS 1.4.2 to AS 1.5.x,<br>
<br>
We are trying to draw attention and seek help from AS
development team and other community members who have
successfully migrated AS 1.4.2 to AS 1.5.x. If necessary,
we are willing to provide our MySQL dump file for you to
test.<br>
<br>
Test migration from AS 1.4.2 to AS1.5.x really drives us
mad. Though we don't quite see any (out of mem) error in
the log, we still blindly pump up heap size (Xmx )to 6GB,
stack size set o 3MB and rerun rebuild index or the
complete migration steps, the problem is still there -
Solr seemingly very silently stops writing or committing
index files when the number of docs in Solr reaches to
about 15,xxx as opposed to 500,xxx indexed docs found in
our 1.4.2 instance, though thereafter we still can see the
" end_commit_flush" message pop up in the log from time
to time .Our test box environments are <o:p> </o:p></p>
<p>1. Redhat 6.8 ,JAVA build 1.7.0_67 . MySQL 5.1.7 and 8GB
memory<br>
2.. Redhat 7.2 Virtual Machine,NYSQL 5.5.45, java
1.80_65,and 4GB.<br>
We also can confirm database side migration is largely
done with new tables and fields added, existing records
converted and top container records added. The problem is
sticking to rebuilding the whole index - Solr stops
writing and committing index prematurely after the
number of docs grows to a small number(12xxx-15xxx)
though commit flush can still be seen thereafter .<br>
<br>
Now we have exhausted ideas and means in figuring out why
this "no record found " problem that seemingly only
happens to us.<br>
<br>
Other experiment we did is export EAD file of one resource
record from our production and load it into a 1.4.2 test
instance and then upgrade this test instance to 1.5.x.
this time the resource record can be indexed and
appear(some issue with the Name ) in the test 1.5.x
instance.<br>
<br>
I think there is some fundamental but very sneaky issue
with 1.5.x indexing (rebuild index). The challenge is that
no explicit error message that could be easily found in
the log that can give us some hint and therefore this is a
nightmare given the long waiting time before you can
confirm a successful indexing or not. May be a
standalone tool allowing user to manually rebuild index
could be very helpful and straightforward, and less
arcane.<br>
<br>
As mentioned earlier, records have been converted and
migrated but not indexed, what else we tried is use direct
route path (can be inferred from our production) to pull
records out and update them by toggling through
Suppress/Unsuppress or Publisesh/Unpublished , then we can
get those updated records indexed. in the following
diagram, we can see 3 resources, 2 agent records and some
other record types highlighted in yellow appear in the
types field, as opposed to the types (not highlighted)
originally indexed and generated by the migration process.
Also in the same diagram, the number of indexed docs is
too small (we can see about half million docs in our 1.4.2
production instance).Also we found a side issue with
agent record, no matter what you set for Publish, Solr
only sees it unpublished.But At least, this experiment
can confirm there is not obvious problem with dynamic
indexing. <br>
<br>
If AS developers or other AS users want to reproduce the
issue or give a try for a solution, we can provide our
v1.4.2 database dump or the v1.5.x database dump.<o:p></o:p></p>
<p>Thank you very much. <o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Mang Sun<o:p></o:p></p>
<p>Rice U.<o:p></o:p></p>
<p><img moz-do-not-send="true" id="_x0000_i1025"
src="imap://ms20@imap.mail.rice.edu:993/fetch%3EUID%3E/Sent%3E3792?header=quotebody/;section=2.2?part=1.2.2"
height="672" border="0" width="683"><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On 9/9/2016 11:55 AM, Christine Di
Bella wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Mang,</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">How
long ago did you start the reindex and how big is your
database? The v1.5.1 upgrade improved indexing speed,
especially for large databases, but the indexing does
still take some time. People on this list can probably
give you a sense of how long it took them for
different sizes of databases. It’s probably been most
common to run it overnight or over a weekend, when use
of the system is low.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">(Some
people were large databases were experiencing problems
with indexing taking an excessive amount of time or
not completing at all, which was one of the reasons
for the quick release of v1.5.1.)</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Christine</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">Christine
Di Bella</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">Community
Outreach Manager</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D"><a
moz-do-not-send="true"
href="mailto:christine.dibella@lyrasis.org"><span
style="color:#0563C1">christine.dibella@lyrasis.org</span></a></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">800.999.8558
x2905</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">678-235-2905</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">cdibella13
(Skype) </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif"><img
moz-do-not-send="true" id="Picture_x0020_1"
src="imap://ms20@imap.mail.rice.edu:993/fetch%3EUID%3E/Sent%3E3792?header=quotebody/;section=2.3?part=1.2.3"
alt="cid:image003.png@01CE734E.FD759D30" height="55"
border="0" width="199"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Mang Sun<br>
<b>Sent:</b> Friday, September 9, 2016 12:31 PM<br>
<b>To:</b> Archivesspace Users Group <a
moz-do-not-send="true"
href="mailto:archivesspace_users_group@lyralists.lyrasis.org">
<archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] No
record found after test migration from v1.4.2 to
1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
I even didn't copy the data folder of the v1.4.2 into
v.1.5.0. but even after I follow the recommended way by
copying the data folder and removing those two
subfolders mentioned by Joshua the problem is still
there.Peeping into Solr schema, I found field "types"
only have the following four types but not resource and
digital_object,subject and agent . The missing types may
explain why we find no records under every record type
tab. Puzzled~ Mang<br>
<br>
<br>
<o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt"> </span><span
style="font-size:9.0pt">12608</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22top_container%22"><span
style="text-decoration:none">top_container</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt"> </span><span
style="font-size:9.0pt">1,169</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22tree_view%22"><span
style="text-decoration:none">tree_view</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt"> </span><span
style="font-size:9.0pt">75</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22archival_object%22"><span
style="text-decoration:none">archival_object</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt"> </span><span
style="font-size:9.0pt">1</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22repository%22"><span
style="text-decoration:none">repository</span></a></span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On 9/9/2016 8:52 AM, Sally
Vermaaten wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">Hi Mang Sun, <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I agree with Joshua - this
sounds to me like an indexing problem to me. In
the course of upgrading to 1.5.0 did you delete
the data/solr_index/index directory and all files
in the data/indexer_state directory? This is one
of the recommended steps in the <a
moz-do-not-send="true"
href="https://github.com/archivesspace/archivesspace/blob/master/UPGRADING_1.5.0.md"
target="_blank">instructions for upgrading to
v.1.5.0</a>. We accidentally missed this step
once in a running a test upgrade and definitely
experienced some indexing problems though I don't
remember the details. As it was a test upgrade
(and it sounds like that's what you're doing as
well) we just started afresh and ran the upgrade
process over again. When we included that step,
things were fine. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">On a related note - there's a <a
moz-do-not-send="true"
href="https://github.com/archivesspace/archivesspace/releases/tag/v1.5.1"
target="_blank">1.5.1 release of ArchivesSpace</a> that
includes several fixes for bugs that were found in
the weeks after 1.5.0 was released. If are looking
to update to a 1.5.x version, you may want to
consider upgrading to 1.5.1 one rather than
1.5.0. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Good luck,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Sally <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On Fri, Sep 9, 2016 at 9:50 AM,
Joshua D. Shaw <<a moz-do-not-send="true"
href="mailto:Joshua.D.Shaw@dartmouth.edu"
target="_blank">Joshua.D.Shaw@dartmouth.edu</a>>
wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid
#CCCCCC 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal">I believe the suggestion for
migration to 1.5+ was to delete the existing
index and indexer states which will trigger a
complete reindex.<br>
<br>
Best,<br>
Joshua<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
<br>
<br>
<br>
On Sep 9, 2016, at 8:20 AM, "Mang Sun" <<a
moz-do-not-send="true"
href="mailto:mang.sun@rice.edu">mang.sun@rice.edu</a>>
wrote:<br>
<br>
> i<br>
><br>
> After we migrate our v.1.4.2 test
instance to v1.5.0, we can't find any
records but just no record in Staff
interface and public interface.<br>
><br>
> But if we open a migrated record
(saycollection record) using the direct
route path to that record and resave it,
this record but only this one starts to show
up under Collections when browsing
collections. This problem does not come with
any new record created within v.1.5.0. Any
suggestion?<br>
><br>
> Thank you.<br>
><br>
> Mang Sun<br>
><br>
> Rice U.<br>
><br>
><br>
><br>
>
_______________________________________________<br>
> Archivesspace_Users_Group mailing list<br>
> <a moz-do-not-send="true"
href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
> <a moz-do-not-send="true"
href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group"
target="_blank">
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><br>
_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a moz-do-not-send="true"
href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
<a moz-do-not-send="true"
href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group"
target="_blank">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Sally Vermaaten<br>
Project Manager, Archival Systems<br>
New York University Libraries<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">1-212-992-6259<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Archivesspace_Users_Group mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a>
</pre>
</blockquote>
<br>
</blockquote>
<br>
</body>
</html>