<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Christine,</p>
<p>I completely missed your email but I find it and read it now.
Sorry for my negligence. Actually, yesterday, Jason Loeffler
contacted me offline to show his willingness to take a look at the
problem.</p>
<p>I shared with him the download link for our 1.4.2 database dump
and 1.5.1 database dump. Below is the download link :</p>
<p><a class="moz-txt-link-freetext" href="https://rice.box.com/s/9y8zqbygx23tqbm5wpl3d47ke34p4pma">https://rice.box.com/s/9y8zqbygx23tqbm5wpl3d47ke34p4pma</a> <br>
</p>
<p><br>
</p>
<p>Thank you very much.</p>
<p>Mang<br>
</p>
<p><br>
</p>
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 9/15/2016 11:47 AM, Christine Di
Bella wrote:<br>
</div>
<blockquote
cite="mid:CY1PR0801MB084261728DD54D78B02394B3F1F00@CY1PR0801MB0842.namprd08.prod.outlook.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New",serif;
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma",sans-serif;
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma",sans-serif;
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle25
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle26
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Mang,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">After
your report on Monday that you didn’t see a change over the
weekend, I requested the folks at LYRASIS Digital Technology
Services that have been helping with these kinds of
inquiries to look into this with you and work with you
directly to try to get a resolution. I copied you on that
request and they got in touch with you, but as of yesterday
had not yet heard back from you. It’s not clear from this
thread yesterday and today whether you are aware that’s the
mechanism we’ve been pursuing to help you. Because your
situation seems like it may be due to some local factors in
your data or your migration, we wanted to get more details
and troubleshoot it directly. Would you please let us know
if you’ve seen these messages?<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">(And
thanks to everyone who’s been pitching in and sharing their
knowledge on the move from 1.4.2 to 1.5.1!)<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Christine<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a class="moz-txt-link-abbreviated" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a class="moz-txt-link-freetext" href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>] <b>On
Behalf Of
</b>Mang Sun<br>
<b>Sent:</b> Thursday, September 15, 2016 11:54 AM<br>
<b>To:</b> Archivesspace Users Group
<a class="moz-txt-link-rfc2396E" href="mailto:archivesspace_users_group@lyralists.lyrasis.org"><archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP -
No record found after test migration from v1.4.2 to
1.5.0<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p>Patrick,<o:p></o:p></p>
<p>I did test with 1.5.0 and 1.5.1 and ran into the same
problem.<o:p></o:p></p>
<p><o:p> </o:p></p>
<p>Mang<o:p></o:p></p>
<p><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 9/15/2016 10:39 AM, Galligan, Patrick
wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rachel,</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">It
was a known issue that 1.5.0 had indexing problems. These
have generally been fixed in 1.5.1. I’d suggest using that
version for your test migration.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Patrick
Galligan</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rockefeller
Archive Center</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Assistant
Digital Archivist</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">914-366-6386</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Maderik, Rachel A<br>
<b>Sent:</b> Thursday, September 15, 2016 11:30 AM<br>
<b>To:</b> 'Archivesspace Users Group'<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP -
No record found after test migration from v1.4.2 to
1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">I
was able to replicate this problem using Rice’s data. I
set up a fresh instance running 1.4.2 using their database
dump from that version, and it built the index fine (took
10-15 minutes). When I migrated it to 1.5, the indexer
seems to get hung up after indexing the top containers
(which finished about 2 hrs ago). Below is an error
message that appears right after it finishes the top
containers (and continues to appear repeatedly in the log
file). It seems to be related to indexing archival
objects, though I can’t say I understand anything more
than that:</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~
Indexed 12884 top_container records in 600 seconds ~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Sep
15, 2016 9:33:57 AM
org.eclipse.jetty.server.handler.ContextHandler$Context
log</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">INFO:
DEBUG: resetting rack response due exception</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Failure
in periodic indexer worker thread: <!DOCTYPE HTML
PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "<a
moz-do-not-send="true"
href="http://www.w3.org/TR/html4/loose.dtd">http://www.w3.org/TR/html4/loose.dtd</a>"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">…</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><body></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="summary"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<h1>Internal Server Error
<span>(500)</span></h1></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<table class="meta"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<th>Request Method:</th></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<td>GET</td></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<th>Request
<a moz-do-not-send="true" href="URL:%3c/th">URL:</th</a>></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<td><a moz-do-not-send="true"
href="http:////localhost:8089/repositories/2/archival_objects?id_set=1%2C2%2C3%2C4%2C5%2C6%2C7%2C8%2C9%2C10%2C11%2C12%2C13%2C14%2C15%2C16%2C17%2C18%2C19%2C20%2C21%2C22%2C23%2C24%2C25&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object">http://localhost:8089/repositories/2/archival_objects?id_set=1%2C2%2C3%2C4%2C5%2C6%2C7%2C8%2C9%2C10%2C11%2C12%2C13%2C14%2C15%2C16%2C17%2C18%2C19%2C20%2C21%2C22%2C23%2C24%2C25&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object</a></td></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</tr></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</table></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="info"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<p>(NoMethodError) undefined method
`related_records' for nil:NilClass</p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<div id="explanation"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
<p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
You're seeing this error because you use
<code>JRuby::Rack::ErrorApp::ShowStatus</code>.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</p></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">
</div></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"></body></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Rachel
Maderik</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Systems
and Technology Librarian</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">501D
Preston Library</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Virginia
Military Institute</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Lexington,
VA 24450</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">540-464-7572</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Mang Sun<br>
<b>Sent:</b> Wednesday, September 14, 2016 3:00 PM<br>
<b>To:</b> Archivesspace Users Group <<a
moz-do-not-send="true"
href="mailto:archivesspace_users_group@lyralists.lyrasis.org">archivesspace_users_group@lyralists.lyrasis.org</a>><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] hELP -
No record found after test migration from v1.4.2 to
1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p>Christine and other AS community members who have
successfully migrated AS 1.4.2 to AS 1.5.x,<br>
<br>
We are trying to draw attention and seek help from AS
development team and other community members who have
successfully migrated AS 1.4.2 to AS 1.5.x. If necessary, we
are willing to provide our MySQL dump file for you to test.<br>
<br>
Test migration from AS 1.4.2 to AS1.5.x really drives us
mad. Though we don't quite see any (out of mem) error in the
log, we still blindly pump up heap size (Xmx )to 6GB, stack
size set o 3MB and rerun rebuild index or the complete
migration steps, the problem is still there - Solr seemingly
very silently stops writing or committing index files when
the number of docs in Solr reaches to about 15,xxx as
opposed to 500,xxx indexed docs found in our 1.4.2
instance, though thereafter we still can see the "
end_commit_flush" message pop up in the log from time to
time .Our test box environments are <o:p>
</o:p></p>
<p>1. Redhat 6.8 ,JAVA build 1.7.0_67 . MySQL 5.1.7 and 8GB
memory<br>
2.. Redhat 7.2 Virtual Machine,NYSQL 5.5.45, java
1.80_65,and 4GB.<br>
We also can confirm database side migration is largely
done with new tables and fields added, existing records
converted and top container records added. The problem is
sticking to rebuilding the whole index - Solr stops writing
and committing index prematurely after the number of docs
grows to a small number(12xxx-15xxx) though commit flush
can still be seen thereafter .<br>
<br>
Now we have exhausted ideas and means in figuring out why
this "no record found " problem that seemingly only happens
to us.<br>
<br>
Other experiment we did is export EAD file of one resource
record from our production and load it into a 1.4.2 test
instance and then upgrade this test instance to 1.5.x. this
time the resource record can be indexed and appear(some
issue with the Name ) in the test 1.5.x instance.<br>
<br>
I think there is some fundamental but very sneaky issue with
1.5.x indexing (rebuild index). The challenge is that no
explicit error message that could be easily found in the log
that can give us some hint and therefore this is a nightmare
given the long waiting time before you can confirm a
successful indexing or not. May be a standalone tool
allowing user to manually rebuild index could be very
helpful and straightforward, and less arcane.<br>
<br>
As mentioned earlier, records have been converted and
migrated but not indexed, what else we tried is use direct
route path (can be inferred from our production) to pull
records out and update them by toggling through
Suppress/Unsuppress or Publisesh/Unpublished , then we can
get those updated records indexed. in the following diagram,
we can see 3 resources, 2 agent records and some other
record types highlighted in yellow appear in the types
field, as opposed to the types (not highlighted) originally
indexed and generated by the migration process. Also in the
same diagram, the number of indexed docs is too small (we
can see about half million docs in our 1.4.2 production
instance).Also we found a side issue with agent record, no
matter what you set for Publish, Solr only sees it
unpublished.But At least, this experiment can confirm
there is not obvious problem with dynamic indexing.
<br>
<br>
If AS developers or other AS users want to reproduce the
issue or give a try for a solution, we can provide our
v1.4.2 database dump or the v1.5.x database dump.<o:p></o:p></p>
<p>Thank you very much. <o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Mang Sun<o:p></o:p></p>
<p>Rice U.<o:p></o:p></p>
<p><img id="_x0000_i1025"
src="cid:part9.F9F5309D.7F451248@rice.edu" height="672"
border="0" width="683"><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On 9/9/2016 11:55 AM, Christine Di
Bella wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Mang,</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">How
long ago did you start the reindex and how big is your
database? The v1.5.1 upgrade improved indexing speed,
especially for large databases, but the indexing does
still take some time. People on this list can probably
give you a sense of how long it took them for different
sizes of databases. It’s probably been most common to
run it overnight or over a weekend, when use of the
system is low.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">(Some
people were large databases were experiencing problems
with indexing taking an excessive amount of time or not
completing at all, which was one of the reasons for the
quick release of v1.5.1.)</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Christine</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">Christine
Di Bella</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">Community
Outreach Manager</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D"><a
moz-do-not-send="true"
href="mailto:christine.dibella@lyrasis.org"><span
style="color:#0563C1">christine.dibella@lyrasis.org</span></a></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">800.999.8558
x2905</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">678-235-2905</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D">cdibella13
(Skype) </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Arial",sans-serif"><img
id="Picture_x0020_1"
src="cid:part11.E8E47912.56735F68@rice.edu"
alt="cid:image003.png@01CE734E.FD759D30" height="55"
border="0" width="199"></span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">
<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
[<a moz-do-not-send="true"
href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
<b>On Behalf Of </b>Mang Sun<br>
<b>Sent:</b> Friday, September 9, 2016 12:31 PM<br>
<b>To:</b> Archivesspace Users Group <a
moz-do-not-send="true"
href="mailto:archivesspace_users_group@lyralists.lyrasis.org">
<archivesspace_users_group@lyralists.lyrasis.org></a><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] No
record found after test migration from v1.4.2 to
1.5.0</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
I even didn't copy the data folder of the v1.4.2 into
v.1.5.0. but even after I follow the recommended way by
copying the data folder and removing those two subfolders
mentioned by Joshua the problem is still there.Peeping
into Solr schema, I found field "types" only have the
following four types but not resource and
digital_object,subject and agent . The missing types may
explain why we find no records under every record type
tab. Puzzled~ Mang<br>
<br>
<br>
<o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt">
</span><span style="font-size:9.0pt">12608</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22top_container%22"><span
style="text-decoration:none">top_container</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt">
</span><span style="font-size:9.0pt">1,169</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22tree_view%22"><span
style="text-decoration:none">tree_view</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt">
</span><span style="font-size:9.0pt">75</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22archival_object%22"><span
style="text-decoration:none">archival_object</span></a></span><o:p></o:p></p>
<div style="border:none;border-top:solid #999999
1.0pt;padding:0in 0in 0in 0in">
<p
style="margin:0in;margin-bottom:.0001pt;text-indent:-.25in;line-height:14.4pt;background:#999999;float:left"><span
style="font-size:10.0pt;font-family:Symbol">·</span><span
style="font-size:7.0pt">
</span><span style="font-size:9.0pt">1</span><o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-left:.5in;text-indent:-.25in;line-height:14.4pt">
<span style="font-size:10.0pt;font-family:"Courier
New",serif">o</span><span style="font-size:7.0pt">
</span><span style="font-size:9.0pt"><a
moz-do-not-send="true"
href="http://archives-test.library.rice.edu:8090/#/collection1/query?q=types:%22repository%22"><span
style="text-decoration:none">repository</span></a></span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On 9/9/2016 8:52 AM, Sally Vermaaten
wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">Hi Mang Sun, <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I agree with Joshua - this sounds
to me like an indexing problem to me. In the course
of upgrading to 1.5.0 did you delete the
data/solr_index/index directory and all files in the
data/indexer_state directory? This is one of the
recommended steps in the <a moz-do-not-send="true"
href="https://github.com/archivesspace/archivesspace/blob/master/UPGRADING_1.5.0.md"
target="_blank">instructions for upgrading to
v.1.5.0</a>. We accidentally missed this step once
in a running a test upgrade and definitely
experienced some indexing problems though I don't
remember the details. As it was a test upgrade (and
it sounds like that's what you're doing as well) we
just started afresh and ran the upgrade process over
again. When we included that step, things were
fine. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">On a related note - there's a <a
moz-do-not-send="true"
href="https://github.com/archivesspace/archivesspace/releases/tag/v1.5.1"
target="_blank">1.5.1 release of ArchivesSpace</a> that
includes several fixes for bugs that were found in
the weeks after 1.5.0 was released. If are looking
to update to a 1.5.x version, you may want to
consider upgrading to 1.5.1 one rather than 1.5.0. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Good luck,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Sally <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On Fri, Sep 9, 2016 at 9:50 AM,
Joshua D. Shaw <<a moz-do-not-send="true"
href="mailto:Joshua.D.Shaw@dartmouth.edu"
target="_blank">Joshua.D.Shaw@dartmouth.edu</a>>
wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid
#CCCCCC 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal">I believe the suggestion for
migration to 1.5+ was to delete the existing index
and indexer states which will trigger a complete
reindex.<br>
<br>
Best,<br>
Joshua<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
<br>
<br>
<br>
On Sep 9, 2016, at 8:20 AM, "Mang Sun" <<a
moz-do-not-send="true"
href="mailto:mang.sun@rice.edu">mang.sun@rice.edu</a>>
wrote:<br>
<br>
> i<br>
><br>
> After we migrate our v.1.4.2 test
instance to v1.5.0, we can't find any records
but just no record in Staff interface and
public interface.<br>
><br>
> But if we open a migrated record
(saycollection record) using the direct route
path to that record and resave it, this record
but only this one starts to show up under
Collections when browsing collections. This
problem does not come with any new record
created within v.1.5.0. Any suggestion?<br>
><br>
> Thank you.<br>
><br>
> Mang Sun<br>
><br>
> Rice U.<br>
><br>
><br>
><br>
>
_______________________________________________<br>
> Archivesspace_Users_Group mailing list<br>
> <a moz-do-not-send="true"
href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
> <a moz-do-not-send="true"
href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group"
target="_blank">
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><br>
_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a moz-do-not-send="true"
href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
<a moz-do-not-send="true"
href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group"
target="_blank">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Sally Vermaaten<br>
Project Manager, Archival Systems<br>
New York University Libraries<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">1-212-992-6259<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Archivesspace_Users_Group mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Archivesspace_Users_Group mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a>
<a class="moz-txt-link-freetext" href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a>
</pre>
</blockquote>
<br>
</body>
</html>