<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoPlainText">We are in the process of upgrading our site from 1.4.2 to 1.5.3 and we are seeing a similar error as has been described in this thread. We are seeing the error below and continued looping of the indexer trying to index the archival objects.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">~~~ Indexed 1225 of 67886 archival_object records in repository 2 ( added 25 records in 6399.0ms ) ~~~<o:p></o:p></p>
<p class="MsoPlainText">~~~ Indexed 1250 of 67886 archival_object records in repository 2 ( added 25 records in 5488.0ms ) ~~~<o:p></o:p></p>
<p class="MsoPlainText">E, [2017-03-16T16:53:51.425000 #779] ERROR -- : Thread-2392462: Unhandled exception!<o:p></o:p></p>
<p class="MsoPlainText">E, [2017-03-16T16:53:51.425000 #779] ERROR -- :<o:p></o:p></p>
<p class="MsoPlainText">undefined method `related_records' for nil:NilClass<o:p></o:p></p>
<p class="MsoPlainText">/opt/archivesspace-1.5.3/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:64:in `top_container'<o:p></o:p></p>
<p class="MsoPlainText">/opt/archivesspace-1.5.3/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:24:in `type_1'<o:p></o:p></p>
<p class="MsoPlainText">/opt/archivesspace-1.5.3/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:14:in `to_hash'<o:p></o:p></p>
<p class="MsoPlainText">org/jruby/RubyHash.java:1341:in `each'<o:p></o:p></p>
<p class="MsoPlainText">org/jruby/RubyEnumerable.java:757:in `map'<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Does a resolution to this issue exist?<o:p></o:p></p>
<p class="MsoPlainText">How do I find what the offending set of data is causing the problem?<o:p></o:p></p>
<p class="MsoPlainText">How do I proceed?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Thank you for your help.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Regards,<o:p></o:p></p>
<p class="MsoNormal"><u><span style="font-size:10.0pt;color:#365F91">__________________________<o:p></o:p></span></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#365F91">Brent Ellingson<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#365F91">Sr. Software Engineer<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#365F91">BYU Library<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#365F91">801-422-6148<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Date: Mon, 23 Jan 2017 19:54:53 +0000<o:p></o:p></p>
<p class="MsoPlainText">From: "Majewski, Steven Dennis (sdm7g)" <<a href="mailto:sdm7g@eservices.virginia.edu">sdm7g@eservices.virginia.edu</a>><o:p></o:p></p>
<p class="MsoPlainText">To: Archivesspace Users Group<o:p></o:p></p>
<p class="MsoPlainText"> <<a href="mailto:archivesspace_users_group@lyralists.lyrasis.org">archivesspace_users_group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText">Subject: Re: [Archivesspace_Users_Group] Indexer erroring in 1.5.2<o:p></o:p></p>
<p class="MsoPlainText">Message-ID:<o:p></o:p></p>
<p class="MsoPlainText"> <<a href="mailto:1B0EA75C-EE19-492A-B057-FBAEFBBFB880@eservices.virginia.edu">1B0EA75C-EE19-492A-B057-FBAEFBBFB880@eservices.virginia.edu</a>><o:p></o:p></p>
<p class="MsoPlainText">Content-Type: text/plain; charset="utf-8"<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">The first two issues appear to be due to trailing spaces in some of the container barcodes.<o:p></o:p></p>
<p class="MsoPlainText">Top containers have already been created for barcodes without trailing space, and so it appears that the barcodes don?t match.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 20, 2017, at 3:49 PM, Majewski, Steven Dennis (sdm7g) <<a href="mailto:sdm7g@eservices.virginia.edu%3cmailto:sdm7g@eservices.virginia.edu">sdm7g@eservices.virginia.edu<mailto:sdm7g@eservices.virginia.edu</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 13, 2017, at 6:15 PM, James Bullen <<a href="mailto:james@hudmol.com%3cmailto:james@hudmol.com">james@hudmol.com<mailto:james@hudmol.com</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Hi Steve,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">That fits the pattern I?m seeing in John?s data. Have you checked the container conversion log for any errors relating to that record?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Cheers,<o:p></o:p></p>
<p class="MsoPlainText">James<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Just re-did migration from 1.4.2 to 1.5.1 again, and I?m inspecting the logs.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Yes, archival_objects/255 is on that list.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">error,message,url<o:p></o:p></p>
<p class="MsoPlainText">JSONModel::ValidationException,barcode_1 -- Mismatch when mapping between barcode and barcode_1,http://UL-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/331<<a href="http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/331">http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/331</a>><o:p></o:p></p>
<p class="MsoPlainText">JSONModel::ValidationException,barcode_1 -- Mismatch when mapping between barcode and barcode_1,http://UL-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/2059<<a href="http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/2059">http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/2059</a>><o:p></o:p></p>
<p class="MsoPlainText">JSONModel::ValidationException,indicator_1 -- Mismatch when mapping between indicator and indicator_1,http://UL-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/255<<a href="http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/255">http://ul-sdm7g-mbp.local/resolve/readonly?uri=/repositories/3/archival_objects/255</a>><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I need to inspect the other repo logs and see if all of the ones that break are getting caught, but it looks likely.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I?m trying to interpret what exactly those messages are complaining about.<o:p></o:p></p>
<p class="MsoPlainText">Do those error messages and object dumps mean anything to you off the bat?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">? Steve.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 14, 2017, at 8:37 AM, Majewski, Steven Dennis (sdm7g) <<a href="mailto:sdm7g@eservices.virginia.edu%3cmailto:sdm7g@eservices.virginia.edu">sdm7g@eservices.virginia.edu<mailto:sdm7g@eservices.virginia.edu</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">It looks like the indexer gives and error because the backend is getting an error turning the SQL model into a JSON model.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">For some of the archival objects that are failing to index, the significant difference is that they do not have a sub_container in their instance. Trying to access the json from the backend in 1.5.2 just yields an error message, but
going back to test 1.5.1 migration:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">[ This is json from the same screen capture in my previous message. ]<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">archival_object 255 ( which causes error on index )<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">{<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "position": 17,<o:p></o:p></p>
<p class="MsoPlainText"> "publish": true,<o:p></o:p></p>
<p class="MsoPlainText"> "ref_id": "aspace_22a35d6a6ee59ac454ca8f35232b0b40",<o:p></o:p></p>
<p class="MsoPlainText"> "title": "Buttons and uniform parts, souvenirs, and medals",<o:p></o:p></p>
<p class="MsoPlainText"> "display_string": "Buttons and uniform parts, souvenirs, and medals, undated",<o:p></o:p></p>
<p class="MsoPlainText"> "restrictions_apply": false,<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2017-01-06T22:25:38Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "suppressed": false,<o:p></o:p></p>
<p class="MsoPlainText"> "level": "file",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "archival_object",<o:p></o:p></p>
<p class="MsoPlainText"> "external_ids": [],<o:p></o:p></p>
<p class="MsoPlainText"> "subjects": [],<o:p></o:p></p>
<p class="MsoPlainText"> "linked_events": [],<o:p></o:p></p>
<p class="MsoPlainText"> "extents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "dates": [<o:p></o:p></p>
<p class="MsoPlainText"> {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "expression": "undated",<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "date_type": "inclusive",<o:p></o:p></p>
<p class="MsoPlainText"> "label": "creation",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "date"<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> ],<o:p></o:p></p>
<p class="MsoPlainText"> "external_documents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "rights_statements": [],<o:p></o:p></p>
<p class="MsoPlainText"> "linked_agents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "instances": [<o:p></o:p></p>
<p class="MsoPlainText"> {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "instance_type": "Realia",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "instance",<o:p></o:p></p>
<p class="MsoPlainText"> "is_representative": false,<o:p></o:p></p>
<p class="MsoPlainText"> "container": {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "indicator_1": "Artifacts 1",<o:p></o:p></p>
<p class="MsoPlainText"> "barcode_1": "X030898965",<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2016-11-22T16:58:54Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "type_1": "box",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "container",<o:p></o:p></p>
<p class="MsoPlainText"> "container_locations": []<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> ],<o:p></o:p></p>
<p class="MsoPlainText"> "notes": [],<o:p></o:p></p>
<p class="MsoPlainText"> "uri": "/repositories/3/archival_objects/255",<o:p></o:p></p>
<p class="MsoPlainText"> "repository": {<o:p></o:p></p>
<p class="MsoPlainText"> "ref": "/repositories/3"<o:p></o:p></p>
<p class="MsoPlainText"> },<o:p></o:p></p>
<p class="MsoPlainText"> "resource": {<o:p></o:p></p>
<p class="MsoPlainText"> "ref": "/repositories/3/resources/11"<o:p></o:p></p>
<p class="MsoPlainText"> },<o:p></o:p></p>
<p class="MsoPlainText"> "has_unpublished_ancestor": false<o:p></o:p></p>
<p class="MsoPlainText">}<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">archival_object 256: ( indexes successfully, once 255 is deleted. )<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">{<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "position": 18,<o:p></o:p></p>
<p class="MsoPlainText"> "publish": false,<o:p></o:p></p>
<p class="MsoPlainText"> "ref_id": "aspace_15da7f2a9b0184a65b1280ae05a7598a",<o:p></o:p></p>
<p class="MsoPlainText"> "title": "Buttons and uniform parts, souvenirs, and medals",<o:p></o:p></p>
<p class="MsoPlainText"> "display_string": "Buttons and uniform parts, souvenirs, and medals, undated",<o:p></o:p></p>
<p class="MsoPlainText"> "restrictions_apply": false,<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2017-01-06T22:25:38Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "suppressed": false,<o:p></o:p></p>
<p class="MsoPlainText"> "level": "file",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "archival_object",<o:p></o:p></p>
<p class="MsoPlainText"> "external_ids": [],<o:p></o:p></p>
<p class="MsoPlainText"> "subjects": [],<o:p></o:p></p>
<p class="MsoPlainText"> "linked_events": [],<o:p></o:p></p>
<p class="MsoPlainText"> "extents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "dates": [<o:p></o:p></p>
<p class="MsoPlainText"> {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "expression": "undated",<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "date_type": "inclusive",<o:p></o:p></p>
<p class="MsoPlainText"> "label": "creation",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "date"<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> ],<o:p></o:p></p>
<p class="MsoPlainText"> "external_documents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "rights_statements": [],<o:p></o:p></p>
<p class="MsoPlainText"> "linked_agents": [],<o:p></o:p></p>
<p class="MsoPlainText"> "instances": [<o:p></o:p></p>
<p class="MsoPlainText"> {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2015-08-11T21:43:55Z",<o:p></o:p></p>
<p class="MsoPlainText"> "instance_type": "Realia",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "instance",<o:p></o:p></p>
<p class="MsoPlainText"> "is_representative": false,<o:p></o:p></p>
<p class="MsoPlainText"> "sub_container": {<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 0,<o:p></o:p></p>
<p class="MsoPlainText"> "created_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "last_modified_by": "admin",<o:p></o:p></p>
<p class="MsoPlainText"> "create_time": "2017-01-06T22:28:29Z",<o:p></o:p></p>
<p class="MsoPlainText"> "system_mtime": "2017-01-06T22:28:29Z",<o:p></o:p></p>
<p class="MsoPlainText"> "user_mtime": "2017-01-06T22:28:29Z",<o:p></o:p></p>
<p class="MsoPlainText"> "jsonmodel_type": "sub_container",<o:p></o:p></p>
<p class="MsoPlainText"> "top_container": {<o:p></o:p></p>
<p class="MsoPlainText"> "ref": "/repositories/3/top_containers/1573"<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> },<o:p></o:p></p>
<p class="MsoPlainText"> "container": {<o:p></o:p></p>
<p class="MsoPlainText"> "type_1": "box",<o:p></o:p></p>
<p class="MsoPlainText"> "indicator_1": "Artifacts 2",<o:p></o:p></p>
<p class="MsoPlainText"> "barcode_1": "X030866782",<o:p></o:p></p>
<p class="MsoPlainText"> "container_locations": [],<o:p></o:p></p>
<p class="MsoPlainText"> "lock_version": 1<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> }<o:p></o:p></p>
<p class="MsoPlainText"> ],<o:p></o:p></p>
<p class="MsoPlainText"> "notes": [],<o:p></o:p></p>
<p class="MsoPlainText"> "uri": "/repositories/3/archival_objects/256",<o:p></o:p></p>
<p class="MsoPlainText"> "repository": {<o:p></o:p></p>
<p class="MsoPlainText"> "ref": "/repositories/3"<o:p></o:p></p>
<p class="MsoPlainText"> },<o:p></o:p></p>
<p class="MsoPlainText"> "resource": {<o:p></o:p></p>
<p class="MsoPlainText"> "ref": "/repositories/3/resources/11"<o:p></o:p></p>
<p class="MsoPlainText"> },<o:p></o:p></p>
<p class="MsoPlainText"> "has_unpublished_ancestor": false<o:p></o:p></p>
<p class="MsoPlainText">}<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">But as I noted previously, I don?t see the significant difference in the data in 1.4.2 that was migrated that would account for one failing and the other succeeding.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">( It appears that there are other records causing errors that don?t necessarily fit this same pattern. )<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">But the fact that this info is missing in the 1.5.1 migration does suggest it?s not a 1.5.2 only bug, but a problem with the container migration in earlier versions that is just made more visible by some 1.5.2 changes.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">? Steve.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 12, 2017, at 11:39 PM, James Bullen <<a href="mailto:james@hudmol.com%3cmailto:james@hudmol.com">james@hudmol.com<mailto:james@hudmol.com</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Hi,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">It looks like the problem John is seeing with the indexer failing after upgrading to 1.5.2 is caused by an issue with a record following the container conversion. I?m following up with John off-list on the specifics of his problem. Hopefully
we?ll be able to confirm this when we get to a resolution.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">The container management upgrade has been the source of quite a few bugs and it is on our radar for review.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Cheers,<o:p></o:p></p>
<p class="MsoPlainText">James<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 13, 2017, at 1:30 AM, Hambleton, John S <<a href="mailto:jhamblet@nmu.edu%3cmailto:jhamblet@nmu.edu">jhamblet@nmu.edu<mailto:jhamblet@nmu.edu</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Yes, thank you,<o:p></o:p></p>
<p class="MsoPlainText">I sent my data to you off-list.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">John H<o:p></o:p></p>
<p class="MsoPlainText">NMU<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">From: <a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org%3cmailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">
archivesspace_users_group-bounces@lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>> [<a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]
On Behalf Of James Bullen<o:p></o:p></p>
<p class="MsoPlainText">Sent: Wednesday, January 11, 2017 6:56 PM<o:p></o:p></p>
<p class="MsoPlainText">To: Archivesspace Users Group <<a href="mailto:archivesspace_users_group@lyralists.lyrasis.org%3cmailto:archivesspace_users_group@lyralists.lyrasis.org">archivesspace_users_group@lyralists.lyrasis.org<mailto:archivesspace_users_group@lyralists.lyrasis.org</a>>><o:p></o:p></p>
<p class="MsoPlainText">Subject: Re: [Archivesspace_Users_Group] Indexer erroring in 1.5.2<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Hi John and Steve,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Can either of you send some sample data that surfaces this bug?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Cheers,<o:p></o:p></p>
<p class="MsoPlainText">James<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 12, 2017, at 8:17 AM, Majewski, Steven Dennis (sdm7g) <<a href="mailto:sdm7g@eservices.virginia.edu%3cmailto:sdm7g@eservices.virginia.edu">sdm7g@eservices.virginia.edu<mailto:sdm7g@eservices.virginia.edu</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">After seeing this message, I tried 1.5.2 on my Mac (10.11.6) laptop and I?m also seeing the same undefined method `related_records' for nil:NilClass error, whether or not I do an intervening ( and successful, BTW ) update to 1.5.1.<o:p></o:p></p>
<p class="MsoPlainText">Reindexing never seems to progress and so browse resources never shows any records.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">? Steve Majewski<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">On Jan 11, 2017, at 1:58 PM, Hambleton, John S <<a href="mailto:jhamblet@nmu.edu%3cmailto:jhamblet@nmu.edu">jhamblet@nmu.edu<mailto:jhamblet@nmu.edu</a>>> wrote:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Folks,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I am testing archivesspace 1.5.2 on CentOS 6, using a copy of our 1.4.2 production database.<o:p></o:p></p>
<p class="MsoPlainText">Wondering why it seems like the indexer is taking so long to finish, I am seeing this in the archivesspace.out log, which makes me think the indexer is caught in an endless loop:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Keep seeing the SAME indexer messages over and over again:<o:p></o:p></p>
<p class="MsoPlainText">~~~ Indexed 1475 of 1941 accession records in repository 3 ( added 25 records in 8229.0ms ) ~~~ ~~~ Indexed 1500 of 1941 accession records in repository 3 ( added 25 records in 5251.0ms ) ~~~<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">And then,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">E, [2017-01-11T13:41:10.740000 #32733] ERROR -- : Thread-6445852: Unhandled exception!<o:p></o:p></p>
<p class="MsoPlainText">E, [2017-01-11T13:41:10.741000 #32733] ERROR -- :<o:p></o:p></p>
<p class="MsoPlainText">undefined method `related_records' for nil:NilClass /usr/local/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:64:in `top_container'<o:p></o:p></p>
<p class="MsoPlainText">/usr/local/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:24:in `type_1'<o:p></o:p></p>
<p class="MsoPlainText">/usr/local/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/subcontainer_to_aspace_json_mapper.rb:14:in `to_hash'<o:p></o:p></p>
<p class="MsoPlainText">org/jruby/RubyHash.java:1341:in `each'<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">And then seems to start indexing the same data over again:<o:p></o:p></p>
<p class="MsoPlainText">~~~ Indexed 50 of 1941 accession records in repository 3 ( added 25 records in 11153.0ms ) ~~~ ~~~ Indexed 75 of 1941 accession records in repository 3 ( added 25 records in 10051.0ms ) ~~~ ~~~ Indexed 100 of 1941 accession records
in repository 3 ( added 25 records in 9558.0ms ) ~~~<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Kind of looks like the indexer errors on ?something? then, tries to reindex the same accession records over and over again. I had followed the advice here:https://github.com/archivesspace/archivesspace/blob/master/UPGRADING_1.5.0.md#conversion<o:p></o:p></p>
<p class="MsoPlainText">before starting archivesspace, that is, ?delete your Solr index files to start with a fresh index?.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Any help is appreciated.<o:p></o:p></p>
<p class="MsoPlainText">Thanks,<o:p></o:p></p>
<p class="MsoPlainText">John H<o:p></o:p></p>
<p class="MsoPlainText">NMU<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">!DSPAM:587793334611909212977! _______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">!DSPAM:587793334611909212977!<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">!DSPAM:587948af109451970717657!<o:p></o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">!DSPAM:587948af109451970717657!<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><7ebc58861f8c38997d24d1316e9276ec>_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Archivesspace_Users_Group mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org%3cmailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org<mailto:Archivesspace_Users_Group@lyralists.lyrasis.org</a>><o:p></o:p></p>
<p class="MsoNormal"><a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>