<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Courier;
panose-1:2 7 4 9 2 2 5 2 4 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:menlo;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.xapple-converted-space
{mso-style-name:x_apple-converted-space;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Just to second this: I would love to have a schema available that defines what type of EAD files are supported by ArchivesSpace!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> archivesspace_users_group-bounces@lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org]
<b>On Behalf Of </b>Steven Majewski<br>
<b>Sent:</b> Friday, March 07, 2014 5:04 PM<br>
<b>To:</b> Archivesspace Users Group<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] EAD Import - cryptic error messages<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I can now batch import a large majority of our 4074 EAD files into ArchivesSpace. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">( I’ve only samples and tested a portion of other Virginia Heritage institutions 6000+ files. ) <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">All but 21 files parse and produce json files with my batch import parser. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Not all of those json files import with POST /repositories/$ID/batch_imports: several hundred fail,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">usually with Java memory errors returned. In the one instance I’ve tried, I was able to import <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">the file successfully using the frontend web import job upload form. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The remaining error messages are:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-family:Courier"> 1 #<:ValidationException: {:errors=>{"instances/0/container/type_1"=>["Property is required but was missing"]}}><br>
1 #<:ValidationException: {:errors=>{"record"=>["Can't unambiguously match {:reference_text=>\"(In non correspondence -legal)\"} against schema types: [\"JSONModel(:note_index_item) object\"]. Resolve this by adding a 'jsonmodel_type' property to {:reference_text=>\"(In
non correspondence -legal)\"}"]}}><br>
1 Invalid schema given: string<br>
2 #<:ValidationException: {:errors=>{"notes/7/subnotes/0/content"=>["Must be 65000 characters or fewer"]}}><br>
16 #<:ValidationException: {:errors=>{"extents"=>["At least 1 item(s) is required"]}}></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I will continue to investigate these errors, but in the mean time, it seemed we could import a sufficient number to go on to <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">evaluating the rest of the system. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Here is the stylesheet I’m using to fix some of these import problems. In some cases, the “fix” is just papering over a problem<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">to get the guide imported. For example, we’re inserting “1 arbitrary_unit” for missing <extent> elements; or arbitrarily truncating<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">the <eadid> at 255 characters. The desired plan would be to get all of the collections imported into ArchivesSpace and review<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">and correct them there (rather than editing EAD xml files). But we need a good way of tagging the elements that need review<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">and correction. I don’t know if the xml comments I’ve inserted will prove to be a useful solution to that. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Here, I believe Archivist’s Toolkit solution was to import files even when it didn’t meet it’s requirements, but then you could not<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">publish or expand the hierarchy of the guide until you had gone thru and corrected the issues, which were hilighted in the edit<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">form. This would be the ideal, but I would at least like to figure out how to tag elements as needing review. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">( BTW: What is the difference between not-published & suppressed ? ) <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Looking directly at the json files (using that patch below) definitely speeded up finding the source of the problems. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">This is the main problem with using an intermediate representation like json-model: the error messages all reference<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">the intermediate language, and not the source language. What is the poor EAD author to make of an error message<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">like this: <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:Courier">#<:ValidationException: {:errors=>{"record"=>["Can't unambiguously match {:reference_text=>\"(In non correspondence -legal)\"} against schema types: [\"JSONModel(:note_index_item) object\"]. Resolve this
by adding a 'jsonmodel_type' property to {:reference_text=>\"(In non correspondence -legal)\"}"]}}></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">??<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">If fixing the error messages proves to be too difficult a task, maybe it would be simpler to produce a schema that matches <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">what AS EAD import accepts, and people can do their own pre-validation against that restricted schema. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">( Or is the goal the other way around ? to eventually get AS imported to handle any valid EAD file ? ) <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">— Steve Majewski / UVA Alderman Library<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mar 3, 2014, at 5:25 PM, Chris Fitzpatrick <<a href="mailto:Chris.Fitzpatrick@lyrasis.org">Chris.Fitzpatrick@lyrasis.org</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">Hi Steven,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">Wow, thanks for this. I'm am going over this and it really helps for the improved error messaging we are trying to setup. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">I definitely think it should be doable to strip out any empty XML tags and not have them create JSON nodes.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">Also looking at the diff you sent..it seems to cause some problems with the test suite, but I need to figure out what's going on there and way this is stripping out
some of these error messages. Will update soon. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">But yes, until then a good work around would be to strip out empty EAD tags prior to import....<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif"">best,chris. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:10.0pt;font-family:"Calibri","sans-serif"">Chris Fitzpatrick | <a href="mailto:chris.fitzpatrick@lyrasis.org">chris.fitzpatrick@lyrasis.org</a><br>
Developer, ArchivesSpace<br>
<a href="http://archivesspace.org/">http://archivesspace.org/</a></span><span style="font-family:"Calibri","sans-serif""><o:p></o:p></span></p>
</div>
</div>
<div>
<div class="MsoNormal" align="center" style="text-align:center;background:white">
<span style="font-family:"Calibri","sans-serif";color:#282828">
<hr size="2" width="767" style="width:575.25pt" align="center">
</span></div>
<div id="x_divRplyFwdMsg">
<p class="MsoNormal" style="background:white"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#282828">From:</span></b><span class="xapple-converted-space"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#282828"> </span></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#282828"><a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>
<<a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a>> on behalf of Steven Majewski <<a href="mailto:sdm7g@virginia.edu">sdm7g@virginia.edu</a>><br>
<b>Sent:</b><span class="xapple-converted-space"> </span>Saturday, March 01, 2014 5:14 PM<br>
<b>To:</b><span class="xapple-converted-space"> </span>Archivesspace Users Group<br>
<b>Subject:</b><span class="xapple-converted-space"> </span>Re: [Archivesspace_Users_Group] EAD Import - cryptic error messages</span><span style="font-family:"Calibri","sans-serif";color:#282828">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">I found a way to get info on the EAD -> JSON_schema mappings, and I’ve managed to fix those notes/0/content errors as well as several others.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">For debugging purposes, I make this temporary change to jsonmodel_wrap.rb to ignore all validation errors,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">and I run my command line EAD import parser. ( I haven’t tried running this code on the backend server — no idea what that might break. )<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><b><span style="font-family:"menlo","serif";color:#692828">--- a/backend/app/converters/lib/jsonmodel_wrap.rb</span></b><span style="font-family:"menlo","serif";color:#692828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><b><span style="font-family:"menlo","serif";color:#692828">+++ b/backend/app/converters/lib/jsonmodel_wrap.rb</span></b><span style="font-family:"menlo","serif";color:#692828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#0193A0">@@ -13,10 +13,10 @@</span><span class="xapple-converted-space"><span style="font-family:"menlo","serif";color:#282828"> </span></span><span style="font-family:"menlo","serif";color:#282828">module
ASpaceImport<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> # TODO - speed things up by avoiding this another way<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> rescue JSONModel::ValidationException => e<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#A61709">- e.errors.reject! {|path, mssg|<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#A61709">- e.attribute_types &&<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#A61709">- e.attribute_types.has_key?(path) &&<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#A61709">- e.attribute_types[path] == 'ArchivesSpaceDynamicEnum'}<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#019500">+ e.errors.reject! {|path, mssg| true }<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#019500">+# e.attribute_types &&<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#019500">+# e.attribute_types.has_key?(path) &&<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#019500">+# e.attribute_types[path] == 'ArchivesSpaceDynamicEnum'}<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">This generates json files for almost all of the EAD files. ( except for about 30, which I assume are the ones with errors other<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">than #<:ValidationException…> ). The ones that would not have normally validated correctly will still generate validation<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">errors if POSTED to /repositories/$ID/batch_imports. However, I can pipe them thru json_pp and search for the schema <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">property in the error message. So far, this has yielded enough context information to identify the source of the problem <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">in the EAD file. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">Most of these problems seem to trace back to empty elements in the EAD file. <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">In a few cases, there is a missing required element ( unitid, for example ), but in most cases, removing the empty element<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">fixes the problem. Is this something that could be fixed in the parser ? : if the element is empty, don’t create a JSON property<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">for it ? <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">( For now, I’m adding templates for all of the glitches I’ve found to a AS fixup stylesheet run as a pre-process to AS import. ) <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">— Steve Majewski<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828">On Feb 28, 2014, at 8:43 AM, Brad Westbrook <<a href="mailto:brad.westbrook@lyrasis.org">brad.westbrook@lyrasis.org</a>> wrote:<o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><br>
<br>
<o:p></o:p></span></p>
<div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi, Steve,</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I won’t be able to address your mapping request until next week.</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">We are working on a public release now which will address the LDAP security hole reported a couple of weeks ago and include a number
of enhancements made since the 1.0.4 release on Jan. 20. We are aiming to announce the release later today, but it might not be until Monday, depending on resolution of one item.</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Brad</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D">Bradley D. Westbrook</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D">Program Manager</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D"><a href="mailto:brad@archivesspace.org"><span style="color:#1F497D">brad.westbrook@lyrasis.org</span></a></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D">800.999.8558 x2910</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D">678.235.2910</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#1F497D">bradley_d_westbrook (Skype) </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Arial","sans-serif";color:#282828"><image001.png></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#282828"><o:p></o:p></span></p>
</div>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<div>
<p class="MsoNormal" style="background:white"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#282828">From:</span></b><span class="xapple-converted-space"><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#282828"> </span></span><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#282828"><a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">archivesspace_users_group-bounces@lyralists.lyrasis.org</a><span class="xapple-converted-space"> </span>[<a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</a>]<b>On
Behalf Of<span class="xapple-converted-space"> </span></b>Steven Majewski<br>
<b>Sent:</b><span class="xapple-converted-space"> </span>Friday, February 28, 2014 8:33 AM<br>
<b>To:</b><span class="xapple-converted-space"> </span>Archivesspace Users Group<br>
<b>Subject:</b><span class="xapple-converted-space"> </span>Re: [Archivesspace_Users_Group] EAD Import - cryptic error messages</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828">Brad:<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> Can you express this requirement in terms of EAD elements instead of JSONModel schema types ? <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> It’s that mapping that is giving me trouble: trying to turn the schema references in those error messages<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> into elements in the imported EAD that need to be addressed. <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> Any ETA for that next release ? <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828">I’ve managed to fixup some of the import problems with a stylesheet: I’m up to 2749 files out of 4074 parsing successfully ( up from 0 and 300+ on my <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828">initial efforts ). That notes/0/content message is my greatest outstanding issue: <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828">1210 #<:ValidationException: {:errors=>{"notes/0/content"=>["At least 1 item(s) is required"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 31 Unexpected Object Type in Queue: Expected archival_object got container</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 30 #<:ValidationException: {:errors=>{"dates"=>["one or more required (or enter a Title)"], "title"=>["must not be an empty string (or enter a Date)"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 11 #<:ValidationException: {:errors=>{"instances/0/container/indicator_1"=>["Property is required but was missing"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 11 #<:ValidationException: {:errors=>{"id_0"=>["Property is required but was missing"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 8 #<:ValidationException: {:errors=>{"extents"=>["At least 1 item(s) is required"], "notes/0/content"=>["At least 1 item(s) is required"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 6 #<:ValidationException: {:errors=>{"extents"=>["At least 1 item(s) is required"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 5 #<:ValidationException: {:errors=>{"notes/0/content"=>["At least 1 item(s) is required"], "id_0"=>["Property is required but was missing"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 5 #<:ValidationException: {:errors=>{"ead_id"=>["Must be 255 characters or fewer"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 2 #<:ValidationException: {:errors=>{"instances/0/container/type_1"=>["Property is required but was missing"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 Invalid schema given: string</span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 #<:ValidationException: {:errors=>{"record"=>["Can't unambiguously match {:reference_text=>\"(In non correspondence -legal)\"} against schema types:
[\"JSONModel(:note_index_item) object\"]. Resolve this by adding a 'jsonmodel_type' property to {:reference_text=>\"(In non correspondence -legal)\"}"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 #<:ValidationException: {:errors=>{"notes/7/subnotes/0/content"=>["Must be 65000 characters or fewer"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 #<:ValidationException: {:errors=>{"notes/0/content"=>["At least 1 item(s) is required"], "notes/8/subnotes/0/content"=>["Must be 65000 characters
or fewer"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 #<:ValidationException: {:errors=>{"instances/0/container/type_1"=>["Property is required but was missing"], "instances/0/container/indicator_1"=>["Property
is required but was missing"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:#D4C0AC"><span style="font-family:"menlo","serif";color:#282828"> 1 #<:ValidationException: {:errors=>{"extents"=>["At least 1 item(s) is required"], "ead_id"=>["Must be 255 characters or fewer"]}}></span><span style="color:#282828"><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828">— Steve M.<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white"><span style="color:#282828"> <o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="background:white"><span style="font-family:"Calibri","sans-serif";color:#282828"><o:p> </o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:11.5pt;font-family:"Helvetica","sans-serif"">_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
<a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>