<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=windows-1258">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<base href="x-msg://1078/"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Lucida Grande";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Mark,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Attached is a brief record from the report that included one of these errors for your review – it is the first character in Ĺlborg on line 98.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cory Nimer<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Manuscripts Cataloger/Metadata Specialist<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Brigham Young University<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1108 HBLL<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">(801) 422-6091<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> archivesspace_users_group-bounces@lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org]
<b>On Behalf Of </b>Mark A. Matienzo<br>
<b>Sent:</b> Friday, November 22, 2013 11:24 AM<br>
<b>To:</b> Archivesspace Users Group<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] Character conversion during migration?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi Cory,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Without access to the record itself, it might be hard for us to deduce. It is entirely possible that there's a problem with this character in the AT record. Can you possibly export the record as EAD and send it to us to start?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Best,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Lucida Grande","serif";color:black">Mark A. Matienzo | <a href="mailto:mark.matienzo@nyu.edu">mark.matienzo@nyu.edu</a><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Lucida Grande","serif";color:black">Technical Architect, ArchivesSpace<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Lucida Grande","serif";color:black"><a href="http://archivesspace.org/">http://archivesspace.org/</a><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Nov 22, 2013, at 10:50 AM, Cory Nimer <<a href="mailto:cory_nimer@byu.edu">cory_nimer@byu.edu</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Going through the report from our migration into ArchivesSpace, it included a number of entries complaining about failed character conversion (example below for Dublán (Mexico)).
From the message, it appears that it is trying to convert from ASCII 8 bit to UTF8. We understood from our IT staff that our AT installation was already in UTF8, though.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Is there any way to configure or modify the import routine to avoid this conversion? If we need to clean up our data, how should it be encoded to convert correctly?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Thanks,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Cory Nimer<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Manuscripts Cataloger/Metadata Specialist<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Brigham Young University<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">801/422-6091<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">--------------------------------------------<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Endpoint:<span class="apple-converted-space"> </span><a href="http://ds1.lib.byu.edu:9089/subjects"><span style="color:purple">http://ds1.lib.byu.edu:9089/subjects</span></a><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">AT Identifier:Subject->Dubl‡n (Mexico)--History--Sources<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Status code: 500<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Status text: Server Error<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">JSON: {"source":"lcnaf","vocabulary":"/vocabularies/1","external_ids":[{"external_id":"4273","source":"Archivists Toolkit Database::SUBJECT"}],"terms":[{"vocabulary":"/vocabularies/1","term":"Dubl‡n
(Mexico)","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"History","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"Sources","term_type":"geographic"}]}<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">org.jruby.exceptions.RaiseException: (Encoding::ConverterNotFoundError) code converter not found (ASCII-8BIT to UTF-8)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyString.encode(org/jruby/RubyString.java:7590)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at RESTHelpers::ResponseHelpers.json_response(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/rest.rb:9)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at RUBY.ERROR (?-mix:)(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:177)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyMethod.call(org/jruby/RubyMethod.java:118)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at RUBY.compile!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1293)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:897)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:895)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.error_block!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:998)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at RUBY.handle_exception!(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:192)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:960)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:780)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at ArchivesSpaceService::RequestWrappingMiddleware.call(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:245)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::XSSHeader.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/xss_header.rb:18)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::PathTraversal.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/path_traversal.rb:16)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::JsonCsrf.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/json_csrf.rb:18)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Protection::FrameOptions.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/frame_options.rb:31)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::NullLogger.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/nulllogger.rb:9)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Head.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/head.rb:9)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::ExtendedRack.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:124)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.synchronize(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1499)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Builder.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/builder.rb:134)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:64)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1617)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:49)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> at Rack::Handler::Servlet.call(file:/opt/archivesspace/gems/gems/jruby-rack-1.1.12/lib/jruby-rack-1.1.12.jar!/rack/handler/servlet.rb:22)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Lucida Grande","serif"">_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org"><span style="color:purple">Archivesspace_Users_Group@lyralists.lyrasis.org</span></a><br>
<a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group"><span style="color:purple">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</span></a><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>