<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=windows-1258">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Going through the report from our migration into ArchivesSpace, it included a number of entries complaining about failed character conversion (example below for Dublán (Mexico)). From the message, it appears that it is trying to convert
from ASCII 8 bit to UTF8. We understood from our IT staff that our AT installation was already in UTF8, though.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Is there any way to configure or modify the import routine to avoid this conversion? If we need to clean up our data, how should it be encoded to convert correctly?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Cory Nimer<o:p></o:p></p>
<p class="MsoNormal">Manuscripts Cataloger/Metadata Specialist<o:p></o:p></p>
<p class="MsoNormal">Brigham Young University<o:p></o:p></p>
<p class="MsoNormal">801/422-6091<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">--------------------------------------------<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Endpoint: <a href="http://ds1.lib.byu.edu:9089/subjects">http://ds1.lib.byu.edu:9089/subjects</a><o:p></o:p></p>
<p class="MsoNormal">AT Identifier:Subject->Dubl‡n (Mexico)--History--Sources<o:p></o:p></p>
<p class="MsoNormal">Status code: 500<o:p></o:p></p>
<p class="MsoNormal">Status text: Server Error<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">JSON: {"source":"lcnaf","vocabulary":"/vocabularies/1","external_ids":[{"external_id":"4273","source":"Archivists Toolkit Database::SUBJECT"}],"terms":[{"vocabulary":"/vocabularies/1","term":"Dubl‡n (Mexico)","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"History","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"Sources","term_type":"geographic"}]}<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">org.jruby.exceptions.RaiseException: (Encoding::ConverterNotFoundError) code converter not found (ASCII-8BIT to UTF-8)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyString.encode(org/jruby/RubyString.java:7590)<o:p></o:p></p>
<p class="MsoNormal"> at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)<o:p></o:p></p>
<p class="MsoNormal"> at RESTHelpers::ResponseHelpers.json_response(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/rest.rb:9)<o:p></o:p></p>
<p class="MsoNormal"> at RUBY.ERROR (?-mix:)(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:177)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyMethod.call(org/jruby/RubyMethod.java:118)<o:p></o:p></p>
<p class="MsoNormal"> at RUBY.compile!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1293)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:897)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:895)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.error_block!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:998)<o:p></o:p></p>
<p class="MsoNormal"> at RUBY.handle_exception!(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:192)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:960)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:780)<o:p></o:p></p>
<p class="MsoNormal"> at ArchivesSpaceService::RequestWrappingMiddleware.call(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:245)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::XSSHeader.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/xss_header.rb:18)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::PathTraversal.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/path_traversal.rb:16)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::JsonCsrf.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/json_csrf.rb:18)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Protection::FrameOptions.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/frame_options.rb:31)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::NullLogger.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/nulllogger.rb:9)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Head.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/head.rb:9)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::ExtendedRack.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:124)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.synchronize(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1499)<o:p></o:p></p>
<p class="MsoNormal"> at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Builder.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/builder.rb:134)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:64)<o:p></o:p></p>
<p class="MsoNormal"> at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1617)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:49)<o:p></o:p></p>
<p class="MsoNormal"> at Rack::Handler::Servlet.call(file:/opt/archivesspace/gems/gems/jruby-rack-1.1.12/lib/jruby-rack-1.1.12.jar!/rack/handler/servlet.rb:22)
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>