[Archivesspace_Users_Group] Character conversion during migration?

[Cory Nimer]

Going through the report from our migration into ArchivesSpace, it included a number of entries complaining about failed character conversion (example below for Dublán (Mexico)). From the message, it appears that it is trying to convert from ASCII 8 bit to UTF8. We understood from our IT staff that our AT installation was already in UTF8, though.

Is there any way to configure or modify the import routine to avoid this conversion? If we need to clean up our data, how should it be encoded to convert correctly?

Thanks,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
801/422-6091

--------------------------------------------

Endpoint: http://ds1.lib.byu.edu:9089/subjects
AT Identifier:Subject->Dubl‡n (Mexico)--History--Sources
Status code: 500
Status text: Server Error

JSON: {"source":"lcnaf","vocabulary":"/vocabularies/1","external_ids":[{"external_id":"4273","source":"Archivists Toolkit Database::SUBJECT"}],"terms":[{"vocabulary":"/vocabularies/1","term":"Dubl‡n (Mexico)","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"History","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"Sources","term_type":"geographic"}]}

org.jruby.exceptions.RaiseException: (Encoding::ConverterNotFoundError) code converter not found (ASCII-8BIT to UTF-8)
                at org.jruby.RubyString.encode(org/jruby/RubyString.java:7590)
                at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)
                at RESTHelpers::ResponseHelpers.json_response(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/rest.rb:9)
                at RUBY.ERROR (?-mix:)(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:177)
                at org.jruby.RubyMethod.call(org/jruby/RubyMethod.java:118)
                at RUBY.compile!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1293)
                at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:897)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:895)
                at Sinatra::Base.error_block!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:998)
                at RUBY.handle_exception!(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:192)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:960)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:780)
                at ArchivesSpaceService::RequestWrappingMiddleware.call(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:245)
                at Rack::Protection::XSSHeader.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/xss_header.rb:18)
                at Rack::Protection::PathTraversal.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/path_traversal.rb:16)
                at Rack::Protection::JsonCsrf.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/json_csrf.rb:18)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::FrameOptions.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/frame_options.rb:31)
                at Rack::NullLogger.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/nulllogger.rb:9)
                at Rack::Head.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/head.rb:9)
                at Sinatra::ExtendedRack.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:124)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Sinatra::Base.synchronize(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1499)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Rack::Builder.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/builder.rb:134)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:64)
                at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1617)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:49)
                at Rack::Handler::Servlet.call(file:/opt/archivesspace/gems/gems/jruby-rack-1.1.12/lib/jruby-rack-1.1.12.jar!/rack/handler/servlet.rb:22)

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20131122/bec97607/attachment.html>