[Archivesspace_Users_Group] Character conversion during migration?

Cory Nimer cory_nimer at byu.edu
Fri Nov 22 19:09:39 EST 2013 

Mark,

Attached is a brief record from the report that included one of these errors for your review – it is the first character in Ålborg on line 98.

Thanks,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
1108 HBLL
(801) 422-6091

From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Mark A. Matienzo
Sent: Friday, November 22, 2013 11:24 AM
To: Archivesspace Users Group
Subject: Re: [Archivesspace_Users_Group] Character conversion during migration?

Hi Cory,

Without access to the record itself, it might be hard for us to deduce. It is entirely possible that there's a problem with this character in the AT record. Can you possibly export the record as EAD and send it to us to start?

Best,

Mark A. Matienzo | mark.matienzo at nyu.edu<mailto:mark.matienzo at nyu.edu>
Technical Architect, ArchivesSpace
http://archivesspace.org/

On Nov 22, 2013, at 10:50 AM, Cory Nimer <cory_nimer at byu.edu<mailto:cory_nimer at byu.edu>> wrote:


Going through the report from our migration into ArchivesSpace, it included a number of entries complaining about failed character conversion (example below for Dublán (Mexico)). From the message, it appears that it is trying to convert from ASCII 8 bit to UTF8. We understood from our IT staff that our AT installation was already in UTF8, though.

Is there any way to configure or modify the import routine to avoid this conversion? If we need to clean up our data, how should it be encoded to convert correctly?

Thanks,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
801/422-6091

--------------------------------------------

Endpoint: http://ds1.lib.byu.edu:9089/subjects
AT Identifier:Subject->Dubl‡n (Mexico)--History--Sources
Status code: 500
Status text: Server Error

JSON: {"source":"lcnaf","vocabulary":"/vocabularies/1","external_ids":[{"external_id":"4273","source":"Archivists Toolkit Database::SUBJECT"}],"terms":[{"vocabulary":"/vocabularies/1","term":"Dubl‡n (Mexico)","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"History","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"Sources","term_type":"geographic"}]}

org.jruby.exceptions.RaiseException: (Encoding::ConverterNotFoundError) code converter not found (ASCII-8BIT to UTF-8)
                at org.jruby.RubyString.encode(org/jruby/RubyString.java:7590)
                at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)
                at RESTHelpers::ResponseHelpers.json_response(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/rest.rb:9)
                at RUBY.ERROR (?-mix:)(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:177)
                at org.jruby.RubyMethod.call(org/jruby/RubyMethod.java:118)
                at RUBY.compile!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1293)
                at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:897)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:895)
                at Sinatra::Base.error_block!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:998)
                at RUBY.handle_exception!(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:192)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:960)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:780)
                at ArchivesSpaceService::RequestWrappingMiddleware.call(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:245)
                at Rack::Protection::XSSHeader.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/xss_header.rb:18)
                at Rack::Protection::PathTraversal.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/path_traversal.rb:16)
                at Rack::Protection::JsonCsrf.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/json_csrf.rb:18)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::FrameOptions.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/frame_options.rb:31)
                at Rack::NullLogger.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/nulllogger.rb:9)
                at Rack::Head.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/head.rb:9)
                at Sinatra::ExtendedRack.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:124)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Sinatra::Base.synchronize(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1499)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Rack::Builder.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/builder.rb:134)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:64)
                at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1617)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:49)
                at Rack::Handler::Servlet.call(file:/opt/archivesspace/gems/gems/jruby-rack-1.1.12/lib/jruby-rack-1.1.12.jar!/rack/handler/servlet.rb:22)

_______________________________________________
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group at lyralists.lyrasis.org<mailto:Archivesspace_Users_Group at lyralists.lyrasis.org>
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20131123/e017ea0f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: UPB_MSSSC1555.xml
Type: application/xml
Size: 4966 bytes
Desc: UPB_MSSSC1555.xml
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20131123/e017ea0f/attachment.xml>

More information about the Archivesspace_Users_Group mailing list