[Archivesspace_Users_Group] Character conversion during migration?

Cory Nimer cory_nimer at byu.edu
Mon Nov 25 11:03:40 EST 2013 

Thanks for your help with this, Mark. Attached is another record with the entry for Dublán (line 87), as requested.

Thanks again,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
1108 HBLL
(801) 422-6091

From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Mark A. Matienzo
Sent: Monday, November 25, 2013 6:41 AM
To: Archivesspace Users Group
Subject: Re: [Archivesspace_Users_Group] Character conversion during migration?

Thanks Cory - we'll look into it. Can you also send along the initial record you reported the issue with in your first message?

Best,

Mark A. Matienzo | mark.matienzo at nyu.edu<mailto:mark.matienzo at nyu.edu>
Technical Architect, ArchivesSpace
http://archivesspace.org/

On Nov 22, 2013, at 7:09 PM, Cory Nimer <cory_nimer at byu.edu<mailto:cory_nimer at byu.edu>> wrote:


Mark,

Attached is a brief record from the report that included one of these errors for your review – it is the first character in Ålborg on line 98.

Thanks,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
1108 HBLL
(801) 422-6091

From: archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org> [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:bounces at lyralists.lyrasis.org>] On Behalf OfMark A. Matienzo
Sent: Friday, November 22, 2013 11:24 AM
To: Archivesspace Users Group
Subject: Re: [Archivesspace_Users_Group] Character conversion during migration?

Hi Cory,

Without access to the record itself, it might be hard for us to deduce. It is entirely possible that there's a problem with this character in the AT record. Can you possibly export the record as EAD and send it to us to start?

Best,

Mark A. Matienzo | mark.matienzo at nyu.edu<mailto:mark.matienzo at nyu.edu>
Technical Architect, ArchivesSpace
http://archivesspace.org/

On Nov 22, 2013, at 10:50 AM, Cory Nimer <cory_nimer at byu.edu<mailto:cory_nimer at byu.edu>> wrote:



Going through the report from our migration into ArchivesSpace, it included a number of entries complaining about failed character conversion (example below for Dublán (Mexico)). From the message, it appears that it is trying to convert from ASCII 8 bit to UTF8. We understood from our IT staff that our AT installation was already in UTF8, though.

Is there any way to configure or modify the import routine to avoid this conversion? If we need to clean up our data, how should it be encoded to convert correctly?

Thanks,

Cory Nimer
Manuscripts Cataloger/Metadata Specialist
Brigham Young University
801/422-6091

--------------------------------------------

Endpoint: http://ds1.lib.byu.edu:9089/subjects
AT Identifier:Subject->Dubl‡n (Mexico)--History--Sources
Status code: 500
Status text: Server Error

JSON: {"source":"lcnaf","vocabulary":"/vocabularies/1","external_ids":[{"external_id":"4273","source":"Archivists Toolkit Database::SUBJECT"}],"terms":[{"vocabulary":"/vocabularies/1","term":"Dubl‡n (Mexico)","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"History","term_type":"geographic"},{"vocabulary":"/vocabularies/1","term":"Sources","term_type":"geographic"}]}

org.jruby.exceptions.RaiseException: (Encoding::ConverterNotFoundError) code converter not found (ASCII-8BIT to UTF-8)
                at org.jruby.RubyString.encode(org/jruby/RubyString.java:7590)
                at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)
                at RESTHelpers::ResponseHelpers.json_response(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/rest.rb:9)
                at RUBY.ERROR (?-mix:)(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:177)
                at org.jruby.RubyMethod.call(org/jruby/RubyMethod.java:118)
                at RUBY.compile!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1293)
                at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:897)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.process_route(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:895)
                at Sinatra::Base.error_block!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:998)
                at RUBY.handle_exception!(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/lib/exceptions.rb:192)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:966)
                at Sinatra::Base.dispatch!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:960)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1254)
                at Sinatra::Base.invoke(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:946)
                at Sinatra::Base.call!(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:794)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:780)
                at ArchivesSpaceService::RequestWrappingMiddleware.call(/opt/archivesspace/data/tmp/jetty-0.0.0.0-9089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:245)
                at Rack::Protection::XSSHeader.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/xss_header.rb:18)
                at Rack::Protection::PathTraversal.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/path_traversal.rb:16)
                at Rack::Protection::JsonCsrf.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/json_csrf.rb:18)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::Base.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/base.rb:49)
                at Rack::Protection::FrameOptions.call(/opt/archivesspace/gems/gems/rack-protection-1.5.0/lib/rack/protection/frame_options.rb:31)
                at Rack::NullLogger.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/nulllogger.rb:9)
                at Rack::Head.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/head.rb:9)
                at Sinatra::ExtendedRack.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:124)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Sinatra::Base.synchronize(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1499)
                at Sinatra::Base.call(/opt/archivesspace/gems/gems/sinatra-1.3.6/lib/sinatra/base.rb:1417)
                at Rack::Builder.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/builder.rb:134)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:64)
                at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1617)
                at Rack::URLMap.call(/opt/archivesspace/gems/gems/rack-1.4.5/lib/rack/urlmap.rb:49)
                at Rack::Handler::Servlet.call(file:/opt/archivesspace/gems/gems/jruby-rack-1.1.12/lib/jruby-rack-1.1.12.jar!/rack/handler/servlet.rb:22)

_______________________________________________
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group at lyralists.lyrasis.org<mailto:Archivesspace_Users_Group at lyralists.lyrasis.org>
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

<UPB_MSSSC1555.xml>_______________________________________________
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group at lyralists.lyrasis.org<mailto:Archivesspace_Users_Group at lyralists.lyrasis.org>
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20131125/0935d8d4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: UPB_MSS1420.xml
Type: application/xml
Size: 4941 bytes
Desc: UPB_MSS1420.xml
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20131125/0935d8d4/attachment.xml>

More information about the Archivesspace_Users_Group mailing list