From brianjhoffman at gmail.com Sun Aug 2 11:10:24 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Sun, 2 Aug 2015 11:10:24 -0400 Subject: [Archivesspace_Users_Group] Serving ArchivesSpace with prefix and proxy In-Reply-To: <013D7175-F944-4957-9BB6-28FBC5396EBB@virginia.edu> References: <89120530-E6F5-402A-9F8A-8B4C9A9EF976@gmail.com> <63BA130D-BF95-446C-B1B2-01359656DC8D@gmail.com> <09AB5DCD-F59F-420A-82CE-7F13C1C8E075@virginia.edu> <34E8E503-EFEB-45FF-9D05-31E97C924C67@virginia.edu> <4AA8AB03-2BB4-4027-AB77-E09445748186@virginia.edu> <75E512E9-FB6E-4997-84FF-0A7A180639DD@virginia.edu> <7C61E11B-F43C-4F82-9B29-28C01CFED85E@virginia.edu> <40C2A75C-BCA3-45B6-A836-2A471F51ABCE@virginia.edu> <013D7175-F944-4957-9BB6-28FBC5396EBB@virginia.edu> Message-ID: I think the main problem here was that the instructions for running ArchivesSpace under a prefix were a little half-baked - I?ve reworked things so that in the next release the same set of configuration parameters referenced in the instructions for configuring HTTPS can also be used to configure prefixing by way of the Apache Proxy and ProxyPass directives. You can see the documentation here - note that this does not apply to the current release: https://github.com/archivesspace/archivesspace/blob/prefix-problems/README_PREFIX.md Brian > On Jul 25, 2015, at 3:35 PM, Steven Majewski wrote: > > > Went back to hard coding some of the asset paths in .less assets. > > It appears the .erb trick works for some files but for other causes the precompile to fail. > I figured I?ld go back to looking at that issue after I find all of the required changes and test them with hard coded values. > > > Further testing I found that the component paths in the public resource views are also broken. > > I tested hardcoding the ?/public/? prefix, and that fixes the problem. > > > diff --git a/public/app/views/records/_components.html.erb b/public/app/views/records/_components.html.erb > index e332e6f..4300347 100644 > --- a/public/app/views/records/_components.html.erb > +++ b/public/app/views/records/_components.html.erb > @@ -31,7 +31,7 @@ >
  • > {if has_children}{/if} > > - ${title} > + ${title} > {if has_children}
      {/if} >
      • > --> > > > > I think I may have to give up on the goal of getting this working for our production deployment, at least for the time being. The more I test it, the more bugs I find. I?m not feeling very confident that this is the last one. > > > > ? Steve. > > > >> On Jul 25, 2015, at 10:41 AM, Steven Majewski > wrote: >> >> >> >> >>> On Jul 24, 2015, at 9:44 PM, Steven Majewski > wrote: >>> >>> >>> The resources that are failing all seem to be hardwired in less stylesheets. >>> It would seem that the RAILS_RELATIVE_URL_ROOT patch is unnecessary ? the paths >>> that are variable were already getting prefixed properly, and that can?t do anything >>> about the hardwired paths in these stylesheets. >>> >>> As a hack, it appears to work to edit the hardwired paths in the less stylesheets. >>> ( At least for frontend app, I haven?t tried the same changes to public yet. ) >>> >>> Unfortunately, I?m not familiar enough with lessc and how it?s called in Rails >>> to know if it?s possible to pass the path prefix in as a variable. >>> >>> >> >> Reading the docs on the Rails asset pipeline, it seems the suggested way to do something >> like that ( their example is with sass, not less, but it should be the same sort of thing ) >> is to use .erb templating and that the pipeline will successively process extensions: >> icons.less.erb ==> icons.less ==> icons.css >> >> >> I tried adding the fronted_prefix in icons.less.erb, but my build failed. >> >> >> Thinking I may have had a syntax error, I tried just renaming ?icons.less" to ?icons.less.erb", >> but the build still fails with a not very informative stack track: >> ( I?ve also tried renaming to ?icons.css.less.erb? with result the same. ) >> >> >> frontend:war: >> [echo] Precompiling Rails assets (this can take a little while...) >> [java] rake aborted! >> [java] LoadError: no such file to load -- action_controller/railtie >> [java] org/jruby/RubyKernel.java:1071:in `require' >> [java] /projects/Archivespace/dcs-archivesspace/frontend/config/application.rb:4:in `(root)' >> [java] org/jruby/RubyKernel.java:1071:in `require' >> [java] /projects/Archivespace/dcs-archivesspace/build/jruby-complete-1.7.18.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55:in `require' >> [java] /projects/Archivespace/dcs-archivesspace/build/jruby-complete-1.7.18.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:53:in `require' >> [java] /projects/Archivespace/dcs-archivesspace/frontend/Rakefile:1:in `(root)' >> [java] org/jruby/RubyKernel.java:1087:in `load' >> [java] /projects/Archivespace/dcs-archivesspace/frontend/Rakefile:5:in `(root)' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/rake_module.rb:1:in `(root)' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/rake_module.rb:28:in `load_rakefile' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:689:in `raw_load_rakefile' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:94:in `load_rakefile' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:93:in `load_rakefile' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:77:in `run' >> [java] /projects/Archivespace/dcs-archivesspace/build/gems/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' >> [java] org/jruby/RubyKernel.java:1087:in `load' >> [java] /usr/local/var/rbenv/versions/jruby-1.7.11/bin/rake:23:in `(root)' >> >> >> >> >> For this deployment, I will probably go back to just editing the hardwired urls in those stylesheets. >> Another possible option may be to just serve up the static files directly from apache ? >> not using the proxy to rails app. The question there is whether I can get the public and frontend >> assets to merge together nicely. >> >> >> ? Steve. >> >> >> >>> Here are the paths that I changed in frontend app. >>> I expect to find a similar set in the public app stylesheets. >>> >>> >>> ? Steve. >>> >>> >>> diff --git a/frontend/app/assets/stylesheets/archivesspace/icons.less b/frontend/app/assets/stylesheets/archivesspace/icons.less >>> index 773070d..49edb32 100644 >>> --- a/frontend/app/assets/stylesheets/archivesspace/icons.less >>> +++ b/frontend/app/assets/stylesheets/archivesspace/icons.less >>> @@ -1,10 +1,10 @@ >>> @font-face { >>> font-family: 'icomoon'; >>> - src:url('/assets/icomoon/icomoon.eot?-z7cehr'); >>> - src:url('/assets/icomoon/icomoon.eot?#iefix-z7cehr') format('embedded-opentype'), >>> - url('/assets/icomoon/icomoon.woff?-z7cehr') format('woff'), >>> - url('/assets/icomoon/icomoon.ttf?-z7cehr') format('truetype'), >>> - url('/assets/icomoon/icomoon.svg?-z7cehr#icomoon') format('svg'); >>> + src:url('/admin/assets/icomoon/icomoon.eot?-z7cehr'); >>> + src:url('/admin/assets/icomoon/icomoon.eot?#iefix-z7cehr') format('embedded-opentype'), >>> + url('/admin/assets/icomoon/icomoon.woff?-z7cehr') format('woff'), >>> + url('/admin/assets/icomoon/icomoon.ttf?-z7cehr') format('truetype'), >>> + url('/admin/assets/icomoon/icomoon.svg?-z7cehr#icomoon') format('svg'); >>> } >>> >>> .icomoon { >>> diff --git a/frontend/app/assets/stylesheets/themes/default/bootstrap.less b/frontend/app/assets/stylesheets/themes/default/bootstrap.less >>> index 25150dd..bdf1817 100644 >>> --- a/frontend/app/assets/stylesheets/themes/default/bootstrap.less >>> +++ b/frontend/app/assets/stylesheets/themes/default/bootstrap.less >>> @@ -1,4 +1,4 @@ >>> // override icon paths >>> @import "bootstrap/variables"; >>> - at icon-font-path: "/assets/"; >>> + at icon-font-path: "/admin/assets/"; >>> @import "bootstrap/bootstrap"; >>> >>> >>> >>> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From cbarber at amherst.edu Mon Aug 3 10:55:13 2015 From: cbarber at amherst.edu (Christina Barber) Date: Mon, 3 Aug 2015 14:55:13 +0000 Subject: [Archivesspace_Users_Group] Failed Print to PDF job Message-ID: Hi all, I have had several Print to PDF jobs fail recently and am receiving errors messages like this: org.apache.fop.fo.ValidationException: "fo:block" is not a valid child of "fo:bookmark-title"! (See position 65:-1) org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of "fo:bookmark-title"! (See position 125:-1) Can anyone offer insight into what these fop errors might mean or how they can be corrected? Also, any thoughts on how to determine the position of the errors ("See position 65:-1). Thank you, Chris Christina E. Barber Deputy Archivist Amherst College cbarber at amherst.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Mon Aug 3 11:38:38 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Mon, 3 Aug 2015 11:38:38 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Message-ID: Hey, We're trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I'm getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 4 10:47:56 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 4 Aug 2015 14:47:56 +0000 Subject: [Archivesspace_Users_Group] Failed Print to PDF job In-Reply-To: References: Message-ID: Hi Christina, Yes, the EAD to PDF process requires this tricky XSLT thing that makes figuring out what's going on a little difficult. Would you be able to email me the EAD XML and I can take a look? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Christina Barber Sent: Monday, August 3, 2015 4:55 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] Failed Print to PDF job Hi all, I have had several Print to PDF jobs fail recently and am receiving errors messages like this: org.apache.fop.fo.ValidationException: "fo:block" is not a valid child of "fo:bookmark-title"! (See position 65:-1) org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of "fo:bookmark-title"! (See position 125:-1) Can anyone offer insight into what these fop errors might mean or how they can be corrected? Also, any thoughts on how to determine the position of the errors ("See position 65:-1). Thank you, Chris Christina E. Barber Deputy Archivist Amherst College cbarber at amherst.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From ljdavis at colgate.edu Tue Aug 4 10:49:40 2015 From: ljdavis at colgate.edu (Lora Davis) Date: Tue, 4 Aug 2015 10:49:40 -0400 Subject: [Archivesspace_Users_Group] Failed Print to PDF job In-Reply-To: References: Message-ID: Glad I checked my email before submitting the exact same concern to the group. We're hosted so I can't do much digging, but I tried to generate a PDF from the same (large, tons of series) problem resource record on a virtual machine running ArchivesSpace v1.1.0-rc8 (so, pre-batch job handling of print to PDF) and got the same error. So, I suspect there is an issue with the resource record itself playing nicely with the XSL-FO, but don't know how to go about troubleshooting it (and, frankly, haven't had the time). EAD exports just fine so I just published a quick shell of a guide to meet the needs of the user requesting the PDF, but obviously want to get to the bottom of this as well. FYI: Full error log pasted below Lora Generating PDF for Ernest K. Gann papers org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of "fo:bookmark-title"! (See position 45:-1) net.sf.saxon.event.ContentHandlerProxy.handleSAXException(net/sf/saxon/event/ContentHandlerProxy.java:542) net.sf.saxon.event.ContentHandlerProxy.startContent(net/sf/saxon/event/ContentHandlerProxy.java:386) net.sf.saxon.event.NamespaceReducer.startContent(net/sf/saxon/event/NamespaceReducer.java:199) net.sf.saxon.event.ReceivingContentHandler.startElement(net/sf/saxon/event/ReceivingContentHandler.java:351) net.sf.saxon.event.Sender.sendSAXSource(net/sf/saxon/event/Sender.java:428) net.sf.saxon.event.Sender.send(net/sf/saxon/event/Sender.java:170) net.sf.saxon.IdentityTransformer.transform(net/sf/saxon/IdentityTransformer.java:46) java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:606) RUBY.to_pdf(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/AS_fop.rb:45) RUBY.run(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/print_to_pdf_runner.rb:46) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:24) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:24) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:23) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:23) RUBY.run(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/print_to_pdf_runner.rb:23) BackgroundJobQueue.run_pending_job(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100) BackgroundJobQueue.run_pending_job(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100) RUBY.start_background_thread(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128) java.lang.Thread.run(java/lang/Thread.java:745) On Mon, Aug 3, 2015 at 10:55 AM, Christina Barber wrote: > Hi all, > > > > I have had several Print to PDF jobs fail recently and am receiving errors > messages like this: > > > > org.apache.fop.fo.ValidationException: "fo:block" is not a valid child of > "fo:bookmark-title"! (See position 65:-1) > > org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of > "fo:bookmark-title"! (See position 125:-1) > > > > Can anyone offer insight into what these fop errors might mean or how they > can be corrected? Also, any thoughts on how to determine the position of > the errors (?See position 65:-1). > > > > Thank you, > > Chris > > > > Christina E. Barber > > Deputy Archivist > > Amherst College > > cbarber at amherst.edu > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 4 10:58:38 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 4 Aug 2015 14:58:38 +0000 Subject: [Archivesspace_Users_Group] Failed Print to PDF job In-Reply-To: References: , Message-ID: Hi Lora, Sure, just send me the EAD XML and I can take a look. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Tuesday, August 4, 2015 4:49 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Failed Print to PDF job Glad I checked my email before submitting the exact same concern to the group. We're hosted so I can't do much digging, but I tried to generate a PDF from the same (large, tons of series) problem resource record on a virtual machine running ArchivesSpace v1.1.0-rc8 (so, pre-batch job handling of print to PDF) and got the same error. So, I suspect there is an issue with the resource record itself playing nicely with the XSL-FO, but don't know how to go about troubleshooting it (and, frankly, haven't had the time). EAD exports just fine so I just published a quick shell of a guide to meet the needs of the user requesting the PDF, but obviously want to get to the bottom of this as well. FYI: Full error log pasted below Lora Generating PDF for Ernest K. Gann papers org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of "fo:bookmark-title"! (See position 45:-1) net.sf.saxon.event.ContentHandlerProxy.handleSAXException(net/sf/saxon/event/ContentHandlerProxy.java:542) net.sf.saxon.event.ContentHandlerProxy.startContent(net/sf/saxon/event/ContentHandlerProxy.java:386) net.sf.saxon.event.NamespaceReducer.startContent(net/sf/saxon/event/NamespaceReducer.java:199) net.sf.saxon.event.ReceivingContentHandler.startElement(net/sf/saxon/event/ReceivingContentHandler.java:351) net.sf.saxon.event.Sender.sendSAXSource(net/sf/saxon/event/Sender.java:428) net.sf.saxon.event.Sender.send(net/sf/saxon/event/Sender.java:170) net.sf.saxon.IdentityTransformer.transform(net/sf/saxon/IdentityTransformer.java:46) java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:606) RUBY.to_pdf(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/AS_fop.rb:45) RUBY.run(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/print_to_pdf_runner.rb:46) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:24) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:24) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:23) RequestContext.open(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/request_context.rb:23) RUBY.run(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/print_to_pdf_runner.rb:23) BackgroundJobQueue.run_pending_job(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100) BackgroundJobQueue.run_pending_job(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100) RUBY.start_background_thread(/home/colgate/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128) java.lang.Thread.run(java/lang/Thread.java:745) On Mon, Aug 3, 2015 at 10:55 AM, Christina Barber > wrote: Hi all, I have had several Print to PDF jobs fail recently and am receiving errors messages like this: org.apache.fop.fo.ValidationException: "fo:block" is not a valid child of "fo:bookmark-title"! (See position 65:-1) org.apache.fop.fo.ValidationException: "fo:inline" is not a valid child of "fo:bookmark-title"! (See position 125:-1) Can anyone offer insight into what these fop errors might mean or how they can be corrected? Also, any thoughts on how to determine the position of the errors ("See position 65:-1). Thank you, Chris Christina E. Barber Deputy Archivist Amherst College cbarber at amherst.edu _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 4 11:01:24 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 4 Aug 2015 15:01:24 +0000 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: Hey Patrick, Hm, can you send me an EAD file and I can try this out? Also, are you running on a windows machine? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Monday, August 3, 2015 5:38 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hey, We're trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I'm getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Tue Aug 4 11:51:44 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Tue, 4 Aug 2015 11:51:44 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. > On Aug 3, 2015, at 11:38 AM, Galligan, Patrick wrote: > > Hey, > > We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. > > However, when trying to run it from our dev server, I?m getting the following error: > > NoMethodError: undefined method `rewind' for nil:NilClass > > Any idea what could be causing that? > > Patrick Galligan > Rockefeller Archive Center > Assistant Digital Archivist > 914-366-6386 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 4 11:59:35 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 4 Aug 2015 15:59:35 +0000 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: , Message-ID: Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steven Majewski Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn't find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there's a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] - Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We're trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I'm getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From harnold at rockarch.org Tue Aug 4 12:11:16 2015 From: harnold at rockarch.org (Arnold, Hillel) Date: Tue, 4 Aug 2015 12:11:16 -0400 Subject: [Archivesspace_Users_Group] Mass export of EAD In-Reply-To: References: Message-ID: Hi, Just wanted to follow up on this thread. It appears that changing an agent or subject record associated with a resource or archival_object changes the modified date for that resource or archival_object. At least, when using the ?modified_since? parameter on both the resource and archival_objects endpoints of the AS API, those resources/archival_objects are returned. Can someone who?s more familiar with the business logic for the ?modified_since? parameter confirm this? I don?t see this parameter documented anywhere in the AS API documentation, so I kind of feel like I?m shooting in the dark. Thanks! Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Wednesday, July 29, 2015 at 6:48 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD So I did a bit more looking into this today and apparently the archival_objects parameter accepts the modified_since parameter as well, so as Brian suggests it?s really easy to query for resource and component mtimes. I tweaked my incremental export script so it looks in both places now: https://github.com/RockefellerArchiveCenter/scripts/blob/master/archivesspace/asExportIncremental.py I haven?t tried, but I?m assuming you could use this same pattern to look for modified agents/subjects etc., if you wanted to. Also, the other EAD export script that Patrick sent around the other day had an issue with exporting large resources, which I?ve now fixed by streaming the response: https://github.com/RockefellerArchiveCenter/scripts/blob/master/archivesspace/asExport-ead.py However, if you?re going to do a mass export of all the EAD from your repo it probably makes sense to just use the ead_export script that comes with AS. It?s way more robust and was written by people who actually know what they?re doing. Hillel From: brian > Reply-To: Archivesspace Users Group > Date: Wednesday, July 29, 2015 at 12:12 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD It seems to me like it might not be a great idea to change the business rules for how a resource record's mtime gets updated, but that it wouldn't be too hard to add a new field to the resource that tracks the last component update. It also seems like it wouldn't be too hard for the services under discussion to query for component mtimes as well as resource mtimes. Sent from my T-Mobile 4G LTE Device -------- Original message -------- From: "Arnold, Hillel" > Date:07/28/2015 4:23 PM (GMT-05:00) To: Archivesspace Users Group > Cc: Subject: Re: [Archivesspace_Users_Group] Mass export of EAD Hi Mark, Yup, you?re absolutely right. I made the (erroneous) assumption that changes to mtimes for descendant components would propagate in the resource record as well. This seems like something that would be best done in AS itself; I?m wondering if Brian or Chris have any thoughts about how this could be accomplished? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Mark Cooper > Reply-To: Archivesspace Users Group > Date: Tuesday, July 28, 2015 at 3:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD In case you're interested, but haven't seen it, there is a doc for the export script: https://github.com/archivesspace/archivesspace/blob/master/launcher/ead_export/REPO_EAD_EXPORT_README.md Right now it just exports every EAD associated with a specified repo to a zip file and doesn't have date or incremental awareness. That could be added as the resources endpoint accepts a "modified_since" parameter (as a timestamp). I just rough tested: date -d '2015-07-01 00:00:00' +'%s' # 1435734000 curl -H "X-ArchivesSpace-Session: $TOKEN" "http://localhost:8089/repositories/2/resources?all_ids=true&modified_since=1435734000" Returns what appears to be the correct set of results. The obvious problem is that it isn't descendent aware, so it's only direct changes to the topmost resource record that count for the "modified_since" parameter. If the api also factored in descendent mtimes for records types that have them that would have been ideal =) Some workaround, or a solution, for that limitation is going to be required for any time based incremental type export (assuming you need any descendent / component updates to be considered as an update to the resource for what you're doing -- in other words, you may not be able to just rely on the resource mtime). Mark Cooper Technical Lead, Hosting and Support LYRASIS email: mark.cooper at lyrasis.org skype: mark_c_cooper ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Suda, Phillip J > Sent: Tuesday, July 28, 2015 9:13 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Mass export of EAD Thanks all for your suggestions/scripts/help. This is a great start. Thank you, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 From:archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Kevin Clair Sent: Tuesday, July 28, 2015 10:41 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD I have a Perl script I run from command line that runs every batch export I want or need at this point: https://github.com/duspeccoll/as_utils/blob/master/reports.pl It grabs the JSON list of all the IDs for a given model, and then either dumps everything into a single JSON object or exports to some other format. The EAD export is lines 206-224. This is *extremely* customized for our environment, and I?ve made no effort yet to modify it for general use, but it?s an idea of how one could go about doing this. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Tuesday, July 28, 2015 9:34 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Mass export of EAD There is ead_export.sh in the scripts directory. It only exports published collections, but that can be changed in the code if needed. That script runs locally on the AS server and it writes into the archivesspace/data/ directory, so you need write access. resource ids will not necessarily be sequential after deletions and transfers, but you can get a JSON list of all of the ids from /repositories/$REPO_ID/resources?all_ids=true and then loop over those ids. ? Steve Majewski On Jul 28, 2015, at 11:15 AM, Alexander Duryee > wrote: Phil, As far as I'm aware, there's no bulk EAD export functionality in ASpace. However, since ASpace's resource identifiers are sequential integers, you can loop over each resource id in a repository and make an API call for its EAD record: for x in {first..last}; do curl -H '[session token]' "https://[address]/repositories/[id]/resource_descriptions/${x}.xml" > aspace_${x}.xml; done A loop like that should generate EAD records for each resource in your repository. Regards, --Alex On Tue, Jul 28, 2015 at 10:27 AM, Suda, Phillip J > wrote: Greetings all, Is there an API or mass export feature for exporting all EAD records from a repository, etc.? I am only seeing a collection level export feature. Thanks, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Alexander Duryee Metadata Archivist New York Public Library (917)-229-9590 alexanderduryee at nypl.org _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Tue Aug 4 12:15:35 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Tue, 4 Aug 2015 12:15:35 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: , Message-ID: Awesome! Thanks guys, got this running perfectly on our development server. As always, we'll be updating our github with any code that we produce in case anyone else is interested in automatically generating PDFs in the backend. Thanks! Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Tuesday, August 04, 2015 12:00 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 * archivesspace/ead2pdf * GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn't find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there's a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] - Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We're trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I'm getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From brianjhoffman at gmail.com Tue Aug 4 12:49:32 2015 From: brianjhoffman at gmail.com (brian) Date: Tue, 04 Aug 2015 12:49:32 -0400 Subject: [Archivesspace_Users_Group] (no subject) Message-ID: Sent from my T-Mobile 4G LTE Device -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 4 13:39:54 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 4 Aug 2015 17:39:54 +0000 Subject: [Archivesspace_Users_Group] Updated Documentation Message-ID: Hi All, Just wanted to let you all know I've been adding some more documentation to the http://archivesspace.github.io/archivesspace/ . Let me know what you think or better yet send a pull request. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From harnold at rockarch.org Tue Aug 4 14:41:14 2015 From: harnold at rockarch.org (Arnold, Hillel) Date: Tue, 4 Aug 2015 14:41:14 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From psuda1 at tulane.edu Tue Aug 4 14:54:58 2015 From: psuda1 at tulane.edu (Suda, Phillip J) Date: Tue, 4 Aug 2015 18:54:58 +0000 Subject: [Archivesspace_Users_Group] ASpace and Apache revisited In-Reply-To: References: <6FB2CC92-A520-4701-BE30-74A6D2E35298@virginia.edu> <1F1E72103798F04D96C355B296D7C61B4FCF3D@mb2-uts.du.edu>, Message-ID: I am still waiting on indexing to finish (indexing rounds still running). The data in Archon was 2GB+/-. When I ran this locally, things started up right away on my MAC. When I moved to Linux server, frontend(staff interface) starts but public takes forever and is still indexing. I tried adjust the indexer threads/cpus but still not finished after about 3 days. Any ideas? I guess I can rail against University IT to give me more memory/cpu. Thanks, Phil ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Suda, Phillip J Sent: Friday, July 31, 2015 10:15 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited Thanks Kevin. I will give these suggestions a try. I appreciate it. Phil From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Kevin Clair Sent: Friday, July 31, 2015 10:07 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited When we first migrated, we also had timeout issues during the initial index round. We were able to add more memory to the VM ArchivesSpace runs on, which solved the problem for us, but if you can?t do that you can also adjust the number of CPU cores ArchivesSpace uses to index and the number of records it indexes at a time, which lengthens the amount of time the index takes but is less resource-intensive. I think the :indexer_records_per_thread and :indexer_thread_count settings are 25 and 4 out of the box, respectively; I have it set to 20 and 2 on my test VMs because they have less memory and processing power than our production server. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Suda, Phillip J Sent: Friday, July 31, 2015 8:56 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited I confirmed that the ports are open. I do not see any errors but it still seems to be indexing (?running index round??). From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 9:50 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited Firewall settings ? ( Always my first suspicion when using a non standard port # ) Can you access it from the localhost ? Any errors in the logfile on startup ? ? Steve Majewski On Jul 31, 2015, at 10:28 AM, Suda, Phillip J > wrote: Greetings all, We have ASpace 1.3.0 up and running on a dev server. We are able to get to localhost:8080 (staff interface) but we are unable to get localhost:8081 open. We are getting timeout errors, etc. The config settings are listed below: AppConfig[:backend_url] = "http://localhost:8089" AppConfig[:frontend_url] = "http://localhost:8080" AppConfig[:frontend_prefix] = proc { "#{URI(AppConfig[:frontend_url]).path}/".gsub(%r{/+$}, "/") } AppConfig[:solr_url] = "http://localhost:8090" AppConfig[:indexer_url] = "http://localhost:8091" AppConfig[:public_url] = "http://localhost:8081" AppConfig[:public_prefix] = proc { "#{URI(AppConfig[:public_url]).path}/".gsub(%r{/+$}, "/") } The Apache config is Ataspace.tulane.edu:8080 (staff) Ataspace.tulane.edu:8081 (public) Thanks, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Tue Aug 4 15:03:00 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Tue, 4 Aug 2015 15:03:00 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: <5FB4EC11-F6F3-4906-A6A9-9E7DA15CBEE4@virginia.edu> I?ve forked it at: https://github.com/sdm7g/ead2pdf and made some changes. It?s working better but still not properly out of the jar file. Usually, xslt includes are relative based on the base directory of the parent stylesheet, so this would do it: diff --git a/lib/as-ead-pdf.xsl b/lib/as-ead-pdf.xsl index 3954349..ccf041b 100644 --- a/lib/as-ead-pdf.xsl +++ b/lib/as-ead-pdf.xsl @@ -21,7 +21,7 @@ - + However, the XSLT is being passed in as a stream, so it doesn?t have a context for the xslt file path, and is falling back to the user?s PWD. I added this to pass the context in with system_id: diff --git a/lib/AS_fop.rb b/lib/AS_fop.rb index 1f97f0e..8b72e3a 100644 --- a/lib/AS_fop.rb +++ b/lib/AS_fop.rb @@ -22,6 +22,7 @@ class ASFop attr_accessor :source attr_accessor :xslt + attr_accessor :file def initialize(source, output= nil, xslt = nil ) abort("#{source} not found") unless File.exists?(source) @@ -30,11 +31,12 @@ class ASFop @source = source @xml = IO.read(source) @output = output.nil? ? "#{source}.pdf" : output + @file = xslt if xslt.nil? - file =File.join( File.dirname(__FILE__), '../lib' ,'as-ead-pdf.xsl').gsub("\\", "/" ) - @xslt = File.read( file, system_id: file ) - else + @file =File.join( File.dirname(__FILE__) ,'as-ead-pdf.xsl').gsub("\\", "/" ) + @xslt = File.read( file, system_id: @file ) + else @xslt = File.read( xslt ) end @@ -42,7 +44,7 @@ class ASFop def to_fo - transformer = Saxon.XSLT(@xslt) + transformer = Saxon.XSLT(@xslt, system_id: @file ) transformer.transform(Saxon.XML(@xml)).to_s end And it runs correctly if I run calling jruby on bin/ead2pdf-main.rb. However, after packaging up the jar file with warble, I get errors running it out of the jar. This gives me an error: java -jar ../sdm7g/ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] in as-ead-pdf.xsl: XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-helper-functions.xsl: /projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-helper-functions.xsl (No such file or directory) As does this, passing the stylesheet explicitly: work$ java -jar ../sdm7g/ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf 'file:/projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-ead-pdf.xsl' prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] in as-ead-pdf.xsl: XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-helper-functions.xsl: /projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-helper-functions.xsl (No such file or directory) But prefixing that URL referencing the jar file with ?jar:? works ( except that now it?s finding the include, but not finding the .png logo ): work$ java -jar ../sdm7g/ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf 'jar:file:/projects/Archivespace/sdm7g/ead2pdf/ead2pdf.jar!/ead2pdf/lib/as-ead-pdf.xsl' prod/local-exp/22-MSS12838.xml 22.pdf Aug 04, 2015 2:57:05 PM org.apache.fop.events.LoggingEventListener processEvent SEVERE: Image not found. URI: ./lib/archivesspace.small.png. (See position 74:55) Aug 04, 2015 2:57:05 PM org.apache.fop.events.LoggingEventListener processEvent INFO: Rendered page #1. Aug 04, 2015 2:57:06 PM org.apache.fop.events.LoggingEventListener processEvent INFO: Rendered page #2. Not quite sure how to fix this in the code yet? ? Steve. > On Aug 4, 2015, at 2:41 PM, Arnold, Hillel wrote: > > Hi Chris, > I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. > > Hillel Arnold > Lead Digital Archivist > Rockefeller Archive Center > > From: Chris Fitzpatrick > > Reply-To: Archivesspace Users Group > > Date: Tuesday, August 4, 2015 at 11:59 AM > To: Archivesspace Users Group > > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > > > Hi, > > Yeah, I just updated the ead2pdf jar, with I think fixes this.. > > It's here: > https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 > > Release 0.0.5 ? archivesspace/ead2pdf ? GitHub > ead2pdf - ASpace EAD2PDF > Read more... > > b,chris. > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > > Sent: Tuesday, August 4, 2015 5:51 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > > I ran the conversion on a random exported EAD file and got the same error. > The rest of the message shows it couldn?t find as-helper-functions.xsl > > work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf > prod/local-exp/22-MSS12838.xml > 22.pdf > Error at /xsl:stylesheet/xsl:include[1] > XTSE0165: I/O error reported by XML parser processing > file:/projects/Archivespace/work/lib/as-helper-functions.xsl: > /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) > NoMethodError: undefined method `rewind' for nil:NilClass > > It looks like there?s a path dependency on finding that file: > > ead2pdf$ ack as-helper-functions > lib/as-ead-pdf.xsl > 24: > > lib/AS_fop.rb > 36: # @xslt.gsub!('', "" ) > > > When I cd into the ead2pdf directory and run the same transform, it runs without error. > > [ file path is: ead2pdf/lib/as-helper-functions.xsl ] > > ? Steve. > > > >> On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: >> >> Hey, >> >> We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. >> >> However, when trying to run it from our dev server, I?m getting the following error: >> >> NoMethodError: undefined method `rewind' for nil:NilClass >> >> Any idea what could be causing that? >> >> Patrick Galligan >> Rockefeller Archive Center >> Assistant Digital Archivist >> 914-366-6386 >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From harnold at rockarch.org Tue Aug 4 15:03:19 2015 From: harnold at rockarch.org (Arnold, Hillel) Date: Tue, 4 Aug 2015 15:03:19 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 2:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From jhamblet at nmu.edu Tue Aug 4 15:04:37 2015 From: jhamblet at nmu.edu (Hambleton, John S) Date: Tue, 4 Aug 2015 19:04:37 +0000 Subject: [Archivesspace_Users_Group] ASpace and Apache revisited In-Reply-To: References: <6FB2CC92-A520-4701-BE30-74A6D2E35298@virginia.edu> <1F1E72103798F04D96C355B296D7C61B4FCF3D@mb2-uts.du.edu>, Message-ID: <815f9b46fb1e4dc080c9a1e52e876a20@EX01.ads.nmu.edu> Something similar happened to us after upgrading from 1.1.2 to 1.3.0 on Linux. I triggered a "re-index" and kept an eye on the log "archivespace.out". Looked like the same: location records event records archival object records resource records digital objects subject records were being re-indexed over and over again. It "looked" from the log like some kind of error was hit then the indexer would cycle all over again. I filed a case: "AS-42". To get out of this I did the following: -Stop archivesspace -Redo the upgrade (I had saved the 1.1.2 directory) -Do not trigger a complete re-index Then it appeared things were fine. John H NMU From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Suda, Phillip J Sent: Tuesday, August 04, 2015 2:55 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited I am still waiting on indexing to finish (indexing rounds still running). The data in Archon was 2GB+/-. When I ran this locally, things started up right away on my MAC. When I moved to Linux server, frontend(staff interface) starts but public takes forever and is still indexing. I tried adjust the indexer threads/cpus but still not finished after about 3 days. Any ideas? I guess I can rail against University IT to give me more memory/cpu. Thanks, Phil ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Suda, Phillip J > Sent: Friday, July 31, 2015 10:15 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited Thanks Kevin. I will give these suggestions a try. I appreciate it. Phil From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Kevin Clair Sent: Friday, July 31, 2015 10:07 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited When we first migrated, we also had timeout issues during the initial index round. We were able to add more memory to the VM ArchivesSpace runs on, which solved the problem for us, but if you can't do that you can also adjust the number of CPU cores ArchivesSpace uses to index and the number of records it indexes at a time, which lengthens the amount of time the index takes but is less resource-intensive. I think the :indexer_records_per_thread and :indexer_thread_count settings are 25 and 4 out of the box, respectively; I have it set to 20 and 2 on my test VMs because they have less memory and processing power than our production server. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Suda, Phillip J Sent: Friday, July 31, 2015 8:56 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited I confirmed that the ports are open. I do not see any errors but it still seems to be indexing ("running index round..."). From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 9:50 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ASpace and Apache revisited Firewall settings ? ( Always my first suspicion when using a non standard port # ) Can you access it from the localhost ? Any errors in the logfile on startup ? - Steve Majewski On Jul 31, 2015, at 10:28 AM, Suda, Phillip J > wrote: Greetings all, We have ASpace 1.3.0 up and running on a dev server. We are able to get to localhost:8080 (staff interface) but we are unable to get localhost:8081 open. We are getting timeout errors, etc. The config settings are listed below: AppConfig[:backend_url] = "http://localhost:8089" AppConfig[:frontend_url] = "http://localhost:8080" AppConfig[:frontend_prefix] = proc { "#{URI(AppConfig[:frontend_url]).path}/".gsub(%r{/+$}, "/") } AppConfig[:solr_url] = "http://localhost:8090" AppConfig[:indexer_url] = "http://localhost:8091" AppConfig[:public_url] = "http://localhost:8081" AppConfig[:public_prefix] = proc { "#{URI(AppConfig[:public_url]).path}/".gsub(%r{/+$}, "/") } The Apache config is Ataspace.tulane.edu:8080 (staff) Ataspace.tulane.edu:8081 (public) Thanks, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From mclellanah at longwood.edu Tue Aug 4 15:10:24 2015 From: mclellanah at longwood.edu (McLellan, Amanda) Date: Tue, 4 Aug 2015 15:10:24 -0400 Subject: [Archivesspace_Users_Group] Question about java Message-ID: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> Hi all, We're in the process of obtaining AS; our IT department just let me know that they likely won't install it because it is java based and they're getting away from all java programs. (How this is going to shake out with our java-based ILS.... *sigh*) Anyway - does anyone have any advice about what to say or do with an IT department that considers Java to be a security risk? Does AS have any plans to move away from java at any point? Amanda ________________________________ Amanda Hartman McLellan Head of Special Collections and Digital Initiatives Tel: 434-395-2443 -------------- next part -------------- An HTML attachment was scrubbed... URL: From brianjhoffman at gmail.com Tue Aug 4 15:19:44 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Tue, 4 Aug 2015 15:19:44 -0400 Subject: [Archivesspace_Users_Group] Question about java In-Reply-To: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> References: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> Message-ID: <526BEE78-654F-4126-A181-9BFA476A9BE4@gmail.com> It sounds like you have a very fancy IT department - treat them nicely! Ironically, a major point of AS running in the JVM is to make it palatable to IT departments? :) > On Aug 4, 2015, at 3:10 PM, McLellan, Amanda wrote: > > Hi all, > > We?re in the process of obtaining AS; our IT department just let me know that they likely won?t install it because it is java based and they?re getting away from all java programs. (How this is going to shake out with our java-based ILS?. *sigh*) Anyway ? does anyone have any advice about what to say or do with an IT department that considers Java to be a security risk? Does AS have any plans to move away from java at any point? > > Amanda > > Amanda Hartman McLellan > Head of Special Collections and Digital Initiatives > Tel: 434-395-2443 > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Tue Aug 4 15:33:25 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Tue, 4 Aug 2015 15:33:25 -0400 Subject: [Archivesspace_Users_Group] Question about java In-Reply-To: <526BEE78-654F-4126-A181-9BFA476A9BE4@gmail.com> References: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> <526BEE78-654F-4126-A181-9BFA476A9BE4@gmail.com> Message-ID: <42647CE8-AF42-40BC-B792-61EF0943E367@virginia.edu> I wonder what they consider NOT a security risk! ? Steve. > On Aug 4, 2015, at 3:19 PM, Brian Hoffman wrote: > > It sounds like you have a very fancy IT department - treat them nicely! > > Ironically, a major point of AS running in the JVM is to make it palatable to IT departments? :) > > > >> On Aug 4, 2015, at 3:10 PM, McLellan, Amanda > wrote: >> >> Hi all, >> >> We?re in the process of obtaining AS; our IT department just let me know that they likely won?t install it because it is java based and they?re getting away from all java programs. (How this is going to shake out with our java-based ILS?. *sigh*) Anyway ? does anyone have any advice about what to say or do with an IT department that considers Java to be a security risk? Does AS have any plans to move away from java at any point? >> >> Amanda >> >> Amanda Hartman McLellan >> Head of Special Collections and Digital Initiatives >> Tel: 434-395-2443 >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From brianjhoffman at gmail.com Tue Aug 4 15:33:52 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Tue, 4 Aug 2015 15:33:52 -0400 Subject: [Archivesspace_Users_Group] Question about java In-Reply-To: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> References: <24AE227ABBEF4848B7DF69673190446B73D7C8CF04@terrier.longwood.edu> Message-ID: <1DC628FD-540E-4B00-AC85-8C5753F2FA5E@gmail.com> Hi Amanda, A more serious response - have you asked them if they have read the README and other basic documentation for administrators? It is available here: https://github.com/archivesspace/archivesspace/blob/master/README.md Is it possible that they are incorrectly assuming that ArchivesSpace is a Java applet for the browser? If they still insist that it is a security problem, I would insist that they be more explicit about what their concerns are. Brian > On Aug 4, 2015, at 3:10 PM, McLellan, Amanda wrote: > > Hi all, > > We?re in the process of obtaining AS; our IT department just let me know that they likely won?t install it because it is java based and they?re getting away from all java programs. (How this is going to shake out with our java-based ILS?. *sigh*) Anyway ? does anyone have any advice about what to say or do with an IT department that considers Java to be a security risk? Does AS have any plans to move away from java at any point? > > Amanda > > Amanda Hartman McLellan > Head of Special Collections and Digital Initiatives > Tel: 434-395-2443 > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Tue Aug 4 19:03:24 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Tue, 4 Aug 2015 19:03:24 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: Message-ID: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> My fork at https://github.com/sdm7g/ead2pdf is working out of the .jar alone now, finding the included stylesheet, however it?s still getting an error on including the logo ./lib/archivesspace.small.png which it still expects to be relative to $PWD. Looking for a fix for that... ? Steve. > On Aug 4, 2015, at 3:03 PM, Arnold, Hillel wrote: > > Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? > > Hillel Arnold > Lead Digital Archivist > Rockefeller Archive Center > > From: , Hillel Arnold > > Reply-To: Archivesspace Users Group > > Date: Tuesday, August 4, 2015 at 2:41 PM > To: Archivesspace Users Group > > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > Hi Chris, > I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. > > Hillel Arnold > Lead Digital Archivist > Rockefeller Archive Center > > From: Chris Fitzpatrick > > Reply-To: Archivesspace Users Group > > Date: Tuesday, August 4, 2015 at 11:59 AM > To: Archivesspace Users Group > > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > > > Hi, > > Yeah, I just updated the ead2pdf jar, with I think fixes this.. > > It's here: > https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 > > Release 0.0.5 ? archivesspace/ead2pdf ? GitHub > ead2pdf - ASpace EAD2PDF > Read more... > > b,chris. > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > > Sent: Tuesday, August 4, 2015 5:51 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > > I ran the conversion on a random exported EAD file and got the same error. > The rest of the message shows it couldn?t find as-helper-functions.xsl > > work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf > prod/local-exp/22-MSS12838.xml > 22.pdf > Error at /xsl:stylesheet/xsl:include[1] > XTSE0165: I/O error reported by XML parser processing > file:/projects/Archivespace/work/lib/as-helper-functions.xsl: > /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) > NoMethodError: undefined method `rewind' for nil:NilClass > > It looks like there?s a path dependency on finding that file: > > ead2pdf$ ack as-helper-functions > lib/as-ead-pdf.xsl > 24: > > lib/AS_fop.rb > 36: # @xslt.gsub!('', "" ) > > > When I cd into the ead2pdf directory and run the same transform, it runs without error. > > [ file path is: ead2pdf/lib/as-helper-functions.xsl ] > > ? Steve. > > > >> On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: >> >> Hey, >> >> We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. >> >> However, when trying to run it from our dev server, I?m getting the following error: >> >> NoMethodError: undefined method `rewind' for nil:NilClass >> >> Any idea what could be causing that? >> >> Patrick Galligan >> Rockefeller Archive Center >> Assistant Digital Archivist >> 914-366-6386 >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From sdm7g at virginia.edu Wed Aug 5 00:25:47 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Wed, 5 Aug 2015 00:25:47 -0400 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import Message-ID: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. Looking further, I find a Jira issue reporting this: https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 pointing me to the Yale-ead-exporter plugin: https://github.com/archivesspace/yale-ead-exporter I downloaded and installed the yale-ead-exporter. ArchivesSpace fails to restart do to a syntax error. I fixed and reported syntax error: https://github.com/archivesspace/yale-ead-exporter/issues/1 and restarted successfully. I installed plugin on both servers and did another export and import cycle. This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. BTW: Is this the best and current repo for that work: https://github.com/hudmol/container_management I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. ? Steve Majewski -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From james at hudmol.com Wed Aug 5 02:43:37 2015 From: james at hudmol.com (James Bullen) Date: Wed, 5 Aug 2015 16:43:37 +1000 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> Message-ID: <8A8FC33E-986A-46CE-AC1B-6CB5BE165E35@hudmol.com> Hi Steve, Just on the container management repos: hudmol/container_management is the version developed for Yale which currently works against AS v1.1. hudmol/container_management_dartmouth is a fork developed for Dartmouth that includes support for AS v1.3 and the ability to print container labels. Cheers, James > On Aug 5, 2015, at 2:25 PM, Steven Majewski > wrote: > > > We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. > > Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. > > Looking further, I find a Jira issue reporting this: > https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 > > pointing me to the Yale-ead-exporter plugin: > > https://github.com/archivesspace/yale-ead-exporter > > > I downloaded and installed the yale-ead-exporter. > ArchivesSpace fails to restart do to a syntax error. > > I fixed and reported syntax error: > https://github.com/archivesspace/yale-ead-exporter/issues/1 > > and restarted successfully. > I installed plugin on both servers and did another export and import cycle. > > This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. > > > The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. > > > I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. > > I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. > > BTW: Is this the best and current repo for that work: > https://github.com/hudmol/container_management > > I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. > > > ? Steve Majewski > > > > > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > !DSPAM:55c1905d40921268321363! -------------- next part -------------- An HTML attachment was scrubbed... URL: From robin_mcelheny at harvard.edu Wed Aug 5 11:55:32 2015 From: robin_mcelheny at harvard.edu (McElheny, Robin G.) Date: Wed, 5 Aug 2015 15:55:32 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports Message-ID: At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn't see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them - and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. [cid:image001.jpg at 01D0CF75.A0567BD0] * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don't do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: [cid:image002.jpg at 01D0CF75.A0567BD0] * Here's another example: [cid:image003.jpg at 01D0CF75.A0567BD0] * In the case of an HTML report, it displays page footers - odd for online display. [htmlreport] Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: [cid:image005.jpg at 01D0CF75.A0567BD0] * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in "Waiting for (server)" messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 16855 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 59883 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.jpg Type: image/jpeg Size: 37229 bytes Desc: image003.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.jpg Type: image/jpeg Size: 21318 bytes Desc: image004.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.jpg Type: image/jpeg Size: 22259 bytes Desc: image005.jpg URL: From sdm7g at virginia.edu Wed Aug 5 12:07:28 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Wed, 5 Aug 2015 12:07:28 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> Message-ID: OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. You should be able to download and run just the jar file from this release. Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. ? Steve > On Aug 4, 2015, at 7:03 PM, Steven Majewski wrote: > > My fork at https://github.com/sdm7g/ead2pdf > is working out of the .jar alone now, finding the included stylesheet, > however it?s still getting an error on including the logo ./lib/archivesspace.small.png > which it still expects to be relative to $PWD. > > Looking for a fix for that... > > ? Steve. > > > >> On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: >> >> Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? >> >> Hillel Arnold >> Lead Digital Archivist >> Rockefeller Archive Center >> >> From: , Hillel Arnold > >> Reply-To: Archivesspace Users Group > >> Date: Tuesday, August 4, 2015 at 2:41 PM >> To: Archivesspace Users Group > >> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >> >> Hi Chris, >> I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. >> >> Hillel Arnold >> Lead Digital Archivist >> Rockefeller Archive Center >> >> From: Chris Fitzpatrick > >> Reply-To: Archivesspace Users Group > >> Date: Tuesday, August 4, 2015 at 11:59 AM >> To: Archivesspace Users Group > >> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >> >> >> >> Hi, >> >> Yeah, I just updated the ead2pdf jar, with I think fixes this.. >> >> It's here: >> https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 >> >> Release 0.0.5 ? archivesspace/ead2pdf ? GitHub >> ead2pdf - ASpace EAD2PDF >> Read more... >> >> b,chris. >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > >> Sent: Tuesday, August 4, 2015 5:51 PM >> To: Archivesspace Users Group >> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >> >> >> I ran the conversion on a random exported EAD file and got the same error. >> The rest of the message shows it couldn?t find as-helper-functions.xsl >> >> work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf >> prod/local-exp/22-MSS12838.xml >> 22.pdf >> Error at /xsl:stylesheet/xsl:include[1] >> XTSE0165: I/O error reported by XML parser processing >> file:/projects/Archivespace/work/lib/as-helper-functions.xsl: >> /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) >> NoMethodError: undefined method `rewind' for nil:NilClass >> >> It looks like there?s a path dependency on finding that file: >> >> ead2pdf$ ack as-helper-functions >> lib/as-ead-pdf.xsl >> 24: >> >> lib/AS_fop.rb >> 36: # @xslt.gsub!('', "" ) >> >> >> When I cd into the ead2pdf directory and run the same transform, it runs without error. >> >> [ file path is: ead2pdf/lib/as-helper-functions.xsl ] >> >> ? Steve. >> >> >> >>> On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: >>> >>> Hey, >>> >>> We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. >>> >>> However, when trying to run it from our dev server, I?m getting the following error: >>> >>> NoMethodError: undefined method `rewind' for nil:NilClass >>> >>> Any idea what could be causing that? >>> >>> Patrick Galligan >>> Rockefeller Archive Center >>> Assistant Digital Archivist >>> 914-366-6386 >>> >>> _______________________________________________ >>> Archivesspace_Users_Group mailing list >>> Archivesspace_Users_Group at lyralists.lyrasis.org >>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From harnold at rockarch.org Wed Aug 5 12:57:15 2015 From: harnold at rockarch.org (Arnold, Hillel) Date: Wed, 5 Aug 2015 12:57:15 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> Message-ID: Steve, Thanks so much for this! I can confirm this .jar file works as expected: you don?t have to cd into the ead2pdf directory and you can create a pdf in another location (directory permissions permitting, obviously). Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Steven Majewski > Reply-To: Archivesspace Users Group > Date: Wednesday, August 5, 2015 at 12:07 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. You should be able to download and run just the jar file from this release. Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. ? Steve On Aug 4, 2015, at 7:03 PM, Steven Majewski > wrote: My fork at https://github.com/sdm7g/ead2pdf is working out of the .jar alone now, finding the included stylesheet, however it?s still getting an error on including the logo ./lib/archivesspace.small.png which it still expects to be relative to $PWD. Looking for a fix for that... ? Steve. On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 2:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From jlecampbell at ucdavis.edu Wed Aug 5 14:29:55 2015 From: jlecampbell at ucdavis.edu (Jared Campbell) Date: Wed, 5 Aug 2015 18:29:55 +0000 Subject: [Archivesspace_Users_Group] ArchiveSpace Failing to Import Two Legacy EAD Finding Aids Message-ID: Hello Fellow ASpacers, I am wondering if anybody out there can shed some light on the following error messages I'm getting when I try to import two large (17MB and 9.2MB) and "old" legacy EAD FA's into ASpace. No doubt there are some issues mapping the older encoding in these files to ASpace but all I'm getting are 's, so I am not sure if it is the encoding or the size of the FA's that are causing the problems (or some other completely separate issue). First the error messages from the import page: ================================================== eastman.xml ================================================== !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! IMPORT ERROR !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Error: #:0x7d5a8b45>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! And from ASpace system log: snyder.xml E, [2015-07-07T12:36:29.710000 #5901] ERROR -- : Thread-22066: Job 71 failed: undefined method `items' for #<#:0x7d5a8b45> ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:386:in `_chronitem'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in `handle_opener'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in `run'", "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in `run'", "org/jruby/RubyArray.java:1613:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in `synchronize'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in `open'", "org/jruby/RubyFixnum.java:280:in `times'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in `run_pending_job'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in `start_background_thread'"] eastman.xml: E, [2015-07-07T12:40:01.988000 #5901] ERROR -- : Thread-22066: Job 72 failed: undefined method `+' for nil:NilClass ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in `_daogrp'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:286:in `ancestor'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in `_daogrp'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in `handle_opener'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in `run'", "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in `run'", "org/jruby/RubyArray.java:1613:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in `synchronize'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in `open'", "org/jruby/RubyFixnum.java:280:in `times'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in `run_pending_job'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in `start_background_thread'"] Thanks in advance for any insight, --JC -------------- next part -------------- An HTML attachment was scrubbed... URL: From mauraa at brandeis.edu Wed Aug 5 14:37:22 2015 From: mauraa at brandeis.edu (Maura Carbone) Date: Wed, 5 Aug 2015 14:37:22 -0400 Subject: [Archivesspace_Users_Group] ArchiveSpace Failing to Import Two Legacy EAD Finding Aids In-Reply-To: References: Message-ID: Hi Jared, Could you send along the EAD files (assuming there's nothing sensitive in them)? It might help in diagnosing the issue. -Maura On Wed, Aug 5, 2015 at 2:29 PM, Jared Campbell wrote: > Hello Fellow ASpacers, > > > I am wondering if anybody out there can shed some light on the following > error messages I'm getting when I try to import two large (17MB and 9.2MB) > and "old" legacy EAD FA's into ASpace. No doubt there are some issues > mapping the older encoding in these files to ASpace but all I'm getting are > 's, so I am not sure if it is the encoding or the size of > the FA's that are causing the problems (or some other completely separate > issue). > > > First the error messages from the import page: > > > > ================================================== > eastman.xml > ================================================== > > > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > IMPORT ERROR > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > > Error: # > AND > > ================================================== > snyder.xml > ================================================== > > > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > IMPORT ERROR > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > > Error: # #<#:0x7d5a8b45>> > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > > And from ASpace system log: > > > snyder.xml > > > E, [2015-07-07T12:36:29.710000 #5901] ERROR -- : Thread-22066: Job 71 > failed: undefined method `items' for #<#:0x7d5a8b45> > ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:386:in > `_chronitem'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in > `handle_opener'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in > `run'", > "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in > `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in > `run'", "org/jruby/RubyArray.java:1613:in `each'", > "org/jruby/RubyEnumerable.java:977:in `each_with_index'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in > `open'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in > `transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in > `_transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in > `_transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in > `transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in > `hold'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in > `hold'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in > `synchronize'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in > `transaction'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in > `transaction'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in > `open'", "org/jruby/RubyFixnum.java:280:in `times'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in > `open'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in > `run_pending_job'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in > `start_background_thread'"] > > > eastman.xml: > > E, [2015-07-07T12:40:01.988000 #5901] ERROR -- : Thread-22066: Job 72 > failed: undefined method `+' for nil:NilClass > ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in > `_daogrp'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:286:in > `ancestor'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in > `_daogrp'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in > `handle_opener'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in > `run'", > "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in > `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in > `run'", "org/jruby/RubyArray.java:1613:in `each'", > "org/jruby/RubyEnumerable.java:977:in `each_with_index'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in > `open'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in > `transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in > `_transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in > `_transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in > `transaction'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in > `hold'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in > `hold'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in > `synchronize'", > "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in > `transaction'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in > `transaction'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in > `open'", "org/jruby/RubyFixnum.java:280:in `times'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in > `open'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in > `run'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in > `run_pending_job'", > "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in > `start_background_thread'"] > > > > Thanks in advance for any insight, > > > --JC > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From rrotter at umich.edu Wed Aug 5 17:10:27 2015 From: rrotter at umich.edu (Ryan Rotter) Date: Wed, 5 Aug 2015 17:10:27 -0400 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: <8A8FC33E-986A-46CE-AC1B-6CB5BE165E35@hudmol.com> References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> <8A8FC33E-986A-46CE-AC1B-6CB5BE165E35@hudmol.com> Message-ID: So, to be clear, if we want to use the CM plugin with a current version of AS container_management_dartmouth is the best version at present? Since I'm not a client of hudmol I don't have much ground to ask you for anything, but it would be helpful if the README.md or release notes made it clear what releases of AS your plugin was compatible with. On 5 August 2015 at 02:43, James Bullen wrote: > > Hi Steve, > > Just on the container management repos: > > hudmol/container_management is the version developed for Yale which > currently works against AS v1.1. > > hudmol/container_management_dartmouth is a fork developed for Dartmouth > that includes support for AS v1.3 and the ability to print container labels. > > > Cheers, > James > > > On Aug 5, 2015, at 2:25 PM, Steven Majewski wrote: > > > We made an initial attempt to migrate EAD from our test server onto a > production server by exporting with ead_export.sh script on the test server > and importing on production server. Everything appeared to work OK, but on > further inspection we found that the barcodes were not imported. Further > inspection showed that the barcodes are not exported in EAD. > > Looking at the export/import mappings spreadsheet, I see that a mapping is > given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace > mappings. > > Looking further, I find a Jira issue reporting this: > > https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 > > pointing me to the Yale-ead-exporter plugin: > > https://github.com/archivesspace/yale-ead-exporter > > > I downloaded and installed the yale-ead-exporter. > ArchivesSpace fails to restart do to a syntax error. > > I fixed and reported syntax error: > https://github.com/archivesspace/yale-ead-exporter/issues/1 > > and restarted successfully. > I installed plugin on both servers and did another export and import > cycle. > > This appeared to mostly work, except that instances of Type "Graphic > Materials? with a barcode were imported as Type ?Graphic? with a barcode of > ?Materials? . I changed the delimiter in both the export and import methods > of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to > work. > > > The main reason I bring this up in detail rather than just forking and > fixing it is that my impression from the export/import mappings, JIRA > thread, etc. is that these issues were unresolved due to a lack of > consensus on how (or even whether) barcodes should be encoded. I?m hoping > for some discussion and consensus on that issue now. > > > I also understand that barcodes and location information might be > something that some may not want published. Typically, one might use an > @audience attribute to tag things in the EAD that shouldn?t be published, > but that?s not available when encoding the barcode itself as an attribute. > However, if we?re using EAD as the standard for transmission and archiving > we need to include that info. Perhaps we need an export option that turns > this feature off and on ( like the :use_numbered_c_tags or :include_daos > flags ): this would need more extensive changes than the current plugin. > > I?m also wondering if this is either addressed by the Yale Container > Management work or if any changes here might conflict with that. I see many > mentions of barcodes, but I didn?t see anything that looked like the > export/import changes in the yale-ead-exporter plugin. > > BTW: Is this the best and current repo for that work: > https://github.com/hudmol/container_management > > I also see a container_management_dartmouth and a container branch on > archivespace/archivesspace. > > > ? Steve Majewski > > > > > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > !DSPAM:55c1905d40921268321363! > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Wed Aug 5 17:23:14 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Wed, 5 Aug 2015 17:23:14 -0400 Subject: [Archivesspace_Users_Group] new user defaults? Message-ID: When new users are added to the frontend admin app, they don?t have any access rights. Is there a way to change the defaults for new users so they are automatically added to a base level group ? I couldn?t find anything in preferences or settings. I would like everyone who can log in to at least get read permission to all repositories. I would also note that it takes many mouse clicks to add a bunch of users to a group. It only seems to be able to take one user-id at a time. It would be nice if you could paste in a whole list of user ids before clicking on add, but that doesn?t seem to work. ? Steve Majewski -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From mark.custer at yale.edu Wed Aug 5 17:45:07 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Wed, 5 Aug 2015 21:45:07 +0000 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> Message-ID: Steven, I think that exporting barcodes in the EAD is a sensible default (especially since EAD3 has a new @containerid attribute for storing barcodes). If folks don?t want to include those in their EAD, though, then there should be an option to turn that off, as you mention. Barcodes exported by default in the AT, so I think that the expectation has been set. As for the Yale Container management plugin (and the Dartmouth one, by extension, which is 1.3 compatible), barcodes are supported in the EAD export? and the imports! Better yet, distinct barcodes are stored only once in the database, instead of every single time the same box is referenced. Additionally, container profiles are also included in the EAD imports and exports, tucked away in @altrender attributes. Locations aren?t included, which I think is sensible (i.e. not something for a public finding aid), but it would be possible for someone to write a plugin that would put that information into an EAD physloc tag once the container management work is integrated into the ArchivesSpace core code. Either way, just think of the cool visualizations that could be done with all of this container data ?. Not only can you show the researcher a flattened box listing, but you can show them how big the entire collection would be ? and what sorts of boxes they?d see ? if they were able to request everything at once into the reading room. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Wednesday, August 05, 2015 12:26 AM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] barcodes and EAD export/import We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. Looking further, I find a Jira issue reporting this: https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 pointing me to the Yale-ead-exporter plugin: https://github.com/archivesspace/yale-ead-exporter I downloaded and installed the yale-ead-exporter. ArchivesSpace fails to restart do to a syntax error. I fixed and reported syntax error: https://github.com/archivesspace/yale-ead-exporter/issues/1 and restarted successfully. I installed plugin on both servers and did another export and import cycle. This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. BTW: Is this the best and current repo for that work: https://github.com/hudmol/container_management I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. ? Steve Majewski -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.custer at yale.edu Wed Aug 5 17:52:48 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Wed, 5 Aug 2015 21:52:48 +0000 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> Message-ID: I should?ve also added that we are *not* using the ?yale-ead-exporter? plugin, https://github.com/archivesspace/yale-ead-exporter That was created during the code4lib conference, to illustrate how a plugin could be written to enhance the EAD exporter (thanks again, Chris!). As we continued to work on the container management plugin with HM, though, that barcode information got stored in a new table, so the EAD exporter had to be updated yet again? but that?s handled completely within the container management plugin. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Custer, Mark Sent: Wednesday, August 05, 2015 5:45 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] barcodes and EAD export/import Steven, I think that exporting barcodes in the EAD is a sensible default (especially since EAD3 has a new @containerid attribute for storing barcodes). If folks don?t want to include those in their EAD, though, then there should be an option to turn that off, as you mention. Barcodes exported by default in the AT, so I think that the expectation has been set. As for the Yale Container management plugin (and the Dartmouth one, by extension, which is 1.3 compatible), barcodes are supported in the EAD export? and the imports! Better yet, distinct barcodes are stored only once in the database, instead of every single time the same box is referenced. Additionally, container profiles are also included in the EAD imports and exports, tucked away in @altrender attributes. Locations aren?t included, which I think is sensible (i.e. not something for a public finding aid), but it would be possible for someone to write a plugin that would put that information into an EAD physloc tag once the container management work is integrated into the ArchivesSpace core code. Either way, just think of the cool visualizations that could be done with all of this container data ?. Not only can you show the researcher a flattened box listing, but you can show them how big the entire collection would be ? and what sorts of boxes they?d see ? if they were able to request everything at once into the reading room. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Wednesday, August 05, 2015 12:26 AM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] barcodes and EAD export/import We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. Looking further, I find a Jira issue reporting this: https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 pointing me to the Yale-ead-exporter plugin: https://github.com/archivesspace/yale-ead-exporter I downloaded and installed the yale-ead-exporter. ArchivesSpace fails to restart do to a syntax error. I fixed and reported syntax error: https://github.com/archivesspace/yale-ead-exporter/issues/1 and restarted successfully. I installed plugin on both servers and did another export and import cycle. This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. BTW: Is this the best and current repo for that work: https://github.com/hudmol/container_management I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. ? Steve Majewski -------------- next part -------------- An HTML attachment was scrubbed... URL: From james at hudmol.com Wed Aug 5 19:03:58 2015 From: james at hudmol.com (James Bullen) Date: Thu, 6 Aug 2015 09:03:58 +1000 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> <8A8FC33E-986A-46CE-AC1B-6CB5BE165E35@hudmol.com> Message-ID: <8CD38877-2D8A-4A0A-8717-3C02192B3CB7@hudmol.com> Hi Ryan, I?ve updated the readmes. I believe the ArchivesSpace team is planning to merge the CM plugin with the core, so I would recommend waiting for that. Cheers, James > On Aug 6, 2015, at 7:10 AM, Ryan Rotter > wrote: > > So, to be clear, if we want to use the CM plugin with a current version of AS container_management_dartmouth is the best version at present? Since I'm not a client of hudmol I don't have much ground to ask you for anything, but it would be helpful if the README.md or release notes made it clear what releases of AS your plugin was compatible with. > > On 5 August 2015 at 02:43, James Bullen > wrote: > > Hi Steve, > > Just on the container management repos: > > hudmol/container_management is the version developed for Yale which currently works against AS v1.1. > > hudmol/container_management_dartmouth is a fork developed for Dartmouth that includes support for AS v1.3 and the ability to print container labels. > > > Cheers, > James > > >> On Aug 5, 2015, at 2:25 PM, Steven Majewski > wrote: >> >> >> We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. >> >> Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. >> >> Looking further, I find a Jira issue reporting this: >> https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 >> >> pointing me to the Yale-ead-exporter plugin: >> >> https://github.com/archivesspace/yale-ead-exporter >> >> >> I downloaded and installed the yale-ead-exporter. >> ArchivesSpace fails to restart do to a syntax error. >> >> I fixed and reported syntax error: >> https://github.com/archivesspace/yale-ead-exporter/issues/1 >> >> and restarted successfully. >> I installed plugin on both servers and did another export and import cycle. >> >> This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. >> >> >> The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. >> >> >> I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. >> >> I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. >> >> BTW: Is this the best and current repo for that work: >> https://github.com/hudmol/container_management >> >> I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. >> >> >> ? Steve Majewski >> >> >> >> >> >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > !DSPAM:55c27bd8191905858113537! _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > !DSPAM:55c27bd8191905858113537! -------------- next part -------------- An HTML attachment was scrubbed... URL: From brad.westbrook at lyrasis.org Wed Aug 5 20:01:40 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Thu, 6 Aug 2015 00:01:40 +0000 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: <8CD38877-2D8A-4A0A-8717-3C02192B3CB7@hudmol.com> References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> <8A8FC33E-986A-46CE-AC1B-6CB5BE165E35@hudmol.com> <8CD38877-2D8A-4A0A-8717-3C02192B3CB7@hudmol.com> Message-ID: Hi, Ryan, James is correct: the ArchivesSpace developers have started the process of merging the Yale CM plugin into the ArchivesSpace base code. The story for this work is at https://archivesspace.atlassian.net/browse/AR-1182. Best, Brad W. From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James Bullen Sent: Wednesday, August 05, 2015 7:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] barcodes and EAD export/import Hi Ryan, I?ve updated the readmes. I believe the ArchivesSpace team is planning to merge the CM plugin with the core, so I would recommend waiting for that. Cheers, James On Aug 6, 2015, at 7:10 AM, Ryan Rotter > wrote: So, to be clear, if we want to use the CM plugin with a current version of AS container_management_dartmouth is the best version at present? Since I'm not a client of hudmol I don't have much ground to ask you for anything, but it would be helpful if the README.md or release notes made it clear what releases of AS your plugin was compatible with. On 5 August 2015 at 02:43, James Bullen > wrote: Hi Steve, Just on the container management repos: hudmol/container_management is the version developed for Yale which currently works against AS v1.1. hudmol/container_management_dartmouth is a fork developed for Dartmouth that includes support for AS v1.3 and the ability to print container labels. Cheers, James On Aug 5, 2015, at 2:25 PM, Steven Majewski > wrote: We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. Looking further, I find a Jira issue reporting this: https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 pointing me to the Yale-ead-exporter plugin: https://github.com/archivesspace/yale-ead-exporter I downloaded and installed the yale-ead-exporter. ArchivesSpace fails to restart do to a syntax error. I fixed and reported syntax error: https://github.com/archivesspace/yale-ead-exporter/issues/1 and restarted successfully. I installed plugin on both servers and did another export and import cycle. This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. BTW: Is this the best and current repo for that work: https://github.com/hudmol/container_management I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. ? Steve Majewski _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group !DSPAM:55c27bd8191905858113537! _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group !DSPAM:55c27bd8191905858113537! -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Wed Aug 5 20:28:14 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Wed, 5 Aug 2015 20:28:14 -0400 Subject: [Archivesspace_Users_Group] barcodes and EAD export/import In-Reply-To: References: <678D70C5-B4FE-4A41-8F10-FC4B8D61ECBE@virginia.edu> Message-ID: <9A961D53-7010-40CD-83A8-58A0A8CFCD1D@virginia.edu> Thanks Mark. I?ll take that as advising that I should sit tight and wait for the integration of the new container model into the next release to handle the bigger picture items, and should just use the modified yale-ead-exporter I have for my immediate data migration problem. Do you know if the migration to the new model be handled by the usual db migration script, or will there be some additional conversion steps required? Brad: I assume this work is in the ?container? git branch. Let me know when you think it?s ready for end-user testing and I?ll give it a try. ? Steve. > On Aug 5, 2015, at 5:52 PM, Custer, Mark wrote: > > I should?ve also added that we are *not* using the ?yale-ead-exporter? plugin, https://github.com/archivesspace/yale-ead-exporter That was created during the code4lib conference, to illustrate how a plugin could be written to enhance the EAD exporter (thanks again, Chris!). > > As we continued to work on the container management plugin with HM, though, that barcode information got stored in a new table, so the EAD exporter had to be updated yet again? but that?s handled completely within the container management plugin. > > Mark > > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Custer, Mark > Sent: Wednesday, August 05, 2015 5:45 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] barcodes and EAD export/import > > Steven, > > I think that exporting barcodes in the EAD is a sensible default (especially since EAD3 has a new @containerid attribute for storing barcodes). If folks don?t want to include those in their EAD, though, then there should be an option to turn that off, as you mention. Barcodes exported by default in the AT, so I think that the expectation has been set. > > As for the Yale Container management plugin (and the Dartmouth one, by extension, which is 1.3 compatible), barcodes are supported in the EAD export? and the imports! Better yet, distinct barcodes are stored only once in the database, instead of every single time the same box is referenced. Additionally, container profiles are also included in the EAD imports and exports, tucked away in @altrender attributes. Locations aren?t included, which I think is sensible (i.e. not something for a public finding aid), but it would be possible for someone to write a plugin that would put that information into an EAD physloc tag once the container management work is integrated into the ArchivesSpace core code. Either way, just think of the cool visualizations that could be done with all of this container data J. Not only can you show the researcher a flattened box listing, but you can show them how big the entire collection would be ? and what sorts of boxes they?d see ? if they were able to request everything at once into the reading room. > > Mark > > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski > Sent: Wednesday, August 05, 2015 12:26 AM > To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] barcodes and EAD export/import > > > We made an initial attempt to migrate EAD from our test server onto a production server by exporting with ead_export.sh script on the test server and importing on production server. Everything appeared to work OK, but on further inspection we found that the barcodes were not imported. Further inspection showed that the barcodes are not exported in EAD. > > Looking at the export/import mappings spreadsheet, I see that a mapping is given for barcodes in ArchivesSpace to EAD, but not in EAD to ArchivesSpace mappings. > > Looking further, I find a Jira issue reporting this: > https://archivesspace.atlassian.net/browse/AR-983?jql=text%20~%20%22container%20label%22 > > pointing me to the Yale-ead-exporter plugin: > > https://github.com/archivesspace/yale-ead-exporter > > > I downloaded and installed the yale-ead-exporter. > ArchivesSpace fails to restart do to a syntax error. > > I fixed and reported syntax error: > https://github.com/archivesspace/yale-ead-exporter/issues/1 > > and restarted successfully. > I installed plugin on both servers and did another export and import cycle. > > This appeared to mostly work, except that instances of Type "Graphic Materials? with a barcode were imported as Type ?Graphic? with a barcode of ?Materials? . I changed the delimiter in both the export and import methods of the plugin from a space (? ? ) to a bar ( ?|? ). So far this seems to work. > > > The main reason I bring this up in detail rather than just forking and fixing it is that my impression from the export/import mappings, JIRA thread, etc. is that these issues were unresolved due to a lack of consensus on how (or even whether) barcodes should be encoded. I?m hoping for some discussion and consensus on that issue now. > > > I also understand that barcodes and location information might be something that some may not want published. Typically, one might use an @audience attribute to tag things in the EAD that shouldn?t be published, but that?s not available when encoding the barcode itself as an attribute. However, if we?re using EAD as the standard for transmission and archiving we need to include that info. Perhaps we need an export option that turns this feature off and on ( like the :use_numbered_c_tags or :include_daos flags ): this would need more extensive changes than the current plugin. > > I?m also wondering if this is either addressed by the Yale Container Management work or if any changes here might conflict with that. I see many mentions of barcodes, but I didn?t see anything that looked like the export/import changes in the yale-ead-exporter plugin. > > BTW: Is this the best and current repo for that work: > https://github.com/hudmol/container_management > > I also see a container_management_dartmouth and a container branch on archivespace/archivesspace. > > > ? Steve Majewski > > > > > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From sdm7g at virginia.edu Wed Aug 5 20:38:44 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Wed, 5 Aug 2015 20:38:44 -0400 Subject: [Archivesspace_Users_Group] Also: setting groups/permissions thru backend API [was: new user defaults?] In-Reply-To: References: Message-ID: <2747D6D1-B3D9-464D-A0F5-26BD082939D0@virginia.edu> I would like to use the backend API to set user permissions to avoid a couple hundred mouse clicks on the admin web forms. ( Adding users to a group seems to require you add them one at a time. It would be nicer if you could paste a list of user ids into that field and click Add just once. Or maybe put everything in a checkbox matrix so you can set several user/repo/groups/permissions at once. ) I?ve tried doing a "GET /users/$ID? , pulling the permissions out of one user as a template and merging those permissions into another users json with jq, and posting again to "POST /users/$ID? . The return value from that makes it appear to have updated: {"status":"Updated","id":13,"lock_version":3,"stale":null,"uri":"/users/13","warnings":[]} But doing another GET shows nothing changed. I?ve also tried appending ?groups%5B%5D=/repositories/3/groups/15 to the URL ( which should be "repository-basic-data-entry? group for that repo ) which also returns what looks like an updated status, but again, it appears unchanged. In both cases, *something* got updated, if only the modification date, because if I do the same operation a second time using the same JSON, it rejects the 2nd attempt with: {"error":"The record you tried to update has been modified since you fetched it."} I haven?t yet tried posting to /repositories/$REPO/groups yet. Is that the one that works ? Can anyone suggest a working API formula ? ? Steve. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From brianjhoffman at gmail.com Wed Aug 5 23:27:04 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Wed, 5 Aug 2015 23:27:04 -0400 Subject: [Archivesspace_Users_Group] Plugin for generating HTML finding aids Message-ID: <412870F4-5A4A-48B4-87A3-2CF7BA711FC4@gmail.com> Hi, I just posted a plugin that will add an HTML option to the Export menu for resources. When you choose this option, a new backend job will be created that will generate an EAD for the resource and then use the XSLT stylesheet that ships with ArchivesSpace to transform the EAD into HTML. The completed job page will display a link to download the HTML. https://github.com/quoideneuf/aspace_export_html It is untested and may be a bit buggy. Brian -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 6 06:05:04 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 6 Aug 2015 10:05:04 +0000 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> , Message-ID: Hi, Yeah, thanks for this..sorry, originally did this with about 50% of my attention. I've updated the ead2pdf project. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Arnold, Hillel Sent: Wednesday, August 5, 2015 6:57 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Steve, Thanks so much for this! I can confirm this .jar file works as expected: you don?t have to cd into the ead2pdf directory and you can create a pdf in another location (directory permissions permitting, obviously). Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Steven Majewski > Reply-To: Archivesspace Users Group > Date: Wednesday, August 5, 2015 at 12:07 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. You should be able to download and run just the jar file from this release. Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. ? Steve On Aug 4, 2015, at 7:03 PM, Steven Majewski > wrote: My fork at https://github.com/sdm7g/ead2pdf is working out of the .jar alone now, finding the included stylesheet, however it?s still getting an error on including the logo ./lib/archivesspace.small.png which it still expects to be relative to $PWD. Looking for a fix for that... ? Steve. On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 2:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 6 06:35:13 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 6 Aug 2015 10:35:13 +0000 Subject: [Archivesspace_Users_Group] ArchiveSpace Failing to Import Two Legacy EAD Finding Aids In-Reply-To: References: Message-ID: Hi Jared, So, would it be possible for you to send the EAD files? For snyder.xml, there's a that seems to be causing an issue. For eastman.xml, its a daodesc, but that one seems a little more complicated...I might need to look at the EAD to figure that one out. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Jared Campbell Sent: Wednesday, August 5, 2015 8:29 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] ArchiveSpace Failing to Import Two Legacy EAD Finding Aids Hello Fellow ASpacers, I am wondering if anybody out there can shed some light on the following error messages I'm getting when I try to import two large (17MB and 9.2MB) and "old" legacy EAD FA's into ASpace. No doubt there are some issues mapping the older encoding in these files to ASpace but all I'm getting are 's, so I am not sure if it is the encoding or the size of the FA's that are causing the problems (or some other completely separate issue). First the error messages from the import page: ================================================== eastman.xml ================================================== !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! IMPORT ERROR !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Error: #:0x7d5a8b45>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! And from ASpace system log: snyder.xml E, [2015-07-07T12:36:29.710000 #5901] ERROR -- : Thread-22066: Job 71 failed: undefined method `items' for #<#:0x7d5a8b45> ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:386:in `_chronitem'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in `handle_opener'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in `run'", "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in `run'", "org/jruby/RubyArray.java:1613:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in `synchronize'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in `open'", "org/jruby/RubyFixnum.java:280:in `times'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in `run_pending_job'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in `start_background_thread'"] eastman.xml: E, [2015-07-07T12:40:01.988000 #5901] ERROR -- : Thread-22066: Job 72 failed: undefined method `+' for nil:NilClass ["/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in `_daogrp'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:286:in `ancestor'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/ead_converter.rb:667:in `_daogrp'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:139:in `handle_opener'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:91:in `run'", "/usr/local/archivesspace-1.2.0/gems/gems/nokogiri-1.6.6.2-java/lib/nokogiri/xml/reader.rb:107:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/xml_sax.rb:75:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:72:in `run'", "org/jruby/RubyArray.java:1613:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:68:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:117:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:93:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:134:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:122:in `_transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:108:in `transaction'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:98:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/connection_pool/threaded.rb:87:in `hold'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/connecting.rb:255:in `synchronize'", "/usr/local/archivesspace-1.2.0/gems/gems/sequel-4.20.0/lib/sequel/database/transactions.rb:97:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:92:in `transaction'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:116:in `open'", "org/jruby/RubyFixnum.java:280:in `times'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in `open'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:64:in `run'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:100:in `run_pending_job'", "/usr/local/archivesspace-1.2.0/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/background_job_queue.rb:128:in `start_background_thread'"] Thanks in advance for any insight, --JC -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 6 07:16:03 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 6 Aug 2015 11:16:03 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: References: Message-ID: Hi Robin, So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: AppConfig[:compile_jasper] = true and restart ASpace. This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio. Just be sure to recompile your reports. For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of McElheny, Robin G. Sent: Wednesday, August 5, 2015 5:55 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: [Archivesspace_Users_Group] Problems with ASpace reports At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn?t see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them ? and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. [cid:image001.jpg at 01D0CF75.A0567BD0] * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don?t do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: [cid:image002.jpg at 01D0CF75.A0567BD0] * Here?s another example: [cid:image003.jpg at 01D0CF75.A0567BD0] * In the case of an HTML report, it displays page footers ? odd for online display. [htmlreport] Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: [cid:image005.jpg at 01D0CF75.A0567BD0] * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in ?Waiting for (server)? messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 16855 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 59883 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.jpg Type: image/jpeg Size: 37229 bytes Desc: image003.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.jpg Type: image/jpeg Size: 21318 bytes Desc: image004.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.jpg Type: image/jpeg Size: 22259 bytes Desc: image005.jpg URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 6 08:27:41 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 6 Aug 2015 12:27:41 +0000 Subject: [Archivesspace_Users_Group] Mass export of EAD In-Reply-To: References: , Message-ID: Hej, Yes, so updating any associated record will update the "system_mtime" field in the data base for the parent record. That because the indexer uses this to tell what records are needing to be reindexed, so for example updating an agent will require the resource to be reindexed. This is done in the relationship mixin. Thie modified_since param is what searches against the system_mtime field. It's added with the other pagination parameters, which are really poorly documented. Sorry, I keep meaning to go back and fix the YARD documentation to include these, since they're kind of mixed into a lot of the end-points. I've been working on the documentation build a lot in preparation for SAA, so I'll be sure to add this to my list. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Arnold, Hillel Sent: Tuesday, August 4, 2015 6:11 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Mass export of EAD Hi, Just wanted to follow up on this thread. It appears that changing an agent or subject record associated with a resource or archival_object changes the modified date for that resource or archival_object. At least, when using the ?modified_since? parameter on both the resource and archival_objects endpoints of the AS API, those resources/archival_objects are returned. Can someone who?s more familiar with the business logic for the ?modified_since? parameter confirm this? I don?t see this parameter documented anywhere in the AS API documentation, so I kind of feel like I?m shooting in the dark. Thanks! Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Wednesday, July 29, 2015 at 6:48 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD So I did a bit more looking into this today and apparently the archival_objects parameter accepts the modified_since parameter as well, so as Brian suggests it?s really easy to query for resource and component mtimes. I tweaked my incremental export script so it looks in both places now: https://github.com/RockefellerArchiveCenter/scripts/blob/master/archivesspace/asExportIncremental.py I haven?t tried, but I?m assuming you could use this same pattern to look for modified agents/subjects etc., if you wanted to. Also, the other EAD export script that Patrick sent around the other day had an issue with exporting large resources, which I?ve now fixed by streaming the response: https://github.com/RockefellerArchiveCenter/scripts/blob/master/archivesspace/asExport-ead.py However, if you?re going to do a mass export of all the EAD from your repo it probably makes sense to just use the ead_export script that comes with AS. It?s way more robust and was written by people who actually know what they?re doing. Hillel From: brian > Reply-To: Archivesspace Users Group > Date: Wednesday, July 29, 2015 at 12:12 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD It seems to me like it might not be a great idea to change the business rules for how a resource record's mtime gets updated, but that it wouldn't be too hard to add a new field to the resource that tracks the last component update. It also seems like it wouldn't be too hard for the services under discussion to query for component mtimes as well as resource mtimes. Sent from my T-Mobile 4G LTE Device -------- Original message -------- From: "Arnold, Hillel" > Date:07/28/2015 4:23 PM (GMT-05:00) To: Archivesspace Users Group > Cc: Subject: Re: [Archivesspace_Users_Group] Mass export of EAD Hi Mark, Yup, you?re absolutely right. I made the (erroneous) assumption that changes to mtimes for descendant components would propagate in the resource record as well. This seems like something that would be best done in AS itself; I?m wondering if Brian or Chris have any thoughts about how this could be accomplished? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Mark Cooper > Reply-To: Archivesspace Users Group > Date: Tuesday, July 28, 2015 at 3:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD In case you're interested, but haven't seen it, there is a doc for the export script: https://github.com/archivesspace/archivesspace/blob/master/launcher/ead_export/REPO_EAD_EXPORT_README.md Right now it just exports every EAD associated with a specified repo to a zip file and doesn't have date or incremental awareness. That could be added as the resources endpoint accepts a "modified_since" parameter (as a timestamp). I just rough tested: date -d '2015-07-01 00:00:00' +'%s' # 1435734000 curl -H "X-ArchivesSpace-Session: $TOKEN" "http://localhost:8089/repositories/2/resources?all_ids=true&modified_since=1435734000" Returns what appears to be the correct set of results. The obvious problem is that it isn't descendent aware, so it's only direct changes to the topmost resource record that count for the "modified_since" parameter. If the api also factored in descendent mtimes for records types that have them that would have been ideal =) Some workaround, or a solution, for that limitation is going to be required for any time based incremental type export (assuming you need any descendent / component updates to be considered as an update to the resource for what you're doing -- in other words, you may not be able to just rely on the resource mtime). Mark Cooper Technical Lead, Hosting and Support LYRASIS email: mark.cooper at lyrasis.org skype: mark_c_cooper ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Suda, Phillip J > Sent: Tuesday, July 28, 2015 9:13 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Mass export of EAD Thanks all for your suggestions/scripts/help. This is a great start. Thank you, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 From:archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Kevin Clair Sent: Tuesday, July 28, 2015 10:41 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Mass export of EAD I have a Perl script I run from command line that runs every batch export I want or need at this point: https://github.com/duspeccoll/as_utils/blob/master/reports.pl It grabs the JSON list of all the IDs for a given model, and then either dumps everything into a single JSON object or exports to some other format. The EAD export is lines 206-224. This is *extremely* customized for our environment, and I?ve made no effort yet to modify it for general use, but it?s an idea of how one could go about doing this. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Tuesday, July 28, 2015 9:34 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Mass export of EAD There is ead_export.sh in the scripts directory. It only exports published collections, but that can be changed in the code if needed. That script runs locally on the AS server and it writes into the archivesspace/data/ directory, so you need write access. resource ids will not necessarily be sequential after deletions and transfers, but you can get a JSON list of all of the ids from /repositories/$REPO_ID/resources?all_ids=true and then loop over those ids. ? Steve Majewski On Jul 28, 2015, at 11:15 AM, Alexander Duryee > wrote: Phil, As far as I'm aware, there's no bulk EAD export functionality in ASpace. However, since ASpace's resource identifiers are sequential integers, you can loop over each resource id in a repository and make an API call for its EAD record: for x in {first..last}; do curl -H '[session token]' "https://[address]/repositories/[id]/resource_descriptions/${x}.xml" > aspace_${x}.xml; done A loop like that should generate EAD records for each resource in your repository. Regards, --Alex On Tue, Jul 28, 2015 at 10:27 AM, Suda, Phillip J > wrote: Greetings all, Is there an API or mass export feature for exporting all EAD records from a repository, etc.? I am only seeing a collection level export feature. Thanks, Phil Phillip Suda Systems Librarian Howard-Tilton Memorial Library Tulane University psuda1 at tulane.edu 504-865-5607 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Alexander Duryee Metadata Archivist New York Public Library (917)-229-9590 alexanderduryee at nypl.org _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From robin_mcelheny at harvard.edu Thu Aug 6 08:16:41 2015 From: robin_mcelheny at harvard.edu (McElheny, Robin G.) Date: Thu, 6 Aug 2015 12:16:41 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: References: Message-ID: Thanks, Chris - this is a helpful starting point. More feedback to come. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 06, 2015 7:16 AM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Robin, So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: AppConfig[:compile_jasper] = true and restart ASpace. This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio. Just be sure to recompile your reports. For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of McElheny, Robin G. > Sent: Wednesday, August 5, 2015 5:55 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: [Archivesspace_Users_Group] Problems with ASpace reports At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn't see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them - and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. [cid:image001.jpg at 01D0D020.3864B7C0] * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don't do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: [cid:image002.jpg at 01D0D020.3864B7C0] * Here's another example: [cid:image003.jpg at 01D0D020.3864B7C0] * In the case of an HTML report, it displays page footers - odd for online display. [htmlreport] Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: [cid:image005.jpg at 01D0D020.3864B7C0] * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in "Waiting for (server)" messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 16855 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 59883 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.jpg Type: image/jpeg Size: 37229 bytes Desc: image003.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.jpg Type: image/jpeg Size: 21318 bytes Desc: image004.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.jpg Type: image/jpeg Size: 22259 bytes Desc: image005.jpg URL: From harnold at rockarch.org Thu Aug 6 12:38:42 2015 From: harnold at rockarch.org (Arnold, Hillel) Date: Thu, 6 Aug 2015 12:38:42 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> Message-ID: So trying to run the .jar from the master branch of this repo I?m getting an error: LoadError: no such file to load -- saxon-xslt require at org/jruby/RubyKernel.java:1065 require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 (root) at /Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/lib/AS_fop.rb:8 require at org/jruby/RubyKernel.java:1065 (root) at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1 require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 load at org/jruby/RubyKernel.java:1081 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/bin/ead2pdf-main.rb:5 require at org/jruby/RubyKernel.java:1065 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 error: org.jruby.embed.EvalFailedException: (LoadError) no such file to load -- saxon-xslt I?m able to run it fine from Steve?s fork. Additionally when I try to compile this locally, the resulting .jar throws the same error. I?m not getting any error/unexpected messages when running `warble compiled jar`, but I don?t really know enough to be able to troubleshoot much further?any ideas? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Thursday, August 6, 2015 at 6:05 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, thanks for this..sorry, originally did this with about 50% of my attention. I've updated the ead2pdf project. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Arnold, Hillel > Sent: Wednesday, August 5, 2015 6:57 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Steve, Thanks so much for this! I can confirm this .jar file works as expected: you don?t have to cd into the ead2pdf directory and you can create a pdf in another location (directory permissions permitting, obviously). Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Steven Majewski > Reply-To: Archivesspace Users Group > Date: Wednesday, August 5, 2015 at 12:07 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. You should be able to download and run just the jar file from this release. Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. ? Steve On Aug 4, 2015, at 7:03 PM, Steven Majewski > wrote: My fork at https://github.com/sdm7g/ead2pdf is working out of the .jar alone now, finding the included stylesheet, however it?s still getting an error on including the logo ./lib/archivesspace.small.png which it still expects to be relative to $PWD. Looking for a fix for that... ? Steve. On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 2:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Thu Aug 6 13:07:02 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Thu, 6 Aug 2015 13:07:02 -0400 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> Message-ID: If I do a git diff on my master vs upstream/master I see a difference only in the jar file. If I checkout that branch and run the jar, I get the same error, but if I run ?warble? it seems to fix it. Maybe just running ?warble? as opposed to ?warble compiled jar? is doing some other dependency checking first ? I?m also running under rbenv with version jruby-1.7.11, which might make a difference in how bundler works. ? Steve. > On Aug 6, 2015, at 12:38 PM, Arnold, Hillel wrote: > > So trying to run the .jar from the master branch of this repo I?m getting an error: > LoadError: no such file to load -- saxon-xslt > require at org/jruby/RubyKernel.java:1065 > require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 > (root) at /Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/lib/AS_fop.rb:8 > require at org/jruby/RubyKernel.java:1065 > (root) at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1 > require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 > load at org/jruby/RubyKernel.java:1081 > (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/bin/ead2pdf-main.rb:5 > require at org/jruby/RubyKernel.java:1065 > (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 > (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 > error: org.jruby.embed.EvalFailedException: (LoadError) no such file to load -- saxon-xslt > > I?m able to run it fine from Steve?s fork. > > Additionally when I try to compile this locally, the resulting .jar throws the same error. I?m not getting any error/unexpected messages when running `warble compiled jar`, but I don?t really know enough to be able to troubleshoot much further?any ideas? > > Hillel Arnold > Lead Digital Archivist > Rockefeller Archive Center > > From: Chris Fitzpatrick > > Reply-To: Archivesspace Users Group > > Date: Thursday, August 6, 2015 at 6:05 AM > To: Archivesspace Users Group > > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > Hi, > > Yeah, thanks for this..sorry, originally did this with about 50% of my attention. I've updated the ead2pdf project. b,chris. > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Arnold, Hillel > > Sent: Wednesday, August 5, 2015 6:57 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > Steve, > Thanks so much for this! I can confirm this .jar file works as expected: you don?t have to cd into the ead2pdf directory and you can create a pdf in another location (directory permissions permitting, obviously). > > Hillel Arnold > Lead Digital Archivist > Rockefeller Archive Center > > From: Steven Majewski > > Reply-To: Archivesspace Users Group > > Date: Wednesday, August 5, 2015 at 12:07 PM > To: Archivesspace Users Group > > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? > > > OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. > You should be able to download and run just the jar file from this release. > > Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf > > > Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. > > > ? Steve > > >> On Aug 4, 2015, at 7:03 PM, Steven Majewski > wrote: >> >> My fork at https://github.com/sdm7g/ead2pdf >> is working out of the .jar alone now, finding the included stylesheet, >> however it?s still getting an error on including the logo ./lib/archivesspace.small.png >> which it still expects to be relative to $PWD. >> >> Looking for a fix for that... >> >> ? Steve. >> >> >> >>> On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: >>> >>> Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? >>> >>> Hillel Arnold >>> Lead Digital Archivist >>> Rockefeller Archive Center >>> >>> From: , Hillel Arnold > >>> Reply-To: Archivesspace Users Group > >>> Date: Tuesday, August 4, 2015 at 2:41 PM >>> To: Archivesspace Users Group > >>> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >>> >>> Hi Chris, >>> I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. >>> >>> Hillel Arnold >>> Lead Digital Archivist >>> Rockefeller Archive Center >>> >>> From: Chris Fitzpatrick > >>> Reply-To: Archivesspace Users Group > >>> Date: Tuesday, August 4, 2015 at 11:59 AM >>> To: Archivesspace Users Group > >>> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >>> >>> >>> >>> Hi, >>> >>> Yeah, I just updated the ead2pdf jar, with I think fixes this.. >>> >>> It's here: >>> https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 >>> >>> Release 0.0.5 ? archivesspace/ead2pdf ? GitHub >>> ead2pdf - ASpace EAD2PDF >>> Read more... >>> >>> b,chris. >>> >>> Chris Fitzpatrick | Developer, ArchivesSpace >>> Skype: chrisfitzpat | Phone: 918.236.6048 >>> http://archivesspace.org/ >>> >>> >>> From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > >>> Sent: Tuesday, August 4, 2015 5:51 PM >>> To: Archivesspace Users Group >>> Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? >>> >>> >>> I ran the conversion on a random exported EAD file and got the same error. >>> The rest of the message shows it couldn?t find as-helper-functions.xsl >>> >>> work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf >>> prod/local-exp/22-MSS12838.xml >>> 22.pdf >>> Error at /xsl:stylesheet/xsl:include[1] >>> XTSE0165: I/O error reported by XML parser processing >>> file:/projects/Archivespace/work/lib/as-helper-functions.xsl: >>> /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) >>> NoMethodError: undefined method `rewind' for nil:NilClass >>> >>> It looks like there?s a path dependency on finding that file: >>> >>> ead2pdf$ ack as-helper-functions >>> lib/as-ead-pdf.xsl >>> 24: >>> >>> lib/AS_fop.rb >>> 36: # @xslt.gsub!('', "" ) >>> >>> >>> When I cd into the ead2pdf directory and run the same transform, it runs without error. >>> >>> [ file path is: ead2pdf/lib/as-helper-functions.xsl ] >>> >>> ? Steve. >>> >>> >>> >>>> On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: >>>> >>>> Hey, >>>> >>>> We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. >>>> >>>> However, when trying to run it from our dev server, I?m getting the following error: >>>> >>>> NoMethodError: undefined method `rewind' for nil:NilClass >>>> >>>> Any idea what could be causing that? >>>> >>>> Patrick Galligan >>>> Rockefeller Archive Center >>>> Assistant Digital Archivist >>>> 914-366-6386 >>>> >>>> _______________________________________________ >>>> Archivesspace_Users_Group mailing list >>>> Archivesspace_Users_Group at lyralists.lyrasis.org >>>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >>> _______________________________________________ >>> Archivesspace_Users_Group mailing list >>> Archivesspace_Users_Group at lyralists.lyrasis.org >>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From mark.custer at yale.edu Thu Aug 6 13:32:50 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Thu, 6 Aug 2015 17:32:50 +0000 Subject: [Archivesspace_Users_Group] EAD Import Issue... In-Reply-To: <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> References: <92723F32A19E4446AB97F20B464D1CEB633B0789@EXBOX01.admin.colum.edu> <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> Message-ID: Right, there are no XML encoding errors in the file, so xmllint is indeed correct. After I downloaded the original file, though, I got the same error that Dominic received when trying to import the file. After replacing the smart quotes as Christy suggested, the file imported without issue. Ideally, I don?t think that the ASpace importer should choke on smart quotes, but you can certainly test for any potentially offending characters via Schematron (or other ways) prior to importing. After learning of this issue, I added the following test to a Schematron file to do just that: Smart quote detected. These characters need to be replaced before importing your files into ArchivesSpace. Not an ideal way to do things, but at least it warns me now if any my EAD files have one of three characters prior to importing the file. From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 2:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... When I download that original email enclosure and run xmllint on it, it doesn?t show any encoding errors. I was also able to import it into ArchivesSpace without any errors. I wonder if the translation to and from Base64 encoding of the email enclosure somehow transforms the character encoding and fixes the problem ? Re: testing with Schematron: In my experience ( with doing validation in Java and hitting those kind of encoding errors ) encoding errors come from early in the processing pipeline before Schematron or XSLT processing. I think you would need to scan the file for invalid encoding before passing it to the XML parser. ( In fact, I?m not even sure if you can express an invalid encoding in Schematron if it?s XML in a particular encoding. ) ? Steve. On Jul 31, 2015, at 1:12 PM, Custer, Mark > wrote: Interesting. I just tried to change the encoding value, but that doesn?t work. If you do a find and replace in the file to replace the single quotes, though, the record will import fine. I?ve attached a copy of the record that I was able to import. For the record, using that type of single quote doesn?t invalidate the EAD file. It?s still perfectly valid, but I don?t know if it?s fully UTF-8 compliant. Is there any way to come up with a list of invalid characters? If so, then that could be added to a Schematron file to test and make sure those values aren?t present before attempting to do the batch upload. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 12:31 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... You might also try changing the encoding of the EAD file in the XML header. If it?s not declared, by default it?s UTF-8. Change the first line to: ( I don?t know for a fact if this will work for ArchivesSpace, but it works with most parsers and validators. ) Alternatively, if you have ?iconv? you can run a conversion thru that program to change the encoding: iconv -f WINDOWS-1252 -t UTF-8 ? Steve Majewski On Jul 31, 2015, at 12:17 PM, Tomecek, Christy > wrote: Hello, I think the issue is that there are Word ?Smart Quotes? in your text fields (not the markup itself). The EAD won?t validate if they are present. Example (Smart quote highlighted): Dating from 1918 to 2000, the History and Background Information series consists of written histories, newspaper clippings, and anniversary publications documenting St. Vincent?s steady growth in the Lincoln Park neighborhood. There is a way to turn off Smart Quotes in Word so this way you don?t have to go line by line fixing them if you are doing a copy-paste from a Word Document into ASpace. ? Open Word. Go to File (or if you are in Windows 8/8.1, go to the Windows logo button). ? Scroll to the bottom of the sidebar where things like "New," "Save," etc. are and click on "Options" at the bottom. ? Go to "Proofing," located on the sidebar. ? Go to "AutoCorrect Options" in the main panel. ? Go to the "AutoFormat As You Type" tab and uncheck the "'Straight quotes' with 'smart quotes'" options under "Replace When You Type." Best, Christy -- Christy Tomecek Archives Assistant Yale University Library Manuscripts and Archives 203-432-7382 christy.tomecek at yale.edu From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Rossetti, Dominic Sent: Friday, July 31, 2015 11:58 AM To: 'archivesspace_users_group at lyralists.lyrasis.org' Subject: [Archivesspace_Users_Group] EAD Import Issue... Hey all, When trying to import EAD I get the following error message in the log file: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! IMPORT ERROR !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! I?ve attached a file as an example. The EAD is valid and correct. Not sure what is causing the issue. _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Thu Aug 6 13:44:53 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Thu, 6 Aug 2015 13:44:53 -0400 Subject: [Archivesspace_Users_Group] aspace_client gem ? Message-ID: <54C20EE7-BD49-4E59-BD09-D27AB075D2E5@virginia.edu> I seem to have built up a collection of scripts that I run from jirb in development environment, that would be nice to be able to package up as a stand alone. I also found https://github.com/archivesspace/aspace-client , which looks like a possible starting point to do that. However, I?m wondering if it would be possible to gem-ify some of the jsonmodels and schema and some other client code to make this simpler. To make it useful, I would think archivespace itself would have to use the same gem, as the idea would be to make it simple to sync schema version of your client code with schema versions in archivesspace webapps. ? Steve. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From Joshua.D.Shaw at dartmouth.edu Thu Aug 6 14:09:18 2015 From: Joshua.D.Shaw at dartmouth.edu (Joshua D. Shaw) Date: Thu, 6 Aug 2015 18:09:18 +0000 Subject: [Archivesspace_Users_Group] Turn off Logging of db username and password Message-ID: <40AA7532-0628-411D-8AF5-72042FB1E834@dartmouth.edu> Does anyone know of a way to turn off the logging of the mysql database username and password in the output log? I've set my log level to "fatal" in the config file, but I still see the username and password. I'd love to know if there's away to remove this as its (potentially) another security hole - along with having the username and password in clear text in the config file. Thanks! Joshua -------------- next part -------------- An HTML attachment was scrubbed... URL: From brent_ellingson at byu.edu Thu Aug 6 16:16:50 2015 From: brent_ellingson at byu.edu (Brent Ellingson) Date: Thu, 6 Aug 2015 20:16:50 +0000 Subject: [Archivesspace_Users_Group] Upgrade from 1.1.2 to 1.3.0 directly or incrementally Message-ID: <7f2495e401e94626bdeb12964ecaf57e@MB7.byu.local> We are currently on version 1.1.2 and are getting ready to upgrade to 1.3.0. My question is: is it possible to upgrade directly from 1.1.2 to 1.3.0 or do we need to do it in increments, 1.1.2 > 1.2.0 > 1.3.0? Thank you for your help. Regards, __________________________ Brent Ellingson Sr. Software Engineer 2750 Harold B. Lee Library Brigham Young University (801)422-6148 -------------- next part -------------- An HTML attachment was scrubbed... URL: From KUTZUBA at hws.edu Thu Aug 6 16:51:44 2015 From: KUTZUBA at hws.edu (Kutzuba, Jamie) Date: Thu, 6 Aug 2015 20:51:44 +0000 Subject: [Archivesspace_Users_Group] Upgrade from 1.1.2 to 1.3.0 directly or incrementally In-Reply-To: <7f2495e401e94626bdeb12964ecaf57e@MB7.byu.local> References: <7f2495e401e94626bdeb12964ecaf57e@MB7.byu.local> Message-ID: Hi Brent- You can go directly. We recently upgraded from 1.0.9. Thanks- Jamie 315.781.4355 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Brent Ellingson Sent: Thursday, August 06, 2015 4:17 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] Upgrade from 1.1.2 to 1.3.0 directly or incrementally We are currently on version 1.1.2 and are getting ready to upgrade to 1.3.0. My question is: is it possible to upgrade directly from 1.1.2 to 1.3.0 or do we need to do it in increments, 1.1.2 > 1.2.0 > 1.3.0? Thank you for your help. Regards, __________________________ Brent Ellingson Sr. Software Engineer 2750 Harold B. Lee Library Brigham Young University (801)422-6148 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 6 17:22:52 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 6 Aug 2015 21:22:52 +0000 Subject: [Archivesspace_Users_Group] ead2pdf manual PDF creation? In-Reply-To: References: <44BC0469-8224-43B7-AC64-C47135C3C725@virginia.edu> , Message-ID: Hi, yeah sorry...I need to quit the multitasking. Didn't do a bundle before I built the jar, so the saxon-xslt gems wasn't included in the jar. Fixed the jar file in the repo and release page. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steven Majewski Sent: Thursday, August 6, 2015 7:07 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? If I do a git diff on my master vs upstream/master I see a difference only in the jar file. If I checkout that branch and run the jar, I get the same error, but if I run ?warble? it seems to fix it. Maybe just running ?warble? as opposed to ?warble compiled jar? is doing some other dependency checking first ? I?m also running under rbenv with version jruby-1.7.11, which might make a difference in how bundler works. ? Steve. On Aug 6, 2015, at 12:38 PM, Arnold, Hillel > wrote: So trying to run the .jar from the master branch of this repo I?m getting an error: LoadError: no such file to load -- saxon-xslt require at org/jruby/RubyKernel.java:1065 require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 (root) at /Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/lib/AS_fop.rb:8 require at org/jruby/RubyKernel.java:1065 (root) at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1 require at /var/folders/ts/sw453n7d4511xs2c03ks66tr0000gn/T/jruby733257485658081325extract/jruby-stdlib-complete-1.7.16.1.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:55 load at org/jruby/RubyKernel.java:1081 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/ead2pdf/bin/ead2pdf-main.rb:5 require at org/jruby/RubyKernel.java:1065 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 (root) at file:/Users/harnold/Repos/ead2pdf/ead2pdf.jar!/META-INF/main.rb:1 error: org.jruby.embed.EvalFailedException: (LoadError) no such file to load -- saxon-xslt I?m able to run it fine from Steve?s fork. Additionally when I try to compile this locally, the resulting .jar throws the same error. I?m not getting any error/unexpected messages when running `warble compiled jar`, but I don?t really know enough to be able to troubleshoot much further?any ideas? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Thursday, August 6, 2015 at 6:05 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, thanks for this..sorry, originally did this with about 50% of my attention. I've updated the ead2pdf project. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Arnold, Hillel > Sent: Wednesday, August 5, 2015 6:57 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Steve, Thanks so much for this! I can confirm this .jar file works as expected: you don?t have to cd into the ead2pdf directory and you can create a pdf in another location (directory permissions permitting, obviously). Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Steven Majewski > Reply-To: Archivesspace Users Group > Date: Wednesday, August 5, 2015 at 12:07 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? OK: Latest version also fixes the relative URLS for logo reference when running out of the jar file. You should be able to download and run just the jar file from this release. Release jarfile-fix: tagged for release: fixes problems with relative URLs when running ap? ? sdm7g/ead2pdf Try replacing ead2pdf/lib/archivesspace.small.png in the .jar file with your own logo renamed. ? Steve On Aug 4, 2015, at 7:03 PM, Steven Majewski > wrote: My fork at https://github.com/sdm7g/ead2pdf is working out of the .jar alone now, finding the included stylesheet, however it?s still getting an error on including the logo ./lib/archivesspace.small.png which it still expects to be relative to $PWD. Looking for a fix for that... ? Steve. On Aug 4, 2015, at 3:03 PM, Arnold, Hillel > wrote: Also, it?s apparently not possible to create a PDF file anywhere outside of the ead2pdf directory either? Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: , Hillel Arnold > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 2:41 PM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi Chris, I?m still having trouble running this when I?m not in the ead2pdf directory, as Steve points out below. Hillel Arnold Lead Digital Archivist Rockefeller Archive Center From: Chris Fitzpatrick > Reply-To: Archivesspace Users Group > Date: Tuesday, August 4, 2015 at 11:59 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? Hi, Yeah, I just updated the ead2pdf jar, with I think fixes this.. It's here: https://github.com/archivesspace/ead2pdf/releases/tag/0.0.5 [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Release 0.0.5 ? archivesspace/ead2pdf ? GitHub ead2pdf - ASpace EAD2PDF Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steven Majewski > Sent: Tuesday, August 4, 2015 5:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] ead2pdf manual PDF creation? I ran the conversion on a random exported EAD file and got the same error. The rest of the message shows it couldn?t find as-helper-functions.xsl work$ java -jar ../ead2pdf/ead2pdf.jar prod/local-exp/22-MSS12838.xml 22.pdf prod/local-exp/22-MSS12838.xml 22.pdf Error at /xsl:stylesheet/xsl:include[1] XTSE0165: I/O error reported by XML parser processing file:/projects/Archivespace/work/lib/as-helper-functions.xsl: /projects/Archivespace/work/lib/as-helper-functions.xsl (No such file or directory) NoMethodError: undefined method `rewind' for nil:NilClass It looks like there?s a path dependency on finding that file: ead2pdf$ ack as-helper-functions lib/as-ead-pdf.xsl 24: lib/AS_fop.rb 36: # @xslt.gsub!('', "" ) When I cd into the ead2pdf directory and run the same transform, it runs without error. [ file path is: ead2pdf/lib/as-helper-functions.xsl ] ? Steve. On Aug 3, 2015, at 11:38 AM, Galligan, Patrick > wrote: Hey, We?re trying to set up a workflow where we automatically generate PDF copies of finding aids from our EAD. Rather than set up two API calls (one to export updated EAD and one to download updated PDF), we wanted to use the ead2pdf.jar to run through and create PDF files. However, when trying to run it from our dev server, I?m getting the following error: NoMethodError: undefined method `rewind' for nil:NilClass Any idea what could be causing that? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From EJOLLEY at nla.gov.au Fri Aug 7 01:13:13 2015 From: EJOLLEY at nla.gov.au (Emma Jolley) Date: Fri, 7 Aug 2015 05:13:13 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: References: Message-ID: <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> Hi Chris We have had the same issues as Robin with the reports. We have tried to implement your suggested solutions below but now received the following error message which I've copied below. Any advice on this? In addition, I have asked previously but have never received an answer - I wonder if there is any documentation on what criteria the reports use to identify records that meet the nominated criteria. For example what fields is used to indicate an unprocessed Accession and what field is used to indicate an uncatalogued accession? Many thanks Emma [cid:image007.png at 01D0D122.90592940] From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, 6 August 2015 9:16 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Robin, So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: AppConfig[:compile_jasper] = true and restart ASpace. This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio. Just be sure to recompile your reports. For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of McElheny, Robin G. > Sent: Wednesday, August 5, 2015 5:55 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: [Archivesspace_Users_Group] Problems with ASpace reports At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn't see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them - and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. [cid:image008.jpg at 01D0D122.90592940] * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don't do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: [cid:image009.jpg at 01D0D122.90592940] * Here's another example: [cid:image010.jpg at 01D0D122.90592940] * In the case of an HTML report, it displays page footers - odd for online display. [htmlreport] Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: [cid:image012.jpg at 01D0D122.90592940] * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in "Waiting for (server)" messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 56144 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.jpg Type: image/jpeg Size: 16855 bytes Desc: image008.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.jpg Type: image/jpeg Size: 59883 bytes Desc: image009.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.jpg Type: image/jpeg Size: 37229 bytes Desc: image010.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.jpg Type: image/jpeg Size: 21318 bytes Desc: image011.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.jpg Type: image/jpeg Size: 22259 bytes Desc: image012.jpg URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 7 05:49:00 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 7 Aug 2015 09:49:00 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> References: , <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> Message-ID: Hi Emma, Can you look at what's being output into the log? The easiest way to see what the report is doing is to look at the Jasper XML, which you can see here => https://github.com/archivesspace/archivesspace/blob/master/reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml#L20-L37 The basic SQL query is defined in the tag, with the formatting happening below. You can edit this file to fit your needs, then restart ASpace to have it recompiled. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Emma Jolley Sent: Friday, August 7, 2015 7:13 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Chris We have had the same issues as Robin with the reports. We have tried to implement your suggested solutions below but now received the following error message which I?ve copied below. Any advice on this? In addition, I have asked previously but have never received an answer ? I wonder if there is any documentation on what criteria the reports use to identify records that meet the nominated criteria. For example what fields is used to indicate an unprocessed Accession and what field is used to indicate an uncatalogued accession? Many thanks Emma [cid:image007.png at 01D0D122.90592940] From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, 6 August 2015 9:16 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Robin, So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: AppConfig[:compile_jasper] = true and restart ASpace. This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio. Just be sure to recompile your reports. For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of McElheny, Robin G. > Sent: Wednesday, August 5, 2015 5:55 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: [Archivesspace_Users_Group] Problems with ASpace reports At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn?t see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them ? and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. [cid:image008.jpg at 01D0D122.90592940] * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don?t do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: [cid:image009.jpg at 01D0D122.90592940] * Here?s another example: [cid:image010.jpg at 01D0D122.90592940] * In the case of an HTML report, it displays page footers ? odd for online display. [htmlreport] Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: [cid:image012.jpg at 01D0D122.90592940] * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in ?Waiting for (server)? messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 56144 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.jpg Type: image/jpeg Size: 16855 bytes Desc: image008.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.jpg Type: image/jpeg Size: 59883 bytes Desc: image009.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.jpg Type: image/jpeg Size: 37229 bytes Desc: image010.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.jpg Type: image/jpeg Size: 21318 bytes Desc: image011.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.jpg Type: image/jpeg Size: 22259 bytes Desc: image012.jpg URL: From melissa.wisner at yale.edu Fri Aug 7 10:48:47 2015 From: melissa.wisner at yale.edu (Wisner, Melissa) Date: Fri, 7 Aug 2015 14:48:47 +0000 Subject: [Archivesspace_Users_Group] indexing problem? Message-ID: <9E8D0784D9B39B41933B014FA7C528E93C0C6287@x10-mbx5.yu.yale.edu> Hello, Our AS users have reported they were unable to search/retrieve data they just added to ArchivesSpace. We assume this is a problem with the index, if after even several hours a record cannot be retrieved by a barcode. Scenario 1: over 2 -3 days a newly added record could not be retrieved by barcode. When staff would try and create a new record with the same barcode, AS would tell them barcode already exists. After the 3rd day it could be retrieved through a barcode search. Scenario 2: same report came in Thursday morning. Newly added record could not be retrieved by barcode. Today it still can't. But I can retrieve it by the top container number highlighted below in yellow. This behavior is very odd. The reported issue from Thursday morning is shown in this snippet from the log files. There appears to be an error message at the end of this regarding End of File/EOF. I do not know if that is the problem, or what that error means. Additionally, the config file for our production AS does not include certain entries that are shown here as defaults: https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb Specifically- AppConfig[:solr_indexing_frequency_seconds] = 30 and AppConfig[:indexer_solr_timeout_seconds] = 300 If these are not defined, does the default still apply? A default of 30 seconds seems reasonable, and if it is a default even if not defined, why would we see such delays with our index? This is a major problem, as staff cannot do their work when they can't find the records they've been working on. Started GET "/resolve/edit?uri=%2Frepositories%2F12%2Ftop_containers%2F224618" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by ResolverController#resolve_edit as HTML Parameters: {"uri"=>"/repositories/12/top_containers/224618"} Redirected to http://aspace.library.yale.edu/plugins/top_containers/224618/edit Completed 302 Found in 176.0ms Started GET "/plugins/top_containers/224618/edit" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by TopContainersController#edit as HTML Parameters: {"id"=>"224618"} Started POST "/update_monitor/poll" for 130.132.143.66 at 2015-08-06 11:18:09 -0400 Processing by UpdateMonitorController#poll as JSON Parameters: {"lock_version"=>"0", "uri"=>"/repositories/12/archival_objects/2104298"} Completed 200 OK in 204.0ms (Views: 2.0ms) Rendered shared/_breadcrumb.html.erb (26.0ms) Rendered shared/_sidebar.html.erb (3.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (6.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (29.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (4.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (11.0ms) Rendered container_locations/_template.html.erb (0.0ms) Rendered shared/_subrecord_form.html.erb (15.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (57.0ms) Rendered shared/_sidebar.html.erb (5.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (13.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (42.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (7.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (23.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (16.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (101.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (25.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (14.0ms) Rendered locations/_linker.html.erb (12.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/edit.html.erb within layouts/application (523.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/layout_head.html.erb (7.0ms) Rendered /archivesspace/plugins/oclc/frontend/views/layout_head.html.erb (1.0ms) Rendered /archivesspace/plugins/yale_accessions/frontend/views/layout_head.html.erb (4.0ms) Rendered shared/_browser_support.html.erb (0.0ms) Rendered shared/_header_user.html.erb (71.0ms) Rendered shared/_header_global.html.erb (87.0ms) Rendered site/_branding.html.erb (2.0ms) Rendered shared/_advanced_search.html.erb (404.0ms) Rendered shared/_header_repository.html.erb (497.0ms) Rendered site/_footer.html.erb (0.0ms) Rendered shared/_templates.html.erb (17.0ms) Completed 200 OK in 3774.0ms (Views: 1299.0ms) Aug 06, 2015 11:18:14 AM org.apache.solr.core.SolrCore execute INFO: [collection1] webapp= path=/select params={facet=true&pf=four_part_id^4&sort=&start=0&q=ms+*&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&facet.field=primary_type&facet.field=creators&facet.field=subjects&wt=json&fq=repository:"/repositories/12"+OR+repository:global&fq=types:("resource")&fq=-exclude_by_default:true&rows=10&defType=edismax} hits=3381 status=0 QTime=41654 Completed 200 OK in 44280.0ms (Views: 370.0ms) 2015-08-06 11:18:17 -0400: Running index round # Melissa Wisner Yale Library IT -------------- next part -------------- An HTML attachment was scrubbed... URL: From jlake at library.berkeley.edu Fri Aug 7 11:40:06 2015 From: jlake at library.berkeley.edu (James D. LAKE) Date: Fri, 7 Aug 2015 08:40:06 -0700 Subject: [Archivesspace_Users_Group] Error messages during dev import Message-ID: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From brianjhoffman at gmail.com Fri Aug 7 11:46:03 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Fri, 7 Aug 2015 11:46:03 -0400 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: <83453C0A-67A6-4D68-B7A7-3DBB4DC2075B@gmail.com> Hi James, Can you send me a copy of the entire EAD? Brian > On Aug 7, 2015, at 11:40 AM, James D. LAKE wrote: > > Hi - > > We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. > > Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. > > Jim Lake > UC Berkeley Library > > *** > > Error: # > > This component seems to be OK: > > > > 5 > 3 > Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) > 1956 > > > > But this one generated the error: > > > > 5 > 4 > Katz Case > 1964-1965 > > > > *** > > This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: > > #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> > > > > 1 > Bibliography on 3 x 5 index cards - Compiled by Genie Candau > 1956 - 1991 > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From maureen.callahan at yale.edu Fri Aug 7 13:44:42 2015 From: maureen.callahan at yale.edu (Callahan, Maureen) Date: Fri, 7 Aug 2015 17:44:42 +0000 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects Message-ID: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Hi everyone, This may be a dumb question. I?m trying to wade in from the shallow end. I have a list of digital objects that I want to create in ArchivesSpace and a list of which archival objects they should become instances of. I?m sitting down to write a script to start doing this work, and I?m wondering if this is possible ? if there?s actually an endpoint that will let me do this. I see that I can post children digital objects to already-existing digital objects (POST /repositories/:repo_id/digital_object_components/:id/children), but I don?t see an explicit way to add digital objects as instances of archival objects. Thoughts? How would others approach this work? Maureen From archives at steinbeck.org Fri Aug 7 14:02:32 2015 From: archives at steinbeck.org (Steinbeck Archives) Date: Fri, 7 Aug 2015 18:02:32 +0000 Subject: [Archivesspace_Users_Group] Config Settings Message-ID: Hello, Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. I am wondering if there's some setting in the config.rb that I haven't set properly. Thanks, Lisa C. Josephs Archivist National Steinbeck Center 1 Main Street, Salinas, CA -------------- next part -------------- An HTML attachment was scrubbed... URL: From Kevin.Clair at du.edu Fri Aug 7 14:02:55 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Fri, 7 Aug 2015 18:02:55 +0000 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Message-ID: Hi Maureen, I've been working on a plugin that allows us to create new digital objects based on the metadata in an existing item record, to aid in our digitization workflow, and this is one of the problems it sets out to fix for us. What I ended up having to do was, once the digital object had been created, grab its URI, download the JSON for the original archival object, attach the digital object URI as a linked instance, and re-upload the new JSON through the backend. As far as I know that's the only solution, unless it's possible to write a plug-in with a backend controller that handles all those steps in one go. We also can't do this in batches yet, it only allows for linking single digital objects to single items. The code is here, with huge caveats that it's written specifically for our workflows and isn't actually in production at Denver yet: https://github.com/duspeccoll/digitized_object -k -----Original Message----- From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Callahan, Maureen Sent: Friday, August 07, 2015 11:45 AM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects Hi everyone, This may be a dumb question. I?m trying to wade in from the shallow end. I have a list of digital objects that I want to create in ArchivesSpace and a list of which archival objects they should become instances of. I?m sitting down to write a script to start doing this work, and I?m wondering if this is possible ? if there?s actually an endpoint that will let me do this. I see that I can post children digital objects to already-existing digital objects (POST /repositories/:repo_id/digital_object_components/:id/children), but I don?t see an explicit way to add digital objects as instances of archival objects. Thoughts? How would others approach this work? Maureen _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group From ns96 at nyu.edu Fri Aug 7 14:08:57 2015 From: ns96 at nyu.edu (Nathan Stevens) Date: Fri, 7 Aug 2015 14:08:57 -0400 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Message-ID: Kevin is correct, this is the way to do this using the REST APIs. NYU, is also going to have to tackle this issue since they make extensive use of an AT plugin which does this. I was thinking of creating a desktop version of the AT plugin that works with ASpace, but time or the budget to do so is not currently there. On Fri, Aug 7, 2015 at 2:02 PM, Kevin Clair wrote: > Hi Maureen, > > I've been working on a plugin that allows us to create new digital objects > based on the metadata in an existing item record, to aid in our > digitization workflow, and this is one of the problems it sets out to fix > for us. What I ended up having to do was, once the digital object had been > created, grab its URI, download the JSON for the original archival object, > attach the digital object URI as a linked instance, and re-upload the new > JSON through the backend. As far as I know that's the only solution, unless > it's possible to write a plug-in with a backend controller that handles all > those steps in one go. > > We also can't do this in batches yet, it only allows for linking single > digital objects to single items. > > The code is here, with huge caveats that it's written specifically for our > workflows and isn't actually in production at Denver yet: > https://github.com/duspeccoll/digitized_object -k > > -----Original Message----- > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of > Callahan, Maureen > Sent: Friday, August 07, 2015 11:45 AM > To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] attaching digital objects to archival > objects > > Hi everyone, > > This may be a dumb question. I?m trying to wade in from the shallow end. > > I have a list of digital objects that I want to create in ArchivesSpace > and a list of which archival objects they should become instances of. I?m > sitting down to write a script to start doing this work, and I?m wondering > if this is possible ? if there?s actually an endpoint that will let me do > this. I see that I can post children digital objects to already-existing > digital objects (POST > /repositories/:repo_id/digital_object_components/:id/children), but I don?t > see an explicit way to add digital objects as instances of archival objects. > > Thoughts? How would others approach this work? > > Maureen > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From djpillen at umich.edu Fri Aug 7 14:13:16 2015 From: djpillen at umich.edu (Dallas Pillen) Date: Fri, 7 Aug 2015 14:13:16 -0400 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Message-ID: Hi Maureen, Not sure if this is the best/most appropriate way to do this, but I worked up a prototype for doing something similar to this that grabs an archival object's JSON, creates a new digital object and stores its URI, and then uses the update archival object endpoint (POST /repositories/:repo_id/:archival_objects/:id) to repost the archival object with the new instance. The script (that also has some probably irrelevant stuff up top to search for an archival object by its refid) is here: https://github.com/djpillen/bentley_scripts/blob/master/update_archival_object.py On Fri, Aug 7, 2015 at 1:44 PM, Callahan, Maureen wrote: > Hi everyone, > > This may be a dumb question. I?m trying to wade in from the shallow end. > > I have a list of digital objects that I want to create in ArchivesSpace > and a list of which archival objects they should become instances of. I?m > sitting down to write a script to start doing this work, and I?m wondering > if this is possible ? if there?s actually an endpoint that will let me do > this. I see that I can post children digital objects to already-existing > digital objects (POST > /repositories/:repo_id/digital_object_components/:id/children), but I don?t > see an explicit way to add digital objects as instances of archival objects. > > Thoughts? How would others approach this work? > > Maureen > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > -- *Dallas Pillen*Project Archivist Bentley Historical Library 1150 Beal Avenue Ann Arbor, Michigan 48109-2113 734.647.3559 Twitter Facebook -------------- next part -------------- An HTML attachment was scrubbed... URL: From maureen.callahan at yale.edu Fri Aug 7 14:13:57 2015 From: maureen.callahan at yale.edu (Callahan, Maureen) Date: Fri, 7 Aug 2015 18:13:57 +0000 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Message-ID: <794FA5C2-1F43-4EAC-995A-489DC773C3F8@yale.edu> I?m really thankful for the thoughtful replies and bummed out that this won?t be easy. Kevin, I?m looking at this: What I ended up having to do was, once the digital object had been created, grab its URI, download the JSON for the original archival object, attach the digital object URI as a linked instance, and re-upload the new JSON through the backend. What do you mean when you say that you attach the digital object URI as a linked resource here? Do you have examples of this process that you could send me? My feature request finger is itching? Maureen On Aug 7, 2015, at 2:08 PM, Nathan Stevens > wrote: Kevin is correct, this is the way to do this using the REST APIs. NYU, is also going to have to tackle this issue since they make extensive use of an AT plugin which does this. I was thinking of creating a desktop version of the AT plugin that works with ASpace, but time or the budget to do so is not currently there. On Fri, Aug 7, 2015 at 2:02 PM, Kevin Clair > wrote: Hi Maureen, I've been working on a plugin that allows us to create new digital objects based on the metadata in an existing item record, to aid in our digitization workflow, and this is one of the problems it sets out to fix for us. What I ended up having to do was, once the digital object had been created, grab its URI, download the JSON for the original archival object, attach the digital object URI as a linked instance, and re-upload the new JSON through the backend. As far as I know that's the only solution, unless it's possible to write a plug-in with a backend controller that handles all those steps in one go. We also can't do this in batches yet, it only allows for linking single digital objects to single items. The code is here, with huge caveats that it's written specifically for our workflows and isn't actually in production at Denver yet: https://github.com/duspeccoll/digitized_object -k -----Original Message----- From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Callahan, Maureen Sent: Friday, August 07, 2015 11:45 AM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects Hi everyone, This may be a dumb question. I?m trying to wade in from the shallow end. I have a list of digital objects that I want to create in ArchivesSpace and a list of which archival objects they should become instances of. I?m sitting down to write a script to start doing this work, and I?m wondering if this is possible ? if there?s actually an endpoint that will let me do this. I see that I can post children digital objects to already-existing digital objects (POST /repositories/:repo_id/digital_object_components/:id/children), but I don?t see an explicit way to add digital objects as instances of archival objects. Thoughts? How would others approach this work? Maureen _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org https://urldefense.proofpoint.com/v2/url?u=http-3A__lyralists.lyrasis.org_mailman_listinfo_archivesspace-5Fusers-5Fgroup&d=AwICAg&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=JgH2YCQ8D3P9-Lm_x4bv3d2CZBYlbx6hxnLFHtfovi8&m=hInqqLnf-60PnmBDeh7I3Kwgy-EPNE_tvp1rzNImRaw&s=W2RYENC9A3pZfY24DgqHTXH376cGs5UiZJqFIO49f8I&e= -------------- next part -------------- An HTML attachment was scrubbed... URL: From maureen.callahan at yale.edu Fri Aug 7 14:15:41 2015 From: maureen.callahan at yale.edu (Callahan, Maureen) Date: Fri, 7 Aug 2015 18:15:41 +0000 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> Message-ID: Dallas, this is AWESOME. Funnily enough, I too need to look up the archival object by its refid. This is almost literally everything I need. Maureen On Aug 7, 2015, at 2:13 PM, Dallas Pillen > wrote: Hi Maureen, Not sure if this is the best/most appropriate way to do this, but I worked up a prototype for doing something similar to this that grabs an archival object's JSON, creates a new digital object and stores its URI, and then uses the update archival object endpoint (POST /repositories/:repo_id/:archival_objects/:id) to repost the archival object with the new instance. The script (that also has some probably irrelevant stuff up top to search for an archival object by its refid) is here: https://github.com/djpillen/bentley_scripts/blob/master/update_archival_object.py On Fri, Aug 7, 2015 at 1:44 PM, Callahan, Maureen > wrote: Hi everyone, This may be a dumb question. I?m trying to wade in from the shallow end. I have a list of digital objects that I want to create in ArchivesSpace and a list of which archival objects they should become instances of. I?m sitting down to write a script to start doing this work, and I?m wondering if this is possible ? if there?s actually an endpoint that will let me do this. I see that I can post children digital objects to already-existing digital objects (POST /repositories/:repo_id/digital_object_components/:id/children), but I don?t see an explicit way to add digital objects as instances of archival objects. Thoughts? How would others approach this work? Maureen _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Dallas Pillen Project Archivist [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Avenue Ann Arbor, Michigan 48109-2113 734.647.3559 Twitter Facebook _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org https://urldefense.proofpoint.com/v2/url?u=http-3A__lyralists.lyrasis.org_mailman_listinfo_archivesspace-5Fusers-5Fgroup&d=AwICAg&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=JgH2YCQ8D3P9-Lm_x4bv3d2CZBYlbx6hxnLFHtfovi8&m=mTC1w7j4SL0FLJQhDu7aWSipl_20tTouhMmmqe-h-1s&s=EIrEqNZEYtei_m-oBWB9oWhuSJCOVGeTiCL-wu8OwE8&e= -------------- next part -------------- An HTML attachment was scrubbed... URL: From Kevin.Clair at du.edu Fri Aug 7 14:18:13 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Fri, 7 Aug 2015 18:18:13 +0000 Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects In-Reply-To: <794FA5C2-1F43-4EAC-995A-489DC773C3F8@yale.edu> References: <73F9154D-6E8B-4CF1-BC89-33B62B4E1F91@yale.edu> <794FA5C2-1F43-4EAC-995A-489DC773C3F8@yale.edu> Message-ID: I do it exactly the same way Dallas does (thanks for linking your code just now, by the way!), only in Ruby instead of Perl. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Callahan, Maureen Sent: Friday, August 07, 2015 12:14 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] attaching digital objects to archival objects I?m really thankful for the thoughtful replies and bummed out that this won?t be easy. Kevin, I?m looking at this: What I ended up having to do was, once the digital object had been created, grab its URI, download the JSON for the original archival object, attach the digital object URI as a linked instance, and re-upload the new JSON through the backend. What do you mean when you say that you attach the digital object URI as a linked resource here? Do you have examples of this process that you could send me? My feature request finger is itching? Maureen On Aug 7, 2015, at 2:08 PM, Nathan Stevens > wrote: Kevin is correct, this is the way to do this using the REST APIs. NYU, is also going to have to tackle this issue since they make extensive use of an AT plugin which does this. I was thinking of creating a desktop version of the AT plugin that works with ASpace, but time or the budget to do so is not currently there. On Fri, Aug 7, 2015 at 2:02 PM, Kevin Clair > wrote: Hi Maureen, I've been working on a plugin that allows us to create new digital objects based on the metadata in an existing item record, to aid in our digitization workflow, and this is one of the problems it sets out to fix for us. What I ended up having to do was, once the digital object had been created, grab its URI, download the JSON for the original archival object, attach the digital object URI as a linked instance, and re-upload the new JSON through the backend. As far as I know that's the only solution, unless it's possible to write a plug-in with a backend controller that handles all those steps in one go. We also can't do this in batches yet, it only allows for linking single digital objects to single items. The code is here, with huge caveats that it's written specifically for our workflows and isn't actually in production at Denver yet: https://github.com/duspeccoll/digitized_object -k -----Original Message----- From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Callahan, Maureen Sent: Friday, August 07, 2015 11:45 AM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] attaching digital objects to archival objects Hi everyone, This may be a dumb question. I?m trying to wade in from the shallow end. I have a list of digital objects that I want to create in ArchivesSpace and a list of which archival objects they should become instances of. I?m sitting down to write a script to start doing this work, and I?m wondering if this is possible ? if there?s actually an endpoint that will let me do this. I see that I can post children digital objects to already-existing digital objects (POST /repositories/:repo_id/digital_object_components/:id/children), but I don?t see an explicit way to add digital objects as instances of archival objects. Thoughts? How would others approach this work? Maureen _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org https://urldefense.proofpoint.com/v2/url?u=http-3A__lyralists.lyrasis.org_mailman_listinfo_archivesspace-5Fusers-5Fgroup&d=AwICAg&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=JgH2YCQ8D3P9-Lm_x4bv3d2CZBYlbx6hxnLFHtfovi8&m=hInqqLnf-60PnmBDeh7I3Kwgy-EPNE_tvp1rzNImRaw&s=W2RYENC9A3pZfY24DgqHTXH376cGs5UiZJqFIO49f8I&e= -------------- next part -------------- An HTML attachment was scrubbed... URL: From fruscian at rulmail.rutgers.edu Fri Aug 7 14:48:41 2015 From: fruscian at rulmail.rutgers.edu (Thomas Frusciano) Date: Fri, 7 Aug 2015 14:48:41 -0400 (EDT) Subject: [Archivesspace_Users_Group] AT migration to ArchivesSpace 1.3 In-Reply-To: <68432219.24839421.1438964404814.JavaMail.zimbra@rulmail.rutgers.edu> Message-ID: <1618233021.24955987.1438973321178.JavaMail.zimbra@rulmail.rutgers.edu> Hi -- The archivists at Rutgers are just at the beginning stages of implementing ArchivesSpace 1.3. With the work of Nick Gonzaga, Library Systems staff member, we have set up our system according to the guidelines and now have a functioning MySQL database-driven ArchivesSpace presence. The next step has involved migrating AT data to AS. Using the current AT migration script for AS 1.3, Nick ran the migration according to the documentation provided and was successful in moving subjects, agents, and locations from AT to AS. When he told me to check out the data, I noticed that no accession or resource records migrated! We're not sure about the problem and he stated that during migration, he received many "Fail: Accession records" errors. So, I throw this out to the experts among the user community and the experts at Lyrasis for help. Thanks. Tom -- Thomas J. Frusciano, University Archivist Special Collections and University Archives Rutgers University Libraries 169 College Ave., New Brunswick, NJ 08901-1163 Phone: (848) 932-6149 Fax: (732) 932-7012 E-Mail: fruscian at rulmail.rutgers.edu http://www.libraries.rutgers.edu/rul/libs/scua/university_archives/archives_main.shtml -------------- next part -------------- An HTML attachment was scrubbed... URL: From ns96 at nyu.edu Fri Aug 7 15:15:40 2015 From: ns96 at nyu.edu (Nathan Stevens) Date: Fri, 7 Aug 2015 15:15:40 -0400 Subject: [Archivesspace_Users_Group] AT migration to ArchivesSpace 1.3 In-Reply-To: <1618233021.24955987.1438973321178.JavaMail.zimbra@rulmail.rutgers.edu> References: <68432219.24839421.1438964404814.JavaMail.zimbra@rulmail.rutgers.edu> <1618233021.24955987.1438973321178.JavaMail.zimbra@rulmail.rutgers.edu> Message-ID: Can you send the migration log. The description of the problem is to vague to offer any advice. On Fri, Aug 7, 2015 at 2:48 PM, Thomas Frusciano < fruscian at rulmail.rutgers.edu> wrote: > Hi -- > > The archivists at Rutgers are just at the beginning stages of implementing > ArchivesSpace 1.3. With the work of Nick Gonzaga, Library Systems staff > member, we have set up our system according to the guidelines and now have > a functioning MySQL database-driven ArchivesSpace presence. The next step > has involved migrating AT data to AS. Using the current AT migration > script for AS 1.3, Nick ran the migration according to the documentation > provided and was successful in moving subjects, agents, and locations from > AT to AS. When he told me to check out the data, I noticed that no > accession or resource records migrated! We're not sure about the problem > and he stated that during migration, he received many "Fail: Accession > records" errors. So, I throw this out to the experts among the user > community and the experts at Lyrasis for help. > > Thanks. > > Tom > > -- > Thomas J. Frusciano, University Archivist > Special Collections and University Archives > Rutgers University Libraries > 169 College Ave., New Brunswick, NJ 08901-1163 > Phone: (848) 932-6149 Fax: (732) 932-7012 > E-Mail: fruscian at rulmail.rutgers.edu > > http://www.libraries.rutgers.edu/rul/libs/scua/university_archives/archives_main.shtml > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Fri Aug 7 17:39:02 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Fri, 7 Aug 2015 17:39:02 -0400 Subject: [Archivesspace_Users_Group] EAD Import Issue... In-Reply-To: References: <92723F32A19E4446AB97F20B464D1CEB633B0789@EXBOX01.admin.colum.edu> <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> Message-ID: <5CCEFE11-4E12-4E32-AB78-6679BFC2E6EA@virginia.edu> Yes, but my first point was that ASpace is NOT choking on those smart quotes (at least, not on my test server). There are a number of U+2019 RIGHT SINGLE QUOTATION MARK characters in the file, and for me, the original file is importing without any problems. The original file is also UTF-8 encoding, so the error message was sending us down the wrong track initially. Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> There?s no x9D in U+2019, and Windows-1252 encoding would actually be 92. Maybe the error message indicates something else misconfigured so that it?s reading a valid UTF-8 file but thinking it?s in Windows-1252 encoding, and hitting a valid UTF-8 sequence with a x9D ( which is empty/invalid in W-1252 ) and giving a misleading error message. There is a x9D in RIGHT DOUBLE QUOTATION MARK http://www.fileformat.info/info/unicode/char/201d/index.htm which does also occur in that file. ? Steve. > On Aug 6, 2015, at 1:32 PM, Custer, Mark wrote: > > Right, there are no XML encoding errors in the file, so xmllint is indeed correct. After I downloaded the original file, though, I got the same error that Dominic received when trying to import the file. After replacing the smart quotes as Christy suggested, the file imported without issue. > > Ideally, I don?t think that the ASpace importer should choke on smart quotes, but you can certainly test for any potentially offending characters via Schematron (or other ways) prior to importing. After learning of this issue, I added the following test to a Schematron file to do just that: > > > > > > Smart quote detected. These characters need to be replaced before importing your files > into ArchivesSpace. > > > > > Not an ideal way to do things, but at least it warns me now if any my EAD files have one of three characters prior to importing the file. > > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski > Sent: Friday, July 31, 2015 2:04 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... > > > When I download that original email enclosure and run xmllint on it, it doesn?t show any encoding errors. > I was also able to import it into ArchivesSpace without any errors. > > I wonder if the translation to and from Base64 encoding of the email enclosure somehow > transforms the character encoding and fixes the problem ? > > > Re: testing with Schematron: > > In my experience ( with doing validation in Java and hitting those kind of encoding errors ) > encoding errors come from early in the processing pipeline before Schematron or XSLT processing. > I think you would need to scan the file for invalid encoding before passing it to the XML parser. > ( In fact, I?m not even sure if you can express an invalid encoding in Schematron if it?s XML in > a particular encoding. ) > > > ? Steve. > > > > On Jul 31, 2015, at 1:12 PM, Custer, Mark > wrote: > > Interesting. I just tried to change the encoding value, but that doesn?t work. If you do a find and replace in the file to replace the single quotes, though, the record will import fine. I?ve attached a copy of the record that I was able to import. > > For the record, using that type of single quote doesn?t invalidate the EAD file. It?s still perfectly valid, but I don?t know if it?s fully UTF-8 compliant. > > Is there any way to come up with a list of invalid characters? If so, then that could be added to a Schematron file to test and make sure those values aren?t present before attempting to do the batch upload. > > Mark > > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski > Sent: Friday, July 31, 2015 12:31 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... > > > You might also try changing the encoding of the EAD file in the XML header. > If it?s not declared, by default it?s UTF-8. > Change the first line to: > > > > > ( I don?t know for a fact if this will work for ArchivesSpace, but it works with most parsers and validators. ) > > > Alternatively, if you have ?iconv? you can run a conversion thru that program to change the encoding: > > iconv -f WINDOWS-1252 -t UTF-8 > > > > > ? Steve Majewski > > > > On Jul 31, 2015, at 12:17 PM, Tomecek, Christy > wrote: > > Hello, > > I think the issue is that there are Word ?Smart Quotes? in your text fields (not the markup itself). The EAD won?t validate if they are present. > > Example (Smart quote highlighted): > > Dating from 1918 to 2000, the History and Background Information series consists of written histories, newspaper clippings, and anniversary publications documenting St. Vincent?s steady growth in the Lincoln Park neighborhood. > > There is a way to turn off Smart Quotes in Word so this way you don?t have to go line by line fixing them if you are doing a copy-paste from a Word Document into ASpace. > > ? Open Word. Go to File (or if you are in Windows 8/8.1, go to the Windows logo button). > ? Scroll to the bottom of the sidebar where things like "New," "Save," etc. are and click on "Options" at the bottom. > ? Go to "Proofing," located on the sidebar. > ? Go to "AutoCorrect Options" in the main panel. > ? Go to the "AutoFormat As You Type" tab and uncheck the "'Straight quotes' with 'smart quotes'" options under "Replace When You Type." > > Best, > Christy > > -- > > Christy Tomecek > Archives Assistant > Yale University Library > Manuscripts and Archives > 203-432-7382 > christy.tomecek at yale.edu > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Rossetti, Dominic > Sent: Friday, July 31, 2015 11:58 AM > To: 'archivesspace_users_group at lyralists.lyrasis.org ' > Subject: [Archivesspace_Users_Group] EAD Import Issue... > > Hey all, > > When trying to import EAD I get the following error message in the log file: > > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > IMPORT ERROR > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > > Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > I?ve attached a file as an example. The EAD is valid and correct. Not sure what is causing the issue. > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From mark.custer at yale.edu Sat Aug 8 19:19:53 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Sat, 8 Aug 2015 23:19:53 +0000 Subject: [Archivesspace_Users_Group] EAD Import Issue... In-Reply-To: <5CCEFE11-4E12-4E32-AB78-6679BFC2E6EA@virginia.edu> References: <92723F32A19E4446AB97F20B464D1CEB633B0789@EXBOX01.admin.colum.edu> <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> , <5CCEFE11-4E12-4E32-AB78-6679BFC2E6EA@virginia.edu> Message-ID: I got the same error message when I tied to upload the original file to http://test.archivesspace.org/,http://test.archivesspace.org/, 1.3.2-dev11 (and it failed in the first case, which is why it was posted to the listserv). It's good to know that you were able to import it on your server, but that just makes the whole thing curiouser! I should try to import an EAD or MARC file with right single quotation marks into our our test ASpace server, but I haven't done so yet. It would be nice to get to the bottom of this soon, but I'm afraid that doing so is beyond me. Hopefully others can weigh in on the issue, and hopefully Dominic has since been able to import the EAD file into ASpace. ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org [archivesspace_users_group-bounces at lyralists.lyrasis.org] on behalf of Steven Majewski [sdm7g at virginia.edu] Sent: Friday, August 07, 2015 5:39 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... Yes, but my first point was that ASpace is NOT choking on those smart quotes (at least, not on my test server). There are a number of U+2019 RIGHT SINGLE QUOTATION MARK characters in the file, and for me, the original file is importing without any problems. The original file is also UTF-8 encoding, so the error message was sending us down the wrong track initially. Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> There?s no x9D in U+2019, and Windows-1252 encoding would actually be 92. Maybe the error message indicates something else misconfigured so that it?s reading a valid UTF-8 file but thinking it?s in Windows-1252 encoding, and hitting a valid UTF-8 sequence with a x9D ( which is empty/invalid in W-1252 ) and giving a misleading error message. There is a x9D in RIGHT DOUBLE QUOTATION MARK http://www.fileformat.info/info/unicode/char/201d/index.htm which does also occur in that file. ? Steve. On Aug 6, 2015, at 1:32 PM, Custer, Mark > wrote: Right, there are no XML encoding errors in the file, so xmllint is indeed correct. After I downloaded the original file, though, I got the same error that Dominic received when trying to import the file. After replacing the smart quotes as Christy suggested, the file imported without issue. Ideally, I don?t think that the ASpace importer should choke on smart quotes, but you can certainly test for any potentially offending characters via Schematron (or other ways) prior to importing. After learning of this issue, I added the following test to a Schematron file to do just that: Smart quote detected. These characters need to be replaced before importing your files into ArchivesSpace. Not an ideal way to do things, but at least it warns me now if any my EAD files have one of three characters prior to importing the file. From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 2:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... When I download that original email enclosure and run xmllint on it, it doesn?t show any encoding errors. I was also able to import it into ArchivesSpace without any errors. I wonder if the translation to and from Base64 encoding of the email enclosure somehow transforms the character encoding and fixes the problem ? Re: testing with Schematron: In my experience ( with doing validation in Java and hitting those kind of encoding errors ) encoding errors come from early in the processing pipeline before Schematron or XSLT processing. I think you would need to scan the file for invalid encoding before passing it to the XML parser. ( In fact, I?m not even sure if you can express an invalid encoding in Schematron if it?s XML in a particular encoding. ) ? Steve. On Jul 31, 2015, at 1:12 PM, Custer, Mark > wrote: Interesting. I just tried to change the encoding value, but that doesn?t work. If you do a find and replace in the file to replace the single quotes, though, the record will import fine. I?ve attached a copy of the record that I was able to import. For the record, using that type of single quote doesn?t invalidate the EAD file. It?s still perfectly valid, but I don?t know if it?s fully UTF-8 compliant. Is there any way to come up with a list of invalid characters? If so, then that could be added to a Schematron file to test and make sure those values aren?t present before attempting to do the batch upload. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Steven Majewski Sent: Friday, July 31, 2015 12:31 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... You might also try changing the encoding of the EAD file in the XML header. If it?s not declared, by default it?s UTF-8. Change the first line to: ( I don?t know for a fact if this will work for ArchivesSpace, but it works with most parsers and validators. ) Alternatively, if you have ?iconv? you can run a conversion thru that program to change the encoding: iconv -f WINDOWS-1252 -t UTF-8 ? Steve Majewski On Jul 31, 2015, at 12:17 PM, Tomecek, Christy > wrote: Hello, I think the issue is that there are Word ?Smart Quotes? in your text fields (not the markup itself). The EAD won?t validate if they are present. Example (Smart quote highlighted): Dating from 1918 to 2000, the History and Background Information series consists of written histories, newspaper clippings, and anniversary publications documenting St. Vincent?s steady growth in the Lincoln Park neighborhood. There is a way to turn off Smart Quotes in Word so this way you don?t have to go line by line fixing them if you are doing a copy-paste from a Word Document into ASpace. ? Open Word. Go to File (or if you are in Windows 8/8.1, go to the Windows logo button). ? Scroll to the bottom of the sidebar where things like "New," "Save," etc. are and click on "Options" at the bottom. ? Go to "Proofing," located on the sidebar. ? Go to "AutoCorrect Options" in the main panel. ? Go to the "AutoFormat As You Type" tab and uncheck the "'Straight quotes' with 'smart quotes'" options under "Replace When You Type." Best, Christy -- Christy Tomecek Archives Assistant Yale University Library Manuscripts and Archives 203-432-7382 christy.tomecek at yale.edu From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Rossetti, Dominic Sent: Friday, July 31, 2015 11:58 AM To: 'archivesspace_users_group at lyralists.lyrasis.org' Subject: [Archivesspace_Users_Group] EAD Import Issue... Hey all, When trying to import EAD I get the following error message in the log file: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! IMPORT ERROR !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! I?ve attached a file as an example. The EAD is valid and correct. Not sure what is causing the issue. _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Sat Aug 8 20:50:58 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Sat, 8 Aug 2015 20:50:58 -0400 Subject: [Archivesspace_Users_Group] EAD Import Issue... In-Reply-To: References: <92723F32A19E4446AB97F20B464D1CEB633B0789@EXBOX01.admin.colum.edu> <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> <5CCEFE11-4E12-4E32-AB78-6679BFC2E6EA@virginia.edu> Message-ID: If it?s working for me but not for you and Dominic, that makes me think it?s an issue with a difference in default encodings on the JVM for our respective servers. ( And there are several default settings. Google ?java default encodings? and you?ll find several posts like this: http://stackoverflow.com/questions/1749064/how-to-find-the-default-charset-encoding-in-java ) I have experienced the case in Java where the first line below looses the encoding declared in the input file, and falls back to a java default, while the 2nd line works properly: - InputSource indoc = new InputSource( new InputStreamReader( xmlfile.getInputStream() )); + InputSource indoc = new InputSource( xmlfile.getInputStream() ); I wonder if something like that is happening and the UTF-8 encoded file is being read as Windows-1252. ( That DOES seem to be what that error message is saying to me. ) ? Steve. > On Aug 8, 2015, at 7:19 PM, Custer, Mark wrote: > > I got the same error message when I tied to upload the original file to http://test.archivesspace.org/,http://test.archivesspace.org/, 1.3.2-dev11 (and it failed in the first case, which is why it was posted to the listserv). It's good to know that you were able to import it on your server, but that just makes the whole thing curiouser! I should try to import an EAD or MARC file with right single quotation marks into our our test ASpace server, but I haven't done so yet. It would be nice to get to the bottom of this soon, but I'm afraid that doing so is beyond me. Hopefully others can weigh in on the issue, and hopefully Dominic has since been able to import the EAD file into ASpace. > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [archivesspace_users_group-bounces at lyralists.lyrasis.org] on behalf of Steven Majewski [sdm7g at virginia.edu] > Sent: Friday, August 07, 2015 5:39 PM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... > > > Yes, but my first point was that ASpace is NOT choking on those smart quotes (at least, not on my test server). > > There are a number of U+2019 RIGHT SINGLE QUOTATION MARK characters in the file, and for me, the original file is importing without any problems. > > The original file is also UTF-8 encoding, so the error message was sending us down the wrong track initially. > > > Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> > > There?s no x9D in U+2019, and Windows-1252 encoding would actually be 92. > > > Maybe the error message indicates something else misconfigured so that it?s reading a valid UTF-8 > file but thinking it?s in Windows-1252 encoding, and hitting a valid UTF-8 sequence with a x9D > ( which is empty/invalid in W-1252 ) and giving a misleading error message. > > There is a x9D in RIGHT DOUBLE QUOTATION MARK http://www.fileformat.info/info/unicode/char/201d/index.htm > which does also occur in that file. > > > ? Steve. > > > > >> On Aug 6, 2015, at 1:32 PM, Custer, Mark > wrote: >> >> Right, there are no XML encoding errors in the file, so xmllint is indeed correct. After I downloaded the original file, though, I got the same error that Dominic received when trying to import the file. After replacing the smart quotes as Christy suggested, the file imported without issue. >> >> Ideally, I don?t think that the ASpace importer should choke on smart quotes, but you can certainly test for any potentially offending characters via Schematron (or other ways) prior to importing. After learning of this issue, I added the following test to a Schematron file to do just that: >> >> >> >> >> >> Smart quote detected. These characters need to be replaced before importing your files >> into ArchivesSpace. >> >> >> >> >> Not an ideal way to do things, but at least it warns me now if any my EAD files have one of three characters prior to importing the file. >> >> >> >> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski >> Sent: Friday, July 31, 2015 2:04 PM >> To: Archivesspace Users Group >> Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... >> >> >> When I download that original email enclosure and run xmllint on it, it doesn?t show any encoding errors. >> I was also able to import it into ArchivesSpace without any errors. >> >> I wonder if the translation to and from Base64 encoding of the email enclosure somehow >> transforms the character encoding and fixes the problem ? >> >> >> Re: testing with Schematron: >> >> In my experience ( with doing validation in Java and hitting those kind of encoding errors ) >> encoding errors come from early in the processing pipeline before Schematron or XSLT processing. >> I think you would need to scan the file for invalid encoding before passing it to the XML parser. >> ( In fact, I?m not even sure if you can express an invalid encoding in Schematron if it?s XML in >> a particular encoding. ) >> >> >> ? Steve. >> >> >> >> On Jul 31, 2015, at 1:12 PM, Custer, Mark > wrote: >> >> Interesting. I just tried to change the encoding value, but that doesn?t work. If you do a find and replace in the file to replace the single quotes, though, the record will import fine. I?ve attached a copy of the record that I was able to import. >> >> For the record, using that type of single quote doesn?t invalidate the EAD file. It?s still perfectly valid, but I don?t know if it?s fully UTF-8 compliant. >> >> Is there any way to come up with a list of invalid characters? If so, then that could be added to a Schematron file to test and make sure those values aren?t present before attempting to do the batch upload. >> >> Mark >> >> >> >> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski >> Sent: Friday, July 31, 2015 12:31 PM >> To: Archivesspace Users Group >> Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... >> >> >> You might also try changing the encoding of the EAD file in the XML header. >> If it?s not declared, by default it?s UTF-8. >> Change the first line to: >> >> >> >> >> ( I don?t know for a fact if this will work for ArchivesSpace, but it works with most parsers and validators. ) >> >> >> Alternatively, if you have ?iconv? you can run a conversion thru that program to change the encoding: >> >> iconv -f WINDOWS-1252 -t UTF-8 >> >> >> >> >> ? Steve Majewski >> >> >> >> On Jul 31, 2015, at 12:17 PM, Tomecek, Christy > wrote: >> >> Hello, >> >> I think the issue is that there are Word ?Smart Quotes? in your text fields (not the markup itself). The EAD won?t validate if they are present. >> >> Example (Smart quote highlighted): >> >> Dating from 1918 to 2000, the History and Background Information series consists of written histories, newspaper clippings, and anniversary publications documenting St. Vincent?s steady growth in the Lincoln Park neighborhood. >> >> There is a way to turn off Smart Quotes in Word so this way you don?t have to go line by line fixing them if you are doing a copy-paste from a Word Document into ASpace. >> >> ? Open Word. Go to File (or if you are in Windows 8/8.1, go to the Windows logo button). >> ? Scroll to the bottom of the sidebar where things like "New," "Save," etc. are and click on "Options" at the bottom. >> ? Go to "Proofing," located on the sidebar. >> ? Go to "AutoCorrect Options" in the main panel. >> ? Go to the "AutoFormat As You Type" tab and uncheck the "'Straight quotes' with 'smart quotes'" options under "Replace When You Type." >> >> Best, >> Christy >> >> -- >> >> Christy Tomecek >> Archives Assistant >> Yale University Library >> Manuscripts and Archives >> 203-432-7382 >> christy.tomecek at yale.edu >> >> >> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Rossetti, Dominic >> Sent: Friday, July 31, 2015 11:58 AM >> To: 'archivesspace_users_group at lyralists.lyrasis.org ' >> Subject: [Archivesspace_Users_Group] EAD Import Issue... >> >> Hey all, >> >> When trying to import EAD I get the following error message in the log file: >> >> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >> IMPORT ERROR >> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >> >> >> Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> >> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >> >> I?ve attached a file as an example. The EAD is valid and correct. Not sure what is causing the issue. >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From sdm7g at virginia.edu Sun Aug 9 00:18:17 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Sun, 9 Aug 2015 00:18:17 -0400 Subject: [Archivesspace_Users_Group] EAD Import Issue... In-Reply-To: References: <92723F32A19E4446AB97F20B464D1CEB633B0789@EXBOX01.admin.colum.edu> <92A65AA5-BB91-422E-850C-A3E04B4A5796@virginia.edu> <5CCEFE11-4E12-4E32-AB78-6679BFC2E6EA@virginia.edu> Message-ID: OK. Even stranger, I was able to upload the file without errors to both the sandbox server running 1.3.0 at http://sandbox.archivesspace.org/ http://public.archivesspace.org/repositories/2/resources/5 and the test server running 1.3.2-dev11 at http://test.archivesspace.org/ http://test.archivesspace.org:8081/repositories/18/resources/119 so if that really didn?t work for you, the only thing I can think would be how the browsers are encoding or reporting the encoding of the uploaded file. ( I?m on a Mac with everything in UTF-8 encoding using Safari FWIW. ) ? Steve. > On Aug 8, 2015, at 8:50 PM, Steven Majewski wrote: > > > If it?s working for me but not for you and Dominic, that makes me think it?s an issue with a difference in default encodings on the JVM for our respective servers. ( And there are several default settings. Google > ?java default encodings? and you?ll find several posts like this: http://stackoverflow.com/questions/1749064/how-to-find-the-default-charset-encoding-in-java ) > > I have experienced the case in Java where the first line below looses the encoding declared in the input file, and falls back to a java default, while the 2nd line works properly: > - InputSource indoc = new InputSource( new InputStreamReader( xmlfile.getInputStream() )); > + InputSource indoc = new InputSource( xmlfile.getInputStream() ); > > > I wonder if something like that is happening and the UTF-8 encoded file is being read as Windows-1252. > ( That DOES seem to be what that error message is saying to me. ) > > ? Steve. > > > > >> On Aug 8, 2015, at 7:19 PM, Custer, Mark > wrote: >> >> I got the same error message when I tied to upload the original file to http://test.archivesspace.org/ ,http://test.archivesspace.org/, 1.3.2-dev11 (and it failed in the first case, which is why it was posted to the listserv). It's good to know that you were able to import it on your server, but that just makes the whole thing curiouser! I should try to import an EAD or MARC file with right single quotation marks into our our test ASpace server, but I haven't done so yet. It would be nice to get to the bottom of this soon, but I'm afraid that doing so is beyond me. Hopefully others can weigh in on the issue, and hopefully Dominic has since been able to import the EAD file into ASpace. >> >> >> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [archivesspace_users_group-bounces at lyralists.lyrasis.org ] on behalf of Steven Majewski [sdm7g at virginia.edu ] >> Sent: Friday, August 07, 2015 5:39 PM >> To: Archivesspace Users Group >> Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... >> >> >> Yes, but my first point was that ASpace is NOT choking on those smart quotes (at least, not on my test server). >> >> There are a number of U+2019 RIGHT SINGLE QUOTATION MARK characters in the file, and for me, the original file is importing without any problems. >> >> The original file is also UTF-8 encoding, so the error message was sending us down the wrong track initially. >> >> >> Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> >> >> There?s no x9D in U+2019, and Windows-1252 encoding would actually be 92. >> >> >> Maybe the error message indicates something else misconfigured so that it?s reading a valid UTF-8 >> file but thinking it?s in Windows-1252 encoding, and hitting a valid UTF-8 sequence with a x9D >> ( which is empty/invalid in W-1252 ) and giving a misleading error message. >> >> There is a x9D in RIGHT DOUBLE QUOTATION MARK http://www.fileformat.info/info/unicode/char/201d/index.htm >> which does also occur in that file. >> >> >> ? Steve. >> >> >> >> >>> On Aug 6, 2015, at 1:32 PM, Custer, Mark > wrote: >>> >>> Right, there are no XML encoding errors in the file, so xmllint is indeed correct. After I downloaded the original file, though, I got the same error that Dominic received when trying to import the file. After replacing the smart quotes as Christy suggested, the file imported without issue. >>> >>> Ideally, I don?t think that the ASpace importer should choke on smart quotes, but you can certainly test for any potentially offending characters via Schematron (or other ways) prior to importing. After learning of this issue, I added the following test to a Schematron file to do just that: >>> >>> >>> >>> >>> >>> Smart quote detected. These characters need to be replaced before importing your files >>> into ArchivesSpace. >>> >>> >>> >>> >>> Not an ideal way to do things, but at least it warns me now if any my EAD files have one of three characters prior to importing the file. >>> >>> >>> >>> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski >>> Sent: Friday, July 31, 2015 2:04 PM >>> To: Archivesspace Users Group >>> Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... >>> >>> >>> When I download that original email enclosure and run xmllint on it, it doesn?t show any encoding errors. >>> I was also able to import it into ArchivesSpace without any errors. >>> >>> I wonder if the translation to and from Base64 encoding of the email enclosure somehow >>> transforms the character encoding and fixes the problem ? >>> >>> >>> Re: testing with Schematron: >>> >>> In my experience ( with doing validation in Java and hitting those kind of encoding errors ) >>> encoding errors come from early in the processing pipeline before Schematron or XSLT processing. >>> I think you would need to scan the file for invalid encoding before passing it to the XML parser. >>> ( In fact, I?m not even sure if you can express an invalid encoding in Schematron if it?s XML in >>> a particular encoding. ) >>> >>> >>> ? Steve. >>> >>> >>> >>> On Jul 31, 2015, at 1:12 PM, Custer, Mark > wrote: >>> >>> Interesting. I just tried to change the encoding value, but that doesn?t work. If you do a find and replace in the file to replace the single quotes, though, the record will import fine. I?ve attached a copy of the record that I was able to import. >>> >>> For the record, using that type of single quote doesn?t invalidate the EAD file. It?s still perfectly valid, but I don?t know if it?s fully UTF-8 compliant. >>> >>> Is there any way to come up with a list of invalid characters? If so, then that could be added to a Schematron file to test and make sure those values aren?t present before attempting to do the batch upload. >>> >>> Mark >>> >>> >>> >>> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Steven Majewski >>> Sent: Friday, July 31, 2015 12:31 PM >>> To: Archivesspace Users Group >>> Subject: Re: [Archivesspace_Users_Group] EAD Import Issue... >>> >>> >>> You might also try changing the encoding of the EAD file in the XML header. >>> If it?s not declared, by default it?s UTF-8. >>> Change the first line to: >>> >>> >>> >>> >>> ( I don?t know for a fact if this will work for ArchivesSpace, but it works with most parsers and validators. ) >>> >>> >>> Alternatively, if you have ?iconv? you can run a conversion thru that program to change the encoding: >>> >>> iconv -f WINDOWS-1252 -t UTF-8 >>> >>> >>> >>> >>> ? Steve Majewski >>> >>> >>> >>> On Jul 31, 2015, at 12:17 PM, Tomecek, Christy > wrote: >>> >>> Hello, >>> >>> I think the issue is that there are Word ?Smart Quotes? in your text fields (not the markup itself). The EAD won?t validate if they are present. >>> >>> Example (Smart quote highlighted): >>> >>> Dating from 1918 to 2000, the History and Background Information series consists of written histories, newspaper clippings, and anniversary publications documenting St. Vincent?s steady growth in the Lincoln Park neighborhood. >>> >>> There is a way to turn off Smart Quotes in Word so this way you don?t have to go line by line fixing them if you are doing a copy-paste from a Word Document into ASpace. >>> >>> ? Open Word. Go to File (or if you are in Windows 8/8.1, go to the Windows logo button). >>> ? Scroll to the bottom of the sidebar where things like "New," "Save," etc. are and click on "Options" at the bottom. >>> ? Go to "Proofing," located on the sidebar. >>> ? Go to "AutoCorrect Options" in the main panel. >>> ? Go to the "AutoFormat As You Type" tab and uncheck the "'Straight quotes' with 'smart quotes'" options under "Replace When You Type." >>> >>> Best, >>> Christy >>> >>> -- >>> >>> Christy Tomecek >>> Archives Assistant >>> Yale University Library >>> Manuscripts and Archives >>> 203-432-7382 >>> christy.tomecek at yale.edu >>> >>> >>> From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Rossetti, Dominic >>> Sent: Friday, July 31, 2015 11:58 AM >>> To: 'archivesspace_users_group at lyralists.lyrasis.org ' >>> Subject: [Archivesspace_Users_Group] EAD Import Issue... >>> >>> Hey all, >>> >>> When trying to import EAD I get the following error message in the log file: >>> >>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >>> IMPORT ERROR >>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >>> >>> >>> Error: #<Encoding::UndefinedConversionError: ""\x9D"" from Windows-1252 to UTF-8> >>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! >>> >>> I?ve attached a file as an example. The EAD is valid and correct. Not sure what is causing the issue. >>> _______________________________________________ >>> Archivesspace_Users_Group mailing list >>> Archivesspace_Users_Group at lyralists.lyrasis.org >>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >>> >>> _______________________________________________ >>> Archivesspace_Users_Group mailing list >>> Archivesspace_Users_Group at lyralists.lyrasis.org >>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >>> >>> _______________________________________________ >>> Archivesspace_Users_Group mailing list >>> Archivesspace_Users_Group at lyralists.lyrasis.org >>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From Chris.Fitzpatrick at lyrasis.org Mon Aug 10 05:31:59 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Mon, 10 Aug 2015 09:31:59 +0000 Subject: [Archivesspace_Users_Group] Config Settings In-Reply-To: References: Message-ID: Hi Lisa, What do you mean "does not display"? They are not showing up in the agent index pages on staff UI, public UI, both? Or when you open the record there is an error? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steinbeck Archives Sent: Friday, August 7, 2015 8:02 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Config Settings Hello, Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. I am wondering if there's some setting in the config.rb that I haven't set properly. Thanks, Lisa C. Josephs Archivist National Steinbeck Center 1 Main Street, Salinas, CA -------------- next part -------------- An HTML attachment was scrubbed... URL: From brad.westbrook at lyrasis.org Mon Aug 10 08:20:00 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Mon, 10 Aug 2015 12:20:00 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace Governance Board: Results of 2015 Election and New Apppointments Message-ID: Dear ArchivesSpace members, colleagues, and friends, I am very pleased to announce the results of this year's election for members to the ArchivesSpace Governance Board. They are: * Christian Dupont, Burns Librarian and Associate University Librarian for Special Collections, Boston College, Large membership level, first two-year term ending June 2017 * Gerald (Jay) Gaidmore, Marian Y. Alan McLeod Director of the Special Collections Research Center, College of William & Mary, Medium membership level, second two-year term ending June 2017 * Thomas Adams, Systems & Digital Project Developer, Cold Spring Harbor Laboratory, Very Small membership level, first two-year term ending June 2017 Voting for the Middle membership level ended in a tie, which was resolved Tuesday, Aug. 4, with a coin toss between the two candidates. I am also happy to announce that Robert Miller, CEO of LYRASIS, is succeeding Kate Nevins as the voting representative of LYRASIS and that Jay Schafer, Director of Libraries University of Massachusetts -Amherst, is succeeding Kathy Ray as the ex officio representative of the LYRASIS board. The ArchivesSpace program and community are fortunate that the enthusiastic and capable people that departed the board at the end of this past year-Kate Nevins, Kathy Ray, Tim Pyatt, and Chris Ervin-are being succeeded by equally enthusiastic and capable people. The Governance Board roster, updated for 2015/16, is posted at https://archivesspace.atlassian.net/wiki/display/ABT/Current+Roster+of+Members and http://archivesspace.org/board. The next Governance Board meeting is scheduled for Saturday morning, August 22, in Cleveland, Ohio. While Governance Board meetings are not open to the membership, Board members will be present and available for question and conversation at the ArchivesSpace member meeting that afternoon at the Cleveland Public Library. Looking forward to seeing many of you at the members meeting! Yours, Brad W. Bradley D. Westbrook Program Manager brad.westbrook at lyrasis.org 800.999.8558 x2910 678.235.2910 bradley_d_westbrook (Skype) [cid:image003.png at 01CE734E.FD759D30] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 7640 bytes Desc: image003.png URL: From Chris.Fitzpatrick at lyrasis.org Mon Aug 10 08:57:36 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Mon, 10 Aug 2015 12:57:36 +0000 Subject: [Archivesspace_Users_Group] indexing problem? In-Reply-To: <9E8D0784D9B39B41933B014FA7C528E93C0C6287@x10-mbx5.yu.yale.edu> References: <9E8D0784D9B39B41933B014FA7C528E93C0C6287@x10-mbx5.yu.yale.edu> Message-ID: Hi Melissa, It might be a little tricky for you all, since your Aspace has a lot of customizations and plugins installed that modify a lot of the core ( like top_containers and things having to do with barcodes). But, to answer the question of configuration, yes the defaults are enabled by default. Your config.rb file can be empty, and the values found in config-defaults.rb would be used. ASpace ships with a config.rb file that has the config-defaults.rb files commented out just to show what those defaults are. I've seen the EOF error happen on some random cases where the indexer has nothing to index. What's happening is it's reading a indexer state file that is empty, which it is not expecting. I've found this to be usually be benign. But you can remove this pretty easily... To check this, see if there are any empty files in the indexer_state directory: $ find data/indexer_state/ -type f -empty You can delete those: $ find data/indexer_state/ -type f -empty -exec rm {} \; When the indexer runs next, it will recreate that any files it needs to track the indexer state. If this keeps recurring, then we'll have to figure out why. Also, EOF can in some situations be sent for a HTTP request. First question is if you have the backend on a SSL connection, possibly with a self-signed cert? Also, do you have a proxy in front of the backend? You can try and install this to you plugins/local/indexer directory, restart aspace, and see where the EOF error is happening. b,chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Wisner, Melissa Sent: Friday, August 7, 2015 4:48 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] indexing problem? Hello, Our AS users have reported they were unable to search/retrieve data they just added to ArchivesSpace. We assume this is a problem with the index, if after even several hours a record cannot be retrieved by a barcode. Scenario 1: over 2 -3 days a newly added record could not be retrieved by barcode. When staff would try and create a new record with the same barcode, AS would tell them barcode already exists. After the 3rd day it could be retrieved through a barcode search. Scenario 2: same report came in Thursday morning. Newly added record could not be retrieved by barcode. Today it still can?t. But I can retrieve it by the top container number highlighted below in yellow. This behavior is very odd. The reported issue from Thursday morning is shown in this snippet from the log files. There appears to be an error message at the end of this regarding End of File/EOF. I do not know if that is the problem, or what that error means. Additionally, the config file for our production AS does not include certain entries that are shown here as defaults: https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb Specifically- AppConfig[:solr_indexing_frequency_seconds] = 30 and AppConfig[:indexer_solr_timeout_seconds] = 300 If these are not defined, does the default still apply? A default of 30 seconds seems reasonable, and if it is a default even if not defined, why would we see such delays with our index? This is a major problem, as staff cannot do their work when they can?t find the records they?ve been working on. Started GET "/resolve/edit?uri=%2Frepositories%2F12%2Ftop_containers%2F224618" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by ResolverController#resolve_edit as HTML Parameters: {"uri"=>"/repositories/12/top_containers/224618"} Redirected to http://aspace.library.yale.edu/plugins/top_containers/224618/edit Completed 302 Found in 176.0ms Started GET "/plugins/top_containers/224618/edit" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by TopContainersController#edit as HTML Parameters: {"id"=>"224618"} Started POST "/update_monitor/poll" for 130.132.143.66 at 2015-08-06 11:18:09 -0400 Processing by UpdateMonitorController#poll as JSON Parameters: {"lock_version"=>"0", "uri"=>"/repositories/12/archival_objects/2104298"} Completed 200 OK in 204.0ms (Views: 2.0ms) Rendered shared/_breadcrumb.html.erb (26.0ms) Rendered shared/_sidebar.html.erb (3.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (6.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (29.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (4.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (11.0ms) Rendered container_locations/_template.html.erb (0.0ms) Rendered shared/_subrecord_form.html.erb (15.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (57.0ms) Rendered shared/_sidebar.html.erb (5.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (13.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (42.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (7.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (23.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (16.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (101.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (25.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (14.0ms) Rendered locations/_linker.html.erb (12.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/edit.html.erb within layouts/application (523.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/layout_head.html.erb (7.0ms) Rendered /archivesspace/plugins/oclc/frontend/views/layout_head.html.erb (1.0ms) Rendered /archivesspace/plugins/yale_accessions/frontend/views/layout_head.html.erb (4.0ms) Rendered shared/_browser_support.html.erb (0.0ms) Rendered shared/_header_user.html.erb (71.0ms) Rendered shared/_header_global.html.erb (87.0ms) Rendered site/_branding.html.erb (2.0ms) Rendered shared/_advanced_search.html.erb (404.0ms) Rendered shared/_header_repository.html.erb (497.0ms) Rendered site/_footer.html.erb (0.0ms) Rendered shared/_templates.html.erb (17.0ms) Completed 200 OK in 3774.0ms (Views: 1299.0ms) Aug 06, 2015 11:18:14 AM org.apache.solr.core.SolrCore execute INFO: [collection1] webapp= path=/select params={facet=true&pf=four_part_id^4&sort=&start=0&q=ms+*&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&facet.field=primary_type&facet.field=creators&facet.field=subjects&wt=json&fq=repository:"/repositories/12"+OR+repository:global&fq=types:("resource")&fq=-exclude_by_default:true&rows=10&defType=edismax} hits=3381 status=0 QTime=41654 Completed 200 OK in 44280.0ms (Views: 370.0ms) 2015-08-06 11:18:17 -0400: Running index round # Melissa Wisner Yale Library IT -------------- next part -------------- An HTML attachment was scrubbed... URL: From melissa.wisner at yale.edu Mon Aug 10 09:00:09 2015 From: melissa.wisner at yale.edu (Wisner, Melissa) Date: Mon, 10 Aug 2015 13:00:09 +0000 Subject: [Archivesspace_Users_Group] indexing problem? In-Reply-To: References: <9E8D0784D9B39B41933B014FA7C528E93C0C6287@x10-mbx5.yu.yale.edu> Message-ID: <9E8D0784D9B39B41933B014FA7C528E93C0C95AA@x10-mbx5.yu.yale.edu> Thank you Chris, we'll check this and confirm the other questions. Melissa From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Monday, August 10, 2015 8:58 AM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] indexing problem? Hi Melissa, It might be a little tricky for you all, since your Aspace has a lot of customizations and plugins installed that modify a lot of the core ( like top_containers and things having to do with barcodes). But, to answer the question of configuration, yes the defaults are enabled by default. Your config.rb file can be empty, and the values found in config-defaults.rb would be used. ASpace ships with a config.rb file that has the config-defaults.rb files commented out just to show what those defaults are. I've seen the EOF error happen on some random cases where the indexer has nothing to index. What's happening is it's reading a indexer state file that is empty, which it is not expecting. I've found this to be usually be benign. But you can remove this pretty easily... To check this, see if there are any empty files in the indexer_state directory: $ find data/indexer_state/ -type f -empty You can delete those: $ find data/indexer_state/ -type f -empty -exec rm {} \; When the indexer runs next, it will recreate that any files it needs to track the indexer state. If this keeps recurring, then we'll have to figure out why. Also, EOF can in some situations be sent for a HTTP request. First question is if you have the backend on a SSL connection, possibly with a self-signed cert? Also, do you have a proxy in front of the backend? You can try and install this to you plugins/local/indexer directory, restart aspace, and see where the EOF error is happening. b,chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Wisner, Melissa > Sent: Friday, August 7, 2015 4:48 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] indexing problem? Hello, Our AS users have reported they were unable to search/retrieve data they just added to ArchivesSpace. We assume this is a problem with the index, if after even several hours a record cannot be retrieved by a barcode. Scenario 1: over 2 -3 days a newly added record could not be retrieved by barcode. When staff would try and create a new record with the same barcode, AS would tell them barcode already exists. After the 3rd day it could be retrieved through a barcode search. Scenario 2: same report came in Thursday morning. Newly added record could not be retrieved by barcode. Today it still can't. But I can retrieve it by the top container number highlighted below in yellow. This behavior is very odd. The reported issue from Thursday morning is shown in this snippet from the log files. There appears to be an error message at the end of this regarding End of File/EOF. I do not know if that is the problem, or what that error means. Additionally, the config file for our production AS does not include certain entries that are shown here as defaults: https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb Specifically- AppConfig[:solr_indexing_frequency_seconds] = 30 and AppConfig[:indexer_solr_timeout_seconds] = 300 If these are not defined, does the default still apply? A default of 30 seconds seems reasonable, and if it is a default even if not defined, why would we see such delays with our index? This is a major problem, as staff cannot do their work when they can't find the records they've been working on. Started GET "/resolve/edit?uri=%2Frepositories%2F12%2Ftop_containers%2F224618" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by ResolverController#resolve_edit as HTML Parameters: {"uri"=>"/repositories/12/top_containers/224618"} Redirected to http://aspace.library.yale.edu/plugins/top_containers/224618/edit Completed 302 Found in 176.0ms Started GET "/plugins/top_containers/224618/edit" for 130.132.143.66 at 2015-08-06 11:18:07 -0400 Processing by TopContainersController#edit as HTML Parameters: {"id"=>"224618"} Started POST "/update_monitor/poll" for 130.132.143.66 at 2015-08-06 11:18:09 -0400 Processing by UpdateMonitorController#poll as JSON Parameters: {"lock_version"=>"0", "uri"=>"/repositories/12/archival_objects/2104298"} Completed 200 OK in 204.0ms (Views: 2.0ms) Rendered shared/_breadcrumb.html.erb (26.0ms) Rendered shared/_sidebar.html.erb (3.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (6.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (29.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (4.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (11.0ms) Rendered container_locations/_template.html.erb (0.0ms) Rendered shared/_subrecord_form.html.erb (15.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (57.0ms) Rendered shared/_sidebar.html.erb (5.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_sidebar.html.erb (13.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_toolbar.html.erb (42.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_form_messages.html.erb (7.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (23.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (16.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/_form.html.erb (101.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/container_profiles/_linker.html.erb (25.0ms) Rendered container_locations/_template.html.erb (1.0ms) Rendered shared/_subrecord_form.html.erb (14.0ms) Rendered locations/_linker.html.erb (12.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/top_containers/edit.html.erb within layouts/application (523.0ms) Rendered /archivesspace/plugins/container_management/frontend/views/layout_head.html.erb (7.0ms) Rendered /archivesspace/plugins/oclc/frontend/views/layout_head.html.erb (1.0ms) Rendered /archivesspace/plugins/yale_accessions/frontend/views/layout_head.html.erb (4.0ms) Rendered shared/_browser_support.html.erb (0.0ms) Rendered shared/_header_user.html.erb (71.0ms) Rendered shared/_header_global.html.erb (87.0ms) Rendered site/_branding.html.erb (2.0ms) Rendered shared/_advanced_search.html.erb (404.0ms) Rendered shared/_header_repository.html.erb (497.0ms) Rendered site/_footer.html.erb (0.0ms) Rendered shared/_templates.html.erb (17.0ms) Completed 200 OK in 3774.0ms (Views: 1299.0ms) Aug 06, 2015 11:18:14 AM org.apache.solr.core.SolrCore execute INFO: [collection1] webapp= path=/select params={facet=true&pf=four_part_id^4&sort=&start=0&q=ms+*&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&facet.field=primary_type&facet.field=creators&facet.field=subjects&wt=json&fq=repository:"/repositories/12"+OR+repository:global&fq=types:("resource")&fq=-exclude_by_default:true&rows=10&defType=edismax} hits=3381 status=0 QTime=41654 Completed 200 OK in 44280.0ms (Views: 370.0ms) 2015-08-06 11:18:17 -0400: Running index round # Melissa Wisner Yale Library IT -------------- next part -------------- An HTML attachment was scrubbed... URL: From Gregory.Farr at AustenRiggs.net Mon Aug 10 10:00:21 2015 From: Gregory.Farr at AustenRiggs.net (Gregory.Farr at AustenRiggs.net) Date: Mon, 10 Aug 2015 10:00:21 -0400 Subject: [Archivesspace_Users_Group] AUTO: Gregory Farr is out of the office (returning 08/17/2015) Message-ID: I am out of the office until 08/17/2015. Note: This is an automated response to your message "Re: [Archivesspace_Users_Group] Config Settings" sent on 8/10/2015 5:31:59 AM. This is the only notification you will receive while this person is away. From archives at steinbeck.org Mon Aug 10 12:14:50 2015 From: archives at steinbeck.org (Steinbeck Archives) Date: Mon, 10 Aug 2015 16:14:50 +0000 Subject: [Archivesspace_Users_Group] Config Settings In-Reply-To: References: , Message-ID: Hi Chris, What happens is that I create say, an agent record for a person, but when I go to browse agent records, that new record does not show up in the listing (and so I cannot link it to the subsequent records I am making). When I open the tables in the MySQL workbench, the record is there but it seems like one column of it is just off in some way. Like in one instance the "creator" column for that record was listed as null, even though it was listed as "administrator" in all other cases. If, instead, I try to re-create the same agent, I get the error saying that Authority ID needs to be unique. Thanks, Lisa ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Chris Fitzpatrick Sent: Monday, August 10, 2015 2:31 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings Hi Lisa, What do you mean "does not display"? They are not showing up in the agent index pages on staff UI, public UI, both? Or when you open the record there is an error? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steinbeck Archives Sent: Friday, August 7, 2015 8:02 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Config Settings Hello, Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. I am wondering if there's some setting in the config.rb that I haven't set properly. Thanks, Lisa C. Josephs Archivist National Steinbeck Center 1 Main Street, Salinas, CA ________________________________ -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Mon Aug 10 12:34:47 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Mon, 10 Aug 2015 12:34:47 -0400 Subject: [Archivesspace_Users_Group] Config Settings In-Reply-To: References: Message-ID: <18419A30-C84D-41B8-98EF-E63C5F0832E8@virginia.edu> When I look at my agent_person table in mysql, I see a couple that have NULL as creator, but that doesn?t prevent them from displaying. ( I don?t, however, see any logic in why those couple have NULL when the others are Admin ? they were all agents created from creating new users for the frontend/admin. ) Can you see the new agents using the backend API ? ( This is starting to sound, to me, like one of those Solr indexing problems, where the object is there, but it?s not being found via search. ) ? Steve. > On Aug 10, 2015, at 12:14 PM, Steinbeck Archives wrote: > > Hi Chris, > > What happens is that I create say, an agent record for a person, but when I go to browse agent records, that new record does not show up in the listing (and so I cannot link it to the subsequent records I am making). > > When I open the tables in the MySQL workbench, the record is there but it seems like one column of it is just off in some way. Like in one instance the "creator" column for that record was listed as null, even though it was listed as "administrator" in all other cases. > > If, instead, I try to re-create the same agent, I get the error saying that Authority ID needs to be unique. > > Thanks, > Lisa > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Chris Fitzpatrick > Sent: Monday, August 10, 2015 2:31 AM > To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Config Settings > > > > Hi Lisa, > > What do you mean "does not display"? They are not showing up in the agent index pages on staff UI, public UI, both? Or when you open the record there is an error? > > b,chris. > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steinbeck Archives > Sent: Friday, August 7, 2015 8:02 PM > To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] Config Settings > > Hello, > > Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. > > I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. > > The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. > > I am wondering if there's some setting in the config.rb that I haven't set properly. > > Thanks, > > Lisa C. Josephs > Archivist > National Steinbeck Center > 1 Main Street, > Salinas, CA > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From Chris.Fitzpatrick at lyrasis.org Mon Aug 10 15:13:59 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Mon, 10 Aug 2015 19:13:59 +0000 Subject: [Archivesspace_Users_Group] Config Settings In-Reply-To: <18419A30-C84D-41B8-98EF-E63C5F0832E8@virginia.edu> References: , <18419A30-C84D-41B8-98EF-E63C5F0832E8@virginia.edu> Message-ID: Hi, Yes, the created_by can be null in some cases, and that's ok. It depends on the context the agent was created. Yes, I think the issue is that your indexer is not indexing the record. Search and the index pages use Solr. When you're viewing the record itself (in read-only or edit mode) it's using the DB. Couple of questions: How much RAM does this server have? Are there any errors being spit into the log? You said the created_by listed "administrator". Or is that "admin"? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steven Majewski Sent: Monday, August 10, 2015 6:34 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings When I look at my agent_person table in mysql, I see a couple that have NULL as creator, but that doesn?t prevent them from displaying. ( I don?t, however, see any logic in why those couple have NULL when the others are Admin ? they were all agents created from creating new users for the frontend/admin. ) Can you see the new agents using the backend API ? ( This is starting to sound, to me, like one of those Solr indexing problems, where the object is there, but it?s not being found via search. ) ? Steve. On Aug 10, 2015, at 12:14 PM, Steinbeck Archives > wrote: Hi Chris, What happens is that I create say, an agent record for a person, but when I go to browse agent records, that new record does not show up in the listing (and so I cannot link it to the subsequent records I am making). When I open the tables in the MySQL workbench, the record is there but it seems like one column of it is just off in some way. Like in one instance the "creator" column for that record was listed as null, even though it was listed as "administrator" in all other cases. If, instead, I try to re-create the same agent, I get the error saying that Authority ID needs to be unique. Thanks, Lisa ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Chris Fitzpatrick > Sent: Monday, August 10, 2015 2:31 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings Hi Lisa, What do you mean "does not display"? They are not showing up in the agent index pages on staff UI, public UI, both? Or when you open the record there is an error? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steinbeck Archives > Sent: Friday, August 7, 2015 8:02 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Config Settings Hello, Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. I am wondering if there's some setting in the config.rb that I haven't set properly. Thanks, Lisa C. Josephs Archivist National Steinbeck Center 1 Main Street, Salinas, CA _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Mon Aug 10 16:31:29 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Mon, 10 Aug 2015 16:31:29 -0400 Subject: [Archivesspace_Users_Group] Also: setting groups/permissions thru backend API [was: new user defaults?] In-Reply-To: <2747D6D1-B3D9-464D-A0F5-26BD082939D0@virginia.edu> References: <2747D6D1-B3D9-464D-A0F5-26BD082939D0@virginia.edu> Message-ID: OK: I found a formula that seems to work. I also found that the clue as to why modifying permissions in the POST /users API method didn?t work is in the schema docs (if you click ?view source?), where the permissions attribute of user is marked: ?readonly?: true . However, passing the groups URI as a parameter string also didn?t work. And it still seems rather misleading that those API calls returned a status of ?Updated? with ?warnings?:[]. A warning would seem appropriate here (if possible). Also, I?ld still like to know if there is a way to set default permissions for new users. The working method: If $UU = a list of usernames already created in AS: [ ?user1?, ?user2?, ?user3? ? ] and /repositories/5/group/28 = "group_code": "repository-viewers", "description": "Viewers of the workspace repository? ? This retrieves JSON for that group and adds the list of usernames to the JSON: GG=$(curl_as_osx admin pwd http://localhost:8089/repositories/5/groups/28 | jq " .member_usernames = $UU") And posts the modified JSON to the backend: curl_as_osx -d "$GG" admin pwd http://localhost:8089/repositories/5/groups/28 Now retrieving the group JSON from the backend shows the updated users, and going to the ?Manage User Access? page for that repository now shows that group checked for each the users. ? Steve Majewski > On Aug 5, 2015, at 8:38 PM, Steven Majewski wrote: > > > I would like to use the backend API to set user permissions to avoid a couple hundred mouse clicks on the admin web forms. ( Adding users to a group seems to require you add them one at a time. It would be nicer if you could paste a list of user ids into that field and click Add just once. Or maybe put everything in a checkbox matrix so you can set several user/repo/groups/permissions at once. ) > > I?ve tried doing a "GET /users/$ID? , pulling the permissions out of one user as a template and merging those permissions into another users json with jq, and posting again to "POST /users/$ID? . > > The return value from that makes it appear to have updated: > {"status":"Updated","id":13,"lock_version":3,"stale":null,"uri":"/users/13","warnings":[]} > > > But doing another GET shows nothing changed. > > > I?ve also tried appending ?groups%5B%5D=/repositories/3/groups/15 to the URL > ( which should be "repository-basic-data-entry? group for that repo ) which also returns what > looks like an updated status, but again, it appears unchanged. > > In both cases, *something* got updated, if only the modification date, because if I do the same operation a second time using the same JSON, it rejects the 2nd attempt with: > > {"error":"The record you tried to update has been modified since you fetched it."} > > > I haven?t yet tried posting to /repositories/$REPO/groups yet. Is that the one that works ? > > > Can anyone suggest a working API formula ? > > > ? Steve. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From Kevin.Clair at du.edu Mon Aug 10 17:40:21 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Mon, 10 Aug 2015 21:40:21 +0000 Subject: [Archivesspace_Users_Group] system requirements and performance Message-ID: Hello, I would be interested in hearing other users' current specifications for the systems on which they run ArchivesSpace. Our archivists here have been reporting very poor system performance for the last few days, and I'm guessing it's because the system runs slowly while the indexer is running against large collections, but I'm not sure if there's any configurations I can change or requests I can make to our host to improve things at all. Currently our database is 621 MB and our Solr index is 1.8 GB. We have about 125,000 archival objects, 7,500 digital objects, and 850 resources. As of this writing we have 864 MB of memory free out of 3 GB total, running on 2 CPUs, and the indexer has two cycles devoted to it indexing 20 records at a time. Any help would be appreciated. thanks! -k -------------- next part -------------- An HTML attachment was scrubbed... URL: From j at minorscience.com Mon Aug 10 17:56:43 2015 From: j at minorscience.com (Jason Loeffler) Date: Mon, 10 Aug 2015 17:56:43 -0400 Subject: [Archivesspace_Users_Group] system requirements and performance In-Reply-To: References: Message-ID: Kevin, Your box appears appropriately resourced. Is the poor performance encountered only when viewing resources in tree view or is this a system-wide issue? Do you have many (>1000s) child or sibling resources nested under a parent resource? I've seen slow load times with such collections. Jason On Aug 10, 2015 5:40 PM, "Kevin Clair" wrote: > Hello, > > > > I would be interested in hearing other users? current specifications for > the systems on which they run ArchivesSpace. Our archivists here have been > reporting very poor system performance for the last few days, and I?m > guessing it?s because the system runs slowly while the indexer is running > against large collections, but I?m not sure if there?s any configurations I > can change or requests I can make to our host to improve things at all. > > > > Currently our database is 621 MB and our Solr index is 1.8 GB. We have > about 125,000 archival objects, 7,500 digital objects, and 850 resources. > As of this writing we have 864 MB of memory free out of 3 GB total, running > on 2 CPUs, and the indexer has two cycles devoted to it indexing 20 records > at a time. > > > > Any help would be appreciated. thanks! -k > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Kevin.Clair at du.edu Mon Aug 10 21:06:11 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Tue, 11 Aug 2015 01:06:11 +0000 Subject: [Archivesspace_Users_Group] system requirements and performance In-Reply-To: References: Message-ID: Hi Jason, The problems eventually become system-wide, but they appear most when people are working on our larger collections (the largest of which have tens of thousands of archival and digital objects linked somewhere within the collection hierarchy). I figured it was something related to that and have been waiting to hear about testing or a fix for it; in the meantime I was curious to hear if anyone else had been able to tune their indexer to mitigate it somewhat. -k From: > on behalf of Jason Loeffler > Reply-To: Archivesspace Group > Date: Monday, August 10, 2015 at 3:56 PM To: Archivesspace Group > Subject: Re: [Archivesspace_Users_Group] system requirements and performance Kevin, Your box appears appropriately resourced. Is the poor performance encountered only when viewing resources in tree view or is this a system-wide issue? Do you have many (>1000s) child or sibling resources nested under a parent resource? I've seen slow load times with such collections. Jason On Aug 10, 2015 5:40 PM, "Kevin Clair" > wrote: Hello, I would be interested in hearing other users' current specifications for the systems on which they run ArchivesSpace. Our archivists here have been reporting very poor system performance for the last few days, and I'm guessing it's because the system runs slowly while the indexer is running against large collections, but I'm not sure if there's any configurations I can change or requests I can make to our host to improve things at all. Currently our database is 621 MB and our Solr index is 1.8 GB. We have about 125,000 archival objects, 7,500 digital objects, and 850 resources. As of this writing we have 864 MB of memory free out of 3 GB total, running on 2 CPUs, and the indexer has two cycles devoted to it indexing 20 records at a time. Any help would be appreciated. thanks! -k _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 11 04:03:49 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 11 Aug 2015 08:03:49 +0000 Subject: [Archivesspace_Users_Group] system requirements and performance In-Reply-To: References: , Message-ID: Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ Hi Kevin, There is a bit of documentation on Aspace performance you can see here: http://archivesspace.github.io/archivesspace/user/tuning-archivesspace/ . One thing people often over look is their MySQL settings, which can really impact the application. However, you'll also need to sort out if this is a server side or client side issue. By "large records", are you meaning large record trees in the hierarchy ( like resources and archival object ) , or records with lots of subjects, agents, etc. associations? Typically, large trees are not the issue, but it's the main associations that cause problems on the client side. b,chris. -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 11 05:51:47 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 11 Aug 2015 09:51:47 +0000 Subject: [Archivesspace_Users_Group] Turn off Logging of db username and password In-Reply-To: <40AA7532-0628-411D-8AF5-72042FB1E834@dartmouth.edu> References: <40AA7532-0628-411D-8AF5-72042FB1E834@dartmouth.edu> Message-ID: Hi Joshua, Agreed that the password should be removed from the URL being printed to the log. The config.rb file is a ruby file that's interpreted by the application. So if you don't want the password stored in this file as text, you can always do something like store it in an environment variable, encrypt it, or store it a file in another location. You should also lock down the file level permission on application, and you can also lock down the access to the MySQL to only allow specific users from specific IPs. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Joshua D. Shaw Sent: Thursday, August 6, 2015 8:09 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Turn off Logging of db username and password Does anyone know of a way to turn off the logging of the mysql database username and password in the output log? I've set my log level to "fatal" in the config file, but I still see the username and password. I'd love to know if there's away to remove this as its (potentially) another security hole - along with having the username and password in clear text in the config file. Thanks! Joshua -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Tue Aug 11 05:52:13 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Tue, 11 Aug 2015 09:52:13 +0000 Subject: [Archivesspace_Users_Group] Turn off Logging of db username and password In-Reply-To: References: <40AA7532-0628-411D-8AF5-72042FB1E834@dartmouth.edu>, Message-ID: Hi, forgot to mention I made a ticket for this here => https://archivesspace.atlassian.net/browse/AR-1310 Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Chris Fitzpatrick Sent: Tuesday, August 11, 2015 11:51 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Turn off Logging of db username and password Hi Joshua, Agreed that the password should be removed from the URL being printed to the log. The config.rb file is a ruby file that's interpreted by the application. So if you don't want the password stored in this file as text, you can always do something like store it in an environment variable, encrypt it, or store it a file in another location. You should also lock down the file level permission on application, and you can also lock down the access to the MySQL to only allow specific users from specific IPs. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Joshua D. Shaw Sent: Thursday, August 6, 2015 8:09 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Turn off Logging of db username and password Does anyone know of a way to turn off the logging of the mysql database username and password in the output log? I've set my log level to "fatal" in the config file, but I still see the username and password. I'd love to know if there's away to remove this as its (potentially) another security hole - along with having the username and password in clear text in the config file. Thanks! Joshua -------------- next part -------------- An HTML attachment was scrubbed... URL: From eckardm at umich.edu Tue Aug 11 15:44:42 2015 From: eckardm at umich.edu (Max Eckard) Date: Tue, 11 Aug 2015 15:44:42 -0400 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Message-ID: Hello ASpacers! We've been working on importing agents into ArchivesSpace, but have run into an issue. As an example, we have a number of elements that are subdivided with topical subjects, like so: - University of Michigan--Students--Political activity. - University of Michigan--Faculty. - American Brass Company--Strikes. The issue we've encountered is that there is no space in ASpace for agents that are subdivided in this way. Note: we are not talking about agents with primary and subordinate names (with periods in between them)--ASpace handles these just fine! We've been thinking about a number of ways to handle this: 1. We could divide up these terms so that the first term gets imported as an agent (in the examples above, corporate entity) and the rest of the term gets imported as a subject (or a subdivided subject). We've experimented a little with this here . The problem with this approach is that subdividing names/agents is a longstanding practice here (and totally acceptable in MARC), and making a change like this would require making an even (arguably) bigger change to descriptive practices here and cause issues with exporting MARC records from ASpace. 2. We could just leave the whole string, dash dashes and all, as the primary form of name. This could work, but it seems inelegant, since each variation would be imported as a new agent, even though we're only referring to one. 3. We could change these to subjects, but that doesn't seem quite right either, since agents can have the role of subject. We've been trying to consider all angles, including what affect a change like this could have on researcher searching and browsing. Now we're wondering what you all do. Do you have subdivided agents (s, s and s)? If so, how have you imported these into ASpace? Thank you for your time! Max -- *Max Eckard* *Assistant Archivist for Digital Curation* Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 <734.763.7518> http://bentley.umich.edu/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From archives at steinbeck.org Tue Aug 11 16:16:39 2015 From: archives at steinbeck.org (Steinbeck Archives) Date: Tue, 11 Aug 2015 20:16:39 +0000 Subject: [Archivesspace_Users_Group] Config Settings In-Reply-To: References: , <18419A30-C84D-41B8-98EF-E63C5F0832E8@virginia.edu>, Message-ID: Hi, Thank you, that does make sense in figuring out what is going on. I've got about 6GB ram. I'm not running from a server right now, just a laptop I loaded Fedora onto; we're still figuring out hosting, which is taking a while. I wanted to get started with cataloging ASAP. I left all the solr defaults in place. As for errors, I'm trying to find something that might relate to the issue, though I am not positive. Below, I've included a section of the log that I think is relevant to trying to create an agent/person a few minutes ago that is acting in the same manner as the issue I've been having. Apologies for not being able to get back to this sooner and thank you for your help. Lisa Aug 11, 2015 12:44:38 PM org.apache.solr.core.SolrCore execute INFO: [collection1] webapp= path=/select params={facet.field=primary_type&facet.field=source&facet.field=rules&start=0&fq=repository:"/repositories/2"+OR+repository:global&fq=types:("agent")&fq={!term+f%3Dprimary_type}agent_person&fq=-exclude_by_default:true&sort=title_sort+asc&rows=10&q=*:*&facet.limit=100&defType=edismax&qf=four_part_id^3+title^2+finding_aid_filing_title^2+fullrecord&pf=four_part_id^4&wt=json&facet=true} hits=8 status=0 QTime=2 D, [2015-08-11T12:44:38.908000 #2799] DEBUG -- : Thread-6972: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"29171"}, ["{\"first_page\":1,\"last_page\":1,\"this_page\":1,\"offset_first\":1,\"offset_last\":8,\"total_hits\":8,\"results\":[{\"id\":\"/agents/people/1\",\"title\":\"Administrator\",\"primary_type\":\"agent_person\",\"types\":[\"agent_person\",\"agent\"],\"json\":\"{\\\"lock_version\\\":0,\\\"publish\\\":false,\\\"create_time\\\":\\\"2015-08-03T03:23:48Z\\\",\\\"system_mtime\\\":\\\"2015-0... in 85.0ms Rendered shared/_breadcrumb.html.erb (1.0ms) Rendered search/_filter.html.erb (13.0ms) Rendered shared/_flash_messages.html.erb (0.0ms) Rendered shared/_pagination_summary.html.erb (49.0ms) Rendered shared/_pagination.html.erb (1.0ms) Rendered search/_listing.html.erb (107.0ms) Rendered agents/index.html.erb within layouts/application (139.0ms) Rendered shared/_browser_support.html.erb (0.0ms) Rendered shared/_header_user.html.erb (14.0ms) Rendered shared/_header_global.html.erb (16.0ms) Rendered site/_branding.html.erb (1.0ms) Rendered shared/_advanced_search.html.erb (13.0ms) Rendered shared/_header_repository.html.erb (47.0ms) Rendered site/_footer.html.erb (0.0ms) Rendered shared/_templates.html.erb (4.0ms) Completed 200 OK in 340.0ms (Views: 239.0ms) D, [2015-08-11T12:44:39.620000 #2799] DEBUG -- : Thread-6972: POST /users/staff_system/login [session: nil] D, [2015-08-11T12:44:39.627000 #2799] DEBUG -- : Thread-6972: Post-processed params: {:username=>"staff_system", :password=>"[FILTERED]", :expiring=>false} D, [2015-08-11T12:44:39.782000 #2799] DEBUG -- : Thread-6972: Responded with [403, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"25"}, ["{\"error\":\"Login failed\"}\n"]]... in 162.0ms D, [2015-08-11T12:44:39.791000 #2799] DEBUG -- : Thread-3500: POST /update_monitor [session: nil] D, [2015-08-11T12:44:39.794000 #2799] DEBUG -- : Thread-3500: Post-processed params: {:active_edits=>#"active_edits", "active_edits"=>[{"uri"=>"/agents/people/9", "user"=>"admin", "time"=>"2015-08-11T12:44:27-07:00"}]}>} D, [2015-08-11T12:44:39.796000 #2799] DEBUG -- : Thread-3500: Responded with [403, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"26"}, ["{\"error\":\"Access denied\"}\n"]]... in 4.0ms D, [2015-08-11T12:44:39.802000 #2799] DEBUG -- : Thread-3494: POST /users/staff_system/login [session: nil] D, [2015-08-11T12:44:39.806000 #2799] DEBUG -- : Thread-3494: Post-processed params: {:username=>"staff_system", :password=>"[FILTERED]", :expiring=>false} D, [2015-08-11T12:44:39.916000 #2799] DEBUG -- : Thread-3494: Responded with [403, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"25"}, ["{\"error\":\"Login failed\"}\n"]]... in 114.0ms D, [2015-08-11T12:44:43.838000 #2799] DEBUG -- : Thread-3494: POST /users/search_indexer/login [session: nil] D, [2015-08-11T12:44:43.840000 #2799] DEBUG -- : Thread-3494: Post-processed params: {:username=>"search_indexer", :password=>"[FILTERED]", :expiring=>false} D, [2015-08-11T12:44:43.952000 #2799] DEBUG -- : Thread-3494: Responded with [403, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"25"}, ["{\"error\":\"Login failed\"}\n"]]... in 114.0ms ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Chris Fitzpatrick Sent: Monday, August 10, 2015 12:13 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings Hi, Yes, the created_by can be null in some cases, and that's ok. It depends on the context the agent was created. Yes, I think the issue is that your indexer is not indexing the record. Search and the index pages use Solr. When you're viewing the record itself (in read-only or edit mode) it's using the DB. Couple of questions: How much RAM does this server have? Are there any errors being spit into the log? You said the created_by listed "administrator". Or is that "admin"? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Steven Majewski Sent: Monday, August 10, 2015 6:34 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings When I look at my agent_person table in mysql, I see a couple that have NULL as creator, but that doesn?t prevent them from displaying. ( I don?t, however, see any logic in why those couple have NULL when the others are Admin ? they were all agents created from creating new users for the frontend/admin. ) Can you see the new agents using the backend API ? ( This is starting to sound, to me, like one of those Solr indexing problems, where the object is there, but it?s not being found via search. ) ? Steve. On Aug 10, 2015, at 12:14 PM, Steinbeck Archives > wrote: Hi Chris, What happens is that I create say, an agent record for a person, but when I go to browse agent records, that new record does not show up in the listing (and so I cannot link it to the subsequent records I am making). When I open the tables in the MySQL workbench, the record is there but it seems like one column of it is just off in some way. Like in one instance the "creator" column for that record was listed as null, even though it was listed as "administrator" in all other cases. If, instead, I try to re-create the same agent, I get the error saying that Authority ID needs to be unique. Thanks, Lisa ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Chris Fitzpatrick > Sent: Monday, August 10, 2015 2:31 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Config Settings Hi Lisa, What do you mean "does not display"? They are not showing up in the agent index pages on staff UI, public UI, both? Or when you open the record there is an error? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Steinbeck Archives > Sent: Friday, August 7, 2015 8:02 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Config Settings Hello, Earlier I asked about configuring ArchivesSpace for Windows. I've since scrapped that plan and have installed it running with Fedora Workstation v21. The set up I have currently is mostly a stop-gap measure until the Center figures out where we will host our catalog. I followed the instructions from github and have gotten things to work mostly. However, I am having problems when saving certain items. For example, I made an agent/person entry which saved properly, but it did not display. It was not until I went into the MySQL database and manually tweaked "created_by" from null to "admin." Little things like that happen when I have been creating records, fields are null or otherwise slightly off. On the other hand, I have had no problem saving/displaying the children I've spawned from a resource I started a few days ago. The problem so far has been with creating agents and subjects. Everything in these areas seems to get saved to the database, but just slightly incorrectly, such that it won't be displayed. I am wondering if there's some setting in the config.rb that I haven't set properly. Thanks, Lisa C. Josephs Archivist National Steinbeck Center 1 Main Street, Salinas, CA _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group ________________________________ -------------- next part -------------- An HTML attachment was scrubbed... URL: From mGorzalski at lib.siu.edu Tue Aug 11 16:20:53 2015 From: mGorzalski at lib.siu.edu (Matthew J Gorzalski) Date: Tue, 11 Aug 2015 20:20:53 +0000 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: Message-ID: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Are you an Archon user? We have related agent problems coming from Archon to ASpace. Our test migrations show that any collection that has a corporate/personal name as both the creator and as a subject will migrate BOTH into ASpace under the agent field with NO distinction between creator and subject. Our example is an artificial collection called Morris Library Photograph Collection where Morris Library is both creator and subject. In Archon you can clearly distinguish between these two roles because Creators and Subjects are separate sections. But in ArchivesSpace they are both lumped into Agents and given that generic non-descript person icon. So it is confusing for researchers to see two Morris Library entries under Agents because their roles are not distinguished. This same public interface design flaw works the same for any collection using a name as subject and creator. Mat Gorzalski SIU Carbondale From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Max Eckard Sent: Tuesday, August 11, 2015 2:45 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hello ASpacers! We've been working on importing agents into ArchivesSpace, but have run into an issue. As an example, we have a number of elements that are subdivided with topical subjects, like so: * University of Michigan--Students--Political activity. * University of Michigan--Faculty. * American Brass Company--Strikes. The issue we've encountered is that there is no space in ASpace for agents that are subdivided in this way. Note: we are not talking about agents with primary and subordinate names (with periods in between them)--ASpace handles these just fine! We've been thinking about a number of ways to handle this: 1. We could divide up these terms so that the first term gets imported as an agent (in the examples above, corporate entity) and the rest of the term gets imported as a subject (or a subdivided subject). We've experimented a little with this here. The problem with this approach is that subdividing names/agents is a longstanding practice here (and totally acceptable in MARC), and making a change like this would require making an even (arguably) bigger change to descriptive practices here and cause issues with exporting MARC records from ASpace. 2. We could just leave the whole string, dash dashes and all, as the primary form of name. This could work, but it seems inelegant, since each variation would be imported as a new agent, even though we're only referring to one. 3. We could change these to subjects, but that doesn't seem quite right either, since agents can have the role of subject. We've been trying to consider all angles, including what affect a change like this could have on researcher searching and browsing. Now we're wondering what you all do. Do you have subdivided agents (s, s and s)? If so, how have you imported these into ASpace? Thank you for your time! Max -- Max Eckard Assistant Archivist for Digital Curation [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 http://bentley.umich.edu/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From mauraa at brandeis.edu Tue Aug 11 16:31:00 2015 From: mauraa at brandeis.edu (Maura Carbone) Date: Tue, 11 Aug 2015 16:31:00 -0400 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: Hi Matthew, I'm not entirely sure what you mean by no distinction between creator and subject with regards to agents. Do you mean that you have two agents, one with the role of 'creator' and one with the role of 'subject'? Or do you mean it is bringing in things that should be classified as subjects as agents? Subjects are separate from Agents in ASpace (see an example from one of our collections here: http://findingaids.brandeis.edu/repositories/2/resources/20), but it is possible that the Archon import tool is only interpreting these as agents and not subjects. Max -- I'm not a cataloger or a metadata expert so just personal opinion, but #2 sounds the most feasible given how ASpace displays agents and subjects. Either that somewhat of a middle ground: in that example agents would be UMich and American Brass Company, and Subjects would be the whole term (University of Michigan--Students--Political activity.) That might be a bit more clear for users. Thanks, -Maura On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski wrote: > Are you an Archon user? We have related agent problems coming from Archon > to ASpace. Our test migrations show that any collection that has a > corporate/personal name as both the creator and as a subject will migrate > BOTH into ASpace under the agent field with NO distinction between creator > and subject. Our example is an artificial collection called Morris Library > Photograph Collection where Morris Library is both creator and subject. In > Archon you can clearly distinguish between these two roles because Creators > and Subjects are separate sections. But in ArchivesSpace they are both > lumped into Agents and given that generic non-descript person icon. So it > is confusing for researchers to see two Morris Library entries under Agents > because their roles are not distinguished. This same public interface > design flaw works the same for any collection using a name as subject and > creator. > > > > Mat Gorzalski > > SIU Carbondale > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Max > Eckard > *Sent:* Tuesday, August 11, 2015 2:45 PM > *To:* Archivesspace Users Group < > archivesspace_users_group at lyralists.lyrasis.org> > *Subject:* [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hello ASpacers! > > > > We've been working on importing agents into ArchivesSpace, but have run > into an issue. As an example, we have a number of elements that > are subdivided with topical subjects, like so: > > - University of Michigan--Students--Political activity. > - University of Michigan--Faculty. > - American Brass Company--Strikes. > > The issue we've encountered is that there is no space in ASpace for agents > that are subdivided in this way. Note: we are not talking about agents with > primary and subordinate names (with periods in between them)--ASpace > handles these just fine! We've been thinking about a number of ways to > handle this: > > 1. We could divide up these terms so that the first term gets imported > as an agent (in the examples above, corporate entity) and the rest of the > term gets imported as a subject (or a subdivided subject). We've > experimented a little with this here > . > The problem with this approach is that subdividing names/agents is a > longstanding practice here (and totally acceptable in MARC), and making a > change like this would require making an even (arguably) bigger change to > descriptive practices here and cause issues with exporting MARC records > from ASpace. > 2. We could just leave the whole string, dash dashes and all, as the > primary form of name. This could work, but it seems inelegant, since each > variation would be imported as a new agent, even though we're only > referring to one. > 3. We could change these to subjects, but that doesn't seem quite > right either, since agents can have the role of subject. > > We've been trying to consider all angles, including what affect a change > like this could have on researcher searching and browsing. Now we're > wondering what you all do. Do you have subdivided agents (s, > s and s)? If so, how have you imported these into ASpace? > > > > Thank you for your time! > > > > Max > > > > > -- > > *Max Eckard* > *Assistant Archivist for Digital Curation* > > > > Bentley Historical Library > > 1150 Beal Ave. > Ann Arbor, MI 48109-2113 > 734/763-7518 <734.763.7518> > > http://bentley.umich.edu/ > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Tue Aug 11 16:40:28 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Tue, 11 Aug 2015 16:40:28 -0400 Subject: [Archivesspace_Users_Group] Removing records and moving them to separate repository? Message-ID: Hey all, Does anyone have experience with removing resource records from repository and putting them into a totally separate repository? Some background: long before I started, the decision was made to include library materials in with archival materials in AT. As such, each book became a separate resource record. These resource records clutter our main repository, and I'd like to remove them and transfer them over to a separate repository, all at once. Anyone have any experience with this type of work? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From mGorzalski at lib.siu.edu Tue Aug 11 16:49:06 2015 From: mGorzalski at lib.siu.edu (Matthew J Gorzalski) Date: Tue, 11 Aug 2015 20:49:06 +0000 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: <831f8627a2a74feb85604b83e7dc3b59@it-excmb3.ad.siu.edu> It happens in situations where the name (as subject) has no subfields. Here is the link to the collection. http://archives.lib.siu.edu/index.php?p=collections/controlcard&id=438 I?ve attached a screen shot of the ASpace result. As I understand it, the migration tool migrates all corporate, personal, and family names into the ASpace agent database. Matt From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Maura Carbone Sent: Tuesday, August 11, 2015 3:31 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hi Matthew, I'm not entirely sure what you mean by no distinction between creator and subject with regards to agents. Do you mean that you have two agents, one with the role of 'creator' and one with the role of 'subject'? Or do you mean it is bringing in things that should be classified as subjects as agents? Subjects are separate from Agents in ASpace (see an example from one of our collections here: http://findingaids.brandeis.edu/repositories/2/resources/20), but it is possible that the Archon import tool is only interpreting these as agents and not subjects. Max -- I'm not a cataloger or a metadata expert so just personal opinion, but #2 sounds the most feasible given how ASpace displays agents and subjects. Either that somewhat of a middle ground: in that example agents would be UMich and American Brass Company, and Subjects would be the whole term (University of Michigan--Students--Political activity.) That might be a bit more clear for users. Thanks, -Maura On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski > wrote: Are you an Archon user? We have related agent problems coming from Archon to ASpace. Our test migrations show that any collection that has a corporate/personal name as both the creator and as a subject will migrate BOTH into ASpace under the agent field with NO distinction between creator and subject. Our example is an artificial collection called Morris Library Photograph Collection where Morris Library is both creator and subject. In Archon you can clearly distinguish between these two roles because Creators and Subjects are separate sections. But in ArchivesSpace they are both lumped into Agents and given that generic non-descript person icon. So it is confusing for researchers to see two Morris Library entries under Agents because their roles are not distinguished. This same public interface design flaw works the same for any collection using a name as subject and creator. Mat Gorzalski SIU Carbondale From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Max Eckard Sent: Tuesday, August 11, 2015 2:45 PM To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hello ASpacers! We've been working on importing agents into ArchivesSpace, but have run into an issue. As an example, we have a number of elements that are subdivided with topical subjects, like so: * University of Michigan--Students--Political activity. * University of Michigan--Faculty. * American Brass Company--Strikes. The issue we've encountered is that there is no space in ASpace for agents that are subdivided in this way. Note: we are not talking about agents with primary and subordinate names (with periods in between them)--ASpace handles these just fine! We've been thinking about a number of ways to handle this: 1. We could divide up these terms so that the first term gets imported as an agent (in the examples above, corporate entity) and the rest of the term gets imported as a subject (or a subdivided subject). We've experimented a little with this here. The problem with this approach is that subdividing names/agents is a longstanding practice here (and totally acceptable in MARC), and making a change like this would require making an even (arguably) bigger change to descriptive practices here and cause issues with exporting MARC records from ASpace. 2. We could just leave the whole string, dash dashes and all, as the primary form of name. This could work, but it seems inelegant, since each variation would be imported as a new agent, even though we're only referring to one. 3. We could change these to subjects, but that doesn't seem quite right either, since agents can have the role of subject. We've been trying to consider all angles, including what affect a change like this could have on researcher searching and browsing. Now we're wondering what you all do. Do you have subdivided agents (s, s and s)? If so, how have you imported these into ASpace? Thank you for your time! Max -- Max Eckard Assistant Archivist for Digital Curation [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 http://bentley.umich.edu/ _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: morris.jpg Type: image/jpeg Size: 220779 bytes Desc: morris.jpg URL: From Kevin.Clair at du.edu Tue Aug 11 16:54:10 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Tue, 11 Aug 2015 20:54:10 +0000 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: 1. We were able to migrate our agents-as-creators and agents-as-subjects separately and have them display as such in the staff frontend, which we managed because they were stored in separate fields in our last collection management system. The public site won?t display ?Creator? or ?Subject? the same way the frontend does; it will only display more specific relator terms. Example: http://duarchives.coalliance.org/repositories/2/resources/496 2. We went with option #2 when we migrated, because it was easier and because at the time I didn?t know how the ?Terms and Subdivisions? in the Agent Links form worked. Ideally I would like to switch over to option #1, but it?s been a low priority, and there are some issues with how the public site displays agent links with terms and subdivisions in that make me not want to devote time to it. An example of this on our site is here: http://duarchives.coalliance.org/repositories/2/resources/725. The ?University of Denver? agent link there is actually ?University of Denver ? Libraries?, and it does correctly exports ?Libraries? as a 610$x in the MARC export, but you wouldn?t know it from the public display. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Maura Carbone Sent: Tuesday, August 11, 2015 2:31 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hi Matthew, I'm not entirely sure what you mean by no distinction between creator and subject with regards to agents. Do you mean that you have two agents, one with the role of 'creator' and one with the role of 'subject'? Or do you mean it is bringing in things that should be classified as subjects as agents? Subjects are separate from Agents in ASpace (see an example from one of our collections here: http://findingaids.brandeis.edu/repositories/2/resources/20), but it is possible that the Archon import tool is only interpreting these as agents and not subjects. Max -- I'm not a cataloger or a metadata expert so just personal opinion, but #2 sounds the most feasible given how ASpace displays agents and subjects. Either that somewhat of a middle ground: in that example agents would be UMich and American Brass Company, and Subjects would be the whole term (University of Michigan--Students--Political activity.) That might be a bit more clear for users. Thanks, -Maura On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski > wrote: Are you an Archon user? We have related agent problems coming from Archon to ASpace. Our test migrations show that any collection that has a corporate/personal name as both the creator and as a subject will migrate BOTH into ASpace under the agent field with NO distinction between creator and subject. Our example is an artificial collection called Morris Library Photograph Collection where Morris Library is both creator and subject. In Archon you can clearly distinguish between these two roles because Creators and Subjects are separate sections. But in ArchivesSpace they are both lumped into Agents and given that generic non-descript person icon. So it is confusing for researchers to see two Morris Library entries under Agents because their roles are not distinguished. This same public interface design flaw works the same for any collection using a name as subject and creator. Mat Gorzalski SIU Carbondale From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Max Eckard Sent: Tuesday, August 11, 2015 2:45 PM To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hello ASpacers! We've been working on importing agents into ArchivesSpace, but have run into an issue. As an example, we have a number of elements that are subdivided with topical subjects, like so: * University of Michigan--Students--Political activity. * University of Michigan--Faculty. * American Brass Company--Strikes. The issue we've encountered is that there is no space in ASpace for agents that are subdivided in this way. Note: we are not talking about agents with primary and subordinate names (with periods in between them)--ASpace handles these just fine! We've been thinking about a number of ways to handle this: 1. We could divide up these terms so that the first term gets imported as an agent (in the examples above, corporate entity) and the rest of the term gets imported as a subject (or a subdivided subject). We've experimented a little with this here. The problem with this approach is that subdividing names/agents is a longstanding practice here (and totally acceptable in MARC), and making a change like this would require making an even (arguably) bigger change to descriptive practices here and cause issues with exporting MARC records from ASpace. 2. We could just leave the whole string, dash dashes and all, as the primary form of name. This could work, but it seems inelegant, since each variation would be imported as a new agent, even though we're only referring to one. 3. We could change these to subjects, but that doesn't seem quite right either, since agents can have the role of subject. We've been trying to consider all angles, including what affect a change like this could have on researcher searching and browsing. Now we're wondering what you all do. Do you have subdivided agents (s, s and s)? If so, how have you imported these into ASpace? Thank you for your time! Max -- Max Eckard Assistant Archivist for Digital Curation [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 http://bentley.umich.edu/ _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From noah.huffman at duke.edu Tue Aug 11 17:03:12 2015 From: noah.huffman at duke.edu (Noah Huffman) Date: Tue, 11 Aug 2015 21:03:12 +0000 Subject: [Archivesspace_Users_Group] Removing records and moving them to separate repository? In-Reply-To: References: Message-ID: Patrick, I've batch transferred resource records to another Repository using the API. If you can get a list of the resource record IDs you want to transfer, you can batch transfer with the command below: curl -H "X-ArchivesSpace-Session: $Token" -d "target_repo=[backend-url]/repositories/[destination_repository_number]" "[backend-url]/repositories/[source_repository_number]/resources/{11,21,31,41,51,221,231}/transfer" http://archivesspace.github.io/archivesspace/api/?shell#post-repositories-repo_id-resources-id-transfer I'm pretty sure you'll lose any links you've established between those resource records and other record types that are scoped to a single repository, particularly accession records. But, maybe this isn't an issue if these are all book records. Also, I vaguely remember that there may be some limit to the number of resource records you can list in the curl command above (a few hundred?). -Noah ================ Noah Huffman Archivist for Metadata and Encoding David M. Rubenstein Rare Book & Manuscript Library Duke University From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Tuesday, August 11, 2015 4:40 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Removing records and moving them to separate repository? Hey all, Does anyone have experience with removing resource records from repository and putting them into a totally separate repository? Some background: long before I started, the decision was made to include library materials in with archival materials in AT. As such, each book became a separate resource record. These resource records clutter our main repository, and I'd like to remove them and transfer them over to a separate repository, all at once. Anyone have any experience with this type of work? Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdm7g at virginia.edu Tue Aug 11 18:23:20 2015 From: sdm7g at virginia.edu (Steven Majewski) Date: Tue, 11 Aug 2015 18:23:20 -0400 Subject: [Archivesspace_Users_Group] Also: setting groups/permissions thru backend API [was: new user defaults?] In-Reply-To: References: <2747D6D1-B3D9-464D-A0F5-26BD082939D0@virginia.edu> Message-ID: <0AC28E82-7741-4C43-87B6-1327B91AE4D4@virginia.edu> I?ve packaged this up as a batch script: https://gist.github.com/sdm7g/93b9e072cffd398484ca Requires curl and jq . (It should probably check for that.) Edit to change HOST and admin user and password. ( It?s using localhost:8089 and admin/admin as defaults for testing. ) You give it a repository id#, a group-code, and a list of usernames. If you just give it a repo-id, it displays the group-codes for that repo. ./adduserstogroup.sh $REPOID repository-viewers userid1 userid2 userid3 ? will add users in the list to repository-viewers group of $REPOID . So if you?ve got one or two dozen users and several repos it makes it easier to manage groups. ( It probably would have been simpler to do in Ruby or Python, but since I started testing with curl and jq, that seemed the path of least resistance at the time. ) I?ld still like to see a better management interface in the frontend webapp. ? Steve Majewski > On Aug 10, 2015, at 4:31 PM, Steven Majewski wrote: > > > OK: I found a formula that seems to work. > > I also found that the clue as to why modifying permissions in the POST /users API method didn?t work is in the schema docs (if you click ?view source?), where the permissions attribute of user is marked: ?readonly?: true . > > However, passing the groups URI as a parameter string also didn?t work. > > And it still seems rather misleading that those API calls returned a status of ?Updated? with ?warnings?:[]. A warning would seem appropriate here (if possible). > > > Also, I?ld still like to know if there is a way to set default permissions for new users. > > > The working method: > > If $UU = a list of usernames already created in AS: [ ?user1?, ?user2?, ?user3? ? ] > and /repositories/5/group/28 = "group_code": "repository-viewers", "description": "Viewers of the workspace repository? ? > > This retrieves JSON for that group and adds the list of usernames to the JSON: > > GG=$(curl_as_osx admin pwd http://localhost:8089/repositories/5/groups/28 | jq " .member_usernames = $UU") > > And posts the modified JSON to the backend: > > curl_as_osx -d "$GG" admin pwd http://localhost:8089/repositories/5/groups/28 > > > Now retrieving the group JSON from the backend shows the updated users, and going to the ?Manage User Access? page for that repository now shows that group checked for each the users. > > > ? Steve Majewski > > > >> On Aug 5, 2015, at 8:38 PM, Steven Majewski > wrote: >> >> >> I would like to use the backend API to set user permissions to avoid a couple hundred mouse clicks on the admin web forms. ( Adding users to a group seems to require you add them one at a time. It would be nicer if you could paste a list of user ids into that field and click Add just once. Or maybe put everything in a checkbox matrix so you can set several user/repo/groups/permissions at once. ) >> >> I?ve tried doing a "GET /users/$ID? , pulling the permissions out of one user as a template and merging those permissions into another users json with jq, and posting again to "POST /users/$ID? . >> >> The return value from that makes it appear to have updated: >> {"status":"Updated","id":13,"lock_version":3,"stale":null,"uri":"/users/13","warnings":[]} >> >> >> But doing another GET shows nothing changed. >> >> >> I?ve also tried appending ?groups%5B%5D=/repositories/3/groups/15 to the URL >> ( which should be "repository-basic-data-entry? group for that repo ) which also returns what >> looks like an updated status, but again, it appears unchanged. >> >> In both cases, *something* got updated, if only the modification date, because if I do the same operation a second time using the same JSON, it rejects the 2nd attempt with: >> >> {"error":"The record you tried to update has been modified since you fetched it."} >> >> >> I haven?t yet tried posting to /repositories/$REPO/groups yet. Is that the one that works ? >> >> >> Can anyone suggest a working API formula ? >> >> >> ? Steve. > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4943 bytes Desc: not available URL: From eckardm at umich.edu Wed Aug 12 11:17:59 2015 From: eckardm at umich.edu (Max Eckard) Date: Wed, 12 Aug 2015 11:17:59 -0400 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: Hello everyone, First things first... thank you for your replies! Second, I have to admit that when we first sent the email, we didn't actually realize that there is indeed a way to add terms and subdivisions to agents with the role of subject in resources in ASpace (that's a mouthful!), because we had only been looking at agents. Reading your replies, though, it became apparent that we were missing something, and when we checked, we were pleasantly surprised to find this: [image: Inline image 1] That doesn't actually help with importing these types of agents into ASpace, but we think we have an idea. We're hoping to be able to import the agent (before the first subdivision) ahead of time, associate the resulting ASpace ref with it in our EAD, split out the rest of the terms in a meaningful way (we've done that in the past by comparing those subdivisions to subdivisions with type subfields in our MARC records), and then, upon import of the resource, add the subdivisions in ASpace. That being said, here are some more specific replies: Mathew: No, we're not an Archon user. We've been using a homegrown system to create and manage our EADs, and for about the past six months or so we've been prepping these EADs for import into ASpace. If you or anyone else is interested, here's a shameless plug for our blog's entries on our ASpace adventures . Maura: I think we'll try to figure out a way to implement the solution we described above, and if that doesn't work, your suggestion seems like a reasonable and researcher-friendly alternative. Kevin: We appreciated hearing about your experience and the reasoning behind it. We won't be using the public display, but it's interesting to note that this is an issue with the public interface. It's also nice to know that agents-as-subjects-with-subdivisions export to MARC properly. Thanks again for your replies! Max On Tue, Aug 11, 2015 at 4:54 PM, Kevin Clair wrote: > 1. We were able to migrate our agents-as-creators and > agents-as-subjects separately and have them display as such in the staff > frontend, which we managed because they were stored in separate fields in > our last collection management system. The public site won?t display > ?Creator? or ?Subject? the same way the frontend does; it will only display > more specific relator terms. Example: > http://duarchives.coalliance.org/repositories/2/resources/496 > > > > 2. We went with option #2 when we migrated, because it was easier > and because at the time I didn?t know how the ?Terms and Subdivisions? in > the Agent Links form worked. Ideally I would like to switch over to option > #1, but it?s been a low priority, and there are some issues with how the > public site displays agent links with terms and subdivisions in that make > me not want to devote time to it. > > > > An example of this on our site is here: > http://duarchives.coalliance.org/repositories/2/resources/725. The > ?University of Denver? agent link there is actually ?University of Denver ? > Libraries?, and it does correctly exports ?Libraries? as a 610$x in the > MARC export, but you wouldn?t know it from the public display. -k > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Maura > Carbone > *Sent:* Tuesday, August 11, 2015 2:31 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hi Matthew, > > I'm not entirely sure what you mean by no distinction between creator and > subject with regards to agents. Do you mean that you have two agents, one > with the role of 'creator' and one with the role of 'subject'? Or do you > mean it is bringing in things that should be classified as subjects as > agents? Subjects are separate from Agents in ASpace (see an example from > one of our collections here: > http://findingaids.brandeis.edu/repositories/2/resources/20), but it is > possible that the Archon import tool is only interpreting these as agents > and not subjects. > > > > Max -- I'm not a cataloger or a metadata expert so just personal opinion, > but #2 sounds the most feasible given how ASpace displays agents and > subjects. Either that somewhat of a middle ground: in that example agents > would be UMich and American Brass Company, and Subjects would be the whole > term (University of Michigan--Students--Political activity.) That might > be a bit more clear for users. > > > > Thanks, > > -Maura > > > > On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski < > mGorzalski at lib.siu.edu> wrote: > > Are you an Archon user? We have related agent problems coming from Archon > to ASpace. Our test migrations show that any collection that has a > corporate/personal name as both the creator and as a subject will migrate > BOTH into ASpace under the agent field with NO distinction between creator > and subject. Our example is an artificial collection called Morris Library > Photograph Collection where Morris Library is both creator and subject. In > Archon you can clearly distinguish between these two roles because Creators > and Subjects are separate sections. But in ArchivesSpace they are both > lumped into Agents and given that generic non-descript person icon. So it > is confusing for researchers to see two Morris Library entries under Agents > because their roles are not distinguished. This same public interface > design flaw works the same for any collection using a name as subject and > creator. > > > > Mat Gorzalski > > SIU Carbondale > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Max > Eckard > *Sent:* Tuesday, August 11, 2015 2:45 PM > *To:* Archivesspace Users Group < > archivesspace_users_group at lyralists.lyrasis.org> > *Subject:* [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hello ASpacers! > > > > We've been working on importing agents into ArchivesSpace, but have run > into an issue. As an example, we have a number of elements that > are subdivided with topical subjects, like so: > > - University of Michigan--Students--Political activity. > - University of Michigan--Faculty. > - American Brass Company--Strikes. > > The issue we've encountered is that there is no space in ASpace for agents > that are subdivided in this way. Note: we are not talking about agents with > primary and subordinate names (with periods in between them)--ASpace > handles these just fine! We've been thinking about a number of ways to > handle this: > > 1. We could divide up these terms so that the first term gets imported > as an agent (in the examples above, corporate entity) and the rest of the > term gets imported as a subject (or a subdivided subject). We've > experimented a little with this here > . > The problem with this approach is that subdividing names/agents is a > longstanding practice here (and totally acceptable in MARC), and making a > change like this would require making an even (arguably) bigger change to > descriptive practices here and cause issues with exporting MARC records > from ASpace. > 2. We could just leave the whole string, dash dashes and all, as the > primary form of name. This could work, but it seems inelegant, since each > variation would be imported as a new agent, even though we're only > referring to one. > 3. We could change these to subjects, but that doesn't seem quite > right either, since agents can have the role of subject. > > We've been trying to consider all angles, including what affect a change > like this could have on researcher searching and browsing. Now we're > wondering what you all do. Do you have subdivided agents (s, > s and s)? If so, how have you imported these into ASpace? > > > > Thank you for your time! > > > > Max > > > > > -- > > *Max Eckard* > *Assistant Archivist for Digital Curation* > > > > Bentley Historical Library > > 1150 Beal Ave. > Ann Arbor, MI 48109-2113 > 734/763-7518 <734.763.7518> > > http://bentley.umich.edu/ > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > > > -- > > Maura Carbone > > Digital Initiatives Librarian > Brandeis University > Library and Technology Services > (781) 736-4659 > 415 South Street, (MS 017/P.O. Box 549110) > Waltham, MA 02454-9110 > email: mauraa at brandeis.edu > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- *Max Eckard* *Assistant Archivist for Digital Curation* Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 <734.763.7518> http://bentley.umich.edu/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image.png Type: image/png Size: 49165 bytes Desc: not available URL: From mark.custer at yale.edu Wed Aug 12 12:39:14 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Wed, 12 Aug 2015 16:39:14 +0000 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: Yep, that?s the way the way to do it. But there may be yet another surprise in order ? at least, there was one for me. As it turns out, those terms and subdivisions that you add to agent and subject records are not linked to subject records. Instead, they?re added to the term table. Also, there?s no typeahead feature when adding those terms, as you?ll notice, but the application will link up to pre-existing term values?. as long as you spell everything the same and the type that?s selected is the same as the pre-existing value. If someone accidentally chooses temporal instead of topical, for instance, you could wind up with two ?Advertising? terms in your term table, for example, that you?ll want to clean up later on. From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Max Eckard Sent: Wednesday, August 12, 2015 11:18 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hello everyone, First things first... thank you for your replies! Second, I have to admit that when we first sent the email, we didn't actually realize that there is indeed a way to add terms and subdivisions to agents with the role of subject in resources in ASpace (that's a mouthful!), because we had only been looking at agents. Reading your replies, though, it became apparent that we were missing something, and when we checked, we were pleasantly surprised to find this: [Inline image 1] That doesn't actually help with importing these types of agents into ASpace, but we think we have an idea. We're hoping to be able to import the agent (before the first subdivision) ahead of time, associate the resulting ASpace ref with it in our EAD, split out the rest of the terms in a meaningful way (we've done that in the past by comparing those subdivisions to subdivisions with type subfields in our MARC records), and then, upon import of the resource, add the subdivisions in ASpace. That being said, here are some more specific replies: Mathew: No, we're not an Archon user. We've been using a homegrown system to create and manage our EADs, and for about the past six months or so we've been prepping these EADs for import into ASpace. If you or anyone else is interested, here's a shameless plug for our blog's entries on our ASpace adventures. Maura: I think we'll try to figure out a way to implement the solution we described above, and if that doesn't work, your suggestion seems like a reasonable and researcher-friendly alternative. Kevin: We appreciated hearing about your experience and the reasoning behind it. We won't be using the public display, but it's interesting to note that this is an issue with the public interface. It's also nice to know that agents-as-subjects-with-subdivisions export to MARC properly. Thanks again for your replies! Max On Tue, Aug 11, 2015 at 4:54 PM, Kevin Clair > wrote: 1. We were able to migrate our agents-as-creators and agents-as-subjects separately and have them display as such in the staff frontend, which we managed because they were stored in separate fields in our last collection management system. The public site won?t display ?Creator? or ?Subject? the same way the frontend does; it will only display more specific relator terms. Example: http://duarchives.coalliance.org/repositories/2/resources/496 2. We went with option #2 when we migrated, because it was easier and because at the time I didn?t know how the ?Terms and Subdivisions? in the Agent Links form worked. Ideally I would like to switch over to option #1, but it?s been a low priority, and there are some issues with how the public site displays agent links with terms and subdivisions in that make me not want to devote time to it. An example of this on our site is here: http://duarchives.coalliance.org/repositories/2/resources/725. The ?University of Denver? agent link there is actually ?University of Denver ? Libraries?, and it does correctly exports ?Libraries? as a 610$x in the MARC export, but you wouldn?t know it from the public display. -k From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Maura Carbone Sent: Tuesday, August 11, 2015 2:31 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hi Matthew, I'm not entirely sure what you mean by no distinction between creator and subject with regards to agents. Do you mean that you have two agents, one with the role of 'creator' and one with the role of 'subject'? Or do you mean it is bringing in things that should be classified as subjects as agents? Subjects are separate from Agents in ASpace (see an example from one of our collections here: http://findingaids.brandeis.edu/repositories/2/resources/20), but it is possible that the Archon import tool is only interpreting these as agents and not subjects. Max -- I'm not a cataloger or a metadata expert so just personal opinion, but #2 sounds the most feasible given how ASpace displays agents and subjects. Either that somewhat of a middle ground: in that example agents would be UMich and American Brass Company, and Subjects would be the whole term (University of Michigan--Students--Political activity.) That might be a bit more clear for users. Thanks, -Maura On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski > wrote: Are you an Archon user? We have related agent problems coming from Archon to ASpace. Our test migrations show that any collection that has a corporate/personal name as both the creator and as a subject will migrate BOTH into ASpace under the agent field with NO distinction between creator and subject. Our example is an artificial collection called Morris Library Photograph Collection where Morris Library is both creator and subject. In Archon you can clearly distinguish between these two roles because Creators and Subjects are separate sections. But in ArchivesSpace they are both lumped into Agents and given that generic non-descript person icon. So it is confusing for researchers to see two Morris Library entries under Agents because their roles are not distinguished. This same public interface design flaw works the same for any collection using a name as subject and creator. Mat Gorzalski SIU Carbondale From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Max Eckard Sent: Tuesday, August 11, 2015 2:45 PM To: Archivesspace Users Group > Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace Hello ASpacers! We've been working on importing agents into ArchivesSpace, but have run into an issue. As an example, we have a number of elements that are subdivided with topical subjects, like so: * University of Michigan--Students--Political activity. * University of Michigan--Faculty. * American Brass Company--Strikes. The issue we've encountered is that there is no space in ASpace for agents that are subdivided in this way. Note: we are not talking about agents with primary and subordinate names (with periods in between them)--ASpace handles these just fine! We've been thinking about a number of ways to handle this: 1. We could divide up these terms so that the first term gets imported as an agent (in the examples above, corporate entity) and the rest of the term gets imported as a subject (or a subdivided subject). We've experimented a little with this here. The problem with this approach is that subdividing names/agents is a longstanding practice here (and totally acceptable in MARC), and making a change like this would require making an even (arguably) bigger change to descriptive practices here and cause issues with exporting MARC records from ASpace. 2. We could just leave the whole string, dash dashes and all, as the primary form of name. This could work, but it seems inelegant, since each variation would be imported as a new agent, even though we're only referring to one. 3. We could change these to subjects, but that doesn't seem quite right either, since agents can have the role of subject. We've been trying to consider all angles, including what affect a change like this could have on researcher searching and browsing. Now we're wondering what you all do. Do you have subdivided agents (s, s and s)? If so, how have you imported these into ASpace? Thank you for your time! Max -- Max Eckard Assistant Archivist for Digital Curation [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 http://bentley.umich.edu/ _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Max Eckard Assistant Archivist for Digital Curation [https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 http://bentley.umich.edu/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 45480 bytes Desc: image002.png URL: From eckardm at umich.edu Wed Aug 12 13:01:27 2015 From: eckardm at umich.edu (Max Eckard) Date: Wed, 12 Aug 2015 13:01:27 -0400 Subject: [Archivesspace_Users_Group] Agents with topical (or other) subdivisions in ASpace In-Reply-To: References: <8937cb7be5ab41b19c9f0663b4b166ad@it-excmb3.ad.siu.edu> Message-ID: Thanks for the tip, Mark! With 1200+ EADs that have this issue, I think it's safe to say that we subdivide agents frequently. We'll have to watch out for this! Max On Wed, Aug 12, 2015 at 12:39 PM, Custer, Mark wrote: > Yep, that?s the way the way to do it. But there may be yet another > surprise in order ? at least, there was one for me. > > > > As it turns out, those terms and subdivisions that you add to agent and > subject records are not linked to subject records. Instead, they?re added > to the term table. Also, there?s no typeahead feature when adding those > terms, as you?ll notice, but the application will link up to pre-existing > term values?. as long as you spell everything the same and the type that?s > selected is the same as the pre-existing value. If someone accidentally > chooses temporal instead of topical, for instance, you could wind up with > two ?Advertising? terms in your term table, for example, that you?ll want > to clean up later on. > > > > > > > > > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Max > Eckard > *Sent:* Wednesday, August 12, 2015 11:18 AM > > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hello everyone, > > > > First things first... thank you for your replies! > > > > Second, I have to admit that when we first sent the email, we didn't > actually realize that there is indeed a way to add terms and subdivisions > to agents with the role of subject in resources in ASpace (that's a > mouthful!), because we had only been looking at agents. Reading your > replies, though, it became apparent that we were missing something, and > when we checked, we were pleasantly surprised to find this: > > > > [image: Inline image 1] > > > > That doesn't actually help with importing these types of agents into > ASpace, but we think we have an idea. We're hoping to be able to import the > agent (before the first subdivision) ahead of time, associate the resulting > ASpace ref with it in our EAD, split out the rest of the terms in a > meaningful way (we've done that in the past by comparing those subdivisions > to subdivisions with type subfields in our MARC records), and then, upon > import of the resource, add the subdivisions in ASpace. > > > > That being said, here are some more specific replies: > > > > Mathew: No, we're not an Archon user. We've been using a homegrown system > to create and manage our EADs, and for about the past six months or so > we've been prepping these EADs for import into ASpace. If you or anyone > else is interested, here's a shameless plug for our blog's entries on our > ASpace adventures > > . > > > > Maura: I think we'll try to figure out a way to implement the solution we > described above, and if that doesn't work, your suggestion seems like a > reasonable and researcher-friendly alternative. > > > > Kevin: We appreciated hearing about your experience and the reasoning > behind it. We won't be using the public display, but it's interesting to > note that this is an issue with the public interface. It's also nice to > know that agents-as-subjects-with-subdivisions export to MARC properly. > > > > Thanks again for your replies! > > > > Max > > > > > > > > On Tue, Aug 11, 2015 at 4:54 PM, Kevin Clair wrote: > > 1. We were able to migrate our agents-as-creators and > agents-as-subjects separately and have them display as such in the staff > frontend, which we managed because they were stored in separate fields in > our last collection management system. The public site won?t display > ?Creator? or ?Subject? the same way the frontend does; it will only display > more specific relator terms. Example: > http://duarchives.coalliance.org/repositories/2/resources/496 > > > > > 2. We went with option #2 when we migrated, because it was easier > and because at the time I didn?t know how the ?Terms and Subdivisions? in > the Agent Links form worked. Ideally I would like to switch over to option > #1, but it?s been a low priority, and there are some issues with how the > public site displays agent links with terms and subdivisions in that make > me not want to devote time to it. > > > > An example of this on our site is here: > http://duarchives.coalliance.org/repositories/2/resources/725 > . > The ?University of Denver? agent link there is actually ?University of > Denver ? Libraries?, and it does correctly exports ?Libraries? as a 610$x > in the MARC export, but you wouldn?t know it from the public display. -k > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Maura > Carbone > *Sent:* Tuesday, August 11, 2015 2:31 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hi Matthew, > > I'm not entirely sure what you mean by no distinction between creator and > subject with regards to agents. Do you mean that you have two agents, one > with the role of 'creator' and one with the role of 'subject'? Or do you > mean it is bringing in things that should be classified as subjects as > agents? Subjects are separate from Agents in ASpace (see an example from > one of our collections here: > http://findingaids.brandeis.edu/repositories/2/resources/20 > ), > but it is possible that the Archon import tool is only interpreting these > as agents and not subjects. > > > > Max -- I'm not a cataloger or a metadata expert so just personal opinion, > but #2 sounds the most feasible given how ASpace displays agents and > subjects. Either that somewhat of a middle ground: in that example agents > would be UMich and American Brass Company, and Subjects would be the whole > term (University of Michigan--Students--Political activity.) That might > be a bit more clear for users. > > > > Thanks, > > -Maura > > > > On Tue, Aug 11, 2015 at 4:20 PM, Matthew J Gorzalski < > mGorzalski at lib.siu.edu> wrote: > > Are you an Archon user? We have related agent problems coming from Archon > to ASpace. Our test migrations show that any collection that has a > corporate/personal name as both the creator and as a subject will migrate > BOTH into ASpace under the agent field with NO distinction between creator > and subject. Our example is an artificial collection called Morris Library > Photograph Collection where Morris Library is both creator and subject. In > Archon you can clearly distinguish between these two roles because Creators > and Subjects are separate sections. But in ArchivesSpace they are both > lumped into Agents and given that generic non-descript person icon. So it > is confusing for researchers to see two Morris Library entries under Agents > because their roles are not distinguished. This same public interface > design flaw works the same for any collection using a name as subject and > creator. > > > > Mat Gorzalski > > SIU Carbondale > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Max > Eckard > *Sent:* Tuesday, August 11, 2015 2:45 PM > *To:* Archivesspace Users Group < > archivesspace_users_group at lyralists.lyrasis.org> > *Subject:* [Archivesspace_Users_Group] Agents with topical (or other) > subdivisions in ASpace > > > > Hello ASpacers! > > > > We've been working on importing agents into ArchivesSpace, but have run > into an issue. As an example, we have a number of elements that > are subdivided with topical subjects, like so: > > - University of Michigan--Students--Political activity. > - University of Michigan--Faculty. > - American Brass Company--Strikes. > > The issue we've encountered is that there is no space in ASpace for agents > that are subdivided in this way. Note: we are not talking about agents with > primary and subordinate names (with periods in between them)--ASpace > handles these just fine! We've been thinking about a number of ways to > handle this: > > 1. We could divide up these terms so that the first term gets imported > as an agent (in the examples above, corporate entity) and the rest of the > term gets imported as a subject (or a subdivided subject). We've > experimented a little with this here > . > The problem with this approach is that subdividing names/agents is a > longstanding practice here (and totally acceptable in MARC), and making a > change like this would require making an even (arguably) bigger change to > descriptive practices here and cause issues with exporting MARC records > from ASpace. > 2. We could just leave the whole string, dash dashes and all, as the > primary form of name. This could work, but it seems inelegant, since each > variation would be imported as a new agent, even though we're only > referring to one. > 3. We could change these to subjects, but that doesn't seem quite > right either, since agents can have the role of subject. > > We've been trying to consider all angles, including what affect a change > like this could have on researcher searching and browsing. Now we're > wondering what you all do. Do you have subdivided agents (s, > s and s)? If so, how have you imported these into ASpace? > > > > Thank you for your time! > > > > Max > > > > > -- > > *Max Eckard* > *Assistant Archivist for Digital Curation* > > > > [image: https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] > > Bentley Historical Library > > 1150 Beal Ave. > Ann Arbor, MI 48109-2113 > 734/763-7518 <734.763.7518> > > http://bentley.umich.edu/ > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > > > > -- > > Maura Carbone > > Digital Initiatives Librarian > Brandeis University > Library and Technology Services > (781) 736-4659 > 415 South Street, (MS 017/P.O. Box 549110) > Waltham, MA 02454-9110 > email: mauraa at brandeis.edu > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > > > > -- > > *Max Eckard* > *Assistant Archivist for Digital Curation* > > > > [image: https://webapps.lsa.umich.edu/dean/lsa_emails/bentley-sig-em.png] > > Bentley Historical Library > > 1150 Beal Ave. > Ann Arbor, MI 48109-2113 > 734/763-7518 <734.763.7518> > > http://bentley.umich.edu/ > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- *Max Eckard* *Assistant Archivist for Digital Curation* Bentley Historical Library 1150 Beal Ave. Ann Arbor, MI 48109-2113 734/763-7518 <734.763.7518> http://bentley.umich.edu/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 45480 bytes Desc: not available URL: From lindsay-morecraft at uiowa.edu Wed Aug 12 16:26:56 2015 From: lindsay-morecraft at uiowa.edu (Morecraft, Lindsay M) Date: Wed, 12 Aug 2015 20:26:56 +0000 Subject: [Archivesspace_Users_Group] Deleted records Message-ID: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don?t want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: From EJOLLEY at nla.gov.au Wed Aug 12 21:50:30 2015 From: EJOLLEY at nla.gov.au (Emma Jolley) Date: Thu, 13 Aug 2015 01:50:30 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Message-ID: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change - Close, Edit - change - Close, etc.). Following this method, the preferred order of components did seem to 'stick'. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren't checking the correct node.. the comment says the right thing while the code does the wrong thing. Here's a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit 'AO Child 3'. When that form is visible I drag 'AO Child 4' above to become the first sibling. I then continue to edit 'AO Child 3' and refresh the page. 'A0 Child 3' is now positioned directly under 'Resource'. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: ATT00001.txt URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Set 2.pdf Type: application/pdf Size: 124262 bytes Desc: Set 2.pdf URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Set 1.pdf Type: application/pdf Size: 120047 bytes Desc: Set 1.pdf URL: From brad.westbrook at lyrasis.org Thu Aug 13 07:47:22 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Thu, 13 Aug 2015 11:47:22 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace Presentations / Events during SAA week in Cleveland, OH Message-ID: Dear ArchivesSpace members and colleagues, For those of you who will be attending SAA in Cleveland next week, we look forward to seeing you there. Here's a roundup of official and unofficial ArchivesSpace activities at the meeting and beyond. If you know of more, feel free to send them to the group! Events and Activities Featuring ArchivesSpace Program Team Members * Tuesday, August 18: Research Forum Poster: Nebium, by Lisa Darms, New York University and Brian Hoffman, ArchivesSpace * Thursday, August 20, 12:15-1:30 p.m. - (Bring Your Own) Brown Bag Lunch on ArchivesSpace and Archivematica Integration, featuring Michael Shallcross and Max Eckard, University of Michigan; Courtney C. Mumma, Artefactual Systems, Inc.; and Brad Westbrook, ArchivesSpace * Thursday, August 20, 5:15-7:15 p.m.-Friday, August 21, 9:45 a.m.-5:00 p.m. - Find Brad, Christine, Chris, and other ArchivesSpace team members in the Exhibit Hall, booth #516. Talk to us about your implementation or pick up some free ArchivesSpace or LYRASIS swag! * Saturday, August 22, 1:00-5:45 p.m. - ArchivesSpace Member Meeting at the Cleveland Public Library (pre-registration required; if you'd like to attend and haven't already registered, please contact Christine) Other Events and Activities at SAA Featuring Discussion of ArchivesSpace * Tuesday, August 18: Research Forum Poster: Back to the Future: Bringing Legacy Description into the Present, by Tiffany Saulter, George Apodaca, and Jaime Margalotti, University of Delaware; Research Forum Session 10, 4:30-4:50 p.m.: Digital Advances - Archivematica Integrations: Handshaking towards Sustainable Digital Preservation, by Courtney C. Mumma, Artefactual Systems, Inc. * Wednesday, August 19, 3:00-4:30 p.m.: Collection Management Tools Roundtable * Thursday, August 20-Friday, August 21: Professional Poster P03: Improving Collection Access Through Standardization of Legacy Descriptions in ArchivesSpace, by Karla Irwin, UNLV * Saturday, August 22, 8:30-9:45 a.m.: Session 601: Don't Break It on Tuesdays and Other Tales: ArchivesSpace in Practice, panel featuring Joanne Archer, University of Maryland; Kevin Clair, University of Denver; Chris Ervin, Mojave Desert Archives; and Matt Gorzalski, Southern Illinois University, Carbondale If you know of other events and presentations at SAA next week that are ArchivesSpace related, please share them with our community. All best, Brad W. Bradley D. Westbrook Program Manager brad.westbrook at lyrasis.org 800.999.8558 x2910 678.235.2910 bradley_d_westbrook (Skype) [cid:image003.png at 01CE734E.FD759D30] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 7646 bytes Desc: image003.png URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 08:37:34 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 12:37:34 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Message-ID: Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Emma Jolley Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Thu Aug 13 08:54:11 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Thu, 13 Aug 2015 08:54:11 -0400 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> Message-ID: Lindsay, While I can?t confirm because I haven?t seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It?s only happened once, and we can?t really test for it, but I think it?s possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don?t want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Thu Aug 13 08:58:00 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Thu, 13 Aug 2015 08:58:00 -0400 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Message-ID: Chris, I'll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change - Close, Edit - change - Close, etc.). Following this method, the preferred order of components did seem to 'stick'. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren't checking the correct node.. the comment says the right thing while the code does the wrong thing. Here's a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit 'AO Child 3'. When that form is visible I drag 'AO Child 4' above to become the first sibling. I then continue to edit 'AO Child 3' and refresh the page. 'A0 Child 3' is now positioned directly under 'Resource'. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From lindsay-morecraft at uiowa.edu Thu Aug 13 09:05:32 2015 From: lindsay-morecraft at uiowa.edu (Morecraft, Lindsay M) Date: Thu, 13 Aug 2015 13:05:32 +0000 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> Message-ID: <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> Hi Patrick & ASpace community, Just about an hour after I sent my initial email, I had it happen again ? so this is two times with two different members of our staff. I anticipate this will happen again, as we are undergoing an effort to clean up around 1000 finding aids that have been transferred from Archon. What we are doing is getting rid of boxes as archival objects, as there is container information in the instances, so having boxes listed as objects is repetitive. Perhaps a suggestion to those managing ArchivesSpace ? when you are about to delete the record as a whole, have a special message box stating you are doing so, rather than have the same deletion warning for everything (archival objects vs entire collection record). Does anyone know if there is a way to retrieve a deleted record? This problem is very frustrating as we are losing hours of work, and any insight/advice would be appreciated. Also, we are using v.1.2.0. Thank you! Lindsay Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Thursday, August 13, 2015 7:54 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Lindsay, While I can?t confirm because I haven?t seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It?s only happened once, and we can?t really test for it, but I think it?s possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don?t want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 09:31:36 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 13:31:36 +0000 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> , <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> Message-ID: Hi Lindsay, I haven't heard of this happening. Can you send me your archivesspace.out log file? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Morecraft, Lindsay M Sent: Thursday, August 13, 2015 3:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Patrick & ASpace community, Just about an hour after I sent my initial email, I had it happen again - so this is two times with two different members of our staff. I anticipate this will happen again, as we are undergoing an effort to clean up around 1000 finding aids that have been transferred from Archon. What we are doing is getting rid of boxes as archival objects, as there is container information in the instances, so having boxes listed as objects is repetitive. Perhaps a suggestion to those managing ArchivesSpace - when you are about to delete the record as a whole, have a special message box stating you are doing so, rather than have the same deletion warning for everything (archival objects vs entire collection record). Does anyone know if there is a way to retrieve a deleted record? This problem is very frustrating as we are losing hours of work, and any insight/advice would be appreciated. Also, we are using v.1.2.0. Thank you! Lindsay Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Thursday, August 13, 2015 7:54 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Lindsay, While I can't confirm because I haven't seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It's only happened once, and we can't really test for it, but I think it's possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don't want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 09:34:28 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 13:34:28 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> , Message-ID: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From andrew-holland at uiowa.edu Thu Aug 13 09:43:06 2015 From: andrew-holland at uiowa.edu (Holland, Andrew S) Date: Thu, 13 Aug 2015 13:43:06 +0000 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> , <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> Message-ID: <91838E17DB562E49861555BB8B87F08A41CF5B8E@ITSNT438.iowa.uiowa.edu> Chris, Here's our log file. I tried doing some searches for record IDs that I knew were deleted, but wasn't coming up with anything... -Andrew Holland From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:32 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Lindsay, I haven't heard of this happening. Can you send me your archivesspace.out log file? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Morecraft, Lindsay M > Sent: Thursday, August 13, 2015 3:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Patrick & ASpace community, Just about an hour after I sent my initial email, I had it happen again - so this is two times with two different members of our staff. I anticipate this will happen again, as we are undergoing an effort to clean up around 1000 finding aids that have been transferred from Archon. What we are doing is getting rid of boxes as archival objects, as there is container information in the instances, so having boxes listed as objects is repetitive. Perhaps a suggestion to those managing ArchivesSpace - when you are about to delete the record as a whole, have a special message box stating you are doing so, rather than have the same deletion warning for everything (archival objects vs entire collection record). Does anyone know if there is a way to retrieve a deleted record? This problem is very frustrating as we are losing hours of work, and any insight/advice would be appreciated. Also, we are using v.1.2.0. Thank you! Lindsay Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Thursday, August 13, 2015 7:54 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Lindsay, While I can't confirm because I haven't seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It's only happened once, and we can't really test for it, but I think it's possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don't want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: archivesspace.out Type: application/octet-stream Size: 11428003 bytes Desc: archivesspace.out URL: From ljdavis at colgate.edu Thu Aug 13 09:59:44 2015 From: ljdavis at colgate.edu (Lora Davis) Date: Thu, 13 Aug 2015 09:59:44 -0400 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Message-ID: All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org> wrote: > > Hi Patrick, > > > It's on the MySQL server that there's usually a bottleneck. What are the > setting there? > > > Also, it's probably a good idea to try out the dev releases and see if you > run into these issues. You can download the latest here: > > https://github.com/archivesspace/archivesspace/releases > > Releases ? archivesspace/archivesspace ? GitHub > archivesspace - The ArchivesSpace archives management tool > Read more... > > > > > b,chris. > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Galligan, Patrick > *Sent:* Thursday, August 13, 2015 2:58 PM > *To:* Archivesspace Users Group > > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > > Chris, > > > > I?ll chime in and say that reordering has continued with the update to > 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the > problem, but two archivists have identified that it still happens at the > RAC. Sometimes the finding aids are large, but sometimes they are just > medium sized. > > > > We only have AS running on our VM, and it should have plenty of ram. See > top information below: > > > > top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 > > Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie > > Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, > 0.0%st > > Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers > > Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached > > > > Patrick Galligan > > Rockefeller Archive Center > > Assistant Digital Archivist > > 914-366-6386 > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Chris > Fitzpatrick > *Sent:* Thursday, August 13, 2015 8:38 AM > *To:* Archivesspace Users Group ( > archivesspace_users_group at lyralists.lyrasis.org) > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > > > > > Hi Emma, > > > > How much RAM do you have for the application and for the MySQL server? > When reordering components with lots of siblings ( hundreds or thousands ), > the positions of all the sibling components need to be updated. If you're > running into a bottle neck on the server, this can timeout and cause the > reordering to be incomplete. > > > > There is some documentation on performance here : > http://archivesspace.github.io/archivesspace/ > > > > I've recently added some code that freezes the tree until the move > operation has been completed, which should help with this problem. Closing > the record does not actually do anything other than change the browser's > page. If you refresh the page, it will refresh the tree as well. > > > > b,chris. > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Emma Jolley > *Sent:* Thursday, August 13, 2015 3:50 AM > *To:* Archivesspace Users Group ( > archivesspace_users_group at lyralists.lyrasis.org) > *Subject:* [Archivesspace_Users_Group] Continuing Problem in Re-Ordering > of components - Critical > > > > Dear ArchivesSpace > > > > We are continuing to encounter the component re-ordering problem when we > edit resources even though we have recently upgraded to the latest version > of ArchivesSpace. > > > > For example, we created a new resource record by importing an EAD XML > finding aid to ArchivesSpace. We then started editing the resource record, > creating new components and moving existing components around the component > hierarchy. Screenshots of the edited version, prior to closing the > resource record, are attached (Set 1). As soon as the resource record was > closed, many of the components re-ordered themselves (see screenshots Set > 2). > > > > We then tried re-re-ordering the components, one change at a time (Edit - > change ? Close, Edit ? change ? Close, etc.). Following this method, the > preferred order of components did seem to ?stick?. However, this is not a > viable solution as this adds significantly to the time required to make > even minor changes to resource records and will greatly hamper our use of > ArchivesSpace for resource description and is virtually impossible when > dealing with some of our larger collections which have thousands of > components in them. > > > > This is extremely frustrating and means that we are unable to undertake > any detailed work or data entry at component level of Resource Records as > it is too difficult to use. This is a *critical* *problem* for us as we > are currently in a massive finding-aid project that requires extensive work > on resource records. > > > > Is there any advice on the delivery of a solution to this problem? It > seems to have been around for a long time and we would be extremely > grateful to see an urgent solution. > > > > I would be happy to log this as a Bug if someone could send me advice on > how to do so. > > > > Many thanks > > > > Emma > > > > > > *Emma Jolley*| Curator of Digital Archives, Pictures and Manuscripts > Branch|National Library of Australia Canberra ACT 2600 > e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms > > > http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts > > > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ > mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org > ] *On Behalf Of *Chris > Fitzpatrick > *Sent:* Saturday, 15 November 2014 9:52 AM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] reordering objects in resource > records > > > > Hi everyone, > > > > Thanks for this and sorry about the pain this has been causing. A few > points: > > > > 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all > versions of AS. > > > > 2) Payton from Hudson Molongo's patch is included into github now, but I > still need to write tests for it. If you want the fix now, you can do a > fresh build on the current version in github. and let us know if it works > for you > > > > 3) In regards to process, I think the problem was that this was reported > along with another similar issue involving instances re-ordering. Also, in > trying to replicate this issue, I mistakenly assumed that it was strictly a > "drag-and-drop" issue and was missing the key edit part of the problem, so > I wasn't able to see the problem immediately. > > > > But, regardless, we all need to make sure that PT tickets get made for any > bug or feature request. If its not in PT, it's probably not going to be > addressed. > > > > I know not everyone has "create" access in Pivotal Tracker ( there's a > license/cost issue there ), but there are quite a few colleagues who can > submit tickets. > > > > I'm also trying to think of ways we can ensure discussions generated here > get captured into tickets, with good suggestions. Anyone have some > suggestions on things that work or that they think might work? > > > > Let me know what you think. > > > > best, > > chris > > > > > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > ------------------------------ > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Ben > Goldman > *Sent:* Friday, November 14, 2014 9:51 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] reordering objects in resource > records > > > > Thanks to everyone who's been testing this and reporting back to the list. > At Penn State we have not had a chance to test this yet as we haven't > upgraded to 1.1, but I would just add that this particular bug has led us > to effectively freeze all data entry at the component level of resource > records, because the results are just too unpredictable and difficult to > remediate. I suspect that other ASpace users might feel the same way. I > would hope that ArchivesSpace could prioritize this fix for immediate > release. > > > > Thanks, > Ben > > > > > > > > *Ben Goldman* > Digital Records Archivist > Penn State University Libraries > University Park, PA > 814-863-8333 > http://www.libraries.psu.edu/psul/speccolls.html > > > ------------------------------ > > *From: *"Lora Davis" > *To: *"Archivesspace Users Group" < > archivesspace_users_group at lyralists.lyrasis.org> > *Sent: *Friday, November 14, 2014 3:43:19 PM > *Subject: *Re: [Archivesspace_Users_Group] reordering objects in > resource records > > > > Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this > happens at random but does not seem to be directly correlated (at least for > us) to actually dragging/dropping/moving components. A case in point: I've > been going through and adding access restriction notes to various > components within existing administrative collections. Last week I clicked > on several existing components in a resource record, added conditions > governing access notes to those components, saved the changes, and went > about the rest of my day. The following day I pulled up the resource to > answer a reference question and, lo and behold, it appeared as if someone > had dipped a giant wooden spoon into the cauldron that was the collection > and stirred all the components about in an infuriatingly nonsensical way to > make component soup of our previously well-ordered resource record. > > > > Payten - Thanks for sharing this code, but just to confirm, have you > tested this fix against the scenario I describe (editing but not moving a > component)? I just want clarification since the description for your patch > ("Patch for drag and drop causing record to lose position/parent") does not > align with the primary problem we are encountering. Again, thanks for your > hard work. > > > > Chris - Do we have a timeline for this release? We are seeing many > benefits to our transition to ArchivesSpace, but this problem has been a > constant thorn in our sides since we first reported it in June. We had > hoped that 1.1.0 would resolve this issue (as we'd been told it would), but > we remain anxious for the day when we can rest assured that ArchivesSpace > gnomes won't enter our resources at night and scramble them all about. > > > > Best, > > > > Lora Davis > > > > On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > > Ah, awesome Payten. > > I couldn't get this to replicate and was thinking it was something in the > backend. > > > > Will apply this and include it in the next release. > > Thanks! > > b,chris. > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > ------------------------------ > > *From:* Payten Giles > *Sent:* Wednesday, November 12, 2014 5:44 AM > *To:* Chris Fitzpatrick; Archivesspace Users Group > > > *Subject:* Re: [Archivesspace_Users_Group] reordering objects in resource > records > > > > Hi there Chris, Allyson, > > > > Eavesdropping a little bit and the guilt of writing this code became too > much! > > > > Chris, this looks like a little bug in the tree.js where we aren?t > checking the correct node.. the comment says the right thing while the code > does the wrong thing. Here?s a gist of a potential patch: > > > > https://gist.github.com/payten/649819e7f08d0de3e945 > > > > To replicate I have a Resource hierarchy something like this: > > > > - Resource > > - AO Parent > > - AO Child 1 > > - AO Child 2 > > - AO Child 3 > > - AO Child 4 > > > > I select and go to edit ?AO Child 3?. When that form is visible I drag > ?AO Child 4? above to become the first sibling. I then continue to edit > ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly > under ?Resource?. > > > > Happy to put together a more formal pull request if you like. > > > > Cheers, > > Payten > > > > On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > > > > Hi Allyson, > > > > Unfortuantely, I haven't been able to replicate the problem of component > movements not sticking. See => > > > https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing > ) > > > > In edit mode, I'm able to drag and drop components, reload the page, or go > to the view page. > > > > Is this happening for every record every time for you? Or is it an > infrequent thing? > > > > Not doubting you ( I promise! ) , just trying to see when this is > happening... > > > > b,chris. > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > ------------------------------ > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Allyson Smally > *Sent:* Friday, November 07, 2014 6:04 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] reordering objects in resource > records > > > > Hello all - > > Unfortunately, after upgrading to the newest release, we are still having > this problem. > > Archival objects are reordering themselves after being edited. > > Is anyone else still having this problem? Does anyone know of a solution? > > Thanks very much, > > Allyson > > Allyson E. Smally > Processing Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > (315) 228-7867 > > > > On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman wrote: > > Hi Chris, > > > > Archival object tree. > > > > Thanks! > > -Ben > > > ------------------------------ > > *From: *"Chris Fitzpatrick" > *To: *"Archivesspace Users Group" < > archivesspace_users_group at lyralists.lyrasis.org> > *Sent: *Thursday, September 25, 2014 3:46:10 AM > > > *Subject: *Re: [Archivesspace_Users_Group] reordering > objects in resource records > > > > Hey Ben, > > > > Soon, I promise! > > > > But just to check, are you talking about reording the archival object tree > for the resource or the order of things like notes and subjects? > > > > b,chris. > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > ------------------------------ > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Ben > Goldman > *Sent:* Tuesday, September 23, 2014 10:19 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] reordering objects in resource > records > > > > Thanks, Allyson. I knew it sounded familiar! > > > > Do we have an ETA on the next release yet? :) > > > > -Ben > > > ------------------------------ > > *From: *"Allyson Smally" > *To: *"Archivesspace Users Group" < > archivesspace_users_group at lyralists.lyrasis.org> > *Sent: *Tuesday, September 23, 2014 4:15:04 PM > *Subject: *Re: [Archivesspace_Users_Group] reordering objects in > resource records > > > > Hi Ben, > > > > Yes, from what I understand this is a known issue. It has been happening > to us a lot as well. > > At SAA this August, I was told it would be fixed in the next release. > > > > -Allyson > > > Allyson E. Smally > Processing Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > (315) 228-7867 > > > > On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman wrote: > > Hello, > > > > I've just experienced an issue and on a cursory search can't tell if it's > been noted in PivotalTracker yet or discussed here yet. > > > > I've been editing an inventory object-by-object in a resource record, > saving each object as I updated it. In one instance I reordered one of the > objects by dragging it further down the tree, then continued editing other > objects. Then I reached an object that could be removed, clicked to delete > it, the resource reloaded in View mode, and the objects appeared to > shuffle, and not seemingly in the order I started with. > > > > -Ben > > > > *Ben Goldman* > Digital Records Archivist > Penn State University Libraries > University Park, PA > 814-863-8333 > http://www.libraries.psu.edu/psul/speccolls.html > > > > > > -- > > Allyson E. Smally > Processing Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > (315) 228-7867 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > > > -- > > Lora J. Davis > Assistant Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > > Tel: (315) 228-6376 > Fax: (315) 228-7934 > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 10:09:46 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 14:09:46 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> , Message-ID: Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 -------------- next part -------------- An HTML attachment was scrubbed... URL: From mauraa at brandeis.edu Thu Aug 13 10:20:30 2015 From: mauraa at brandeis.edu (Maura Carbone) Date: Thu, 13 Aug 2015 10:20:30 -0400 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Message-ID: We haven't had exactly this exact issue, but we have had similar problems when re-ordering (it seems like moving is finished but it causes SQL errors when trying to move again because it actually wasn't done). So looking forward to the tree freezing! I'll see about the memory for MySQL as well. On Thu, Aug 13, 2015 at 10:09 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org> wrote: > Hi Lora, > > > Thanks. One thing to keep in mind is that LYRASIS hosting is separate from > the ArchivesSpace, so if you're having problems with the application, you > should send that information to the ArchivesSpace project team if you want > support from us on it ( "us" being ArchivesSpace and not LYRASIS ). > > > Also, going through all these "reordering issues", one of the problems > with troubleshooting this has been it is heavily depending on how the data > is structured, what user is doing, and the server environment. So, it's > really helpful to get a description of what the data looks like, what > actions the user was doing, and your server environment ( in your case, > you're hosted, which is enough information ). > > > best, chris. > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Lora Davis > *Sent:* Thursday, August 13, 2015 3:59 PM > > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > All, > > Just a quick between-meetings post to note that we at Colgate (Lyrasis > hosted) are also seeing a reappearance of this component reordering > trouble. Our Processing Archivist will contribute a longer post detailing > the issues she's had (including a new behavior we've never encountered > before) later today, but for now I wanted to jump in and say "us too." > > As a hosted instance we have also reported these issues to Lyrasis as well. > > Best, > > Lora > > On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > >> >> Hi Patrick, >> >> >> It's on the MySQL server that there's usually a bottleneck. What are the >> setting there? >> >> >> Also, it's probably a good idea to try out the dev releases and see if >> you run into these issues. You can download the latest here: >> >> https://github.com/archivesspace/archivesspace/releases >> >> Releases ? archivesspace/archivesspace ? GitHub >> archivesspace - The ArchivesSpace archives management tool >> Read more... >> >> >> >> >> b,chris. >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Galligan, Patrick >> *Sent:* Thursday, August 13, 2015 2:58 PM >> *To:* Archivesspace Users Group >> >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> Chris, >> >> >> >> I?ll chime in and say that reordering has continued with the update to >> 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the >> problem, but two archivists have identified that it still happens at the >> RAC. Sometimes the finding aids are large, but sometimes they are just >> medium sized. >> >> >> >> We only have AS running on our VM, and it should have plenty of ram. See >> top information below: >> >> >> >> top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 >> >> Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie >> >> Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, >> 0.0%st >> >> Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers >> >> Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached >> >> >> >> Patrick Galligan >> >> Rockefeller Archive Center >> >> Assistant Digital Archivist >> >> 914-366-6386 >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: >> archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Chris >> Fitzpatrick >> *Sent:* Thursday, August 13, 2015 8:38 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> >> >> >> Hi Emma, >> >> >> >> How much RAM do you have for the application and for the MySQL server? >> When reordering components with lots of siblings ( hundreds or thousands ), >> the positions of all the sibling components need to be updated. If you're >> running into a bottle neck on the server, this can timeout and cause the >> reordering to be incomplete. >> >> >> >> There is some documentation on performance here : >> http://archivesspace.github.io/archivesspace/ >> >> >> >> I've recently added some code that freezes the tree until the move >> operation has been completed, which should help with this problem. Closing >> the record does not actually do anything other than change the browser's >> page. If you refresh the page, it will refresh the tree as well. >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Emma Jolley >> *Sent:* Thursday, August 13, 2015 3:50 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* [Archivesspace_Users_Group] Continuing Problem in Re-Ordering >> of components - Critical >> >> >> >> Dear ArchivesSpace >> >> >> >> We are continuing to encounter the component re-ordering problem when we >> edit resources even though we have recently upgraded to the latest version >> of ArchivesSpace. >> >> >> >> For example, we created a new resource record by importing an EAD XML >> finding aid to ArchivesSpace. We then started editing the resource record, >> creating new components and moving existing components around the component >> hierarchy. Screenshots of the edited version, prior to closing the >> resource record, are attached (Set 1). As soon as the resource record was >> closed, many of the components re-ordered themselves (see screenshots Set >> 2). >> >> >> >> We then tried re-re-ordering the components, one change at a time (Edit - >> change ? Close, Edit ? change ? Close, etc.). Following this method, the >> preferred order of components did seem to ?stick?. However, this is not a >> viable solution as this adds significantly to the time required to make >> even minor changes to resource records and will greatly hamper our use of >> ArchivesSpace for resource description and is virtually impossible when >> dealing with some of our larger collections which have thousands of >> components in them. >> >> >> >> This is extremely frustrating and means that we are unable to undertake >> any detailed work or data entry at component level of Resource Records as >> it is too difficult to use. This is a *critical* *problem* for us as we >> are currently in a massive finding-aid project that requires extensive work >> on resource records. >> >> >> >> Is there any advice on the delivery of a solution to this problem? It >> seems to have been around for a long time and we would be extremely >> grateful to see an urgent solution. >> >> >> >> I would be happy to log this as a Bug if someone could send me advice on >> how to do so. >> >> >> >> Many thanks >> >> >> >> Emma >> >> >> >> >> >> *Emma Jolley*| Curator of Digital Archives, Pictures and Manuscripts >> Branch|National Library of Australia Canberra ACT 2600 >> e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms >> >> >> http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts >> >> >> >> >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ >> mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org >> ] *On Behalf Of >> *Chris Fitzpatrick >> *Sent:* Saturday, 15 November 2014 9:52 AM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi everyone, >> >> >> >> Thanks for this and sorry about the pain this has been causing. A few >> points: >> >> >> >> 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all >> versions of AS. >> >> >> >> 2) Payton from Hudson Molongo's patch is included into github now, but I >> still need to write tests for it. If you want the fix now, you can do a >> fresh build on the current version in github. and let us know if it works >> for you >> >> >> >> 3) In regards to process, I think the problem was that this was reported >> along with another similar issue involving instances re-ordering. Also, in >> trying to replicate this issue, I mistakenly assumed that it was strictly a >> "drag-and-drop" issue and was missing the key edit part of the problem, so >> I wasn't able to see the problem immediately. >> >> >> >> But, regardless, we all need to make sure that PT tickets get made for >> any bug or feature request. If its not in PT, it's probably not going to be >> addressed. >> >> >> >> I know not everyone has "create" access in Pivotal Tracker ( there's a >> license/cost issue there ), but there are quite a few colleagues who can >> submit tickets. >> >> >> >> I'm also trying to think of ways we can ensure discussions generated here >> get captured into tickets, with good suggestions. Anyone have some >> suggestions on things that work or that they think might work? >> >> >> >> Let me know what you think. >> >> >> >> best, >> >> chris >> >> >> >> >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Friday, November 14, 2014 9:51 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks to everyone who's been testing this and reporting back to the >> list. At Penn State we have not had a chance to test this yet as we haven't >> upgraded to 1.1, but I would just add that this particular bug has led us >> to effectively freeze all data entry at the component level of resource >> records, because the results are just too unpredictable and difficult to >> remediate. I suspect that other ASpace users might feel the same way. I >> would hope that ArchivesSpace could prioritize this fix for immediate >> release. >> >> >> >> Thanks, >> Ben >> >> >> >> >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> ------------------------------ >> >> *From: *"Lora Davis" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Friday, November 14, 2014 3:43:19 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - >> this happens at random but does not seem to be directly correlated (at >> least for us) to actually dragging/dropping/moving components. A case in >> point: I've been going through and adding access restriction notes to >> various components within existing administrative collections. Last week I >> clicked on several existing components in a resource record, added >> conditions governing access notes to those components, saved the changes, >> and went about the rest of my day. The following day I pulled up the >> resource to answer a reference question and, lo and behold, it appeared as >> if someone had dipped a giant wooden spoon into the cauldron that was the >> collection and stirred all the components about in an infuriatingly >> nonsensical way to make component soup of our previously well-ordered >> resource record. >> >> >> >> Payten - Thanks for sharing this code, but just to confirm, have you >> tested this fix against the scenario I describe (editing but not moving a >> component)? I just want clarification since the description for your patch >> ("Patch for drag and drop causing record to lose position/parent") does not >> align with the primary problem we are encountering. Again, thanks for your >> hard work. >> >> >> >> Chris - Do we have a timeline for this release? We are seeing many >> benefits to our transition to ArchivesSpace, but this problem has been a >> constant thorn in our sides since we first reported it in June. We had >> hoped that 1.1.0 would resolve this issue (as we'd been told it would), but >> we remain anxious for the day when we can rest assured that ArchivesSpace >> gnomes won't enter our resources at night and scramble them all about. >> >> >> >> Best, >> >> >> >> Lora Davis >> >> >> >> On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> Ah, awesome Payten. >> >> I couldn't get this to replicate and was thinking it was something in the >> backend. >> >> >> >> Will apply this and include it in the next release. >> >> Thanks! >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* Payten Giles >> *Sent:* Wednesday, November 12, 2014 5:44 AM >> *To:* Chris Fitzpatrick; Archivesspace Users Group >> >> >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi there Chris, Allyson, >> >> >> >> Eavesdropping a little bit and the guilt of writing this code became too >> much! >> >> >> >> Chris, this looks like a little bug in the tree.js where we aren?t >> checking the correct node.. the comment says the right thing while the code >> does the wrong thing. Here?s a gist of a potential patch: >> >> >> >> https://gist.github.com/payten/649819e7f08d0de3e945 >> >> >> >> To replicate I have a Resource hierarchy something like this: >> >> >> >> - Resource >> >> - AO Parent >> >> - AO Child 1 >> >> - AO Child 2 >> >> - AO Child 3 >> >> - AO Child 4 >> >> >> >> I select and go to edit ?AO Child 3?. When that form is visible I drag >> ?AO Child 4? above to become the first sibling. I then continue to edit >> ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly >> under ?Resource?. >> >> >> >> Happy to put together a more formal pull request if you like. >> >> >> >> Cheers, >> >> Payten >> >> >> >> On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> >> >> Hi Allyson, >> >> >> >> Unfortuantely, I haven't been able to replicate the problem of component >> movements not sticking. See => >> >> >> https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing >> ) >> >> >> >> In edit mode, I'm able to drag and drop components, reload the page, or >> go to the view page. >> >> >> >> Is this happening for every record every time for you? Or is it an >> infrequent thing? >> >> >> >> Not doubting you ( I promise! ) , just trying to see when this is >> happening... >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Allyson Smally >> *Sent:* Friday, November 07, 2014 6:04 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hello all - >> >> Unfortunately, after upgrading to the newest release, we are still having >> this problem. >> >> Archival objects are reordering themselves after being edited. >> >> Is anyone else still having this problem? Does anyone know of a solution? >> >> Thanks very much, >> >> Allyson >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman wrote: >> >> Hi Chris, >> >> >> >> Archival object tree. >> >> >> >> Thanks! >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Chris Fitzpatrick" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Thursday, September 25, 2014 3:46:10 AM >> >> >> *Subject: *Re: [Archivesspace_Users_Group] reordering >> objects in resource records >> >> >> >> Hey Ben, >> >> >> >> Soon, I promise! >> >> >> >> But just to check, are you talking about reording the archival object >> tree for the resource or the order of things like notes and subjects? >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Tuesday, September 23, 2014 10:19 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks, Allyson. I knew it sounded familiar! >> >> >> >> Do we have an ETA on the next release yet? :) >> >> >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Allyson Smally" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Tuesday, September 23, 2014 4:15:04 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi Ben, >> >> >> >> Yes, from what I understand this is a known issue. It has been happening >> to us a lot as well. >> >> At SAA this August, I was told it would be fixed in the next release. >> >> >> >> -Allyson >> >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman wrote: >> >> Hello, >> >> >> >> I've just experienced an issue and on a cursory search can't tell if it's >> been noted in PivotalTracker yet or discussed here yet. >> >> >> >> I've been editing an inventory object-by-object in a resource record, >> saving each object as I updated it. In one instance I reordered one of the >> objects by dragging it further down the tree, then continued editing other >> objects. Then I reached an object that could be removed, clicked to delete >> it, the resource reloaded in View mode, and the objects appeared to >> shuffle, and not seemingly in the order I started with. >> >> >> >> -Ben >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> >> >> >> -- >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> >> -- >> >> Lora J. Davis >> Assistant Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> >> Tel: (315) 228-6376 >> Fax: (315) 228-7934 >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> > > > -- > Lora J. Davis > Collections Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > Tel: (315) 228-6376 > Fax: (315) 228-7934 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Maura Carbone Digital Initiatives Librarian Brandeis University Library and Technology Services (781) 736-4659 415 South Street, (MS 017/P.O. Box 549110) Waltham, MA 02454-9110 email: mauraa at brandeis.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From jcarll at radcliffe.harvard.edu Thu Aug 13 10:26:57 2015 From: jcarll at radcliffe.harvard.edu (Carll, Johanna) Date: Thu, 13 Aug 2015 14:26:57 +0000 Subject: [Archivesspace_Users_Group] Assigning User Permissions Message-ID: As a repository manager using ArchivesSpace v1.3.0 , I am able to assign users to groups using the "Manage Groups" feature, but trying to assign groups to users in the "Manage User Access" feature results in the following error message: [cid:image003.jpg at 01D0D5B2.948C44E0] The user documentation indicates that repository managers can assign permissions using either the "Manage Groups" or "Manage User Access" feature. Is the above error a bug or is the "Manage User Access" feature only available to the system administrator? Thanks Johanna Carll Archivist and Metadata Specialist Schlesinger Library Radcliffe Institute for Advanced Study Harvard University 10 Garden Street Cambridge, MA 02138 617-495-8524 jcarll at radcliffe.harvard.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.jpg Type: image/jpeg Size: 28110 bytes Desc: image003.jpg URL: From bmg17 at psu.edu Thu Aug 13 10:35:17 2015 From: bmg17 at psu.edu (Ben Goldman) Date: Thu, 13 Aug 2015 10:35:17 -0400 (EDT) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> Message-ID: <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu> Hi Chris, Could you just take a moment to lay out for us what specific information is required to troubleshoot this issue, so we can all start collecting/sharing data in a helpful way? What specific information about the server environment do you need to know? And how would you like us to share what the data looks like? Would attaching an XML version of the record suffice? And is there a better way to collect this data from the institutions experiencing this issue than the listserv? I think it may be worth looking for ways we as a community can start working more stridently toward a solution on this. It's disconcerting t his issue has lingered through several versions of ASpace especially since, a s Emma suggested, this issue is kind of a deal-breaker when encountered. It not only stifles work, it also creates distrust by users working in the system, which works against our efforts to advocate for ASpace locally at our institutions, and more broadly in the archives community. Thanks, Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries From: "Chris Fitzpatrick" To: "Archivesspace Users Group" Sent: Thursday, August 13, 2015 10:09:46 AM Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org < archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick < PGalligan at rockarch.org > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group ( archivesspace_users_group at lyralists.lyrasis.org ) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org < archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley < EJOLLEY at nla.gov.au > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group ( archivesspace_users_group at lyralists.lyrasis.org ) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley | Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au |t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [ mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org < archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman < bmg17 at psu.edu > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html From: "Lora Davis" < ljdavis at colgate.edu > To: "Archivesspace Users Group" < archivesspace_users_group at lyralists.lyrasis.org > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: Payten Giles < payten.giles at gmail.com > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten BQ_BEGIN On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org < archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally < asmally at colgate.edu > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman < bmg17 at psu.edu > wrote: Hi Chris, Archival object tree. Thanks! -Ben From: "Chris Fitzpatrick" < Chris.Fitzpatrick at lyrasis.org > To: "Archivesspace Users Group" < archivesspace_users_group at lyralists.lyrasis.org > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ From: archivesspace_users_group-bounces at lyralists.lyrasis.org < archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman < bmg17 at psu.edu > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben From: "Allyson Smally" < asmally at colgate.edu > To: "Archivesspace Users Group" < archivesspace_users_group at lyralists.lyrasis.org > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman < bmg17 at psu.edu > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group BQ_END -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From bmg17 at psu.edu Thu Aug 13 10:41:37 2015 From: bmg17 at psu.edu (Ben Goldman) Date: Thu, 13 Aug 2015 10:41:37 -0400 (EDT) Subject: [Archivesspace_Users_Group] ASpace Members meeting -- more information for breakout session on systems integration In-Reply-To: <1617692250.2105759.1439326260458.JavaMail.zimbra@psu.edu> References: <1617692250.2105759.1439326260458.JavaMail.zimbra@psu.edu> Message-ID: <601116197.2847345.1439476897586.JavaMail.zimbra@psu.edu> ASpace Community, One of the breakout sessions planned for the member meeting at SAA will focus on systems integration. In order to get a feel for where everyone stands on this topic, we'd like to invite you to take a quick, informal poll and share your thoughts. If systems integration is not something you've yet considered at your institution, please don't feel obligated to complete this form. We are mainly looking for thoughts from those who have been considering or exploring this topic to help inform the discussion points during the break out session. https://docs.google.com/forms/d/1UCwKmJD77sGdMyXtMGvbuG13vU5XyMsE3XJYd6u4BAk/viewform Thanks! -Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 11:33:38 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 15:33:38 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu> References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> , <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu> Message-ID: Hi Ben, Sure, I guess I would start out again by just mentioning again that part of the problem with this problem is that it's not a problem, but rather a series of problems. We've been closing out a lot of the issues, but since there's so much going on in ArchivesSpace, it's really dependent on a lot of factors. So, it's really helpful to know a few things...one would be a general description of the record ( Accession? Resource? Digital Object? Archival Object? Digital Object Component? Classification? ). And especially the size of the records involved ( especially the number of records you tried to move and how many siblings that record has ). Also good to know if your data was imported from an EAD, migrated from Archon/AT, or made from scratch in the application. Also good to know if you've done any transfers for this data ( although these issues have been mostly fixed, I believe ). It's also helpful to know what the user did. Did they click on one record and try and move it or Was it a multiselected batch? Was the multiselect a shift- multiselect or a ctl- multiselect? Did you start from the top and go down on the multiselect or from the bottom and then go up? If it was a ctl- multiselect, what order did you select the records? (more on this in a followup email ) Did you move the record(s) down the list in the same series or up the list in the same series? Or did you re-parent the records into a new series? And it's really helpful if you can replicate this somewhere we can look at the records. Like in the sandbox or test.archivesspace.org. Also very helpful if people can test out changes we've made on the dev releases prior to the version release. We have people on the TAC and UAC testing this out, so if people want to volunteer to test, I think they would be welcome. And, of course, it would be really great it the community could start troubleshooting locally and producing code fixes ( or at least tests ) and sending in pull-requests. In regards to tracking, I'd mention we do have a Jira issue tracker, but I'd leave it to the community to decide what's the best way to track these kinds of support issues... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Ben Goldman Sent: Thursday, August 13, 2015 4:35 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Chris, Could you just take a moment to lay out for us what specific information is required to troubleshoot this issue, so we can all start collecting/sharing data in a helpful way? What specific information about the server environment do you need to know? And how would you like us to share what the data looks like? Would attaching an XML version of the record suffice? And is there a better way to collect this data from the institutions experiencing this issue than the listserv? I think it may be worth looking for ways we as a community can start working more stridently toward a solution on this. It's disconcerting this issue has lingered through several versions of ASpace especially since, as Emma suggested, this issue is kind of a deal-breaker when encountered. It not only stifles work, it also creates distrust by users working in the system, which works against our efforts to advocate for ASpace locally at our institutions, and more broadly in the archives community. Thanks, Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries ________________________________ From: "Chris Fitzpatrick" To: "Archivesspace Users Group" Sent: Thursday, August 13, 2015 10:09:46 AM Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 11:39:24 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 15:39:24 +0000 Subject: [Archivesspace_Users_Group] Multiselect Ordering In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> , <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu>, Message-ID: Hi, Just a quick note related to the reordering issues... One thing I've notice that some people are not aware of is that the multiselect batch moves depend on the order in which you multiselect. For example, if you first select an Archival Object and shift select several records above it, then move those records in a block, you're block will be moved in inverted order. For example: AO 1 AO 2 AO 3 AO 4 AO 5 If I select AO 4, then shift select AO 3 and AO 2 and move them to above AO 1, my result will be: AO 4 AO 3 AO 2 AO 1 AO 5 The same is for ctl- select. The block you're moving depends on the order you select. This is the intended functionality... Does this explanation make sense? best ,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Chris Fitzpatrick Sent: Thursday, August 13, 2015 5:33 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Ben, Sure, I guess I would start out again by just mentioning again that part of the problem with this problem is that it's not a problem, but rather a series of problems. We've been closing out a lot of the issues, but since there's so much going on in ArchivesSpace, it's really dependent on a lot of factors. So, it's really helpful to know a few things...one would be a general description of the record ( Accession? Resource? Digital Object? Archival Object? Digital Object Component? Classification? ). And especially the size of the records involved ( especially the number of records you tried to move and how many siblings that record has ). Also good to know if your data was imported from an EAD, migrated from Archon/AT, or made from scratch in the application. Also good to know if you've done any transfers for this data ( although these issues have been mostly fixed, I believe ). It's also helpful to know what the user did. Did they click on one record and try and move it or Was it a multiselected batch? Was the multiselect a shift- multiselect or a ctl- multiselect? Did you start from the top and go down on the multiselect or from the bottom and then go up? If it was a ctl- multiselect, what order did you select the records? (more on this in a followup email ) Did you move the record(s) down the list in the same series or up the list in the same series? Or did you re-parent the records into a new series? And it's really helpful if you can replicate this somewhere we can look at the records. Like in the sandbox or test.archivesspace.org. Also very helpful if people can test out changes we've made on the dev releases prior to the version release. We have people on the TAC and UAC testing this out, so if people want to volunteer to test, I think they would be welcome. And, of course, it would be really great it the community could start troubleshooting locally and producing code fixes ( or at least tests ) and sending in pull-requests. In regards to tracking, I'd mention we do have a Jira issue tracker, but I'd leave it to the community to decide what's the best way to track these kinds of support issues... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Ben Goldman Sent: Thursday, August 13, 2015 4:35 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Chris, Could you just take a moment to lay out for us what specific information is required to troubleshoot this issue, so we can all start collecting/sharing data in a helpful way? What specific information about the server environment do you need to know? And how would you like us to share what the data looks like? Would attaching an XML version of the record suffice? And is there a better way to collect this data from the institutions experiencing this issue than the listserv? I think it may be worth looking for ways we as a community can start working more stridently toward a solution on this. It's disconcerting this issue has lingered through several versions of ASpace especially since, as Emma suggested, this issue is kind of a deal-breaker when encountered. It not only stifles work, it also creates distrust by users working in the system, which works against our efforts to advocate for ASpace locally at our institutions, and more broadly in the archives community. Thanks, Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries ________________________________ From: "Chris Fitzpatrick" To: "Archivesspace Users Group" Sent: Thursday, August 13, 2015 10:09:46 AM Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From asmally at colgate.edu Thu Aug 13 12:32:23 2015 From: asmally at colgate.edu (Allyson Smally) Date: Thu, 13 Aug 2015 12:32:23 -0400 Subject: [Archivesspace_Users_Group] Multiselect Ordering In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu> Message-ID: This was actually the issue I had just noticed here at Colgate. Thank you for the explanation - I understand now, although it is not really a functionality I would have expected if you had not brought it to our attention. - Allyson On Thu, Aug 13, 2015 at 11:39 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org> wrote: > Hi, > > > Just a quick note related to the reordering issues... > > > One thing I've notice that some people are not aware of is that the > multiselect batch moves depend on the order in which you multiselect. For > example, if you first select an Archival Object and shift select several > records above it, then move those records in a block, you're block will be > moved in inverted order. > > > For example: > > > AO 1 > > AO 2 > > AO 3 > > AO 4 > > AO 5 > > > If I select AO 4, then shift select AO 3 and AO 2 and move them to above > AO 1, my result will be: > > > AO 4 > > AO 3 > > AO 2 > > AO 1 > > AO 5 > > > The same is for ctl- select. The block you're moving depends on the order > you select. This is the intended functionality... > > Does this explanation make sense? > > > best ,chris. > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* Chris Fitzpatrick > *Sent:* Thursday, August 13, 2015 5:33 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > > > Hi Ben, > > > Sure, I guess I would start out again by just mentioning again that part > of the problem with this problem is that it's not a problem, but rather a > series of problems. We've been closing out a lot of the issues, but since > there's so much going on in ArchivesSpace, it's really dependent on a lot > of factors. > > > So, it's really helpful to know a few things...one would be a general > description of the record ( Accession? Resource? Digital Object? Archival > Object? Digital Object Component? Classification? ). And especially the > size of the records involved ( especially the number of records you tried > to move and how many siblings that record has ). > > > Also good to know if your data was imported from an EAD, migrated from > Archon/AT, or made from scratch in the application. Also good to know if > you've done any transfers for this data ( although these issues have been > mostly fixed, I believe ). > > > It's also helpful to know what the user did. Did they click on one record > and try and move it or Was it a multiselected batch? Was the multiselect a > shift- multiselect or a ctl- multiselect? Did you start from the top and go > down on the multiselect or from the bottom and then go up? If it was a ctl- > multiselect, what order did you select the records? (more on this in a > followup email ) Did you move the record(s) down the list in the same > series or up the list in the same series? Or did you re-parent the records > into a new series? > > > And it's really helpful if you can replicate this somewhere we can look at > the records. Like in the sandbox or test.archivesspace.org. > > Also very helpful if people can test out changes we've made on the dev > releases prior to the version release. > > > We have people on the TAC and UAC testing this out, so if people want to > volunteer to test, I think they would be welcome. > > > And, of course, it would be really great it the community could start > troubleshooting locally and producing code fixes ( or at least tests ) and > sending in pull-requests. > > > In regards to tracking, I'd mention we do have a Jira issue tracker, but > I'd leave it to the community to decide what's the best way to track these > kinds of support issues... > > > > b,chris. > > > > > > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Ben > Goldman > *Sent:* Thursday, August 13, 2015 4:35 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > Hi Chris, > > Could you just take a moment to lay out for us what specific information > is required to troubleshoot this issue, so we can all start > collecting/sharing data in a helpful way? What specific information about > the server environment do you need to know? And how would you like us to > share what the data looks like? Would attaching an XML version of the > record suffice? > > And is there a better way to collect this data from the institutions > experiencing this issue than the listserv? I think it may be worth looking > for ways we as a community can start working more stridently toward a > solution on this. It's disconcerting this issue has lingered through > several versions of ASpace especially since, as Emma suggested, this > issue is kind of a deal-breaker when encountered. It not only stifles work, > it also creates distrust by users working in the system, which works > against our efforts to advocate for ASpace locally at our institutions, and > more broadly in the archives community. > > Thanks, > Ben > > *Ben Goldman* > Digital Records Archivist & > Sally W. Kalin Early Career Librarian for Technological Innovations > Penn State University Libraries > > ------------------------------ > *From: *"Chris Fitzpatrick" > *To: *"Archivesspace Users Group" < > archivesspace_users_group at lyralists.lyrasis.org> > *Sent: *Thursday, August 13, 2015 10:09:46 AM > *Subject: *Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > Hi Lora, > > > Thanks. One thing to keep in mind is that LYRASIS hosting is separate from > the ArchivesSpace, so if you're having problems with the application, you > should send that information to the ArchivesSpace project team if you want > support from us on it ( "us" being ArchivesSpace and not LYRASIS ). > > > Also, going through all these "reordering issues", one of the problems > with troubleshooting this has been it is heavily depending on how the data > is structured, what user is doing, and the server environment. So, it's > really helpful to get a description of what the data looks like, what > actions the user was doing, and your server environment ( in your case, > you're hosted, which is enough information ). > > > best, chris. > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Lora Davis > *Sent:* Thursday, August 13, 2015 3:59 PM > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > All, > > Just a quick between-meetings post to note that we at Colgate (Lyrasis > hosted) are also seeing a reappearance of this component reordering > trouble. Our Processing Archivist will contribute a longer post detailing > the issues she's had (including a new behavior we've never encountered > before) later today, but for now I wanted to jump in and say "us too." > > As a hosted instance we have also reported these issues to Lyrasis as well. > > Best, > > Lora > > On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > >> >> Hi Patrick, >> >> >> It's on the MySQL server that there's usually a bottleneck. What are the >> setting there? >> >> >> Also, it's probably a good idea to try out the dev releases and see if >> you run into these issues. You can download the latest here: >> >> https://github.com/archivesspace/archivesspace/releases >> >> Releases ? archivesspace/archivesspace ? GitHub >> archivesspace - The ArchivesSpace archives management tool >> Read more... >> >> >> >> >> b,chris. >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Galligan, Patrick >> *Sent:* Thursday, August 13, 2015 2:58 PM >> *To:* Archivesspace Users Group >> >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> Chris, >> >> >> >> I?ll chime in and say that reordering has continued with the update to >> 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the >> problem, but two archivists have identified that it still happens at the >> RAC. Sometimes the finding aids are large, but sometimes they are just >> medium sized. >> >> >> >> We only have AS running on our VM, and it should have plenty of ram. See >> top information below: >> >> >> >> top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 >> >> Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie >> >> Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, >> 0.0%st >> >> Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers >> >> Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached >> >> >> >> Patrick Galligan >> >> Rockefeller Archive Center >> >> Assistant Digital Archivist >> >> 914-366-6386 >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: >> archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Chris >> Fitzpatrick >> *Sent:* Thursday, August 13, 2015 8:38 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> >> >> >> Hi Emma, >> >> >> >> How much RAM do you have for the application and for the MySQL server? >> When reordering components with lots of siblings ( hundreds or thousands ), >> the positions of all the sibling components need to be updated. If you're >> running into a bottle neck on the server, this can timeout and cause the >> reordering to be incomplete. >> >> >> >> There is some documentation on performance here : >> http://archivesspace.github.io/archivesspace/ >> >> >> >> I've recently added some code that freezes the tree until the move >> operation has been completed, which should help with this problem. Closing >> the record does not actually do anything other than change the browser's >> page. If you refresh the page, it will refresh the tree as well. >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Emma Jolley >> *Sent:* Thursday, August 13, 2015 3:50 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* [Archivesspace_Users_Group] Continuing Problem in Re-Ordering >> of components - Critical >> >> >> >> Dear ArchivesSpace >> >> >> >> We are continuing to encounter the component re-ordering problem when we >> edit resources even though we have recently upgraded to the latest version >> of ArchivesSpace. >> >> >> >> For example, we created a new resource record by importing an EAD XML >> finding aid to ArchivesSpace. We then started editing the resource record, >> creating new components and moving existing components around the component >> hierarchy. Screenshots of the edited version, prior to closing the >> resource record, are attached (Set 1). As soon as the resource record was >> closed, many of the components re-ordered themselves (see screenshots Set >> 2). >> >> >> >> We then tried re-re-ordering the components, one change at a time (Edit - >> change ? Close, Edit ? change ? Close, etc.). Following this method, the >> preferred order of components did seem to ?stick?. However, this is not a >> viable solution as this adds significantly to the time required to make >> even minor changes to resource records and will greatly hamper our use of >> ArchivesSpace for resource description and is virtually impossible when >> dealing with some of our larger collections which have thousands of >> components in them. >> >> >> >> This is extremely frustrating and means that we are unable to undertake >> any detailed work or data entry at component level of Resource Records as >> it is too difficult to use. This is a *critical* *problem* for us as we >> are currently in a massive finding-aid project that requires extensive work >> on resource records. >> >> >> >> Is there any advice on the delivery of a solution to this problem? It >> seems to have been around for a long time and we would be extremely >> grateful to see an urgent solution. >> >> >> >> I would be happy to log this as a Bug if someone could send me advice on >> how to do so. >> >> >> >> Many thanks >> >> >> >> Emma >> >> >> >> >> >> *Emma Jolley*| Curator of Digital Archives, Pictures and Manuscripts >> Branch|National Library of Australia Canberra ACT 2600 >> e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms >> >> >> http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts >> >> >> >> >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ >> mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org >> ] *On Behalf Of >> *Chris Fitzpatrick >> *Sent:* Saturday, 15 November 2014 9:52 AM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi everyone, >> >> >> >> Thanks for this and sorry about the pain this has been causing. A few >> points: >> >> >> >> 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all >> versions of AS. >> >> >> >> 2) Payton from Hudson Molongo's patch is included into github now, but I >> still need to write tests for it. If you want the fix now, you can do a >> fresh build on the current version in github. and let us know if it works >> for you >> >> >> >> 3) In regards to process, I think the problem was that this was reported >> along with another similar issue involving instances re-ordering. Also, in >> trying to replicate this issue, I mistakenly assumed that it was strictly a >> "drag-and-drop" issue and was missing the key edit part of the problem, so >> I wasn't able to see the problem immediately. >> >> >> >> But, regardless, we all need to make sure that PT tickets get made for >> any bug or feature request. If its not in PT, it's probably not going to be >> addressed. >> >> >> >> I know not everyone has "create" access in Pivotal Tracker ( there's a >> license/cost issue there ), but there are quite a few colleagues who can >> submit tickets. >> >> >> >> I'm also trying to think of ways we can ensure discussions generated here >> get captured into tickets, with good suggestions. Anyone have some >> suggestions on things that work or that they think might work? >> >> >> >> Let me know what you think. >> >> >> >> best, >> >> chris >> >> >> >> >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Friday, November 14, 2014 9:51 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks to everyone who's been testing this and reporting back to the >> list. At Penn State we have not had a chance to test this yet as we haven't >> upgraded to 1.1, but I would just add that this particular bug has led us >> to effectively freeze all data entry at the component level of resource >> records, because the results are just too unpredictable and difficult to >> remediate. I suspect that other ASpace users might feel the same way. I >> would hope that ArchivesSpace could prioritize this fix for immediate >> release. >> >> >> >> Thanks, >> Ben >> >> >> >> >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> ------------------------------ >> >> *From: *"Lora Davis" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Friday, November 14, 2014 3:43:19 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - >> this happens at random but does not seem to be directly correlated (at >> least for us) to actually dragging/dropping/moving components. A case in >> point: I've been going through and adding access restriction notes to >> various components within existing administrative collections. Last week I >> clicked on several existing components in a resource record, added >> conditions governing access notes to those components, saved the changes, >> and went about the rest of my day. The following day I pulled up the >> resource to answer a reference question and, lo and behold, it appeared as >> if someone had dipped a giant wooden spoon into the cauldron that was the >> collection and stirred all the components about in an infuriatingly >> nonsensical way to make component soup of our previously well-ordered >> resource record. >> >> >> >> Payten - Thanks for sharing this code, but just to confirm, have you >> tested this fix against the scenario I describe (editing but not moving a >> component)? I just want clarification since the description for your patch >> ("Patch for drag and drop causing record to lose position/parent") does not >> align with the primary problem we are encountering. Again, thanks for your >> hard work. >> >> >> >> Chris - Do we have a timeline for this release? We are seeing many >> benefits to our transition to ArchivesSpace, but this problem has been a >> constant thorn in our sides since we first reported it in June. We had >> hoped that 1.1.0 would resolve this issue (as we'd been told it would), but >> we remain anxious for the day when we can rest assured that ArchivesSpace >> gnomes won't enter our resources at night and scramble them all about. >> >> >> >> Best, >> >> >> >> Lora Davis >> >> >> >> On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> Ah, awesome Payten. >> >> I couldn't get this to replicate and was thinking it was something in the >> backend. >> >> >> >> Will apply this and include it in the next release. >> >> Thanks! >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* Payten Giles >> *Sent:* Wednesday, November 12, 2014 5:44 AM >> *To:* Chris Fitzpatrick; Archivesspace Users Group >> >> >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi there Chris, Allyson, >> >> >> >> Eavesdropping a little bit and the guilt of writing this code became too >> much! >> >> >> >> Chris, this looks like a little bug in the tree.js where we aren?t >> checking the correct node.. the comment says the right thing while the code >> does the wrong thing. Here?s a gist of a potential patch: >> >> >> >> https://gist.github.com/payten/649819e7f08d0de3e945 >> >> >> >> To replicate I have a Resource hierarchy something like this: >> >> >> >> - Resource >> >> - AO Parent >> >> - AO Child 1 >> >> - AO Child 2 >> >> - AO Child 3 >> >> - AO Child 4 >> >> >> >> I select and go to edit ?AO Child 3?. When that form is visible I drag >> ?AO Child 4? above to become the first sibling. I then continue to edit >> ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly >> under ?Resource?. >> >> >> >> Happy to put together a more formal pull request if you like. >> >> >> >> Cheers, >> >> Payten >> >> >> >> On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> >> >> Hi Allyson, >> >> >> >> Unfortuantely, I haven't been able to replicate the problem of component >> movements not sticking. See => >> >> >> https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing >> ) >> >> >> >> In edit mode, I'm able to drag and drop components, reload the page, or >> go to the view page. >> >> >> >> Is this happening for every record every time for you? Or is it an >> infrequent thing? >> >> >> >> Not doubting you ( I promise! ) , just trying to see when this is >> happening... >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Allyson Smally >> *Sent:* Friday, November 07, 2014 6:04 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hello all - >> >> Unfortunately, after upgrading to the newest release, we are still having >> this problem. >> >> Archival objects are reordering themselves after being edited. >> >> Is anyone else still having this problem? Does anyone know of a solution? >> >> Thanks very much, >> >> Allyson >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman wrote: >> >> Hi Chris, >> >> >> >> Archival object tree. >> >> >> >> Thanks! >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Chris Fitzpatrick" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Thursday, September 25, 2014 3:46:10 AM >> >> >> *Subject: *Re: [Archivesspace_Users_Group] reordering >> objects in resource records >> >> >> >> Hey Ben, >> >> >> >> Soon, I promise! >> >> >> >> But just to check, are you talking about reording the archival object >> tree for the resource or the order of things like notes and subjects? >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Tuesday, September 23, 2014 10:19 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks, Allyson. I knew it sounded familiar! >> >> >> >> Do we have an ETA on the next release yet? :) >> >> >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Allyson Smally" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Tuesday, September 23, 2014 4:15:04 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi Ben, >> >> >> >> Yes, from what I understand this is a known issue. It has been happening >> to us a lot as well. >> >> At SAA this August, I was told it would be fixed in the next release. >> >> >> >> -Allyson >> >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman wrote: >> >> Hello, >> >> >> >> I've just experienced an issue and on a cursory search can't tell if it's >> been noted in PivotalTracker yet or discussed here yet. >> >> >> >> I've been editing an inventory object-by-object in a resource record, >> saving each object as I updated it. In one instance I reordered one of the >> objects by dragging it further down the tree, then continued editing other >> objects. Then I reached an object that could be removed, clicked to delete >> it, the resource reloaded in View mode, and the objects appeared to >> shuffle, and not seemingly in the order I started with. >> >> >> >> -Ben >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> >> >> >> -- >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> >> -- >> >> Lora J. Davis >> Assistant Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> >> Tel: (315) 228-6376 >> Fax: (315) 228-7934 >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> > > > -- > Lora J. Davis > Collections Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > Tel: (315) 228-6376 > Fax: (315) 228-7934 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 12:59:01 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 16:59:01 +0000 Subject: [Archivesspace_Users_Group] Multiselect Ordering In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu> , Message-ID: Hey Allyson, Yeah, I didn't know about it either until I went through the code last summer trying to figure how everything worked. It seemed like it was intentional but it took me awhile to figure out why...turns out it's kind of nice feature. For example, look at this screen grab: [cid:6385461a-6037-4b39-b75c-f1063c63f53d] Let's say I Ctl- select Folders 7,8,9,10,11 in that order then move them to the top of the list. The result is: [cid:b28eb0a0-4848-4d68-bfd9-a9d071e4019e] Items with Folder 7, 8, 9, 10, 11 are now in the order I selected. Maybe unexpected, but useful. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Allyson Smally Sent: Thursday, August 13, 2015 6:32 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Multiselect Ordering This was actually the issue I had just noticed here at Colgate. Thank you for the explanation - I understand now, although it is not really a functionality I would have expected if you had not brought it to our attention. - Allyson On Thu, Aug 13, 2015 at 11:39 AM, Chris Fitzpatrick > wrote: Hi, Just a quick note related to the reordering issues... One thing I've notice that some people are not aware of is that the multiselect batch moves depend on the order in which you multiselect. For example, if you first select an Archival Object and shift select several records above it, then move those records in a block, you're block will be moved in inverted order. For example: AO 1 AO 2 AO 3 AO 4 AO 5 If I select AO 4, then shift select AO 3 and AO 2 and move them to above AO 1, my result will be: AO 4 AO 3 AO 2 AO 1 AO 5 The same is for ctl- select. The block you're moving depends on the order you select. This is the intended functionality... Does this explanation make sense? best ,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Chris Fitzpatrick Sent: Thursday, August 13, 2015 5:33 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Ben, Sure, I guess I would start out again by just mentioning again that part of the problem with this problem is that it's not a problem, but rather a series of problems. We've been closing out a lot of the issues, but since there's so much going on in ArchivesSpace, it's really dependent on a lot of factors. So, it's really helpful to know a few things...one would be a general description of the record ( Accession? Resource? Digital Object? Archival Object? Digital Object Component? Classification? ). And especially the size of the records involved ( especially the number of records you tried to move and how many siblings that record has ). Also good to know if your data was imported from an EAD, migrated from Archon/AT, or made from scratch in the application. Also good to know if you've done any transfers for this data ( although these issues have been mostly fixed, I believe ). It's also helpful to know what the user did. Did they click on one record and try and move it or Was it a multiselected batch? Was the multiselect a shift- multiselect or a ctl- multiselect? Did you start from the top and go down on the multiselect or from the bottom and then go up? If it was a ctl- multiselect, what order did you select the records? (more on this in a followup email ) Did you move the record(s) down the list in the same series or up the list in the same series? Or did you re-parent the records into a new series? And it's really helpful if you can replicate this somewhere we can look at the records. Like in the sandbox or test.archivesspace.org. Also very helpful if people can test out changes we've made on the dev releases prior to the version release. We have people on the TAC and UAC testing this out, so if people want to volunteer to test, I think they would be welcome. And, of course, it would be really great it the community could start troubleshooting locally and producing code fixes ( or at least tests ) and sending in pull-requests. In regards to tracking, I'd mention we do have a Jira issue tracker, but I'd leave it to the community to decide what's the best way to track these kinds of support issues... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Thursday, August 13, 2015 4:35 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Chris, Could you just take a moment to lay out for us what specific information is required to troubleshoot this issue, so we can all start collecting/sharing data in a helpful way? What specific information about the server environment do you need to know? And how would you like us to share what the data looks like? Would attaching an XML version of the record suffice? And is there a better way to collect this data from the institutions experiencing this issue than the listserv? I think it may be worth looking for ways we as a community can start working more stridently toward a solution on this. It's disconcerting this issue has lingered through several versions of ASpace especially since, as Emma suggested, this issue is kind of a deal-breaker when encountered. It not only stifles work, it also creates distrust by users working in the system, which works against our efforts to advocate for ASpace locally at our institutions, and more broadly in the archives community. Thanks, Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, August 13, 2015 10:09:46 AM Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Lora Davis > Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Screen Shot 2015-08-04 at 21.04.27.png Type: image/png Size: 1747620 bytes Desc: Screen Shot 2015-08-04 at 21.04.27.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Screen Shot 2015-08-04 at 21.05.03.png Type: image/png Size: 1817292 bytes Desc: Screen Shot 2015-08-04 at 21.05.03.png URL: From Chris.Fitzpatrick at lyrasis.org Thu Aug 13 13:09:36 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Thu, 13 Aug 2015 17:09:36 +0000 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72BD46@EXMBX1.shire.nla.gov.au> , <2104337286.2828362.1439476517022.JavaMail.zimbra@psu.edu>, Message-ID: Also, I realized I forgot to point out the existing ticket we have for this in Jira : https://archivesspace.atlassian.net/browse/AR-1183 Noah Huffman and Kari Smith have both been really helpful banging away on this on our test server. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Chris Fitzpatrick Sent: Thursday, August 13, 2015 5:33 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Ben, Sure, I guess I would start out again by just mentioning again that part of the problem with this problem is that it's not a problem, but rather a series of problems. We've been closing out a lot of the issues, but since there's so much going on in ArchivesSpace, it's really dependent on a lot of factors. So, it's really helpful to know a few things...one would be a general description of the record ( Accession? Resource? Digital Object? Archival Object? Digital Object Component? Classification? ). And especially the size of the records involved ( especially the number of records you tried to move and how many siblings that record has ). Also good to know if your data was imported from an EAD, migrated from Archon/AT, or made from scratch in the application. Also good to know if you've done any transfers for this data ( although these issues have been mostly fixed, I believe ). It's also helpful to know what the user did. Did they click on one record and try and move it or Was it a multiselected batch? Was the multiselect a shift- multiselect or a ctl- multiselect? Did you start from the top and go down on the multiselect or from the bottom and then go up? If it was a ctl- multiselect, what order did you select the records? (more on this in a followup email ) Did you move the record(s) down the list in the same series or up the list in the same series? Or did you re-parent the records into a new series? And it's really helpful if you can replicate this somewhere we can look at the records. Like in the sandbox or test.archivesspace.org. Also very helpful if people can test out changes we've made on the dev releases prior to the version release. We have people on the TAC and UAC testing this out, so if people want to volunteer to test, I think they would be welcome. And, of course, it would be really great it the community could start troubleshooting locally and producing code fixes ( or at least tests ) and sending in pull-requests. In regards to tracking, I'd mention we do have a Jira issue tracker, but I'd leave it to the community to decide what's the best way to track these kinds of support issues... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Ben Goldman Sent: Thursday, August 13, 2015 4:35 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Chris, Could you just take a moment to lay out for us what specific information is required to troubleshoot this issue, so we can all start collecting/sharing data in a helpful way? What specific information about the server environment do you need to know? And how would you like us to share what the data looks like? Would attaching an XML version of the record suffice? And is there a better way to collect this data from the institutions experiencing this issue than the listserv? I think it may be worth looking for ways we as a community can start working more stridently toward a solution on this. It's disconcerting this issue has lingered through several versions of ASpace especially since, as Emma suggested, this issue is kind of a deal-breaker when encountered. It not only stifles work, it also creates distrust by users working in the system, which works against our efforts to advocate for ASpace locally at our institutions, and more broadly in the archives community. Thanks, Ben Ben Goldman Digital Records Archivist & Sally W. Kalin Early Career Librarian for Technological Innovations Penn State University Libraries ________________________________ From: "Chris Fitzpatrick" To: "Archivesspace Users Group" Sent: Thursday, August 13, 2015 10:09:46 AM Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Lora, Thanks. One thing to keep in mind is that LYRASIS hosting is separate from the ArchivesSpace, so if you're having problems with the application, you should send that information to the ArchivesSpace project team if you want support from us on it ( "us" being ArchivesSpace and not LYRASIS ). Also, going through all these "reordering issues", one of the problems with troubleshooting this has been it is heavily depending on how the data is structured, what user is doing, and the server environment. So, it's really helpful to get a description of what the data looks like, what actions the user was doing, and your server environment ( in your case, you're hosted, which is enough information ). best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Lora Davis Sent: Thursday, August 13, 2015 3:59 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical All, Just a quick between-meetings post to note that we at Colgate (Lyrasis hosted) are also seeing a reappearance of this component reordering trouble. Our Processing Archivist will contribute a longer post detailing the issues she's had (including a new behavior we've never encountered before) later today, but for now I wanted to jump in and say "us too." As a hosted instance we have also reported these issues to Lyrasis as well. Best, Lora On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick > wrote: Hi Patrick, It's on the MySQL server that there's usually a bottleneck. What are the setting there? Also, it's probably a good idea to try out the dev releases and see if you run into these issues. You can download the latest here: https://github.com/archivesspace/archivesspace/releases [https://avatars2.githubusercontent.com/u/1311559?v=3&s=400] Releases ? archivesspace/archivesspace ? GitHub archivesspace - The ArchivesSpace archives management tool Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Thursday, August 13, 2015 2:58 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Chris, I?ll chime in and say that reordering has continued with the update to 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the problem, but two archivists have identified that it still happens at the RAC. Sometimes the finding aids are large, but sometimes they are just medium sized. We only have AS running on our VM, and it should have plenty of ram. See top information below: top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:38 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Hi Emma, How much RAM do you have for the application and for the MySQL server? When reordering components with lots of siblings ( hundreds or thousands ), the positions of all the sibling components need to be updated. If you're running into a bottle neck on the server, this can timeout and cause the reordering to be incomplete. There is some documentation on performance here : http://archivesspace.github.io/archivesspace/ I've recently added some code that freezes the tree until the move operation has been completed, which should help with this problem. Closing the record does not actually do anything other than change the browser's page. If you refresh the page, it will refresh the tree as well. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Thursday, August 13, 2015 3:50 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Dear ArchivesSpace We are continuing to encounter the component re-ordering problem when we edit resources even though we have recently upgraded to the latest version of ArchivesSpace. For example, we created a new resource record by importing an EAD XML finding aid to ArchivesSpace. We then started editing the resource record, creating new components and moving existing components around the component hierarchy. Screenshots of the edited version, prior to closing the resource record, are attached (Set 1). As soon as the resource record was closed, many of the components re-ordered themselves (see screenshots Set 2). We then tried re-re-ordering the components, one change at a time (Edit - change ? Close, Edit ? change ? Close, etc.). Following this method, the preferred order of components did seem to ?stick?. However, this is not a viable solution as this adds significantly to the time required to make even minor changes to resource records and will greatly hamper our use of ArchivesSpace for resource description and is virtually impossible when dealing with some of our larger collections which have thousands of components in them. This is extremely frustrating and means that we are unable to undertake any detailed work or data entry at component level of Resource Records as it is too difficult to use. This is a critical problem for us as we are currently in a massive finding-aid project that requires extensive work on resource records. Is there any advice on the delivery of a solution to this problem? It seems to have been around for a long time and we would be extremely grateful to see an urgent solution. I would be happy to log this as a Bug if someone could send me advice on how to do so. Many thanks Emma Emma Jolley| Curator of Digital Archives, Pictures and Manuscripts Branch|National Library of Australia Canberra ACT 2600 e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Saturday, 15 November 2014 9:52 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi everyone, Thanks for this and sorry about the pain this has been causing. A few points: 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all versions of AS. 2) Payton from Hudson Molongo's patch is included into github now, but I still need to write tests for it. If you want the fix now, you can do a fresh build on the current version in github. and let us know if it works for you 3) In regards to process, I think the problem was that this was reported along with another similar issue involving instances re-ordering. Also, in trying to replicate this issue, I mistakenly assumed that it was strictly a "drag-and-drop" issue and was missing the key edit part of the problem, so I wasn't able to see the problem immediately. But, regardless, we all need to make sure that PT tickets get made for any bug or feature request. If its not in PT, it's probably not going to be addressed. I know not everyone has "create" access in Pivotal Tracker ( there's a license/cost issue there ), but there are quite a few colleagues who can submit tickets. I'm also trying to think of ways we can ensure discussions generated here get captured into tickets, with good suggestions. Anyone have some suggestions on things that work or that they think might work? Let me know what you think. best, chris Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Friday, November 14, 2014 9:51 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks to everyone who's been testing this and reporting back to the list. At Penn State we have not had a chance to test this yet as we haven't upgraded to 1.1, but I would just add that this particular bug has led us to effectively freeze all data entry at the component level of resource records, because the results are just too unpredictable and difficult to remediate. I suspect that other ASpace users might feel the same way. I would hope that ArchivesSpace could prioritize this fix for immediate release. Thanks, Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html ________________________________ From: "Lora Davis" > To: "Archivesspace Users Group" > Sent: Friday, November 14, 2014 3:43:19 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - this happens at random but does not seem to be directly correlated (at least for us) to actually dragging/dropping/moving components. A case in point: I've been going through and adding access restriction notes to various components within existing administrative collections. Last week I clicked on several existing components in a resource record, added conditions governing access notes to those components, saved the changes, and went about the rest of my day. The following day I pulled up the resource to answer a reference question and, lo and behold, it appeared as if someone had dipped a giant wooden spoon into the cauldron that was the collection and stirred all the components about in an infuriatingly nonsensical way to make component soup of our previously well-ordered resource record. Payten - Thanks for sharing this code, but just to confirm, have you tested this fix against the scenario I describe (editing but not moving a component)? I just want clarification since the description for your patch ("Patch for drag and drop causing record to lose position/parent") does not align with the primary problem we are encountering. Again, thanks for your hard work. Chris - Do we have a timeline for this release? We are seeing many benefits to our transition to ArchivesSpace, but this problem has been a constant thorn in our sides since we first reported it in June. We had hoped that 1.1.0 would resolve this issue (as we'd been told it would), but we remain anxious for the day when we can rest assured that ArchivesSpace gnomes won't enter our resources at night and scramble them all about. Best, Lora Davis On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick > wrote: Ah, awesome Payten. I couldn't get this to replicate and was thinking it was something in the backend. Will apply this and include it in the next release. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: Payten Giles > Sent: Wednesday, November 12, 2014 5:44 AM To: Chris Fitzpatrick; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi there Chris, Allyson, Eavesdropping a little bit and the guilt of writing this code became too much! Chris, this looks like a little bug in the tree.js where we aren?t checking the correct node.. the comment says the right thing while the code does the wrong thing. Here?s a gist of a potential patch: https://gist.github.com/payten/649819e7f08d0de3e945 To replicate I have a Resource hierarchy something like this: - Resource - AO Parent - AO Child 1 - AO Child 2 - AO Child 3 - AO Child 4 I select and go to edit ?AO Child 3?. When that form is visible I drag ?AO Child 4? above to become the first sibling. I then continue to edit ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly under ?Resource?. Happy to put together a more formal pull request if you like. Cheers, Payten On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick > wrote: Hi Allyson, Unfortuantely, I haven't been able to replicate the problem of component movements not sticking. See => https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing ) In edit mode, I'm able to drag and drop components, reload the page, or go to the view page. Is this happening for every record every time for you? Or is it an infrequent thing? Not doubting you ( I promise! ) , just trying to see when this is happening... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Allyson Smally > Sent: Friday, November 07, 2014 6:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hello all - Unfortunately, after upgrading to the newest release, we are still having this problem. Archival objects are reordering themselves after being edited. Is anyone else still having this problem? Does anyone know of a solution? Thanks very much, Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman > wrote: Hi Chris, Archival object tree. Thanks! -Ben ________________________________ From: "Chris Fitzpatrick" > To: "Archivesspace Users Group" > Sent: Thursday, September 25, 2014 3:46:10 AM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hey Ben, Soon, I promise! But just to check, are you talking about reording the archival object tree for the resource or the order of things like notes and subjects? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Ben Goldman > Sent: Tuesday, September 23, 2014 10:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Thanks, Allyson. I knew it sounded familiar! Do we have an ETA on the next release yet? :) -Ben ________________________________ From: "Allyson Smally" > To: "Archivesspace Users Group" > Sent: Tuesday, September 23, 2014 4:15:04 PM Subject: Re: [Archivesspace_Users_Group] reordering objects in resource records Hi Ben, Yes, from what I understand this is a known issue. It has been happening to us a lot as well. At SAA this August, I was told it would be fixed in the next release. -Allyson Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman > wrote: Hello, I've just experienced an issue and on a cursory search can't tell if it's been noted in PivotalTracker yet or discussed here yet. I've been editing an inventory object-by-object in a resource record, saving each object as I updated it. In one instance I reordered one of the objects by dragging it further down the tree, then continued editing other objects. Then I reached an object that could be removed, clicked to delete it, the resource reloaded in View mode, and the objects appeared to shuffle, and not seemingly in the order I started with. -Ben Ben Goldman Digital Records Archivist Penn State University Libraries University Park, PA 814-863-8333 http://www.libraries.psu.edu/psul/speccolls.html -- Allyson E. Smally Processing Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 (315) 228-7867 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Assistant Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From ljdavis at colgate.edu Thu Aug 13 15:01:24 2015 From: ljdavis at colgate.edu (Lora Davis) Date: Thu, 13 Aug 2015 15:01:24 -0400 Subject: [Archivesspace_Users_Group] Continuing Problem in Re-Ordering of components - Critical Message-ID: Hi Chris, Yes, understood. We initially reported this problem to Lyrasis as we assumed (it now seems incorrectly) that the return of the reordering problem stemmed from other issues we seem to be having (we've been encountering a number of gateway timeouts since the 1.3 upgrade). Knowing how the iterative process of triggering a move of multiple components at once can hit the system and given that we'd been experiencing other responsiveness issues with our hosted instance, we just assumed that the problem was most appropriately submitted to our Lyrasis hosts. Similarly, there were no other reports of others experiencing this issue that I had encountered prior to Emma's post this morning. As soon as I saw Emma's post, I realized that our assumptions were incorrect; this isn't a hosting issue, its a bug others are encountering as well and, therefore, should go to the development team. Anyway, I'd also like to also reemphasize what Ben asked - can we as a community of users (and not just the developers, of course) think of a better way to share *detailed data* regarding these issues than the listserv? And, by extension, can we come to some agreement on what the role of this listserv is in sharing,* more generally*, news/updates/reports/summaries of these issues? To my mind (though I may be alone), there is value in using this list to share initial, "Yea, me too!" or "Has anyone had this weird thing happen?" type posts. Indeed, the "How to Report a Bug" documentation encourages us to, "post a message to the ArchivesSpace Users Group list, asking for help in understanding and verifying the bug you encountered." I really appreciate the sharing that goes on here - discussions of others' plugin developments, conversations about the theoretical implications of some of the development decisions that have been made (e.g. the rights transferred module migrations), and how the ASpace tool can inform evolving best practices for encoding (e.g. recent barcode discussions); but there is also immense value (at least for me) in this list serving as a quick "gut check" venue when we initially suspect we've encountered a problem, but when we aren't all the way convinced it's time to submit a bug report just yet. As a small shop we often feel overwhelmed by the prospect of taking the time to do our due diligence and fully and completely record our issues (including, trying to make a guess as to whether the issue stems from the application or the host), prior to officially submitting them as a bug. Ok, enough of that, and sorry to add yet another listserv post about how to use a listserv to my fellow archivists' inboxes (I'm looking at you A&A), but this is something I've been wondering about for a while. I recognize how easy it is to say, "This isn't working for us," and how difficult it can be address these issues but, yea, this isn't working for us. Indeed, we've even taken the step of adding a "how to report ArchivesSpace problems" to our local front desk manual because there's so many questions to consider when we feel like we might have unearthed a quirk or bug. Best and happy travels to Cleveland for those of you heading off next week, Lora On Thu, Aug 13, 2015 at 10:09 AM, Chris Fitzpatrick < Chris.Fitzpatrick at lyrasis.org> wrote: > Hi Lora, > > > Thanks. One thing to keep in mind is that LYRASIS hosting is separate from > the ArchivesSpace, so if you're having problems with the application, you > should send that information to the ArchivesSpace project team if you want > support from us on it ( "us" being ArchivesSpace and not LYRASIS ). > > > Also, going through all these "reordering issues", one of the problems > with troubleshooting this has been it is heavily depending on how the data > is structured, what user is doing, and the server environment. So, it's > really helpful to get a description of what the data looks like, what > actions the user was doing, and your server environment ( in your case, > you're hosted, which is enough information ). > > > best, chris. > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Lora Davis > *Sent:* Thursday, August 13, 2015 3:59 PM > > *To:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in > Re-Ordering of components - Critical > > All, > > Just a quick between-meetings post to note that we at Colgate (Lyrasis > hosted) are also seeing a reappearance of this component reordering > trouble. Our Processing Archivist will contribute a longer post detailing > the issues she's had (including a new behavior we've never encountered > before) later today, but for now I wanted to jump in and say "us too." > > As a hosted instance we have also reported these issues to Lyrasis as well. > > Best, > > Lora > > On Thu, Aug 13, 2015 at 9:34 AM, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > >> >> Hi Patrick, >> >> >> It's on the MySQL server that there's usually a bottleneck. What are the >> setting there? >> >> >> Also, it's probably a good idea to try out the dev releases and see if >> you run into these issues. You can download the latest here: >> >> https://github.com/archivesspace/archivesspace/releases >> >> Releases ? archivesspace/archivesspace ? GitHub >> archivesspace - The ArchivesSpace archives management tool >> Read more... >> >> >> >> >> b,chris. >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Galligan, Patrick >> *Sent:* Thursday, August 13, 2015 2:58 PM >> *To:* Archivesspace Users Group >> >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> Chris, >> >> >> >> I?ll chime in and say that reordering has continued with the update to >> 1.3.0. I have not resequenced since the upgrade, which MIGHT fix the >> problem, but two archivists have identified that it still happens at the >> RAC. Sometimes the finding aids are large, but sometimes they are just >> medium sized. >> >> >> >> We only have AS running on our VM, and it should have plenty of ram. See >> top information below: >> >> >> >> top - 08:56:43 up 44 days, 23:58, 1 user, load average: 0.36, 0.11, 0.03 >> >> Tasks: 181 total, 1 running, 180 sleeping, 0 stopped, 0 zombie >> >> Cpu(s): 0.2%us, 0.7%sy, 0.0%ni, 98.8%id, 0.2%wa, 0.0%hi, 0.0%si, >> 0.0%st >> >> Mem: 10131060k total, 9929312k used, 201748k free, 106888k buffers >> >> Swap: 6160376k total, 30592k used, 6129784k free, 7918028k cached >> >> >> >> Patrick Galligan >> >> Rockefeller Archive Center >> >> Assistant Digital Archivist >> >> 914-366-6386 >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: >> archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Chris >> Fitzpatrick >> *Sent:* Thursday, August 13, 2015 8:38 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* Re: [Archivesspace_Users_Group] Continuing Problem in >> Re-Ordering of components - Critical >> >> >> >> >> >> Hi Emma, >> >> >> >> How much RAM do you have for the application and for the MySQL server? >> When reordering components with lots of siblings ( hundreds or thousands ), >> the positions of all the sibling components need to be updated. If you're >> running into a bottle neck on the server, this can timeout and cause the >> reordering to be incomplete. >> >> >> >> There is some documentation on performance here : >> http://archivesspace.github.io/archivesspace/ >> >> >> >> I've recently added some code that freezes the tree until the move >> operation has been completed, which should help with this problem. Closing >> the record does not actually do anything other than change the browser's >> page. If you refresh the page, it will refresh the tree as well. >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> >> >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Emma Jolley >> *Sent:* Thursday, August 13, 2015 3:50 AM >> *To:* Archivesspace Users Group ( >> archivesspace_users_group at lyralists.lyrasis.org) >> *Subject:* [Archivesspace_Users_Group] Continuing Problem in Re-Ordering >> of components - Critical >> >> >> >> Dear ArchivesSpace >> >> >> >> We are continuing to encounter the component re-ordering problem when we >> edit resources even though we have recently upgraded to the latest version >> of ArchivesSpace. >> >> >> >> For example, we created a new resource record by importing an EAD XML >> finding aid to ArchivesSpace. We then started editing the resource record, >> creating new components and moving existing components around the component >> hierarchy. Screenshots of the edited version, prior to closing the >> resource record, are attached (Set 1). As soon as the resource record was >> closed, many of the components re-ordered themselves (see screenshots Set >> 2). >> >> >> >> We then tried re-re-ordering the components, one change at a time (Edit - >> change ? Close, Edit ? change ? Close, etc.). Following this method, the >> preferred order of components did seem to ?stick?. However, this is not a >> viable solution as this adds significantly to the time required to make >> even minor changes to resource records and will greatly hamper our use of >> ArchivesSpace for resource description and is virtually impossible when >> dealing with some of our larger collections which have thousands of >> components in them. >> >> >> >> This is extremely frustrating and means that we are unable to undertake >> any detailed work or data entry at component level of Resource Records as >> it is too difficult to use. This is a *critical* *problem* for us as we >> are currently in a massive finding-aid project that requires extensive work >> on resource records. >> >> >> >> Is there any advice on the delivery of a solution to this problem? It >> seems to have been around for a long time and we would be extremely >> grateful to see an urgent solution. >> >> >> >> I would be happy to log this as a Bug if someone could send me advice on >> how to do so. >> >> >> >> Many thanks >> >> >> >> Emma >> >> >> >> >> >> *Emma Jolley*| Curator of Digital Archives, Pictures and Manuscripts >> Branch|National Library of Australia Canberra ACT 2600 >> e: emma.jolley at nla.gov.au|t: 02 6262 1456| www.nla.gov.au/ms >> >> >> http://www.nla.gov.au/support-us/make-a-collection-offer-pictures-and-manuscripts >> >> >> >> >> >> >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ >> mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org >> ] *On Behalf Of >> *Chris Fitzpatrick >> *Sent:* Saturday, 15 November 2014 9:52 AM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi everyone, >> >> >> >> Thanks for this and sorry about the pain this has been causing. A few >> points: >> >> >> >> 1) Just to clarify, this isn't a 1.1.0 bug. It's actually affects all >> versions of AS. >> >> >> >> 2) Payton from Hudson Molongo's patch is included into github now, but I >> still need to write tests for it. If you want the fix now, you can do a >> fresh build on the current version in github. and let us know if it works >> for you >> >> >> >> 3) In regards to process, I think the problem was that this was reported >> along with another similar issue involving instances re-ordering. Also, in >> trying to replicate this issue, I mistakenly assumed that it was strictly a >> "drag-and-drop" issue and was missing the key edit part of the problem, so >> I wasn't able to see the problem immediately. >> >> >> >> But, regardless, we all need to make sure that PT tickets get made for >> any bug or feature request. If its not in PT, it's probably not going to be >> addressed. >> >> >> >> I know not everyone has "create" access in Pivotal Tracker ( there's a >> license/cost issue there ), but there are quite a few colleagues who can >> submit tickets. >> >> >> >> I'm also trying to think of ways we can ensure discussions generated here >> get captured into tickets, with good suggestions. Anyone have some >> suggestions on things that work or that they think might work? >> >> >> >> Let me know what you think. >> >> >> >> best, >> >> chris >> >> >> >> >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Friday, November 14, 2014 9:51 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks to everyone who's been testing this and reporting back to the >> list. At Penn State we have not had a chance to test this yet as we haven't >> upgraded to 1.1, but I would just add that this particular bug has led us >> to effectively freeze all data entry at the component level of resource >> records, because the results are just too unpredictable and difficult to >> remediate. I suspect that other ASpace users might feel the same way. I >> would hope that ArchivesSpace could prioritize this fix for immediate >> release. >> >> >> >> Thanks, >> Ben >> >> >> >> >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> ------------------------------ >> >> *From: *"Lora Davis" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Friday, November 14, 2014 3:43:19 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Yes, just to reiterate what Allyson, Elliot, and Teresa have shared - >> this happens at random but does not seem to be directly correlated (at >> least for us) to actually dragging/dropping/moving components. A case in >> point: I've been going through and adding access restriction notes to >> various components within existing administrative collections. Last week I >> clicked on several existing components in a resource record, added >> conditions governing access notes to those components, saved the changes, >> and went about the rest of my day. The following day I pulled up the >> resource to answer a reference question and, lo and behold, it appeared as >> if someone had dipped a giant wooden spoon into the cauldron that was the >> collection and stirred all the components about in an infuriatingly >> nonsensical way to make component soup of our previously well-ordered >> resource record. >> >> >> >> Payten - Thanks for sharing this code, but just to confirm, have you >> tested this fix against the scenario I describe (editing but not moving a >> component)? I just want clarification since the description for your patch >> ("Patch for drag and drop causing record to lose position/parent") does not >> align with the primary problem we are encountering. Again, thanks for your >> hard work. >> >> >> >> Chris - Do we have a timeline for this release? We are seeing many >> benefits to our transition to ArchivesSpace, but this problem has been a >> constant thorn in our sides since we first reported it in June. We had >> hoped that 1.1.0 would resolve this issue (as we'd been told it would), but >> we remain anxious for the day when we can rest assured that ArchivesSpace >> gnomes won't enter our resources at night and scramble them all about. >> >> >> >> Best, >> >> >> >> Lora Davis >> >> >> >> On Wed, Nov 12, 2014 at 8:40 AM, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> Ah, awesome Payten. >> >> I couldn't get this to replicate and was thinking it was something in the >> backend. >> >> >> >> Will apply this and include it in the next release. >> >> Thanks! >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* Payten Giles >> *Sent:* Wednesday, November 12, 2014 5:44 AM >> *To:* Chris Fitzpatrick; Archivesspace Users Group >> >> >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi there Chris, Allyson, >> >> >> >> Eavesdropping a little bit and the guilt of writing this code became too >> much! >> >> >> >> Chris, this looks like a little bug in the tree.js where we aren?t >> checking the correct node.. the comment says the right thing while the code >> does the wrong thing. Here?s a gist of a potential patch: >> >> >> >> https://gist.github.com/payten/649819e7f08d0de3e945 >> >> >> >> To replicate I have a Resource hierarchy something like this: >> >> >> >> - Resource >> >> - AO Parent >> >> - AO Child 1 >> >> - AO Child 2 >> >> - AO Child 3 >> >> - AO Child 4 >> >> >> >> I select and go to edit ?AO Child 3?. When that form is visible I drag >> ?AO Child 4? above to become the first sibling. I then continue to edit >> ?AO Child 3? and refresh the page. ?A0 Child 3? is now positioned directly >> under ?Resource?. >> >> >> >> Happy to put together a more formal pull request if you like. >> >> >> >> Cheers, >> >> Payten >> >> >> >> On 11 Nov 2014, at 12:53 am, Chris Fitzpatrick < >> Chris.Fitzpatrick at lyrasis.org> wrote: >> >> >> >> Hi Allyson, >> >> >> >> Unfortuantely, I haven't been able to replicate the problem of component >> movements not sticking. See => >> >> >> https://drive.google.com/file/d/0BzRF7huQ7tqKS29oM2RZZWNubGc/view?usp=sharing >> ) >> >> >> >> In edit mode, I'm able to drag and drop components, reload the page, or >> go to the view page. >> >> >> >> Is this happening for every record every time for you? Or is it an >> infrequent thing? >> >> >> >> Not doubting you ( I promise! ) , just trying to see when this is >> happening... >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Allyson Smally >> *Sent:* Friday, November 07, 2014 6:04 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hello all - >> >> Unfortunately, after upgrading to the newest release, we are still having >> this problem. >> >> Archival objects are reordering themselves after being edited. >> >> Is anyone else still having this problem? Does anyone know of a solution? >> >> Thanks very much, >> >> Allyson >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Thu, Sep 25, 2014 at 8:14 AM, Ben Goldman wrote: >> >> Hi Chris, >> >> >> >> Archival object tree. >> >> >> >> Thanks! >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Chris Fitzpatrick" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Thursday, September 25, 2014 3:46:10 AM >> >> >> *Subject: *Re: [Archivesspace_Users_Group] reordering >> objects in resource records >> >> >> >> Hey Ben, >> >> >> >> Soon, I promise! >> >> >> >> But just to check, are you talking about reording the archival object >> tree for the resource or the order of things like notes and subjects? >> >> >> >> b,chris. >> >> >> >> Chris Fitzpatrick | Developer, ArchivesSpace >> Skype: chrisfitzpat | Phone: 918.236.6048 >> http://archivesspace.org/ >> ------------------------------ >> >> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < >> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of >> Ben Goldman >> *Sent:* Tuesday, September 23, 2014 10:19 PM >> *To:* Archivesspace Users Group >> *Subject:* Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Thanks, Allyson. I knew it sounded familiar! >> >> >> >> Do we have an ETA on the next release yet? :) >> >> >> >> -Ben >> >> >> ------------------------------ >> >> *From: *"Allyson Smally" >> *To: *"Archivesspace Users Group" < >> archivesspace_users_group at lyralists.lyrasis.org> >> *Sent: *Tuesday, September 23, 2014 4:15:04 PM >> *Subject: *Re: [Archivesspace_Users_Group] reordering objects in >> resource records >> >> >> >> Hi Ben, >> >> >> >> Yes, from what I understand this is a known issue. It has been happening >> to us a lot as well. >> >> At SAA this August, I was told it would be fixed in the next release. >> >> >> >> -Allyson >> >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> >> >> On Tue, Sep 23, 2014 at 2:52 PM, Ben Goldman wrote: >> >> Hello, >> >> >> >> I've just experienced an issue and on a cursory search can't tell if it's >> been noted in PivotalTracker yet or discussed here yet. >> >> >> >> I've been editing an inventory object-by-object in a resource record, >> saving each object as I updated it. In one instance I reordered one of the >> objects by dragging it further down the tree, then continued editing other >> objects. Then I reached an object that could be removed, clicked to delete >> it, the resource reloaded in View mode, and the objects appeared to >> shuffle, and not seemingly in the order I started with. >> >> >> >> -Ben >> >> >> >> *Ben Goldman* >> Digital Records Archivist >> Penn State University Libraries >> University Park, PA >> 814-863-8333 >> http://www.libraries.psu.edu/psul/speccolls.html >> >> >> >> >> >> -- >> >> Allyson E. Smally >> Processing Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> (315) 228-7867 >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> >> >> -- >> >> Lora J. Davis >> Assistant Archivist >> Colgate University Libraries >> 13 Oak Drive >> Hamilton, NY 13346 >> >> Tel: (315) 228-6376 >> Fax: (315) 228-7934 >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> >> >> _______________________________________________ >> Archivesspace_Users_Group mailing list >> Archivesspace_Users_Group at lyralists.lyrasis.org >> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group >> >> > > > -- > Lora J. Davis > Collections Archivist > Colgate University Libraries > 13 Oak Drive > Hamilton, NY 13346 > Tel: (315) 228-6376 > Fax: (315) 228-7934 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Lora J. Davis Collections Archivist Colgate University Libraries 13 Oak Drive Hamilton, NY 13346 Tel: (315) 228-6376 Fax: (315) 228-7934 -------------- next part -------------- An HTML attachment was scrubbed... URL: From boyd.402 at osu.edu Thu Aug 13 15:19:20 2015 From: boyd.402 at osu.edu (Boyd, Morag) Date: Thu, 13 Aug 2015 19:19:20 +0000 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: <91838E17DB562E49861555BB8B87F08A41CF5B8E@ITSNT438.iowa.uiowa.edu> References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> , <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> <91838E17DB562E49861555BB8B87F08A41CF5B8E@ITSNT438.iowa.uiowa.edu> Message-ID: Hello, We have experienced the accidental deletion of an entire resource twice here at Ohio State. In both cases, the logs indicated it occurred when a user was deleting multiple components. It seems that the first deletion had not yet completed (unbeknownst to the them as there was no visual indication) when the user selected the next component. This meant when the page fully refreshed, the top level was selected and the entire resource deleted. I believe this issue is described in JIRA (https://archivesspace.atlassian.net/browse/AR-1132) and was one of the top vote getters in recent round of voting on development priorities (https://archivesspace.atlassian.net/browse/AR-1182?filter=10800). Our developers were able to restore the data, but it took many hours and was complicated, particularly for the notes. The second time it happened we had a recent copy in our test environment, so we determined it was not worth the estimated 8 hours of developer time to restore it, and exported/imported the EAD instead. We completely agree that some kind of confirmation of what is being deleted, as long with a restore option, would be ideal. Good luck! Morag [The Ohio State University] Morag Boyd, MS(LIS), MA Head, Special Collections Description and Access Associate Professor The Ohio State University Libraries 16 Thompson Library, 1858 Neil Ave Mall, Columbus, OH 43210 614-247-8622 Office boyd.402 at osu.edu library.osu.edu From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Holland, Andrew S Sent: Thursday, August 13, 2015 9:43 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Chris, Here's our log file. I tried doing some searches for record IDs that I knew were deleted, but wasn't coming up with anything... -Andrew Holland From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:32 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Lindsay, I haven't heard of this happening. Can you send me your archivesspace.out log file? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Morecraft, Lindsay M > Sent: Thursday, August 13, 2015 3:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Patrick & ASpace community, Just about an hour after I sent my initial email, I had it happen again - so this is two times with two different members of our staff. I anticipate this will happen again, as we are undergoing an effort to clean up around 1000 finding aids that have been transferred from Archon. What we are doing is getting rid of boxes as archival objects, as there is container information in the instances, so having boxes listed as objects is repetitive. Perhaps a suggestion to those managing ArchivesSpace - when you are about to delete the record as a whole, have a special message box stating you are doing so, rather than have the same deletion warning for everything (archival objects vs entire collection record). Does anyone know if there is a way to retrieve a deleted record? This problem is very frustrating as we are losing hours of work, and any insight/advice would be appreciated. Also, we are using v.1.2.0. Thank you! Lindsay Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Thursday, August 13, 2015 7:54 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Lindsay, While I can't confirm because I haven't seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It's only happened once, and we can't really test for it, but I think it's possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don't want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 3605 bytes Desc: image001.png URL: From ns96 at nyu.edu Thu Aug 13 15:53:15 2015 From: ns96 at nyu.edu (Nathan Stevens) Date: Thu, 13 Aug 2015 15:53:15 -0400 Subject: [Archivesspace_Users_Group] Aspace public interface question In-Reply-To: References: Message-ID: H, Please send all such question to the Archivesspace User Group ( archivesspace_users_group at lyralists.lyrasis.org) On Thu, Aug 13, 2015 at 2:47 PM, Monique Sugimoto wrote: > Hi Nathan, > > I am a current user of Archivist Toolkit. This is being hosted by the > California Digital Library. I will soon be migrating to Aspace. I have a > question about the public side of the Aspace tool. > > As I understand it (and please correct me if I am wrong!), it is not > necessary to use the public access interface of Aspace? I heard several > institutions report at the Western Round-Up in Denver this year that they > migrated to Aspace, but are using their own public interface in conjunction > with the Aspace. > > If it is the case that using the public interface is *not* essential, can > you tell me how that might affect costs for a third-party hosting service. > I'm considering either the Amazon AWS (or some other site) and wanted to > know if by eliminating the need for an extra web server it would decrease > costs. > > We are a very *tiny* (but growing) archives. If I can cut costs > somewhere, I'd like to explore that. > > Thanks very much. > > Monique - > > > > Monique Leahey Sugimoto > Archivist & Adult Services Librarian > Palos Verdes Library District > 701 Silver Spur Road > Rolling Hills Estates, CA 90274 > P: 310-377-9584 ext 213 > F: 310-541-6807 > www.pvld.org > -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From helen.thomas at nicholls.edu Thu Aug 13 16:37:13 2015 From: helen.thomas at nicholls.edu (Helen Thomas) Date: Thu, 13 Aug 2015 15:37:13 -0500 Subject: [Archivesspace_Users_Group] Note headings and descriptions Message-ID: Hello all, I would like to add a content description to a file record, but when I utilize a Note field for this, the Note Type (or custom Label) appears as a header above my description. This looks okay online, but in the PDF version it is very odd to have that field appear as a header (in larger, bold font). Has anyone else found a more elegant solution to this problem? How are you all adding folder-level description? -- *Helen Thomas* Assistant Archivist Ellender Library, Nicholls State University helen.thomas at nicholls.edu | (985) 448-4644 -------------- next part -------------- An HTML attachment was scrubbed... URL: From brianjhoffman at gmail.com Thu Aug 13 22:37:14 2015 From: brianjhoffman at gmail.com (Brian Hoffman) Date: Thu, 13 Aug 2015 22:37:14 -0400 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> Message-ID: Is it possible that your database was restored from a backup or that you created your database elsewhere and then imported it into MySQL? If so, you may simply be missing the stored procedures the Jasper reports rely on. There is a PR concerning this issue here: https://github.com/archivesspace/archivesspace/pull/244 Brian > On Aug 7, 2015, at 5:49 AM, Chris Fitzpatrick wrote: > > > > Hi Emma, > > Can you look at what's being output into the log? > > The easiest way to see what the report is doing is to look at the Jasper XML, which you can see here =>https://github.com/archivesspace/archivesspace/blob/master/reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml#L20-L37 > > The basic SQL query is defined in the tag, with the formatting happening below. You can edit this file to fit your needs, then restart ASpace to have it recompiled. > > b,chris. > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Emma Jolley > Sent: Friday, August 7, 2015 7:13 AM > To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) > Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports > > Hi Chris > > We have had the same issues as Robin with the reports. We have tried to implement your suggested solutions below but now received the following error message which I?ve copied below. Any advice on this? > > In addition, I have asked previously but have never received an answer ? I wonder if there is any documentation on what criteria the reports use to identify records that meet the nominated criteria. For example what fields is used to indicate an unprocessed Accession and what field is used to indicate an uncatalogued accession? > > Many thanks > > Emma > > > > > From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org ] On Behalf Of Chris Fitzpatrick > Sent: Thursday, 6 August 2015 9:16 PM > To: Archivesspace Users Group > Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria > Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports > > > > Hi Robin, > > So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: > AppConfig[:compile_jasper] = true > > and restart ASpace. > > > This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) > > Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. > > In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio . Just be sure to recompile your reports. > > For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. > > best, Chris. > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of McElheny, Robin G. > > Sent: Wednesday, August 5, 2015 5:55 PM > To: Archivesspace Users Group > Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria > Subject: [Archivesspace_Users_Group] Problems with ASpace reports > > At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. > We didn?t see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them ? and how? > Record selection issues: > The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. > > > In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? > > Report format issues: > In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. > > Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" > > In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don?t do this. Some examples: > > In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). > > Here is a screen shot: > > Here?s another example: > > In the case of an HTML report, it displays page footers ? odd for online display. > > > Report failure/timeout: > We encountered many failures. > Example: > When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: > > Internal Server Error (500) > Request Method: GET > Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx > > (TypeError) can't convert nil into String > > You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. > > Another example: > > We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in ?Waiting for (server)? messages with no results. > > > Robin McElheny > Associate University Archivist for Collections and Public Services > Harvard University Archives > Pusey Library > Cambridge, MA 02138 > Email: robin_mcelheny at harvard.edu > Phone: 617-495-2461 > Fax: 617-495-8011 > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 03:07:35 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 07:07:35 +0000 Subject: [Archivesspace_Users_Group] Deleted records In-Reply-To: References: <96B305F061ED68428DDA721BECE2ED15516D1195@ITSNT440.iowa.uiowa.edu> , <96B305F061ED68428DDA721BECE2ED15516D1327@ITSNT440.iowa.uiowa.edu> <91838E17DB562E49861555BB8B87F08A41CF5B8E@ITSNT438.iowa.uiowa.edu>, Message-ID: Hi Morag, Thanks, this is helpful. This actually touches on a larger issue. The ticket you referenced ( AR-1132 ) is a feature request to have a delete confirmation. This ticket hasn't been added to a sprint yet by the features prioritization group yet ( AR-1182 is a mega-ticket that is spanning multiple sprints ), but Mark Cooper stepped in and submitted a pull request. This is all good, except I would say there is an assumption that this feature will fix the issue you're describing, which I'm not actually sure of. You're description is actually slightly different ( in a very important way) than the description in the ticket ( you're saying the delete hasn't completed yet ) and I'd would suggest what so this feature probably won't fix your issue. I've made a bug ticket for what you're describing here : https://archivesspace.atlassian.net/browse/AR-1313 But yes, if you see something in Jira or on the list or over hear something on the bus to work that impacts your Aspace work, definately chime in. Writing to the list is good, or better yet add a comment to the Jira ticket or best of ( gold star for Mr. Cooper ) all write some code or a test and send up a pull-request. best,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Boyd, Morag Sent: Thursday, August 13, 2015 9:19 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hello, We have experienced the accidental deletion of an entire resource twice here at Ohio State. In both cases, the logs indicated it occurred when a user was deleting multiple components. It seems that the first deletion had not yet completed (unbeknownst to the them as there was no visual indication) when the user selected the next component. This meant when the page fully refreshed, the top level was selected and the entire resource deleted. I believe this issue is described in JIRA (https://archivesspace.atlassian.net/browse/AR-1132) and was one of the top vote getters in recent round of voting on development priorities (https://archivesspace.atlassian.net/browse/AR-1182?filter=10800). Our developers were able to restore the data, but it took many hours and was complicated, particularly for the notes. The second time it happened we had a recent copy in our test environment, so we determined it was not worth the estimated 8 hours of developer time to restore it, and exported/imported the EAD instead. We completely agree that some kind of confirmation of what is being deleted, as long with a restore option, would be ideal. Good luck! Morag [The Ohio State University] Morag Boyd, MS(LIS), MA Head, Special Collections Description and Access Associate Professor The Ohio State University Libraries 16 Thompson Library, 1858 Neil Ave Mall, Columbus, OH 43210 614-247-8622 Office boyd.402 at osu.edu library.osu.edu From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Holland, Andrew S Sent: Thursday, August 13, 2015 9:43 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Chris, Here's our log file. I tried doing some searches for record IDs that I knew were deleted, but wasn't coming up with anything? -Andrew Holland From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, August 13, 2015 8:32 AM To: Archivesspace Users Group > Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Lindsay, I haven't heard of this happening. Can you send me your archivesspace.out log file? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Morecraft, Lindsay M > Sent: Thursday, August 13, 2015 3:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Hi Patrick & ASpace community, Just about an hour after I sent my initial email, I had it happen again ? so this is two times with two different members of our staff. I anticipate this will happen again, as we are undergoing an effort to clean up around 1000 finding aids that have been transferred from Archon. What we are doing is getting rid of boxes as archival objects, as there is container information in the instances, so having boxes listed as objects is repetitive. Perhaps a suggestion to those managing ArchivesSpace ? when you are about to delete the record as a whole, have a special message box stating you are doing so, rather than have the same deletion warning for everything (archival objects vs entire collection record). Does anyone know if there is a way to retrieve a deleted record? This problem is very frustrating as we are losing hours of work, and any insight/advice would be appreciated. Also, we are using v.1.2.0. Thank you! Lindsay Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Galligan, Patrick Sent: Thursday, August 13, 2015 7:54 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Deleted records Lindsay, While I can?t confirm because I haven?t seen it happen myself, I have a suspicion that something like what you described has happened at the RAC before. An archivist swore that they had the component selected, but the entire resource was deleted. It?s only happened once, and we can?t really test for it, but I think it?s possible that it happened here. We are using version 1.3.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Morecraft, Lindsay M Sent: Wednesday, August 12, 2015 4:27 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Deleted records Hello everyone, Just throwing this out to the ArchivesSpace community to see if anyone else has been having this problem. While attempting to delete an archival object within a collection, instead of deleting the single item, the entire collection was deleted instead. This was not the case of accidentally selecting the collection level of the hierarchy, as the object that we wanted to deleted was showing up below. Basically, it seemed like the entire collection deleted itself on accident, which we don?t want to happen again! Anyone else experience this, or something similar? Thank you, Lindsay Moen (Morecraft) Processing Librarian Special Collections and University Archives The University of Iowa 319-335-5921 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 3605 bytes Desc: image001.png URL: From EJOLLEY at nla.gov.au Fri Aug 14 03:31:06 2015 From: EJOLLEY at nla.gov.au (Emma Jolley) Date: Fri, 14 Aug 2015 07:31:06 +0000 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> Message-ID: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72D9D0@EXMBX1.shire.nla.gov.au> My apologies for not having sent through the information about the Log. I have to liaise for some time with our IT to get this information. They have sent me the following information which may be of help? Many thanks Emma **** The log entry when running (as an example) the report mentioned in the email below is: D, [2015-08-10T17:58:14.599000 #3236] DEBUG -- : Thread-10076116: GET /repositories/2/reports/accessionsunprocessedreport?lock_version=&format=json [session: nil] D, [2015-08-10T17:58:14.602000 #3236] DEBUG -- : Thread-10076116: Post-processed params: {:format=>"json", :repo_id=>2} D, [2015-08-10T17:58:14.892000 #3236] DEBUG -- : Thread-10076116: Responded with [404, {"Content-Type"=>"application/json; charset=UTF-8", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"144"}, ["{\"error\":{\"AccessionsUnprocessedReport\":[\"net.sf.jasperreports.engine.JRException: Error executing SQL statement for : accessionsUnprocessed\"]}}"]]... in 292.0ms Rendered shared/_breadcrumb.html.erb (1.0ms) Rendered /opt/archivesspace-1.3.0/archivesspace/plugins/nla_accession_reports/frontend/views/reports/index.html.erb within layouts/application (82.0ms) Rendered shared/_browser_support.html.erb (0.0ms) Rendered shared/_header_user.html.erb (6.0ms) Rendered shared/_header_global.html.erb (6.0ms) Rendered site/_branding.html.erb (0.0ms) Rendered shared/_advanced_search.html.erb (5.0ms) Rendered shared/_header_repository.html.erb (18.0ms) Rendered site/_footer.html.erb (0.0ms) Rendered shared/_templates.html.erb (2.0ms) Completed 200 OK in 448.0ms (Views: 114.0ms) Which is not helpful as it essentially just says exactly what gets displayed on the interface. net.sf.jasperreports.engine.JRException: Error executing SQL statement for : accessionsUnprocessed I've run the query in this report directly against the database successfully (cut and paste from reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml and substituting in the repo id) so I think the SQL itself is sound. Further info: The report config being used are: #AppConfig[:report_page_layout] = "letter landscape" AppConfig[:enable_jasper] = true AppConfig[:compile_jasper] = true I've tried with the report_page_layout both commented and uncommented. The java version is: java version "1.7.0_85" OpenJDK Runtime Environment (rhel-2.6.1.3.el6_7-x86_64 u85-b01) OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode) Could there be an issue with using the OpenJDK rather than Oracle's JDK perhaps ? From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Brian Hoffman Sent: Friday, 14 August 2015 12:37 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Is it possible that your database was restored from a backup or that you created your database elsewhere and then imported it into MySQL? If so, you may simply be missing the stored procedures the Jasper reports rely on. There is a PR concerning this issue here: https://github.com/archivesspace/archivesspace/pull/244 Brian On Aug 7, 2015, at 5:49 AM, Chris Fitzpatrick > wrote: Hi Emma, Can you look at what's being output into the log? The easiest way to see what the report is doing is to look at the Jasper XML, which you can see here =>https://github.com/archivesspace/archivesspace/blob/master/reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml#L20-L37 The basic SQL query is defined in the tag, with the formatting happening below. You can edit this file to fit your needs, then restart ASpace to have it recompiled. b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Emma Jolley > Sent: Friday, August 7, 2015 7:13 AM To: Archivesspace Users Group (archivesspace_users_group at lyralists.lyrasis.org) Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Chris We have had the same issues as Robin with the reports. We have tried to implement your suggested solutions below but now received the following error message which I've copied below. Any advice on this? In addition, I have asked previously but have never received an answer - I wonder if there is any documentation on what criteria the reports use to identify records that meet the nominated criteria. For example what fields is used to indicate an unprocessed Accession and what field is used to indicate an uncatalogued accession? Many thanks Emma From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Thursday, 6 August 2015 9:16 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: Re: [Archivesspace_Users_Group] Problems with ASpace reports Hi Robin, So, first you need to make sure you compiled your jasper reports on startup. To do this, edit the config.rb file to have: AppConfig[:compile_jasper] = true and restart ASpace. This will compile the jasper jxml files ( which is most likely what's causing the "can't convert nil to String" errors) Also, you'll need to look at both your application and database server and make sure you're not running into a performance issue. Reports can hit the database really hard, so the timeout errors you're seeing could be the result of your server running out of RAM. In regards to the CSV and Excel and HTML files, yes I would say those are formatted rather poorly by default. You can edit this by modifing your Jasper reports using something like iReport or Jasper studio. Just be sure to recompile your reports. For the parameters, yes this feature is going to be included in a future release. I believe those labels are artifacts from AT. best, Chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From:archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of McElheny, Robin G. > Sent: Wednesday, August 5, 2015 5:55 PM To: Archivesspace Users Group Cc: Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria Subject: [Archivesspace_Users_Group] Problems with ASpace reports At Harvard, we are having major problems with the reporting functionality in the latest ArchivesSpace release. We have tested the reports in our own installation and in the ASpace sandbox with very little success. See below for more details. We didn't see any issues in JIRA that reflects these problems. Has anyone else encountered them? If so, have you resolved them - and how? Record selection issues: * The Accessions Acquired and Accessions Production reports supposedly allow for specified time periods, but no date parameters show up in the report user interface. * In other cases it is unclear how/where to select records for the report (e.g. Digital Object Record). No selection parameters appear in the report interface. Are we supposed to browse records, then select them using the check boxes, then generate reports? Report format issues: * In cases where we were able to download CSV and Excel reports (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), we were unable to sort these reports because the formatting appears to be frozen. The output of the report does not match the file type. It is like getting a static document layered on top of a spreadsheet, rather than an actual spreadsheet. * Xlsx downloads don't export uniform cell sizes, so Excel sorting returns a warning saying "this operation requires the merged cells to be identically sized" * In order for the Xlsx downloads to be useful, each field should be in a separate column to allow tallying and sorting, but the ASpace downloads don't do this. Some examples: In the case of the Accession Deaccession List Report, opening the CSV download in Excel resulted in a very messy, single column spreadsheet that broke data about one deaccesion across multiple rows. (Example: row 48= "Additional records of the League of Women Voters (Cambridge, Mass.),,,,,,1376,,," and row 49 = ",Accession Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). Here is a screen shot: * Here's another example: * In the case of an HTML report, it displays page footers - odd for online display. Report failure/timeout: * We encountered many failures. Example: When we attempted to download an XLSX AccessionsAcquired report in the ArchivesSpace sandbox, we got the following message: Internal Server Error (500) Request Method: GET Request URL: http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx (TypeError) can't convert nil into String You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. Another example: * We were unable to generate any successful Resource reports. All attempts to download reports in any format resulted in "Waiting for (server)" messages with no results. Robin McElheny Associate University Archivist for Collections and Public Services Harvard University Archives Pusey Library Cambridge, MA 02138 Email: robin_mcelheny at harvard.edu Phone: 617-495-2461 Fax: 617-495-8011 _______________________________________________ Archivesspace_Users_Group mailing list Archivesspace_Users_Group at lyralists.lyrasis.org http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group -------------- next part -------------- An HTML attachment was scrubbed... URL: From ns96 at nyu.edu Fri Aug 14 08:27:37 2015 From: ns96 at nyu.edu (Nathan Stevens) Date: Fri, 14 Aug 2015 08:27:37 -0400 Subject: [Archivesspace_Users_Group] Problems with ASpace reports In-Reply-To: <81FF938BA2407B4DA1E134E7FA5C09EC01EB72D9D0@EXMBX1.shire.nla.gov.au> References: <81FF938BA2407B4DA1E134E7FA5C09EC01EB725429@EXMBX1.shire.nla.gov.au> <81FF938BA2407B4DA1E134E7FA5C09EC01EB72D9D0@EXMBX1.shire.nla.gov.au> Message-ID: Hi, The JDK version shouldn't be a problem. This seems like the report is encountering some data it can't handle. Can you send us a MySQL dump of your ASpace database so we can try and replicate the problem on our end? On Fri, Aug 14, 2015 at 3:31 AM, Emma Jolley wrote: > My apologies for not having sent through the information about the Log. I > have to liaise for some time with our IT to get this information. They have > sent me the following information which may be of help? > > > > Many thanks > > > > Emma > > **** > > > > The log entry when running (as an example) the report mentioned in the > email below is: > > > > D, [2015-08-10T17:58:14.599000 #3236] DEBUG -- : Thread-10076116: GET > /repositories/2/reports/accessionsunprocessedreport?lock_version=&format=json > [session: nil] > > D, [2015-08-10T17:58:14.602000 #3236] DEBUG -- : Thread-10076116: > Post-processed params: {:format=>"json", :repo_id=>2} > > D, [2015-08-10T17:58:14.892000 #3236] DEBUG -- : Thread-10076116: > Responded with [404, {"Content-Type"=>"application/json; charset=UTF-8", > "Cache-Control"=>"private, must-revalidate, max-age=0", > "Content-Length"=>"144"}, > ["{\"error\":{\"AccessionsUnprocessedReport\":[\"net.sf.jasperreports.engine.JRException: > Error executing SQL statement for : accessionsUnprocessed\"]}}"]]... in > 292.0ms > > Rendered shared/_breadcrumb.html.erb (1.0ms) > > Rendered > /opt/archivesspace-1.3.0/archivesspace/plugins/nla_accession_reports/frontend/views/reports/index.html.erb > within layouts/application (82.0ms) > > Rendered shared/_browser_support.html.erb (0.0ms) > > Rendered shared/_header_user.html.erb (6.0ms) > > Rendered shared/_header_global.html.erb (6.0ms) > > Rendered site/_branding.html.erb (0.0ms) > > Rendered shared/_advanced_search.html.erb (5.0ms) > > Rendered shared/_header_repository.html.erb (18.0ms) > > Rendered site/_footer.html.erb (0.0ms) > > Rendered shared/_templates.html.erb (2.0ms) > > Completed 200 OK in 448.0ms (Views: 114.0ms) > > > > Which is not helpful as it essentially just says exactly what gets > displayed on the interface. > > > > net.sf.jasperreports.engine.JRException: Error executing SQL statement for > : accessionsUnprocessed > > > > I?ve run the query in this report directly against the database > successfully (cut and paste from > reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml and > substituting in the repo id) so I think the SQL itself is sound. > > > > Further info: > > > > The report config being used are: > > #AppConfig[:report_page_layout] = "letter landscape" > > AppConfig[:enable_jasper] = true > > AppConfig[:compile_jasper] = true > > I?ve tried with the report_page_layout both commented and uncommented. > > > > The java version is: > > java version "1.7.0_85" > > OpenJDK Runtime Environment (rhel-2.6.1.3.el6_7-x86_64 u85-b01) > > OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode) > > > > Could there be an issue with using the OpenJDK rather than Oracle?s JDK > perhaps ? > > > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *Brian > Hoffman > *Sent:* Friday, 14 August 2015 12:37 PM > *To:* Archivesspace Users Group > > *Subject:* Re: [Archivesspace_Users_Group] Problems with ASpace reports > > > > Is it possible that your database was restored from a backup or that you > created your database elsewhere and then imported it into MySQL? If so, you > may simply be missing the stored procedures the Jasper reports rely on. > There is a PR concerning this issue here: > > > > https://github.com/archivesspace/archivesspace/pull/244 > > > > Brian > > > > > > > > On Aug 7, 2015, at 5:49 AM, Chris Fitzpatrick < > Chris.Fitzpatrick at lyrasis.org> wrote: > > > > > > Hi Emma, > > > > Can you look at what's being output into the log? > > > > The easiest way to see what the report is doing is to look at the Jasper > XML, which you can see here => > https://github.com/archivesspace/archivesspace/blob/master/reports/Accessions/AccessionsUnprocessedReport/AccessionsUnprocessedReport.jrxml#L20-L37 > > > > The basic SQL query is defined in the tag, with the formatting > happening below. You can edit this file to fit your needs, then restart > ASpace to have it recompiled. > > > > b,chris. > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > Emma Jolley > *Sent:* Friday, August 7, 2015 7:13 AM > *To:* Archivesspace Users Group ( > archivesspace_users_group at lyralists.lyrasis.org) > *Subject:* Re: [Archivesspace_Users_Group] Problems with ASpace reports > > > > Hi Chris > > > > We have had the same issues as Robin with the reports. We have tried to > implement your suggested solutions below but now received the following > error message which I?ve copied below. Any advice on this? > > > > In addition, I have asked previously but have never received an answer ? I > wonder if there is any documentation on what criteria the reports use to > identify records that meet the nominated criteria. For example what fields > is used to indicate an unprocessed Accession and what field is used to > indicate an uncatalogued accession? > > > > Many thanks > > > > Emma > > > > > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ > mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org > ] *On Behalf Of *Chris > Fitzpatrick > *Sent:* Thursday, 6 August 2015 9:16 PM > *To:* Archivesspace Users Group > *Cc:* Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria > *Subject:* Re: [Archivesspace_Users_Group] Problems with ASpace reports > > > > > > > > Hi Robin, > > > > So, first you need to make sure you compiled your jasper reports on > startup. To do this, edit the config.rb file to have: > > AppConfig[:compile_jasper] = true > > > > and restart ASpace. > > > > > > This will compile the jasper jxml files ( which is most likely what's > causing the "can't convert nil to String" errors) > > > > Also, you'll need to look at both your application and database server and > make sure you're not running into a performance issue. Reports can hit the > database really hard, so the timeout errors you're seeing could be the > result of your server running out of RAM. > > > > In regards to the CSV and Excel and HTML files, yes I would say those are > formatted rather poorly by default. You can edit this by modifing your > Jasper reports using something like iReport or Jasper studio > . Just be sure > to recompile your reports. > > > > For the parameters, yes this feature is going to be included in a future > release. I believe those labels are artifacts from AT. > > > > best, Chris. > > > > > > Chris Fitzpatrick | Developer, ArchivesSpace > Skype: chrisfitzpat | Phone: 918.236.6048 > http://archivesspace.org/ > > > ------------------------------ > > *From:*archivesspace_users_group-bounces at lyralists.lyrasis.org < > archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of > McElheny, Robin G. > *Sent:* Wednesday, August 5, 2015 5:55 PM > *To:* Archivesspace Users Group > *Cc:* Zalduendo, Ines; Wendler, Robin King; Della Monica, Ilaria > *Subject:* [Archivesspace_Users_Group] Problems with ASpace reports > > > > At Harvard, we are having major problems with the reporting functionality > in the latest ArchivesSpace release. We have tested the reports in our own > installation and in the ASpace sandbox with very little success. See below > for more details. > > We didn?t see any issues in JIRA that reflects these problems. Has anyone > else encountered them? If so, have you resolved them ? and how? > > Record selection issues: > > - The Accessions Acquired and Accessions Production reports supposedly > allow for specified time periods, but no date parameters show up in the > report user interface. > > > > > > - In other cases it is unclear how/where to select records for the > report (e.g. Digital Object Record). No selection parameters appear in the > report interface. Are we supposed to browse records, then select them using > the check boxes, then generate reports? > > > > Report format issues: > > - In cases where we were able to download CSV and Excel reports > (Accessions Cataloged, Accessions Deaccessions List, Accessions Inventory), > we were unable to sort these reports because the formatting appears to be > frozen. The output of the report does not match the file type. It is like > getting a static document layered on top of a spreadsheet, rather than an > actual spreadsheet. > > > > - Xlsx downloads don't export uniform cell sizes, so Excel sorting > returns a warning saying "this operation requires the merged cells to be > identically sized" > > > > - In order for the Xlsx downloads to be useful, each field should be > in a separate column to allow tallying and sorting, but the ASpace > downloads don?t do this. Some examples: > > > > In the case of the Accession Deaccession List Report, opening the CSV > download in Excel resulted in a very messy, single column spreadsheet that > broke data about one deaccesion across multiple rows. (Example: row 48= > "Additional records of the League of Women Voters (Cambridge, > Mass.),,,,,,1376,,," and row 49 = ",Accession > Date:,,05/01/1968,Extent:,1.00 Linear_feet,,,,:"). > > > > Here is a screen shot: > > > > - Here?s another example: > > > > - In the case of an HTML report, it displays page footers ? odd for > online display. > > > > > > Report failure/timeout: > > - We encountered many failures. > > Example: > > When we attempted to download an XLSX AccessionsAcquired report in the > ArchivesSpace sandbox, we got the following message: > > > > Internal Server Error (500) > > Request Method: GET > > Request URL: > http://localhost:8089/repositories/4/reports/accessionsacquiredreport?lock_version=&format=xlsx > > > > (TypeError) can't convert nil into String > > > > You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus. > > > > Another example: > > > > - We were unable to generate any successful Resource reports. All > attempts to download reports in any format resulted in ?Waiting for > (server)? messages with no results. > > > > > > Robin McElheny > > Associate University Archivist for Collections and Public Services > > Harvard University Archives > > Pusey Library > > Cambridge, MA 02138 > > Email: robin_mcelheny at harvard.edu > > Phone: 617-495-2461 > > Fax: 617-495-8011 > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > > > _______________________________________________ > Archivesspace_Users_Group mailing list > Archivesspace_Users_Group at lyralists.lyrasis.org > http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group > > -- Nathan Stevens Programmer/Analyst Digital Library Technology Services New York University 1212-998-2653 ns96 at nyu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From mrf22 at psu.edu Fri Aug 14 10:05:45 2015 From: mrf22 at psu.edu (MATTHEW R FRANCIS) Date: Fri, 14 Aug 2015 10:05:45 -0400 (EDT) Subject: [Archivesspace_Users_Group] server error when saving archival objects w/ linked digital objects Message-ID: <1511795124.300027.1439561145323.JavaMail.zimbra@psu.edu> All, We have recently begun testing digital objects in our ASpace installation (v1.2), but when saving the archival objects with linked digital objects we keep running into an error. After linking a digital object: We encounter the following error message when trying to save the archival object: Does anyone have any advice on how to proceed with this? Thanks, -Matt Matt Francis Archivist for Collection Management Special Collections Library Penn State University Twitter: @archivingmatt http://www.archivingmatt.com -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-1.PNG Type: image/png Size: 57892 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-2.PNG Type: image/png Size: 54769 bytes Desc: not available URL: From Kevin.Clair at du.edu Fri Aug 14 10:14:34 2015 From: Kevin.Clair at du.edu (Kevin Clair) Date: Fri, 14 Aug 2015 14:14:34 +0000 Subject: [Archivesspace_Users_Group] server error when saving archival objects w/ linked digital objects In-Reply-To: <1511795124.300027.1439561145323.JavaMail.zimbra@psu.edu> References: <1511795124.300027.1439561145323.JavaMail.zimbra@psu.edu> Message-ID: I got this same error last night while testing a plug-in. The logs said it was because ArchivesSpace had run out of memory (unfortunately I can't copy in the exact message; I restarted ArchivesSpace before I remembered about it). The item in question has a bunch of links in it, which is probably why: http://duarchstaff.coalliance.org/resources/803#tree::archival_object_116219 -k From: > on behalf of MATTHEW FRANCIS > Reply-To: Archivesspace Group > Date: Friday, August 14, 2015 at 8:05 AM To: Archivesspace Group > Subject: [Archivesspace_Users_Group] server error when saving archival objects w/ linked digital objects All, We have recently begun testing digital objects in our ASpace installation (v1.2), but when saving the archival objects with linked digital objects we keep running into an error. After linking a digital object: [cid:6415ab3d13983d4e737f7a381e77c115731e9dad at zimbra] We encounter the following error message when trying to save the archival object: [cid:37f42db9cb9fbe747e5a1ff890c7e01f97e52b1c at zimbra] Does anyone have any advice on how to proceed with this? Thanks, -Matt Matt Francis Archivist for Collection Management Special Collections Library Penn State University Twitter: @archivingmatt http://www.archivingmatt.com -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-1.PNG Type: image/png Size: 57892 bytes Desc: DO-error-1.PNG URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-2.PNG Type: image/png Size: 54769 bytes Desc: DO-error-2.PNG URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 10:21:24 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 14:21:24 +0000 Subject: [Archivesspace_Users_Group] server error when saving archival objects w/ linked digital objects In-Reply-To: <1511795124.300027.1439561145323.JavaMail.zimbra@psu.edu> References: <1511795124.300027.1439561145323.JavaMail.zimbra@psu.edu> Message-ID: Hi Matt, Can you see what is being output into the log? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of MATTHEW R FRANCIS Sent: Friday, August 14, 2015 4:05 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: [Archivesspace_Users_Group] server error when saving archival objects w/ linked digital objects All, We have recently begun testing digital objects in our ASpace installation (v1.2), but when saving the archival objects with linked digital objects we keep running into an error. After linking a digital object: [cid:6415ab3d13983d4e737f7a381e77c115731e9dad at zimbra] We encounter the following error message when trying to save the archival object: [cid:37f42db9cb9fbe747e5a1ff890c7e01f97e52b1c at zimbra] Does anyone have any advice on how to proceed with this? Thanks, -Matt Matt Francis Archivist for Collection Management Special Collections Library Penn State University Twitter: @archivingmatt http://www.archivingmatt.com -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-1.PNG Type: image/png Size: 57892 bytes Desc: DO-error-1.PNG URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: DO-error-2.PNG Type: image/png Size: 54769 bytes Desc: DO-error-2.PNG URL: From jlake at library.berkeley.edu Fri Aug 14 10:26:27 2015 From: jlake at library.berkeley.edu (James D. LAKE) Date: Fri, 14 Aug 2015 07:26:27 -0700 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE wrote: > Hi - > > We're having problems with importing two collections into our dev instance > of AS (see below) which generate error messages for specific components. > In the first case, the collection has other components with similar markup > that result in no error. > > Also, as with Jared Campbell's post this week, we also have a collection > that results in a "NoMethodError: undefined method 'items'" message. > Unlike Jared's case and question re file size, this occurs for a small > collection. > > Jim Lake > UC Berkeley Library > > *** > > Error: # > > This component seems to be OK: > > > > 5 > 3 > Pacific Coast Conference (PCC) Rules: Violations (Interviews > with Athletes) > 1956 > > > > But this one generated the error: > > > > 5 > 4 > Katz Case > 1964-1965 > > > > *** > > This is the only instance of label="Box" in this collection, but there > appears to be nothing unusual about the markup: > > #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - > Compiled by Genie Candau': Invalid value: box> > > > > 1 > Bibliography on 3 x 5 index cards - Compiled by Genie > Candau > 1956 - 1991 > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 10:31:29 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 14:31:29 +0000 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: , Message-ID: Hi Jim, Do you happen to have any example EAD files we can look at? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of James D. LAKE Sent: Friday, August 14, 2015 4:26 PM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From brad.westbrook at lyrasis.org Fri Aug 14 10:30:35 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Fri, 14 Aug 2015 14:30:35 +0000 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: Hi, James, Can you send us the two EADs? Thanks, Brad From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:26 AM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jlake at library.berkeley.edu Fri Aug 14 10:39:02 2015 From: jlake at library.berkeley.edu (James D. LAKE) Date: Fri, 14 Aug 2015 07:39:02 -0700 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: We actually have several other of the container problems since my original post, but we'll just keep it to two for now. :) I'm also including the "items" error EAD. The EADs and errors: cu551_cuuarc.xml :0xc39fbf4>> cu302_cuuarc.xml m2000_50_cubanc.xml On Fri, Aug 14, 2015 at 7:30 AM, Brad Westbrook wrote: > Hi, James, > > > > Can you send us the two EADs? > > > > Thanks, > > > > Brad > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *James > D. LAKE > *Sent:* Friday, August 14, 2015 10:26 AM > *To:* archivesspace_users_group at lyralists.lyrasis.org > *Subject:* Re: [Archivesspace_Users_Group] Error messages during dev > import > > > > Hi - > > > > Just checking again to see if anyone has experienced (and has had > solutions for) error messages when importing EAD instances into AS. For > us, it's: > > > > - "NoMethodError: undefined method 'items'" > > > > - mystery container errors (e.g "box" when the markup appears to be > correct and other "box" components do not generate that error). > > > > Thanks, > > > > Jim Lake > > UC Berkeley Library > > > > > > On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: > > Hi - > > > > We're having problems with importing two collections into our dev instance > of AS (see below) which generate error messages for specific components. > In the first case, the collection has other components with similar markup > that result in no error. > > > > Also, as with Jared Campbell's post this week, we also have a collection > that results in a "NoMethodError: undefined method 'items'" message. > Unlike Jared's case and question re file size, this occurs for a small > collection. > > > > Jim Lake > > UC Berkeley Library > > > > *** > > > > Error: # > > > > This component seems to be OK: > > > > > > > > 5 > > 3 > > Pacific Coast Conference (PCC) Rules: Violations (Interviews > with Athletes) > > 1956 > > > > > > > > But this one generated the error: > > > > > > > > 5 > > 4 > > Katz Case > > 1964-1965 > > > > > > > > *** > > > > This is the only instance of label="Box" in this collection, but there > appears to be nothing unusual about the markup: > > > > #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - > Compiled by Genie Candau': Invalid value: box> > > > > > > > > 1 > > Bibliography on 3 x 5 index cards - Compiled by Genie > Candau > > 1956 - 1991 > > > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: cu551_cuuarc.xml Type: text/xml Size: 19850 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: cu302_cuuarc.xml Type: text/xml Size: 620433 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: m2000_50_cubanc.xml Type: text/xml Size: 251804 bytes Desc: not available URL: From PGalligan at rockarch.org Fri Aug 14 10:42:01 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Fri, 14 Aug 2015 10:42:01 -0400 Subject: [Archivesspace_Users_Group] Digital Object creation Message-ID: We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.custer at yale.edu Fri Aug 14 11:42:13 2015 From: mark.custer at yale.edu (Custer, Mark) Date: Fri, 14 Aug 2015 15:42:13 +0000 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: James, I get a slightly different error when trying to import cu551_cuuarc.xml, but I was able to get it to import after I removed the bioghist note that has the eventgrp elements. Does the EAD importer not support event groups? I?m using version 1.1. Also, I haven?t finishing trying to import the other two files just yet, but I wonder if the problem might be due to the container/@type values? In cu302, included in the distinct types of @type are ?ca4rton? and ?ca35rton? (even if that?s not holding up the importer, I?d assume that was a find and replace error). I?m trying to import m2000 right now, and it?s moving along slowly, but I haven?t seen an error just yet. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:39 AM To: Brad Westbrook Cc: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Error messages during dev import We actually have several other of the container problems since my original post, but we'll just keep it to two for now. :) I'm also including the "items" error EAD. The EADs and errors: cu551_cuuarc.xml :0xc39fbf4>> cu302_cuuarc.xml m2000_50_cubanc.xml On Fri, Aug 14, 2015 at 7:30 AM, Brad Westbrook > wrote: Hi, James, Can you send us the two EADs? Thanks, Brad From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:26 AM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 11:56:56 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 15:56:56 +0000 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: Message-ID: Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From brad.westbrook at lyrasis.org Fri Aug 14 12:26:58 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Fri, 14 Aug 2015 16:26:58 +0000 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: Like Mark, I was able to import cu551 only after omitting the Chron list with the event groups. I was able to import the other two EADs without any problems. I imported them into a localhost using the Derby backend. Brad From: Custer, Mark [mailto:mark.custer at yale.edu] Sent: Friday, August 14, 2015 11:42 AM To: jlake at library.berkeley.edu; Archivesspace Users Group; Brad Westbrook Subject: RE: [Archivesspace_Users_Group] Error messages during dev import James, I get a slightly different error when trying to import cu551_cuuarc.xml, but I was able to get it to import after I removed the bioghist note that has the eventgrp elements. Does the EAD importer not support event groups? I?m using version 1.1. Also, I haven?t finishing trying to import the other two files just yet, but I wonder if the problem might be due to the container/@type values? In cu302, included in the distinct types of @type are ?ca4rton? and ?ca35rton? (even if that?s not holding up the importer, I?d assume that was a find and replace error). I?m trying to import m2000 right now, and it?s moving along slowly, but I haven?t seen an error just yet. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:39 AM To: Brad Westbrook Cc: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Error messages during dev import We actually have several other of the container problems since my original post, but we'll just keep it to two for now. :) I'm also including the "items" error EAD. The EADs and errors: cu551_cuuarc.xml :0xc39fbf4>> cu302_cuuarc.xml m2000_50_cubanc.xml On Fri, Aug 14, 2015 at 7:30 AM, Brad Westbrook > wrote: Hi, James, Can you send us the two EADs? Thanks, Brad From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:26 AM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Fri Aug 14 12:30:15 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Fri, 14 Aug 2015 12:30:15 -0400 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: Message-ID: Chrome. I just did a little bit more iterative testing. Seems like I'm running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 13:03:56 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 17:03:56 +0000 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: , Message-ID: Hm. Ok...which version of chrome and OS? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Friday, August 14, 2015 6:30 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome. I just did a little bit more iterative testing. Seems like I'm running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Fri Aug 14 13:29:47 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Fri, 14 Aug 2015 13:29:47 -0400 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: , Message-ID: Chrome Version 44.0.2403.155 m and Windows 7. I also tried with no luck on Firefox 35.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 1:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hm. Ok...which version of chrome and OS? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 6:30 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome. I just did a little bit more iterative testing. Seems like I'm running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jlake at library.berkeley.edu Fri Aug 14 14:57:21 2015 From: jlake at library.berkeley.edu (James D. LAKE) Date: Fri, 14 Aug 2015 11:57:21 -0700 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: Mark & Brad - I'm having the same result after removing those particular sections. And thanks for pointing out the incorrect container/@type values. I'm still having trouble getting them to process, but at least I have something to go on. If you (or anybody else) finds other possible reasons, please pass them on to the group! Jim On Fri, Aug 14, 2015 at 9:26 AM, Brad Westbrook wrote: > Like Mark, I was able to import cu551 only after omitting the Chron list > with the event groups. I was able to import the other two EADs without any > problems. I imported them into a localhost using the Derby backend. > > > > Brad > > > > > > *From:* Custer, Mark [mailto:mark.custer at yale.edu] > *Sent:* Friday, August 14, 2015 11:42 AM > *To:* jlake at library.berkeley.edu; Archivesspace Users Group; Brad > Westbrook > *Subject:* RE: [Archivesspace_Users_Group] Error messages during dev > import > > > > James, > > > > I get a slightly different error when trying to import cu551_cuuarc.xml, > but I was able to get it to import after I removed the bioghist note that > has the eventgrp elements. Does the EAD importer not support event > groups? I?m using version 1.1. > > > > Also, I haven?t finishing trying to import the other two files just yet, > but I wonder if the problem might be due to the container/@type values? In > cu302, included in the distinct types of @type are ?ca4rton? and > ?ca35rton? (even if that?s not holding up the importer, I?d assume that > was a find and replace error). I?m trying to import m2000 right now, and > it?s moving along slowly, but I haven?t seen an error just yet. > > > > Mark > > > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [ > mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org > ] *On Behalf Of *James > D. LAKE > *Sent:* Friday, August 14, 2015 10:39 AM > *To:* Brad Westbrook > *Cc:* Archivesspace Users Group > *Subject:* Re: [Archivesspace_Users_Group] Error messages during dev > import > > > > We actually have several other of the container problems since my original > post, but we'll just keep it to two for now. :) I'm also including the > "items" error EAD. > > > > The EADs and errors: > > > > cu551_cuuarc.xml > > #<#Class:0x34c4cb35>:0xc39fbf4>> > > > > cu302_cuuarc.xml > > > > > > m2000_50_cubanc.xml > > > > Compiled by Genie Candau': Invalid value: box> > > > > > > On Fri, Aug 14, 2015 at 7:30 AM, Brad Westbrook < > brad.westbrook at lyrasis.org> wrote: > > Hi, James, > > > > Can you send us the two EADs? > > > > Thanks, > > > > Brad > > > > > > *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto: > archivesspace_users_group-bounces at lyralists.lyrasis.org] *On Behalf Of *James > D. LAKE > *Sent:* Friday, August 14, 2015 10:26 AM > *To:* archivesspace_users_group at lyralists.lyrasis.org > *Subject:* Re: [Archivesspace_Users_Group] Error messages during dev > import > > > > Hi - > > > > Just checking again to see if anyone has experienced (and has had > solutions for) error messages when importing EAD instances into AS. For > us, it's: > > > > - "NoMethodError: undefined method 'items'" > > > > - mystery container errors (e.g "box" when the markup appears to be > correct and other "box" components do not generate that error). > > > > Thanks, > > > > Jim Lake > > UC Berkeley Library > > > > > > On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: > > Hi - > > > > We're having problems with importing two collections into our dev instance > of AS (see below) which generate error messages for specific components. > In the first case, the collection has other components with similar markup > that result in no error. > > > > Also, as with Jared Campbell's post this week, we also have a collection > that results in a "NoMethodError: undefined method 'items'" message. > Unlike Jared's case and question re file size, this occurs for a small > collection. > > > > Jim Lake > > UC Berkeley Library > > > > *** > > > > Error: # > > > > This component seems to be OK: > > > > > > > > 5 > > 3 > > Pacific Coast Conference (PCC) Rules: Violations (Interviews > with Athletes) > > 1956 > > > > > > > > But this one generated the error: > > > > > > > > 5 > > 4 > > Katz Case > > 1964-1965 > > > > > > > > *** > > > > This is the only instance of label="Box" in this collection, but there > appears to be nothing unusual about the markup: > > > > #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - > Compiled by Genie Candau': Invalid value: box> > > > > > > > > 1 > > Bibliography on 3 x 5 index cards - Compiled by Genie > Candau > > 1956 - 1991 > > > > > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From brad.westbrook at lyrasis.org Fri Aug 14 15:25:28 2015 From: brad.westbrook at lyrasis.org (Brad Westbrook) Date: Fri, 14 Aug 2015 19:25:28 +0000 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: Hi, James, I have some background questions, for which I don?t see or missed the answers in the exchanges below: 1) What version of ArchivesSpace are you using? 2) Where is your database located? Berkeley server? CDL? 3) Have you test importing any of the files in the ArchivesSpace sandbox? It might process slower but would at least provide a different environment in which to see if you encounter the same results. Brad From: James D. LAKE [mailto:jlake at library.berkeley.edu] Sent: Friday, August 14, 2015 2:57 PM To: Brad Westbrook Cc: Custer, Mark; Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Mark & Brad - I'm having the same result after removing those particular sections. And thanks for pointing out the incorrect container/@type values. I'm still having trouble getting them to process, but at least I have something to go on. If you (or anybody else) finds other possible reasons, please pass them on to the group! Jim On Fri, Aug 14, 2015 at 9:26 AM, Brad Westbrook > wrote: Like Mark, I was able to import cu551 only after omitting the Chron list with the event groups. I was able to import the other two EADs without any problems. I imported them into a localhost using the Derby backend. Brad From: Custer, Mark [mailto:mark.custer at yale.edu] Sent: Friday, August 14, 2015 11:42 AM To: jlake at library.berkeley.edu; Archivesspace Users Group; Brad Westbrook Subject: RE: [Archivesspace_Users_Group] Error messages during dev import James, I get a slightly different error when trying to import cu551_cuuarc.xml, but I was able to get it to import after I removed the bioghist note that has the eventgrp elements. Does the EAD importer not support event groups? I?m using version 1.1. Also, I haven?t finishing trying to import the other two files just yet, but I wonder if the problem might be due to the container/@type values? In cu302, included in the distinct types of @type are ?ca4rton? and ?ca35rton? (even if that?s not holding up the importer, I?d assume that was a find and replace error). I?m trying to import m2000 right now, and it?s moving along slowly, but I haven?t seen an error just yet. Mark From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:39 AM To: Brad Westbrook Cc: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Error messages during dev import We actually have several other of the container problems since my original post, but we'll just keep it to two for now. :) I'm also including the "items" error EAD. The EADs and errors: cu551_cuuarc.xml :0xc39fbf4>> cu302_cuuarc.xml m2000_50_cubanc.xml On Fri, Aug 14, 2015 at 7:30 AM, Brad Westbrook > wrote: Hi, James, Can you send us the two EADs? Thanks, Brad From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of James D. LAKE Sent: Friday, August 14, 2015 10:26 AM To: archivesspace_users_group at lyralists.lyrasis.org Subject: Re: [Archivesspace_Users_Group] Error messages during dev import Hi - Just checking again to see if anyone has experienced (and has had solutions for) error messages when importing EAD instances into AS. For us, it's: - "NoMethodError: undefined method 'items'" - mystery container errors (e.g "box" when the markup appears to be correct and other "box" components do not generate that error). Thanks, Jim Lake UC Berkeley Library On Fri, Aug 7, 2015 at 8:40 AM, James D. LAKE > wrote: Hi - We're having problems with importing two collections into our dev instance of AS (see below) which generate error messages for specific components. In the first case, the collection has other components with similar markup that result in no error. Also, as with Jared Campbell's post this week, we also have a collection that results in a "NoMethodError: undefined method 'items'" message. Unlike Jared's case and question re file size, this occurs for a small collection. Jim Lake UC Berkeley Library *** Error: # This component seems to be OK: 5 3 Pacific Coast Conference (PCC) Rules: Violations (Interviews with Athletes) 1956 But this one generated the error: 5 4 Katz Case 1964-1965 *** This is the only instance of label="Box" in this collection, but there appears to be nothing unusual about the markup: #<RuntimeError: Problem creating 'Bibliography on 3 x 5 index cards - Compiled by Genie Candau': Invalid value: box> 1 Bibliography on 3 x 5 index cards - Compiled by Genie Candau 1956 - 1991 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 16:05:05 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 20:05:05 +0000 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: , , Message-ID: Hi, Weird. Is this what you're doing? https://drive.google.com/file/d/0BzRF7huQ7tqKdTFCZXFZamlZbE0/view?usp=sharing [https://lh4.googleusercontent.com/xMgwS5yr0tJrZA38IL4mznhqAw8kj6n8xu1hwQVDNhvP8Rb7fdp7gQ=w1200-h630-p] foo.mov - Google Drive Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Friday, August 14, 2015 7:29 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome Version 44.0.2403.155 m and Windows 7. I also tried with no luck on Firefox 35.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 1:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hm. Ok...which version of chrome and OS? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 6:30 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome. I just did a little bit more iterative testing. Seems like I'm running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From PGalligan at rockarch.org Fri Aug 14 17:02:21 2015 From: PGalligan at rockarch.org (Galligan, Patrick) Date: Fri, 14 Aug 2015 17:02:21 -0400 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: , , Message-ID: Not quite. Here's where I'm seeing an issue: https://drive.google.com/file/d/0B3nGDOCrqPJ_ZXd5SGZHa0hqMGM/view?usp=sharing Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 4:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi, Weird. Is this what you're doing? https://drive.google.com/file/d/0BzRF7huQ7tqKdTFCZXFZamlZbE0/view?usp=sharing [https://lh4.googleusercontent.com/xMgwS5yr0tJrZA38IL4mznhqAw8kj6n8xu1hwQVDNhvP8Rb7fdp7gQ=w1200-h630-p] foo.mov - Google Drive Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 7:29 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome Version 44.0.2403.155 m and Windows 7. I also tried with no luck on Firefox 35.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 1:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hm. Ok...which version of chrome and OS? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 6:30 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome. I just did a little bit more iterative testing. Seems like I'm running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We've recently updated to version 1.3.0, and I noticed something that I hadn't noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I've replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I've created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From maureen.callahan at yale.edu Fri Aug 14 17:20:10 2015 From: maureen.callahan at yale.edu (Callahan, Maureen) Date: Fri, 14 Aug 2015 21:20:10 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions Message-ID: To the Members of the ArchivesSpace Governance Board: As ArchivesSpace member institutions shift from the task of migrating data to the utilization of ArchivesSpace for production archival management, endemic issues related to performance and scalability are severely limiting our ability to fully utilize the system. Please find the attached report, created by Hudson Molonglo and sponsored by Yale, which outlines a set of sensible next steps to provide immediate relief to some of the problems that users of ArchivesSpace have been experiencing. As members, we are eager to participate in the continued improvement of the application. We see the areas targeted in the report as critical and a necessary first step in addressing performance concerns. We would like to see development to address these concerns happen immediately. Collectively, many of our repositories are experiencing significant performance problems. In some cases, members are seeing work grind to a halt as accession records take as long as twenty seconds to save, archival object records take as long as ten seconds to save, and records with many links (agents and subjects, digital objects, sibling records) may take as long as ten minutes to load, or never load at all. Without better performance from ArchivesSpace, we are hampered in our mission of providing meaningful descriptions of records for our users. We think that you will find Hudson Molonglo?s explanation of these problems and proposed solutions helpful and actionable. While the normal procedures of voting on feature prioritization generally work very well for developing new parts of the application, critical issues like these cannot wait for the next round of voting. As ArchivesSpace continues to mature, production-critical issues will be fewer in number. Until then, it would be helpful to chart an effective path to bringing these problems to the foreground and providing the resources required to address them quickly. Finally, we recognize that like many other projects, ArchivesSpace?s growth will be an iterative development process. And as such, there may be areas of the system -- like the thresholds we discovered for records with many links -- where archival practices exceed the system?s current capacity. Part of the competitive advantage of ArchivesSpace must come from transparency around not only its strengths, but also its current limitations. We request documentation that outlines known thresholds and current capacity, so that we can make responsible decisions about the tool?s implementation at our repositories. We are eager to continue this conversation. Respectfully submitted, Maureen Callahan, on behalf of the Yale University ArchivesSpace Committee Terry Reese, on behalf of The Ohio State University Ben Goldman, on behalf of Pennsylvania State University Chris Prom, on behalf of the University of Illinois at Urbana-Champaign -------------- next part -------------- A non-text attachment was scrubbed... Name: YaleArchivesSpacePerformanceAnalysisReport-2.pdf Type: application/pdf Size: 275770 bytes Desc: YaleArchivesSpacePerformanceAnalysisReport-2.pdf URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 17:27:06 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 21:27:06 +0000 Subject: [Archivesspace_Users_Group] Digital Object creation In-Reply-To: References: , , , Message-ID: Ah, ok. It's the adding the note that is causing the problem. The work around for now might be to create the DO then add your note to it afterward. Added the comment to the ticket. Thanks! b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Galligan, Patrick Sent: Friday, August 14, 2015 11:02 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Not quite. Here?s where I?m seeing an issue: https://drive.google.com/file/d/0B3nGDOCrqPJ_ZXd5SGZHa0hqMGM/view?usp=sharing Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 4:05 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi, Weird. Is this what you're doing? https://drive.google.com/file/d/0BzRF7huQ7tqKdTFCZXFZamlZbE0/view?usp=sharing [https://lh4.googleusercontent.com/xMgwS5yr0tJrZA38IL4mznhqAw8kj6n8xu1hwQVDNhvP8Rb7fdp7gQ=w1200-h630-p] foo.mov - Google Drive Read more... b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 7:29 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome Version 44.0.2403.155 m and Windows 7. I also tried with no luck on Firefox 35.0. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 1:04 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hm. Ok...which version of chrome and OS? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 6:30 PM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Chrome. I just did a little bit more iterative testing. Seems like I?m running into an issue when I add notes. It worked for me with just the base title and ID, worked with file version info, but as soon as I added an Existence and Location of Originals note, it would not save. I tried it on resource Test 3 on the 1999 component. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 From: archivesspace_users_group-bounces at lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chris Fitzpatrick Sent: Friday, August 14, 2015 11:57 AM To: Archivesspace Users Group Subject: Re: [Archivesspace_Users_Group] Digital Object creation Hi Patrick, I just tried this in the sandbox and it created the DO without an issue. What browser are you using? b,chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org > on behalf of Galligan, Patrick > Sent: Friday, August 14, 2015 4:42 PM To: Archivesspace Users Group Subject: [Archivesspace_Users_Group] Digital Object creation We?ve recently updated to version 1.3.0, and I noticed something that I hadn?t noticed before. I tried to manually create a digital object through a resource record. Instead of clicking browse, I clicked create, and the digital object creation window popped up. I entered all necessary information and clicked Create and Link to Digital Object. Afterwards, nothing happens. The system just sits on that window forever until you click cancel. I?ve replicated this issue in the sandbox version as well. Wanted to give everyone a heads up about it. I?ve created an issue in JIRA, let me know if you need any more information. Patrick Galligan Rockefeller Archive Center Assistant Digital Archivist 914-366-6386 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Robert.Miller at lyrasis.org Fri Aug 14 17:45:04 2015 From: Robert.Miller at lyrasis.org (Robert Miller) Date: Fri, 14 Aug 2015 21:45:04 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions In-Reply-To: References: Message-ID: HI Maureen, I have just finished a meeting with my technical team (10 minutes ago). You email arrived right after our meeting concluded. Brad is going to be responding to you with some suggestions and ideas about an action plan. We have, with another arm of LYRASIS, been in discussions with Yale about the problems and have made two proposals to assist you based on what we were told. It appears there are a number of players involved from Yale so it is a little unclear, at least to me, to understand who we should be working with. Are you the point person? My goal is for our team and Org Home to help you work through this situation and to help the community as a whole. If for any reason you do not think this is sufficient, please contact Brad, Angela or me directly. My cell is 415 640 1092. I am around all weekend. Sound OK? Sincerely, Robert Robert Miller Chief Executive Officer 1438 West Peachtree Street NW, Suite 200, Atlanta, GA 30309 Direct: 404-592-4898 Cell: 415-640-1092 Toll free: 800-999-8558 Skype: Robert-Miller [cid:2ED0E48E-29AF-43CB-87B6-E56C487DE1E9][cid:image002.jpg at 01D093D0.E7D9B6B0][cid:image003.jpg at 01D093D0.E7D9B6B0] On Aug 14, 2015, at 4:20 PM, Callahan, Maureen > wrote: To the Members of the ArchivesSpace Governance Board: As ArchivesSpace member institutions shift from the task of migrating data to the utilization of ArchivesSpace for production archival management, endemic issues related to performance and scalability are severely limiting our ability to fully utilize the system. Please find the attached report, created by Hudson Molonglo and sponsored by Yale, which outlines a set of sensible next steps to provide immediate relief to some of the problems that users of ArchivesSpace have been experiencing. As members, we are eager to participate in the continued improvement of the application. We see the areas targeted in the report as critical and a necessary first step in addressing performance concerns. We would like to see development to address these concerns happen immediately. Collectively, many of our repositories are experiencing significant performance problems. In some cases, members are seeing work grind to a halt as accession records take as long as twenty seconds to save, archival object records take as long as ten seconds to save, and records with many links (agents and subjects, digital objects, sibling records) may take as long as ten minutes to load, or never load at all. Without better performance from ArchivesSpace, we are hampered in our mission of providing meaningful descriptions of records for our users. We think that you will find Hudson Molonglo?s explanation of these problems and proposed solutions helpful and actionable. While the normal procedures of voting on feature prioritization generally work very well for developing new parts of the application, critical issues like these cannot wait for the next round of voting. As ArchivesSpace continues to mature, production-critical issues will be fewer in number. Until then, it would be helpful to chart an effective path to bringing these problems to the foreground and providing the resources required to address them quickly. Finally, we recognize that like many other projects, ArchivesSpace?s growth will be an iterative development process. And as such, there may be areas of the system -- like the thresholds we discovered for records with many links -- where archival practices exceed the system?s current capacity. Part of the competitive advantage of ArchivesSpace must come from transparency around not only its strengths, but also its current limitations. We request documentation that outlines known thresholds and current capacity, so that we can make responsible decisions about the tool?s implementation at our repositories. We are eager to continue this conversation. Respectfully submitted, Maureen Callahan, on behalf of the Yale University ArchivesSpace Committee Terry Reese, on behalf of The Ohio State University Ben Goldman, on behalf of Pennsylvania State University Chris Prom, on behalf of the University of Illinois at Urbana-Champaign -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: www.lyrasis.org.png Type: image/png Size: 10337 bytes Desc: www.lyrasis.org.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 854 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.jpg Type: image/jpeg Size: 815 bytes Desc: image003.jpg URL: From Chris.Fitzpatrick at lyrasis.org Fri Aug 14 17:49:25 2015 From: Chris.Fitzpatrick at lyrasis.org (Chris Fitzpatrick) Date: Fri, 14 Aug 2015 21:49:25 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions In-Reply-To: References: Message-ID: Hi Maureen, Thanks for this. It's very helpful, since HM's work is always thorough and top-notch. As luck would have it, I actually committed come code today that implements some of these suggestions. You can see the Jira ticket here: https://archivesspace.atlassian.net/browse/AR-1311 which has a link to the branch with the comments. In a nutshell, associated records ( like notes, subjects, agents ) will not be initialized by the form if they have more than 5 subrecords. In these cases, users can load these records by clicking on subsection. Not having to load the linker, CodeMirror, and other validations really reduces the work the browser has to do. I've been using a test record that Noah Huffman gave me, which is about 25mb in size. I'm doing some additional work to optimize the callbacks and events, especially with giving the user a sense as to what's actually happening. I'm still working out some of the kinks and adding tests, but hoping to put this into the next RC. Please feel free to checkout the code and give it a test against your data. And, as always, pull-requests are welcome. best, chris. Chris Fitzpatrick | Developer, ArchivesSpace Skype: chrisfitzpat | Phone: 918.236.6048 http://archivesspace.org/ ________________________________________ From: archivesspace_users_group-bounces at lyralists.lyrasis.org on behalf of Callahan, Maureen Sent: Friday, August 14, 2015 11:20 PM To: tadams at cshl.edu; christian.dupont at bc.edu; gpgaidmore at wm.edu; lkachure at richmond.edu; Sniffin-Marinoff, Megan; carol.mandel at nyu.edu; Robert Miller; becs at ucsd.edu; jpwilkin at illinois.edu; Angela Spinazze; Jay Schafer; Brad Westbrook Cc: yulaspace at mailman.yale.edu; archivesspace at googlegroups.com; Archivesspace Users Group Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions To the Members of the ArchivesSpace Governance Board: As ArchivesSpace member institutions shift from the task of migrating data to the utilization of ArchivesSpace for production archival management, endemic issues related to performance and scalability are severely limiting our ability to fully utilize the system. Please find the attached report, created by Hudson Molonglo and sponsored by Yale, which outlines a set of sensible next steps to provide immediate relief to some of the problems that users of ArchivesSpace have been experiencing. As members, we are eager to participate in the continued improvement of the application. We see the areas targeted in the report as critical and a necessary first step in addressing performance concerns. We would like to see development to address these concerns happen immediately. Collectively, many of our repositories are experiencing significant performance problems. In some cases, members are seeing work grind to a halt as accession records take as long as twenty seconds to save, archival object records take as long as ten seconds to save, and records with many links (agents and subjects, digital objects, sibling records) may take as long as ten minutes to load, or never load at all. Without better performance from ArchivesSpace, we are hampered in our mission of providing meaningful descriptions of records for our users. We think that you will find Hudson Molonglo?s explanation of these problems and proposed solutions helpful and actionable. While the normal procedures of voting on feature prioritization generally work very well for developing new parts of the application, critical issues like these cannot wait for the next round of voting. As ArchivesSpace continues to mature, production-critical issues will be fewer in number. Until then, it would be helpful to chart an effective path to bringing these problems to the foreground and providing the resources required to address them quickly. Finally, we recognize that like many other projects, ArchivesSpace?s growth will be an iterative development process. And as such, there may be areas of the system -- like the thresholds we discovered for records with many links -- where archival practices exceed the system?s current capacity. Part of the competitive advantage of ArchivesSpace must come from transparency around not only its strengths, but also its current limitations. We request documentation that outlines known thresholds and current capacity, so that we can make responsible decisions about the tool?s implementation at our repositories. We are eager to continue this conversation. Respectfully submitted, Maureen Callahan, on behalf of the Yale University ArchivesSpace Committee Terry Reese, on behalf of The Ohio State University Ben Goldman, on behalf of Pennsylvania State University Chris Prom, on behalf of the University of Illinois at Urbana-Champaign From maureen.callahan at yale.edu Fri Aug 14 17:58:48 2015 From: maureen.callahan at yale.edu (Callahan, Maureen) Date: Fri, 14 Aug 2015 21:58:48 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions In-Reply-To: References: Message-ID: <8AC409B1-93E6-4CAE-9497-18055B43E445@yale.edu> Dear Robert, Thanks for your email ? Lyrasis has certainly demonstrated a commitment to members, which I know that we at Yale are glad to see. The issues addressed in this report are unrelated to Yale?s conversations with Lyrasis about becoming hosted customers ? they address problems in the core application and are shared by the community. Please feel free to continue to direct communications about Lyrasis hosting to Ray Frohlich from our enterprise systems department. Warm wishes, Maureen Maureen Callahan Archivist, Metadata Specialist Manuscripts & Archives Yale University Library maureen.callahan at yale.edu 203.432.3627 Webpage: web.library.yale.edu/mssa Collections: drs.library.yale.edu On Aug 14, 2015, at 5:45 PM, Robert Miller > wrote: HI Maureen, I have just finished a meeting with my technical team (10 minutes ago). You email arrived right after our meeting concluded. Brad is going to be responding to you with some suggestions and ideas about an action plan. We have, with another arm of LYRASIS, been in discussions with Yale about the problems and have made two proposals to assist you based on what we were told. It appears there are a number of players involved from Yale so it is a little unclear, at least to me, to understand who we should be working with. Are you the point person? My goal is for our team and Org Home to help you work through this situation and to help the community as a whole. If for any reason you do not think this is sufficient, please contact Brad, Angela or me directly. My cell is 415 640 1092. I am around all weekend. Sound OK? Sincerely, Robert Robert Miller Chief Executive Officer 1438 West Peachtree Street NW, Suite 200, Atlanta, GA 30309 Direct: 404-592-4898 Cell: 415-640-1092 Toll free: 800-999-8558 Skype: Robert-Miller > On Aug 14, 2015, at 4:20 PM, Callahan, Maureen > wrote: To the Members of the ArchivesSpace Governance Board: As ArchivesSpace member institutions shift from the task of migrating data to the utilization of ArchivesSpace for production archival management, endemic issues related to performance and scalability are severely limiting our ability to fully utilize the system. Please find the attached report, created by Hudson Molonglo and sponsored by Yale, which outlines a set of sensible next steps to provide immediate relief to some of the problems that users of ArchivesSpace have been experiencing. As members, we are eager to participate in the continued improvement of the application. We see the areas targeted in the report as critical and a necessary first step in addressing performance concerns. We would like to see development to address these concerns happen immediately. Collectively, many of our repositories are experiencing significant performance problems. In some cases, members are seeing work grind to a halt as accession records take as long as twenty seconds to save, archival object records take as long as ten seconds to save, and records with many links (agents and subjects, digital objects, sibling records) may take as long as ten minutes to load, or never load at all. Without better performance from ArchivesSpace, we are hampered in our mission of providing meaningful descriptions of records for our users. We think that you will find Hudson Molonglo?s explanation of these problems and proposed solutions helpful and actionable. While the normal procedures of voting on feature prioritization generally work very well for developing new parts of the application, critical issues like these cannot wait for the next round of voting. As ArchivesSpace continues to mature, production-critical issues will be fewer in number. Until then, it would be helpful to chart an effective path to bringing these problems to the foreground and providing the resources required to address them quickly. Finally, we recognize that like many other projects, ArchivesSpace?s growth will be an iterative development process. And as such, there may be areas of the system -- like the thresholds we discovered for records with many links -- where archival practices exceed the system?s current capacity. Part of the competitive advantage of ArchivesSpace must come from transparency around not only its strengths, but also its current limitations. We request documentation that outlines known thresholds and current capacity, so that we can make responsible decisions about the tool?s implementation at our repositories. We are eager to continue this conversation. Respectfully submitted, Maureen Callahan, on behalf of the Yale University ArchivesSpace Committee Terry Reese, on behalf of The Ohio State University Ben Goldman, on behalf of Pennsylvania State University Chris Prom, on behalf of the University of Illinois at Urbana-Champaign -------------- next part -------------- An HTML attachment was scrubbed... URL: From Robert.Miller at lyrasis.org Fri Aug 14 19:59:11 2015 From: Robert.Miller at lyrasis.org (Robert Miller) Date: Fri, 14 Aug 2015 23:59:11 +0000 Subject: [Archivesspace_Users_Group] ArchivesSpace performance problems and solutions In-Reply-To: <8AC409B1-93E6-4CAE-9497-18055B43E445@yale.edu> References: , <8AC409B1-93E6-4CAE-9497-18055B43E445@yale.edu> Message-ID: <65FEC258-E7E0-4505-999F-3837CFA39DCE@lyrasis.org> Hi Maureen, Thx for the speedy reply! I hope to meet you next week at SAA. Thx for clarifying the roles inside of Yale. I think John Hebert, from my DTS team, has suggested a testing strategy to see if we can help isolate the problem. I'll have him chime in here also. (And hopefully I haven't interrupted the path that Angela and Brad are working on. I have asked them to summarize for the community where they think things stand. That might expedite a solution or a path to the same. ) Best, R Robert Miller Chief Executive Officer 1438 West Peachtree Street NW, Suite 200, Atlanta, GA 30309 Direct: 404-592-4898 Cell: 415-640-1092 Toll free: 800-999-8558 Skype: Robert.Miller [cid:image001.png at 01CE1341.AA604180] [Ficon][TIcon] On Aug 14, 2015, at 4:59 PM, Callahan, Maureen > wrote: Dear Robert, Thanks for your email ? Lyrasis has certainly demonstrated a commitment to members, which I know that we at Yale are glad to see. The issues addressed in this report are unrelated to Yale?s conversations with Lyrasis about becoming hosted customers ? they address problems in the core application and are shared by the community. Please feel free to continue to direct communications about Lyrasis hosting to Ray Frohlich from our enterprise systems department. Warm wishes, Maureen Maureen Callahan Archivist, Metadata Specialist Manuscripts & Archives Yale University Library maureen.callahan at yale.edu 203.432.3627 Webpage: web.library.yale.edu/mssa Collections: drs.library.yale.edu On Aug 14, 2015, at 5:45 PM, Robert Miller > wrote: HI Maureen, I have just finished a meeting with my technical team (10 minutes ago). You email arrived right after our meeting concluded. Brad is going to be responding to you with some suggestions and ideas about an action plan. We have, with another arm of LYRASIS, been in discussions with Yale about the problems and have made two proposals to assist you based on what we were told. It appears there are a number of players involved from Yale so it is a little unclear, at least to me, to understand who we should be working with. Are you the point person? My goal is for our team and Org Home to help you work through this situation and to help the community as a whole. If for any reason you do not think this is sufficient, please contact Brad, Angela or me directly. My cell is 415 640 1092. I am around all weekend. Sound OK? Sincerely, Robert Robert Miller Chief Executive Officer 1438 West Peachtree Street NW, Suite 200, Atlanta, GA 30309 Direct: 404-592-4898 Cell: 415-640-1092 Toll free: 800-999-8558 Skype: Robert-Miller > On Aug 14, 2015, at 4:20 PM, Callahan, Maureen > wrote: To the Members of the ArchivesSpace Governance Board: As ArchivesSpace member institutions shift from the task of migrating data to the utilization of ArchivesSpace for production archival management, endemic issues related to performance and scalability are severely limiting our ability to fully utilize the system. Please find the attached report, created by Hudson Molonglo and sponsored by Yale, which outlines a set of sensible next steps to provide immediate relief to some of the problems that users of ArchivesSpace have been experiencing. As members, we are eager to participate in the continued improvement of the application. We see the areas targeted in the report as critical and a necessary first step in addressing performance concerns. We would like to see development to address these concerns happen immediately. Collectively, many of our repositories are experiencing significant performance problems. In some cases, members are seeing work grind to a halt as accession records take as long as twenty seconds to save, archival object records take as long as ten seconds to save, and records with many links (agents and subjects, digital objects, sibling records) may take as long as ten minutes to load, or never load at all. Without better performance from ArchivesSpace, we are hampered in our mission of providing meaningful descriptions of records for our users. We think that you will find Hudson Molonglo?s explanation of these problems and proposed solutions helpful and actionable. While the normal procedures of voting on feature prioritization generally work very well for developing new parts of the application, critical issues like these cannot wait for the next round of voting. As ArchivesSpace continues to mature, production-critical issues will be fewer in number. Until then, it would be helpful to chart an effective path to bringing these problems to the foreground and providing the resources required to address them quickly. Finally, we recognize that like many other projects, ArchivesSpace?s growth will be an iterative development process. And as such, there may be areas of the system -- like the thresholds we discovered for records with many links -- where archival practices exceed the system?s current capacity. Part of the competitive advantage of ArchivesSpace must come from transparency around not only its strengths, but also its current limitations. We request documentation that outlines known thresholds and current capacity, so that we can make responsible decisions about the tool?s implementation at our repositories. We are eager to continue this conversation. Respectfully submitted, Maureen Callahan, on behalf of the Yale University ArchivesSpace Committee Terry Reese, on behalf of The Ohio State University Ben Goldman, on behalf of Pennsylvania State University Chris Prom, on behalf of the University of Illinois at Urbana-Champaign -------------- next part -------------- An HTML attachment was scrubbed... URL: From lgrigsby at library.berkeley.edu Fri Aug 14 21:11:08 2015 From: lgrigsby at library.berkeley.edu (Lynne E. Grigsby) Date: Fri, 14 Aug 2015 18:11:08 -0700 Subject: [Archivesspace_Users_Group] Error messages during dev import In-Reply-To: References: Message-ID: 1) v1.3.0 -- we have the latest version on this server as we want the most up-to-date changes for importing our legacy finding aids. 2) Berkeley Library server -- this is our dev instance. MySQL database. 3) We usually import into our dev machines. We can test with the ArchivesSpace sandbox -- is that what the next step would be? What is the solution if we have a problem with our instance but you don't with yours? Just wondering what the next steps for us are. Lynne On Fri, Aug 14, 2015 at 12:25 PM, Brad Westbrook wrote: > Hi, James, > > > > I have some background questions, for which I don?t see or missed the > answers in the exchanges below: > > > > 1) What version of ArchivesSpace are you using? > > > > 2) Where is your database located? Berkeley server? CDL? > > > > 3) Have you test importing any of the files in the A