<div dir="ltr"><div>Maura,</div><div><br></div><div>I tried to import my fourth batch and also received an error. </div><div><br></div><div>Assuming there was something in my data (a disallowed character or something) that was throwing off the import, without restarting I revisited my third batch and split these into two groups of 50, the first imported fine, the second did not. </div><div><br></div><div>I further parsed the second group of 50 into groups of 10 records each and import failed...then tried individual records one-by-one. Some succeeded, some failed. </div><div><br></div><div>Of those that failed I could not find the offending issue/characters/??? I am continuing the one record import to see if there is a pattern to the records that fail to import. </div><div><br></div><div>Ultimately of course, I'd like to avoid importing the remaining 435 records one at a time, but in assessing those failed single record import attempts, so far I am stumped as to what is causing the error. </div><div><br></div><div>- Nicole</div><div><br></div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div>******<div>Nicole Blechynden</div><div dir="ltr"><div>Archivist</div><div>Heart Mountain Wyoming Foundation</div><div>1539 Road 19</div><div>Powell, WY 82435</div><div>307-754-8000 x103</div></div></div></div></div></div>
<br><div class="gmail_quote">On Thu, Jun 11, 2015 at 12:02 PM, Maura Carbone <span dir="ltr"><<a href="mailto:mauraa@brandeis.edu" target="_blank">mauraa@brandeis.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Nicole,<div>It is possible there is in error in one of the csv files in that third batch. I've found that depending on the type of error your imports can have, you might not actually get specification with what is wrong beyond 'error' (this would happen to me with my EAD imports). When the third batch fails, are you able to import the fourth batch after (without restarting)? Or ever just one record successfully after?</div><div><br></div><div>-Maura</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 11, 2015 at 11:56 AM, Nicole Blechynden <span dir="ltr"><<a href="mailto:nicoleb@heartmountain.org" target="_blank">nicoleb@heartmountain.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid"><div dir="ltr"><div>Hi all,</div><div><br></div><div>I have a little over 600 accession records to import using the CSV template. On my first attempt I received a non-specific error appearing on the Import Job:Job Status screen within the application so I began splitting these into batches of 100 records each. My first two batches imported fine, exactly as expected but when I tried the third batch I again received a non-specific error. </div><div><br></div><div>I opened the archivesspace.out log to see if that might yield any clues but couldn't make heads or tails of it, as far as identify what is failing in the process. </div><div><br></div><div>I'm a couple versions back, using Version v1.1.2 running against the demo database (my current test environment).</div><div><br></div><div>Here's a snippet of code from the .out log from one attempt:</div><div><br>D, [2015-06-10T15:20:47.877000 #5076] DEBUG -- : Thread-14292: Import running for job 75<br>E, [2015-06-10T15:20:47.924000 #5076] ERROR -- : Thread-14296: Job 75 failed: Permission denied - C:\UserFiles\archivesspace\data\tmp\import_batch_working_file_143397124790920150610-5076-lv1tbj ["org/jruby/RubyFile.java:1106:in `unlink'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/converter.rb:22:in `remove_files'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/lib/parse_queue.rb:85:in `each_open_file_path'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/converters/converter.rb:21:in `remove_files'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:80:in `run'", "org/jruby/RubyArray.java:1613:in `each'", "org/jruby/RubyEnumerable.java:977:in `each_with_index'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:63:in `run'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:125:in `open'", "org/jruby/RubyFixnum.java:280:in `times'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/model/db.rb:113:in `open'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_runner.rb:59:in `run'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_job_queue.rb:96:in `run_pending_import'", "C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/lib/batch_import_job_queue.rb:123:in `start_background_thread'"]<br>Started GET "/jobs/75/status" for 0:0:0:0:0:0:0:1 at 2015-06-10 15:20:47 -0600<br>Processing by JobsController#status as JSON<br> Parameters: {"id"=>"75"}<br>D, [2015-06-10T15:20:48.018000 #5076] DEBUG -- : Thread-13264: GET /repositories/4/jobs/75 [session: #<Session:0x91cfe @store={:user=>"admin", :login_time=>2015-06-10 15:17:42 -0600, :expirable=>true}, @id="35a81ae84f5476b18dca98bab372f309ef68464c588359398c4f25e917d14cdf">]<br>D, [2015-06-10T15:20:48.018000 #5076] DEBUG -- : Thread-13264: Post-processed params: {:id=>75, :repo_id=>4}<br>D, [2015-06-10T15:20:48.081000 #5076] DEBUG -- : Thread-13264: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"469"}, ["{\"import_type\":\"accession_csv\",\"lock_version\":2,\"filenames\":[\"realdatatest_301ThruLine400.csv\"],\"time_submitted\":\"2015-06-10 21:20:46 UTC\",\"time_started\":\"2015-06-10 21:20:47 UTC\",\"status\":\"running\",\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2015-06-10T21:20:46Z\",\"system_mtime\":\"2015-06-10T21:20:47Z\",\"user_mtime\":\"2015-06-1... in 94.0ms<br>Completed 200 OK in 125.0ms (Views: 0.0ms)<br>Started GET "/jobs/75" for 0:0:0:0:0:0:0:1 at 2015-06-10 15:20:48 -0600<br>Processing by JobsController#show as HTML<br> Parameters: {"id"=>"75"}<br>D, [2015-06-10T15:20:48.221000 #5076] DEBUG -- : Thread-6996: GET /repositories/4/jobs/75?resolve%5B%5D=repository [session: #<Session:0x1cfa0ee @store={:user=>"admin", :login_time=>2015-06-10 15:17:42 -0600, :expirable=>true}, @id="35a81ae84f5476b18dca98bab372f309ef68464c588359398c4f25e917d14cdf">]<br>D, [2015-06-10T15:20:48.221000 #5076] DEBUG -- : Thread-6996: Post-processed params: {:id=>75, :resolve=>["repository"], :repo_id=>4}<br>D, [2015-06-10T15:20:48.284000 #5076] DEBUG -- : Thread-6996: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"826"}, ["{\"import_type\":\"accession_csv\",\"lock_version\":2,\"filenames\":[\"realdatatest_301ThruLine400.csv\"],\"time_submitted\":\"2015-06-10 21:20:46 UTC\",\"time_started\":\"2015-06-10 21:20:47 UTC\",\"status\":\"running\",\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2015-06-10T21:20:46Z\",\"system_mtime\":\"2015-06-10T21:20:47Z\",\"user_mtime\":\"2015-06-1... in 78.0ms<br> Rendered shared/_breadcrumb.html.erb (16.0ms)<br> Rendered jobs/_show_templates.html.erb (0.0ms)<br> Rendered shared/_sidebar_entry.html.erb (0.0ms)<br> Rendered shared/_sidebar_entry.html.erb (0.0ms)<br> Rendered shared/_sidebar_entry.html.erb (0.0ms)<br> Rendered shared/_sidebar.html.erb (0.0ms)<br> Rendered jobs/_sidebar.html.erb (0.0ms)<br> Rendered jobs/_toolbar.html.erb (0.0ms)<br> Rendered shared/_flash_messages.html.erb (0.0ms)<br> Rendered shared/_flash_messages.html.erb (0.0ms)<br> Rendered jobs/show.html.erb within layouts/application (110.0ms)<br> Rendered shared/_browser_support.html.erb (16.0ms)<br> Rendered shared/_header_user.html.erb (31.0ms)<br> Rendered shared/_header_global.html.erb (31.0ms)<br> Rendered site/_branding.html.erb (0.0ms)<br> Rendered shared/_advanced_search.html.erb (16.0ms)<br> Rendered shared/_header_repository.html.erb (94.0ms)<br> Rendered C:/UserFiles/archivesspace/plugins/aspace_feedback/frontend/views/site/_feedback_form.html.erb (0.0ms)<br> Rendered C:/UserFiles/archivesspace/plugins/aspace_feedback/frontend/views/site/_footer.html.erb (16.0ms)<br> Rendered shared/_templates.html.erb (15.0ms)<br>Completed 200 OK in 406.0ms (Views: 312.0ms)<br>Started GET "/jobs/75/log?offset=0" for 0:0:0:0:0:0:0:1 at 2015-06-10 15:20:48 -0600<br>Processing by JobsController#log as */*<br> Parameters: {"offset"=>"0", "id"=>"75"}<br>Completed 200 OK in 16.0ms<br>D, [2015-06-10T15:20:48.987000 #5076] DEBUG -- : Thread-13264: GET /repositories/4/jobs/75/log?offset=0 [session: #<Session:0xa7438f @store={:user=>"admin", :login_time=>2015-06-10 15:17:42 -0600, :expirable=>true}, @id="35a81ae84f5476b18dca98bab372f309ef68464c588359398c4f25e917d14cdf">]<br>D, [2015-06-10T15:20:48.987000 #5076] DEBUG -- : Thread-13264: Post-processed params: {:id=>75, :repo_id=>4, :offset=>0}<br>D, [2015-06-10T15:20:49.049000 #5076] DEBUG -- : Thread-13264: Responded with [200, {"Content-Type"=>"text/plain", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"499"}, #<Enumerator: #<JRuby::Generator::Threaded:0x1790ec7 @block=#<Proc:0x410aaa@C:/UserFiles/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/controllers/job.rb:116>, @next_element=nil, @index=0, @queue_finalizer=#<JRuby::Generator::Threaded::QueueFinalizer:0xc80a7c @queue=#<JRuby::Generator::Threaded::ProducerQueue:0x4debc2>>, @queue=#<JRuby::Generator::Threaded::... in 93.0ms<br></div><div><br></div><div><br clear="all"></div><div><div><div dir="ltr"><div>******<span><font color="#888888"><div>Nicole Blechynden</div><div dir="ltr"><div>Archivist</div><div>Heart Mountain Wyoming Foundation</div><div>1539 Road 19</div><div>Powell, WY 82435</div><div><a href="tel:307-754-8000%20x103" target="_blank" value="+13077548000">307-754-8000 x103</a></div></div></font></span></div></div></div></div>
</div>
<br>_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org" target="_blank">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
<a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group" target="_blank">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><br>
<br></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div><div dir="ltr">Maura Carbone<div>Digital Initiatives Librarian<br>Brandeis University<br>Library and Technology Services<br><a href="tel:%28781%29%20736-4659" target="_blank" value="+17817364659">(781) 736-4659</a><br>415 South Street, (MS 017/P.O. Box 549110)<br>Waltham, MA 02454-9110<br>email: <a href="mailto:mauraa@brandeis.edu" target="_blank">mauraa@brandeis.edu</a><br></div></div></div>
</font></span></div>
<br>_______________________________________________<br>
Archivesspace_Users_Group mailing list<br>
<a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@lyralists.lyrasis.org</a><br>
<a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group" target="_blank">http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group</a><br>
<br></blockquote></div><br></div>