[Archivesspace_Users_Group] Import Oddities, or How I Learned To Start Worrying And Stuff

[Chris Fitzpatrick]

Hi all,

Having a bit of difficultly replicating this...what might be happening is that if you clear out the database, you will also need to be sure to clear out your import batch space. This is located in data/shared/import_jobs by default. If not, the job counter will start back at 1 and your uploads will have the files from previous imports in them, hence possibly run them through twice...


b,chris. 


Chris Fitzpatrick | Developer, ArchivesSpace
Skype: chrisfitzpat  | Phone: 918.236.6048
http://archivesspace.org/

________________________________________
From: archivesspace_users_group-bounces at lyralists.lyrasis.org <archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Steven Majewski <sdm7g at virginia.edu>
Sent: Tuesday, June 03, 2014 8:37 PM
To: Archivesspace Users Group
Subject: Re: [Archivesspace_Users_Group] Import Oddities,       or How I Learned To Start Worrying And Stuff

On Jun 3, 2014, at 1:54 PM, Bridger Dyson-Smith <bdysonsm at utk.edu> wrote:

> Hi all,
>
> I'm experiencing a number of strange things during batch imports -- I am *mostly* sure that nothing has been slipped into my coffee and I've only had about 1/2 a pot so I don't think it's the caffeine.
>
> Is there any reason that the importer would fail [1] on an EAD (MS.3374) while it was in a job of ~100 files, then succeed [2] on an import of 3 EADs? Has anyone seen anything like this? I did not modify the file between attempts. I'm going to drink more coffee - that seems to help.
>
> In all seriousness, could this be a configuration issue? Maybe Java doesn't have enough memory? I'm very confused by this.
>


Yes — I’ve seen the same thing: A batch import of 23 files fails. Breaking up the task in 3 imports, they all succeed.

I think it was a duplicate id error, but I’m not sure.  At the time I was more intent on getting the files into the system
for evaluation. I will try to reproduce the error and see what I can discover.


— Steve Majewski




> Thanks,
> Bridger
>
> [1] Failure:
> (job info)
> Time Started: 2014-06-03 13:17:10 -0400
> Time Completed:       2014-06-03 13:19:02 -0400
> ==================================================
> MS.3374-ead.xml
> ==================================================
> Error: #<:ValidationException: {:errors=>{"dates"=>["one or more required (or enter a Title)"], "title"=>["must not be an empty string (or enter a Date)"]}}>
>
> [2] Success:
> (job info)
> Time Started: 2014-06-03 13:39:53 -0400
> Time Completed: 2014-06-03 13:39:58 -0400
> ==================================================
> MS.3374-ead.xml
> ==================================================
> 1. STARTED: Reading JSON records
> 1. DONE: Reading JSON records
> 2. STARTED: Validating records and checking links
> 2. DONE: Validating records and checking links
> 3. STARTED: Evaluating record relationships
> 3. DONE: Evaluating record relationships
> 4. STARTED: Saving records: cycle 1
> Created: /agents/people/import_a49b04c2-c1c4-43de-99c2-82d8d802dc0a
> Created: /agents/people/import_da3784b7-bf64-4752-8b80-407b5b6bb04a
> Created: /agents/families/import_ebda7b32-89f8-4296-9fe9-b5ed7b909bc9
> Created: /subjects/import_bd91f306-5b72-4b76-a27d-b7574d29f825
> Created: /repositories/import/resources/import_1b584d0f-f49e-4bba-9fae-2be1cc3d6a61
> 4. DONE: Saving records: cycle 1
> 5. STARTED: Dealing with circular dependencies: cycle 1
> 5. DONE: Dealing with circular dependencies: cycle 1
> 6. STARTED: Saving records: cycle 2
> Created: /repositories/import/archival_objects/import_e5e347ae-6095-4bbe-879a-1714f2351191
> 6. DONE: Saving records: cycle 2
> 7. STARTED: Cleaning up
> 7. DONE: Cleaning up
>
> _______________________________________________
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group at lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group