[Archivesspace_Users_Group] Import Oddities, or How I Learned To Start Worrying And Stuff

Tue Jun 10 09:19:17 EDT 2014

Hi Chris,

I'll zip them up and send them along.
Thanks much!

Best,
Bridger

On 06/10/2014 04:44, Chris Fitzpatrick wrote:
>
>
> Hi Bridger,
>
> Yes, deleting those directories would clean out your import_jobs directory. But if there's no jobs in there, then that's not the issue...
>
> Might it be possible for you to send me a zipped copy of the 100 EAD files that are causing the issue? The bulk batch I'm uploading seems to go through fine, but it's probably something in the data that is triggering the error..
>
> b,chris.
>
> Chris Fitzpatrick | Developer, ArchivesSpace
> Skype: chrisfitzpat  | Phone: 918.236.6048
> http://archivesspace.org/
>
> ________________________________________
> From: archivesspace_users_group-bounces at lyralists.lyrasis.org <archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Bridger Dyson-Smith <bdysonsm at utk.edu>
> Sent: Monday, June 09, 2014 6:42 PM
> To: archivesspace_users_group at lyralists.lyrasis.org
> Subject: Re: [Archivesspace_Users_Group] Import Oddities, or How I Learned To Start Worrying And Stuff
>
> Hi Chris,
>
> Thanks for the response. Apologies if I'm misunderstanding, but if we
> see this error, we should rm -rf
> server:/path/to/archivesspace/data/shared/import_jobs/* and that may
> prevent this?
>
> I guess I'm confused as this error has occurred in a clean ArchivesSpace
> install, on the first import attempt.
>
> Your time & trouble are much appreciated.
> Best,
> Bridger
>
>
>
> On 06/06/2014 13:33, Chris Fitzpatrick wrote:
>>
>>
>> Hi all,
>>
>> Having a bit of difficultly replicating this...what might be happening is that if you clear out the database, you will also need to be sure to clear out your import batch space. This is located in data/shared/import_jobs by default. If not, the job counter will start back at 1 and your uploads will have the files from previous imports in them, hence possibly run them through twice...
>>
>>
>> b,chris.
>>
>>
>> Chris Fitzpatrick | Developer, ArchivesSpace
>> Skype: chrisfitzpat  | Phone: 918.236.6048
>> http://archivesspace.org/
>>
>> ________________________________________
>> From: archivesspace_users_group-bounces at lyralists.lyrasis.org <archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Steven Majewski <sdm7g at virginia.edu>
>> Sent: Tuesday, June 03, 2014 8:37 PM
>> To: Archivesspace Users Group
>> Subject: Re: [Archivesspace_Users_Group] Import Oddities,       or How I Learned To Start Worrying And Stuff
>>
>> On Jun 3, 2014, at 1:54 PM, Bridger Dyson-Smith <bdysonsm at utk.edu> wrote:
>>
>>> Hi all,
>>>
>>> I'm experiencing a number of strange things during batch imports -- I am *mostly* sure that nothing has been slipped into my coffee and I've only had about 1/2 a pot so I don't think it's the caffeine.
>>>
>>> Is there any reason that the importer would fail [1] on an EAD (MS.3374) while it was in a job of ~100 files, then succeed [2] on an import of 3 EADs? Has anyone seen anything like this? I did not modify the file between attempts. I'm going to drink more coffee - that seems to help.
>>>
>>> In all seriousness, could this be a configuration issue? Maybe Java doesn't have enough memory? I'm very confused by this.
>>>
>>
>>
>> Yes — I’ve seen the same thing: A batch import of 23 files fails. Breaking up the task in 3 imports, they all succeed.
>>
>> I think it was a duplicate id error, but I’m not sure.  At the time I was more intent on getting the files into the system
>> for evaluation. I will try to reproduce the error and see what I can discover.
>>
>>
>> — Steve Majewski
>>
>>
>>
>>
>>> Thanks,
>>> Bridger
>>>
>>> [1] Failure:
>>> (job info)
>>> Time Started: 2014-06-03 13:17:10 -0400
>>> Time Completed:       2014-06-03 13:19:02 -0400
>>> ==================================================
>>> MS.3374-ead.xml
>>> ==================================================
>>> Error: #<:ValidationException: {:errors=>{"dates"=>["one or more required (or enter a Title)"], "title"=>["must not be an empty string (or enter a Date)"]}}>
>>>
>>> [2] Success:
>>> (job info)
>>> Time Started: 2014-06-03 13:39:53 -0400
>>> Time Completed: 2014-06-03 13:39:58 -0400
>>> ==================================================
>>> MS.3374-ead.xml
>>> ==================================================
>>> 1. STARTED: Reading JSON records
>>> 1. DONE: Reading JSON records
>>> 2. STARTED: Validating records and checking links
>>> 2. DONE: Validating records and checking links
>>> 3. STARTED: Evaluating record relationships
>>> 3. DONE: Evaluating record relationships
>>> 4. STARTED: Saving records: cycle 1
>>> Created: /agents/people/import_a49b04c2-c1c4-43de-99c2-82d8d802dc0a
>>> Created: /agents/people/import_da3784b7-bf64-4752-8b80-407b5b6bb04a
>>> Created: /agents/families/import_ebda7b32-89f8-4296-9fe9-b5ed7b909bc9
>>> Created: /subjects/import_bd91f306-5b72-4b76-a27d-b7574d29f825
>>> Created: /repositories/import/resources/import_1b584d0f-f49e-4bba-9fae-2be1cc3d6a61
>>> 4. DONE: Saving records: cycle 1
>>> 5. STARTED: Dealing with circular dependencies: cycle 1
>>> 5. DONE: Dealing with circular dependencies: cycle 1
>>> 6. STARTED: Saving records: cycle 2
>>> Created: /repositories/import/archival_objects/import_e5e347ae-6095-4bbe-879a-1714f2351191
>>> 6. DONE: Saving records: cycle 2
>>> 7. STARTED: Cleaning up
>>> 7. DONE: Cleaning up
>>>
>>> _______________________________________________
>>> Archivesspace_Users_Group mailing list
>>> Archivesspace_Users_Group at lyralists.lyrasis.org
>>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>>
>> _______________________________________________
>> Archivesspace_Users_Group mailing list
>> Archivesspace_Users_Group at lyralists.lyrasis.org
>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>>
>
> _______________________________________________
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group at lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
> _______________________________________________
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group at lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>