<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<div style="">
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D">Laurel, all:</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D"> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D">Following up on this issue, I tried to replicate it in the newest version of
<span style="">ArchivesSpace</span>, but I haven’t had any luck (well, I uncovered a few other minor bugs, but nothing as problematic as the ones you reported).
<span style=""> </span>Anyhow, here’s the file that I uploaded for testing, which is in the
<span style="">GoneRepo</span> repository: <a href="http://test.archivesspace.org/resources/151" style="color: rgb(5, 99, 193); text-decoration: underline;" id="LPlnk728498">
http://test.archivesspace.org/resources/151</a>.<span style=""> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D"> </span></p>
<p style="margin: 0in 0in 0.0001pt;"><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">So, it appears that the problem is being caused by how previous importers (or migrators) handled the ampersands versus what the exporter expects
now. </span></font><span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;"> </span><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">For example, this is text from one of our scope and content
notes that was imported from AT, I think:</span></font><span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;">
</span><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">“individual cards measuring 300 by 360mm & captioned.” (</span><span style="font-size: 15px;">and</span><span style="font-size: 11pt;"> that ampersand is not </span></font><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">encoded
as "&", which is how it is imported in versions 1.5, and possibly earlier</span></font><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">).</span></font><span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;"> </span><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">That
ampersand </span></font><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">no longer exports okay in version 1.5, but it exports fine in version 1.4.2</span></font><span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;">
</span><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 11pt;">Ideally, the importers and exporters would have one way to handle XML data but it seems like there have been different ways to do that in the past. I've no clue how best
to handle that </span><span style="font-size: 15px;">with</span><span style="font-size: 11pt;"> the ASpace architecture, aside to say that it should be consistent in all aspects of the application.</span><span style="font-size: 11pt;"></span></font></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<br>
</p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D">Mark</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D"> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<a name="_MailOriginal"><b><span style="">From:</span></b></a><span style=""><span style=""> archivesspace_users_group-bounces@lyralists.lyrasis.org [mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org]
<b>On Behalf Of </b>Custer, Mark<br>
<b>Sent:</b> Thursday, 21 July, 2016 5:12 PM<br>
<b>To:</b> Archivesspace Users Group<br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] RC candidates and v1.5.0 not creating <p> tags in EAD export</span></span></p>
</div>
</div>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D">Hi, Laurel:</span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D">What timing! I remember Brad mentioning this issue before, but I had completely forgotten about it until seeing your message about the exact same time that I was testing a new automatic EAD export service for ArchivesSpace.
Right before I read your message, I was wondering why so many of our files failed to produce valid EAD files. The main problem, it turns out, is the bug that’s not putting paragraph elements around text that has ampersands. But this only happens in the
1.5 versions. I can confirm that in version 1.4.2 this problem doesn’t exist (that’s our production version), but that it does exist in 1.5 (that’s our test version). I haven’t tested anything with the altformavail/extref issues, though.
</span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D">I haven’t looked into the exporter code too much yet, but the history of updates to the EAD exporter file should provide clues (to the developers, at least):
</span></span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_archivesspace_archivesspace_commits_master_backend_app_exporters_serializers_ead.rb&d=CwMFAg&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=s7ciGQfUJeaV_ryx908hbeXDoU9aqDwDN0Z0VbfsJ3Y&m=dURyN9dLHMTStr2wd50oCQjXJwVfE97zD-TWh4fTqus&s=bBnV5XYygTQhUg2JF6pLIPSbdbdXi-bu1T_qRF2ycdo&e=" style="color: rgb(5, 99, 193); text-decoration: underline;"><span style="">https://github.com/archivesspace/archivesspace/commits/master/backend/app/exporters/serializers/ead.rb</span><span style=""></span></a><span style=""><span style="color:#1F497D">
</span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D">Mark</span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="color:#1F497D"> </span></span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><b>From:</b> </span><a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org" style="color: rgb(5, 99, 193); text-decoration: underline;"><span style="">archivesspace_users_group-bounces@lyralists.lyrasis.org</span><span style=""></span></a><span style="">
[</span><a href="mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org" style="color: rgb(5, 99, 193); text-decoration: underline;"><span style="">mailto:archivesspace_users_group-bounces@lyralists.lyrasis.org</span><span style=""></span></a><span style="">]
<b>On Behalf Of </b>McPhee, Laurel<br>
<b>Sent:</b> Thursday, 21 July, 2016 3:45 PM<br>
<b>To:</b> </span><a href="mailto:archivesspace_users_group@lyralists.lyrasis.org" style="color: rgb(5, 99, 193); text-decoration: underline;"><span style="">archivesspace_users_group@lyralists.lyrasis.org</span><span style=""></span></a><span style=""><br>
<b>Subject:</b> [<span style="">Archivesspace_Users_Group</span>] RC candidates and v1.5.0 not creating <p> tags in EAD export</span></p>
</div>
</div>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Hello,</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">UC San Diego discovered an issue in R2 that we informally reported to B. Westbrook in early June. The bug is this: note fields containing either an & entity ref and/or an <extref> tag do not get properly wrapped in a <p> tag upon EAD export.
For example, all of our <prefercite> notes contain the term “Special Collections & Archives”, and because of the presence of the ampersand in the note, do not get wrapped. Similarly, if a bioghist note has an & somewhere in it, none of the paragraphs get wrapped
in a <p> tag, leaving us with giant block of text. And last, in altformavail, where we record the existence of digital versions of our collections with a link, the existence of an <extref> causes the whole note to not get wrapped in a <p> tag when we export
the EAD.</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">This issue breaks our local scripts and also prevents validation on the Online Archive of California. At the time, I didn’t create a JIRA ticket, because we were told the problem was being worked on…but now I’m going through the steps to create
the ticket. Is there any feedback/observations on this in the member community before I do so? It’s happening in v1.5.0, which we tested this morning. Thanks!</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><b>Laurel McPhee</b></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Supervisory Archivist, Special Collections & Archives Program</span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">UC San Diego Library | </span><span style=""><span style="font-size:10.0pt; font-family:Wingdings">(</span></span><span style=""><span style="font-size:10.0pt">
</span>858-534-5619 |</span><span style=""><span style="font-size:10.0pt"> </span>
</span><span style=""><span style="font-size:10.0pt; font-family:Wingdings">*</span></span><span style=""><span style="font-size:10.0pt">
</span></span><a href="mailto:lmcphee@ucsd.edu" style="color: rgb(5, 99, 193); text-decoration: underline;"><span style="">lmcphee@ucsd.edu</span><span style=""></span></a><span style=""></span></p>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<span style=""></span>
<p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
</div>
</div>
</body>
</html>