<div dir="ltr">Hi there,<div><br></div><div>Yes it is definitely possible to use OpenRefine to migrate data into the system. It's my primary tool for our data migration. One of the nice things about OpenRefine is its Templating export option. I was inspired by an extremely helpful University of Maryland Chaos to Order post:</div><div><a href="https://icantiemyownshoes.wordpress.com/2015/11/20/how-i-learned-to-stop-worrying-and-love-the-api/">https://icantiemyownshoes.wordpress.com/2015/11/20/how-i-learned-to-stop-worrying-and-love-the-api/</a><br></div><div><br></div><div>That is how we've been creating records and we have developed a number of templates to export the JSON. There are a few differences in our process. For instance, the bash script didn't like spaces in content, so we added a line </div><div>IFS=$| </div><div><br></div><div>and all of my templates end in a pipe.</div><div><br></div><div>To update records, we were inspired by a Duke Python script:</div><div><a href="https://github.com/duke-libraries/archivesspace-duke-scripts/blob/master/python/duke_archival_object_metadata_adder.py">https://github.com/duke-libraries/archivesspace-duke-scripts/blob/master/python/duke_archival_object_metadata_adder.py</a><br></div><div><a href="https://blogs.library.duke.edu/bitstreams/2016/09/21/archivesspace-api-fun/">https://blogs.library.duke.edu/bitstreams/2016/09/21/archivesspace-api-fun/</a><br></div><div>as described in the blog post above.</div><div><br></div><div>So for instance, we migrated our EAD by using BaseX to extract elements. I created minimal resource records and incrementally added notes.</div><div><br></div><div>The process is somewhat laid out in the slides I made for a presentation:</div><div><a href="https://docs.google.com/presentation/d/1cBrd8qzHK4i8S6SQ_vDlScERixX95lAbE__hd48yIDg/edit?usp=sharing">https://docs.google.com/presentation/d/1cBrd8qzHK4i8S6SQ_vDlScERixX95lAbE__hd48yIDg/edit?usp=sharing</a><br></div><div><br></div><div>Hopefully, this helps.</div><div><br></div><div>-Olivia</div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Feb 12, 2018 at 9:45 AM, Joan Curbow <span dir="ltr"><<a href="mailto:CurbowJ@bvu.edu" target="_blank">CurbowJ@bvu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="m_-7486821003269065284WordSection1">
<p class="MsoNormal">We are a new archives, so we have not had to import any existing data. Lucky us, right? But I’m all-too-human, and I’d now like to do some data cleanup. Is it possible to do data cleanup using OpenRefine? Theoretically, it seems possible
to export “stuff” and pull it into OpenRefine, but I’ve only ever used OpenRefine in a classroom situation, where the data was already populated for us. We did not import the data back into an existing database, either, so my experience is limited to just
the mechanics of OpenRefine. Has anyone used OpenRefine in a real-world situation with data that’s already in Aspace? Or is there a better method for data cleanup?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">A further question/complication is that I’m a lone arranger, and my instance is hosted by Libraryhost, so any data cleanup may have to be done by them? My tech skills are rudimentary, so I’m not clear just how I could get this to work.
I asked them once, but didn’t get a real answer.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Sincerely,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#002244">Joan Curbow</span></b><span style="font-size:12.0pt;font-family:"Times New Roman",serif"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7">Reference Librarian and Archivist</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7">Buena Vista University Library<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7">Buena Vista University<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7">610 West Fourth Street<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7">Storm Lake, Iowa 50588</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7"><a href="tel:(712)%20749-2094" value="+17127492094" target="_blank">712.749.2094</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#90a4b7"><a href="http://www.library.bvu.edu" target="_blank">www.library.bvu.edu</a></span><span style="font-size:12.0pt;font-family:"Times New Roman",serif"><u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<br>______________________________<wbr>_________________<br>
Archivesspace_Users_Group mailing list<br>
<a href="mailto:Archivesspace_Users_Group@lyralists.lyrasis.org">Archivesspace_Users_Group@<wbr>lyralists.lyrasis.org</a><br>
<a href="http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group" rel="noreferrer" target="_blank">http://lyralists.lyrasis.org/<wbr>mailman/listinfo/<wbr>archivesspace_users_group</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div style="font-size:12.8px"><font color="#000000">Olivia Solis, MSIS</font></div><div style="font-size:12.8px"><font color="#000000">Metadata Coordinator</font></div><div style="font-size:12.8px"><font color="#000000">Dolph Briscoe Center for American History</font></div><div style="font-size:12.8px"><font color="#000000">The University of Texas at Austin</font></div><div style="font-size:12.8px"><font color="#000000">2300 Red River St. Stop D1100</font></div><div style="font-size:12.8px"><font color="#000000">Austin TX, 78712-1426</font></div><div style="color:rgb(136,136,136);font-size:12.8px"><span style="color:rgb(0,0,0);font-size:12.8px">(512) 232-8013</span></div></div></div></div></div></div></div>
</div>