<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Whoopsie! That's the other importer thing, just ignore me :-)</div>
<div>
<div id="Signature">
<div>
<div id="divtagdefaultwrapper" dir="ltr" style="color:rgb(0,0,0); background-color:rgb(255,255,255)">
</div>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> archivesspace_users_group-bounces@lyralists.lyrasis.org <archivesspace_users_group-bounces@lyralists.lyrasis.org> on behalf of Blake Carver
<blake.carver@lyrasis.org><br>
<b>Sent:</b> Monday, October 19, 2020 10:01 AM<br>
<b>To:</b> Archivesspace Users Group <archivesspace_users_group@lyralists.lyrasis.org><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] Loading long CSV files for accessions in ArchivesSpace</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
</div>
<table class="x_highlight x_tab-size x_js-file-line-container" style="box-sizing:border-box; border-spacing:0px; border-collapse:collapse; tab-size:8; color:rgb(36,41,46); font-size:14px; background-color:rgb(255,255,255)">
<tbody style="box-sizing:border-box">
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-c" style="box-sizing:border-box; color:rgb(106,115,125)"># specifies whether the "Load Digital Objects" button is available at the Resource Level</span></td>
</tr>
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-v" style="box-sizing:border-box; color:rgb(227,98,9)">AppConfig</span><span class="x_pl-kos" style="box-sizing:border-box">[</span><span class="x_pl-pds" style="box-sizing:border-box; color:rgb(3,47,98)">:hide_do_load</span><span class="x_pl-kos" style="box-sizing:border-box">]</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">=</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">false</span></td>
</tr>
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-c" style="box-sizing:border-box; color:rgb(106,115,125)"># upper row limit for an excel spreadsheet</span></td>
</tr>
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-v" style="box-sizing:border-box; color:rgb(227,98,9)"><span class="x_pl-token" style="box-sizing:border-box">AppConfig</span></span><span class="x_pl-kos" style="box-sizing:border-box">[</span><span class="x_pl-pds" style="box-sizing:border-box; color:rgb(3,47,98)">:bulk_import_rows</span><span class="x_pl-kos" style="box-sizing:border-box">]</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">=</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">1000</span></td>
</tr>
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-c" style="box-sizing:border-box; color:rgb(106,115,125)"># maximum size (in KiloBytes) for an excel spreadsheet</span></td>
</tr>
<tr style="box-sizing:border-box">
<td class="x_blob-num x_js-line-number" style="box-sizing:border-box; padding:0px 10px; width:50px; min-width:50px; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px; line-height:20px; text-align:right; white-space:nowrap; vertical-align:top">
</td>
<td class="x_blob-code x_blob-code-inner x_js-file-line x_highlighted" style="box-sizing:border-box; padding:0px 10px; line-height:20px; vertical-align:top; font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace; font-size:12px">
<span class="x_pl-v" style="box-sizing:border-box; color:rgb(227,98,9)">AppConfig</span><span class="x_pl-kos" style="box-sizing:border-box">[</span><span class="x_pl-pds" style="box-sizing:border-box; color:rgb(3,47,98)">:bulk_import_size</span><span class="x_pl-kos" style="box-sizing:border-box">]</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">=</span>
<span class="x_pl-c1" style="box-sizing:border-box; color:rgb(0,92,197)">256</span></td>
</tr>
</tbody>
</table>
<div>
<div id="x_Signature">
<div>
<div id="x_divtagdefaultwrapper" dir="ltr" style="color:rgb(0,0,0); background-color:rgb(255,255,255)">
<div name="x_divtagdefaultwrapper" style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; margin:0px">
<font face="Calibri,Arial,Helvetica,sans-serif" size="3" color="black"><span dir="ltr" style="font-size:12pt; background-color:white"><font size="2"><span style="font-size:11pt"></span></font></span></font></div>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<a href="https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb#L676-L682">https://github.com/archivesspace/archivesspace/blob/master/common/config/config-defaults.rb#L676-L682</a><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
There are limits in the config.rb</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
</div>
</div>
<div id="x_appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> archivesspace_users_group-bounces@lyralists.lyrasis.org <archivesspace_users_group-bounces@lyralists.lyrasis.org> on behalf of Bowers, Kate
A. <kate_bowers@harvard.edu><br>
<b>Sent:</b> Monday, October 19, 2020 9:28 AM<br>
<b>To:</b> Archivesspace Users Group <archivesspace_users_group@lyralists.lyrasis.org><br>
<b>Subject:</b> Re: [Archivesspace_Users_Group] Loading long CSV files for accessions in ArchivesSpace</font>
<div> </div>
</div>
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:"Dana Library Hand"}
p.x_x_MsoNormal, li.x_x_MsoNormal, div.x_x_MsoNormal
{margin-top:0in;
margin-right:0in;
margin-bottom:8.0pt;
margin-left:0in;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
a:link, span.x_x_MsoHyperlink
{color:#0563C1;
text-decoration:underline}
a:visited, span.x_x_MsoHyperlinkFollowed
{color:#954F72;
text-decoration:underline}
p.x_x_MsoListParagraph, li.x_x_MsoListParagraph, div.x_x_MsoListParagraph
{margin-top:0in;
margin-right:0in;
margin-bottom:8.0pt;
margin-left:.5in;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
p.x_x_MsoListParagraphCxSpFirst, li.x_x_MsoListParagraphCxSpFirst, div.x_x_MsoListParagraphCxSpFirst
{margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
p.x_x_MsoListParagraphCxSpMiddle, li.x_x_MsoListParagraphCxSpMiddle, div.x_x_MsoListParagraphCxSpMiddle
{margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
p.x_x_MsoListParagraphCxSpLast, li.x_x_MsoListParagraphCxSpLast, div.x_x_MsoListParagraphCxSpLast
{margin-top:0in;
margin-right:0in;
margin-bottom:8.0pt;
margin-left:.5in;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
p.x_x_msonormal0, li.x_x_msonormal0, div.x_x_msonormal0
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif}
span.x_x_EmailStyle19
{font-family:"Calibri",sans-serif;
color:windowtext}
span.x_x_EmailStyle20
{font-family:"Calibri",sans-serif;
color:#1F497D}
.x_x_MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
ol
{margin-bottom:0in}
ul
{margin-bottom:0in}
-->
</style>
<div lang="EN-US">
<div class="x_x_WordSection1">
<p class="x_x_MsoNormal"><span style="color:#1F497D">Do you have an idea of what the limit is? That is: what is the largest number of rows you have successfully imported as accessions via spreadsheet?</span></p>
<p class="x_x_MsoNormal"><span style="color:#1F497D">Thanks!</span></p>
<p class="x_x_MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="x_x_MsoNormal"><span style="color:#1F497D">Kate</span></p>
<p class="x_x_MsoNormal"><span style="color:#1F497D"> </span></p>
<div>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D">Kate Bowers</span></p>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D">Collections Services Archivist for Metadata, Standards, and Systems</span></p>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D">Harvard University Archives</span></p>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D">kate_bowers@harvard.edu</span></p>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D"><a href="https://archives.harvard.edu"><span style="color:#0563C1">https://archives.harvard.edu</span></a>
</span></p>
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<span style="font-family:"Dana Library Hand"; color:#1F497D">617-998-5238</span></p>
</div>
<p class="x_x_MsoNormal"><span style="color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_x_MsoNormal" style="margin-bottom:0in; margin-bottom:.0001pt; line-height:normal">
<b>From:</b> archivesspace_users_group-bounces@lyralists.lyrasis.org <archivesspace_users_group-bounces@lyralists.lyrasis.org>
<b>On Behalf Of </b>philip.webster@sheffield.ac.uk<br>
<b>Sent:</b> Monday, October 19, 2020 9:11 AM<br>
<b>To:</b> Archivesspace Users Group <archivesspace_users_group@lyralists.lyrasis.org><br>
<b>Subject:</b> [Archivesspace_Users_Group] Loading long CSV files for accessions in ArchivesSpace</p>
</div>
</div>
<p class="x_x_MsoNormal"> </p>
<p class="x_x_MsoNormal"><span lang="EN-GB">Hi,</span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">One thing we have noticed when attempting to batch load accessions using CSV import capability in ArchivesSpace is that there appears to be some sort of limit that prevents us from loading large numbers of items.</span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">I could think of several reasons why this may be the case.</span></p>
<ol start="1" type="1" style="margin-top:0in">
<li class="x_x_MsoNormalCxSpMiddle" style="mso-list:l0 level1 lfo3"><span lang="EN-GB">There may be a hard-coded limit on the number of rows that can be processed in a single background process.</span></li><li class="x_x_MsoNormalCxSpMiddle" style="mso-list:l0 level1 lfo3"><span lang="EN-GB">There may be a relationship between the amount of memory allocated to ArchivesSpace and the number of rows that can be processed.</span></li><li class="x_x_MsoNormalCxSpMiddle" style="mso-list:l0 level1 lfo3"><span lang="EN-GB">There may be a limited amount of time the background process can run for.</span></li></ol>
<p class="x_x_MsoNormal"><span lang="EN-GB"> </span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">Our current workaround is to split the accessions import CSV into multiple files and load them in sequence.</span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">Does anyone on the mailing list know what could be causing the batch process stop before finishing an entire CSV file?</span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB"> </span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">Regards,</span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">Philip Webster </span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB">The University of Sheffield </span></p>
<p class="x_x_MsoNormal"><span lang="EN-GB"> </span></p>
</div>
</div>
</div>
</body>
</html>