<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">We've found this works pretty well:</span><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div>Disallow: /search*<br>
</div>
<div>Disallow: /inventory/*<br>
</div>
<div>Disallow: /collection_organization/*<br>
</div>
<div>Disallow: /repositories/*/top_containers/*<br>
</div>
<div>Disallow: /check_session*<br>
</div>
<span>Disallow: /repositories/*/resources/*/tree/*</span><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div id="divtagdefaultwrapper" dir="ltr" style="color:rgb(0,0,0); background-color:rgb(255,255,255)">
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> archivesspace_users_group-bounces@lyralists.lyrasis.org <archivesspace_users_group-bounces@lyralists.lyrasis.org> on behalf of Michelle Paquette
<mpaquette@smith.edu><br>
<b>Sent:</b> Wednesday, May 15, 2019 3:30 PM<br>
<b>To:</b> Archivesspace Users Group<br>
<b>Subject:</b> [Archivesspace_Users_Group] Disallows in robots.txt?</font>
<div> </div>
</div>
<div>
<div dir="ltr">Hello all,
<div><br>
</div>
<div>For those of you who are already using the Public User Interface, I wondered if you had suggested disallows for the robots.txt. We're planning to disallow on search but wasn't sure of the arguments for or against other disallows. Any advice much appreciated!</div>
<div><br>
</div>
<div>Michelle Paquette<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr"><font face="tahoma, sans-serif">Michelle Paquette</font>
<div><font face="tahoma, sans-serif">Metadata & Technical Services Archivist</font></div>
<div><font face="tahoma, sans-serif">Special Collections</font></div>
<div><font face="tahoma, sans-serif">Smith College</font></div>
<div><font face="tahoma, sans-serif">413-585-7029</font></div>
<div><font face="tahoma, sans-serif"><a href="mailto:mpaquette@smith.edu" target="_blank">mpaquette@smith.edu</a></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>