[Archivesspace_Users_Group] I Feel the Need for Speed - Time Trials?

Blake Carver blake.carver at lyrasis.org
Fri Feb 22 10:13:08 EST 2019


A few things I've learned about hosting ArchivesSpace for over 5 years...

I've seen a bunch of the "we upgraded and now it's slow" questions, but we've been upgrading many dozens of sites since version 1.x and we've never seen an upgrade cause trouble like that. We've never had to give every site more resources after an upgrade, not even a single site. If it's slow after an upgrade, watch your logs. Is it indexing forever? Does the indexer start over every hour? You have some bad data in there someplace and the indexer is choking. I've seen this as the most common cause of "we upgraded and now it's slow", especially if you're coming from an older version to the newest. These things can be tough to track down.

2gigs of RAM dedicated to your site is probably enough, though more isn't bad. You probably don't need more than 2gigs of RAM if your site isn't HUGE. If your site is HUGE, you probably don't need more than 4gigs. If it's still crashing/slow with 4gigs, something is wrong. That's not total RAM on the server, that's in you startup options for ArchivesSpace. It all depends on how much your site is being used and how much is in there.

Rotate your logs every day, and unless you're debugging things, don't have the log level set to DEBUG. Just make it so logrotate does this for you.

Do a restart once a day or week or maybe every 2 weeks.

I like the idea of bench-marking some kind of standard page on different hardware to see how it performs, maybe even with some different version of ArchivesSpace.


-
Blake Carver
LYRASIS Senior Systems Administrator

________________________________
From: archivesspace_users_group-bounces at lyralists.lyrasis.org <archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of Flannon Jackson <flannon at nyu.edu>
Sent: Friday, February 22, 2019 9:41 AM
To: Archivesspace Users Group
Subject: Re: [Archivesspace_Users_Group] I Feel the Need for Speed - Time Trials?

Hi Alan,

My guess is that your performance degradation was due to lack of disk space on your VM.  Restarting archivesspace resets the logfile in logs/archivesspace.log.  I've seen ours get to a couple of GBs in size and if there's not enough disk space on the system to accommodate it things will definitely slow down.  The downside to simply restarting archivesspace is that it'll clobber the log as it comes up.  If you want to save the old log data you'll need to shut down, move the old log out of the way and then start archivesspace.

Flannon

Flannon Jackson
Senior DevOps Engineer
Digital Library Technology Services
flannon at nyu.edu<mailto:flannon at nyu.edu>

On Fri, Feb 22, 2019 at 9:31 AM Huebschen, Alan M <ahueb2 at uis.edu<mailto:ahueb2 at uis.edu>> wrote:

Hi VivienLea,



I’m not sure if your problems are the same as mine, but I had to address a similar issue recently. Our instance of AS currently runs on a virtual machine with 4gb of ram and after about a month of uptime I got a complaint from our Archives about serious slow-downs. All that was needed to remedy this was restarting the AS service, something like “systemctl restart Archivesspace” in the server environment. This quickly freed up memory that was slowly being consumed over time, so in order to do this on a regular basis I set up a cron job that automatically restarts the AS service once per week in the middle of the night when nobody is using the service.

As a side note we are running v2.5.0.



-Alan Huebschen

Brookens Library

Information Systems

(217) 206-7115



From: archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org> <archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org>> On Behalf Of Emily Pyers
Sent: Thursday, February 21, 2019 6:11 PM
To: Archivesspace Users Group <archivesspace_users_group at lyralists.lyrasis.org<mailto:archivesspace_users_group at lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] I Feel the Need for Speed - Time Trials?



VivienLea,



We haven’t undertaken anything like this, but are also in the process of testing our upgrade to v2.5.2 are noticing significant system slowdowns, so we’d be very interested if any other institutions have done any benchmarking around timings for basic processes, or any feedback on how to improve system speeds!



Cheers,



Emily





Emily Pyers | Metadata & Archival Systems Specialist | Collection Development & Description
In the office Monday, Wednesday - Friday 9.30am-3pm
State Library Victoria | 328 Swanston Street | Melbourne VIC 3000
T +61 3 8664 7368 | epyers at slv.vic.gov.au<mailto:epyers at slv.vic.gov.au>
slv.vic.gov.au<https://urldefense.proofpoint.com/v2/url?u=http-3A__slv.vic.gov.au&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=sLXFb44enot0KpPP2xKyXpQdpOmmmZqf_NVUvxjrJ58&e=>



[Image removed by sender.]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.slv.vic.gov.au_email-5Fcampaign&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=2jorA-6je8iPCpEdXCRmW6PKGD96ssuBUi8-lWrXfos&e=>





[Image removed by sender. follow  us]


[Image removed by sender. SLV facebook]<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.facebook.com_pages_Melbourne-2DAustralia_State-2DLibrary-2Dof-2DVictoria_32256104331&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=AMJkqiDsZmWUYpVUssVes4gN-6ulaObRIrHG99geB8M&e=>


[Image removed by sender. SLV twitter]<https://urldefense.proofpoint.com/v2/url?u=http-3A__twitter.com_Library-5FVic&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=fw_ldSSHky8Q-h-fN0FtBZl--QC7-9XAR2tggScvD9w&e=>


[Image removed by sender. SLV youtube]<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.youtube.com_user_statelibraryvictoria&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=YvH5jPbAYh-0hTBkx8kdPBf9zc1LFohUHAl9tOm4Ioc&e=>


[Image removed by sender. SLV  instagram]<https://urldefense.proofpoint.com/v2/url?u=http-3A__instagram.com_library-5Fvic&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=cs8v-j5qbbHTdWogb3YeOwyQxCIGU-05hTByJap7Lb8&e=>


[Image removed by sender. RACV logo]







From: archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org> [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org>] On Behalf Of Solek, VivianLea
Sent: Friday, 25 January 2019 12:17 AM
To: Archivesspace Users Group
Subject: [Archivesspace_Users_Group] I Feel the Need for Speed - Time Trials?



Good morning all,



I know our installations will all be different which will impact speed, but I’m very curious about the speed of processing that folks are experiencing.  Even the most basic tasks (like clicking on a record group/collection record to open it, seems to take a bit to perform it.  My system (v.2.4.1 in the process of updating to 2.5.1) is on a dedicated cloud server and I know it can be “ramped up” to generate more speed/power,  I just need some stats/data to convince IT that the performance I’m seeing is “below par.”



Am I just being a big impatient or are other people seeing slow speeds as well?  Has anyone done any “time trials” for basic processes?  Has anyone done “time trials” for importing with the Harvard plug in?



Many thanks for any and all insights and data shares!



Best,

VivianLea



VivianLea Solek

Archivist

Knights of Columbus Supreme Council Archives

Knights of Columbus Museum
1 State Street
New Haven, CT 06511-6702

Phone 203 752-4578
Fax 203 865-0351



CONFIDENTIALITY NOTICE: This message and any attachments may contain confidential, proprietary or legally privileged information and is intended only for the use of the addressee or addressees named above for its intended purpose. If you are not the intended recipient of this message, this message constitutes notice that any review, retransmission, distribution, copying or other use or taking any action in reliance on the information in this message and its attachments, is prohibited. If you receive this communication in error, please immediately advise the sender by reply e-mail and delete this message and its attachments from your system without keeping a copy. Unless expressly stated in this e-mail, nothing in this message may be construed as a digital or electronic signature. Thank you.

This message and any attachment is intended only for the use of the Addressee and may contain information that is PRIVILEGED and CONFIDENTIAL. If you are not the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please delete all copies of the message and its attachments and notify the sender immediately. Thank you.

_______________________________________________
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group at lyralists.lyrasis.org<mailto:Archivesspace_Users_Group at lyralists.lyrasis.org>
https://urldefense.proofpoint.com/v2/url?u=http-3A__lyralists.lyrasis.org_mailman_listinfo_archivesspace-5Fusers-5Fgroup&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=0FP9oxw8Wyb-scqgV4H13A&m=ez4KNPvM_MNxKtx-3eScRnWGeaivoWL11dQjZ2aGTd0&s=ZAQHjIe9Dzzqz4Pv-8E7HqCe8rBg20ewKk50thtKV60&e=
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20190222/59c6722b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ~WRD000.jpg
Type: image/jpeg
Size: 823 bytes
Desc: ~WRD000.jpg
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20190222/59c6722b/attachment.jpg>


More information about the Archivesspace_Users_Group mailing list