[Archivesspace_Users_Group] More ArchivesSpace performance analysis -- this time, the database

[Jason Loeffler]

Kudos to Yale for engaging Percona. For small and very small organizations
with limited or no in-house IT support, this kind of contribution is
essential. Having experienced substantial latency on resource trees with
only 3,000 records, I

Chris, regarding benchmarking tools, I've used tuning-primer
<https://launchpad.net/mysql-tuning-primer> and sysbench
<https://github.com/akopytov/sysbench> alongside MySQLTuner for years with
good success. Additionally I've deployed ASpace (and other projects)
against MariaDB <https://mariadb.org/> and Percona's own InnoDB drop-in
replacement with the Xtra DB storage engine
<https://www.percona.com/software/mysql-database/percona-server/xtradb>. No
issues so far.

For organizations with dedicated IT support, I highly recommend the Percona
toolkit  <https://www.percona.com/software/mysql-tools/percona-toolkit>as a
standard part of any deployment as a means to collect and analyze
information about database-related problems.

I'd be happy to describe how I've used these database distributions and
tools in the ASpace context and outline the potential benefits.

That said, having read the Percona report, I'm not entirely clear that
database tuning yields much of a positive impact. The report bears this
out. The section on "Alternatives" in the JRuby GitHub page seems most
promising. I'm not a Java dev, but this description seems very similar to
using in-memory or file-based cache stores, like Memcache or Redis, in
unthreaded applications (e.g. PHP).

Jason Loeffler
Technical Consultant | American Academy in Rome
Principal | Minor Science | Application Development & Metadata Strategy
Brooklyn, New York


On Wed, Aug 26, 2015 at 10:47 AM, Chris Fitzpatrick <
Chris.Fitzpatrick at lyrasis.org> wrote:

>
>
> Hi Maureen,
>
>
> This is excellent. Percona is one of the premier MySQL experts, so this is
> great feedback.
>
>
> Also, I have a page describing some MySQL and application tuning
> suggestions.
> <http://archivesspace.github.io/archivesspace/user/tuning-archivesspace/>
>
> One thing that I suggest is to run a profiler on the MySQL DB server,
> which can give you some ideas on where to look for problem areas. I've been
> using MySQL Tuner for years ( http://mysqltuner.com/)
> <http://mysqltuner.com/> but maybe there are some other things people are
> using? Any suggestions would help, and I can add them to the page ( or
> better yet send me a PR
>
> Also curious about various MySQL distributions ( Oracle, MariaDB, Percona,
> etc ) people are using?  Are people using dedicated db servers, or
> clusters, or just having the db server on the same box as the application?
>
>
> Lastly, it would be great if we could start work on supporting other DBs.
> I think there's a strong interests ( especially from smaller orgs ) for MS
> Server, but are others wanting Oracle or postgres?
>
>
> best, chris.
>
>
>
>
> Chris Fitzpatrick | Developer, ArchivesSpace
> Skype: chrisfitzpat  | Phone: 918.236.6048
> http://archivesspace.org/
>
>
> ------------------------------
> *From:* archivesspace_users_group-bounces at lyralists.lyrasis.org <
> archivesspace_users_group-bounces at lyralists.lyrasis.org> on behalf of
> Callahan, Maureen <maureen.callahan at yale.edu>
> *Sent:* Wednesday, August 26, 2015 3:36 PM
> *To:* 'archivesspace_users_group at lyralists.lyrasis.org'
> *Subject:* [Archivesspace_Users_Group] More ArchivesSpace performance
> analysis -- this time, the database
>
>
> Hi everyone,
>
>
>
> As I’ve reported before, we at Yale are in the middle of an aggressive
> period of analysis to diagnose some of the slow performance we’ve been
> seeing with ArchivesSpace. As part of this initiative, we’ve contracted
> with Percona, a firm that specializes in MySQL database analysis. Their
> report (attached), includes a number of action items that we believe the
> ArchivesSpace community may find helpful. We hope that this will result in
> further improvements to the application.
>
>
>
> Best wishes,
>
> Maureen
>
>
>
> Maureen Callahan
>
> Archivist, Metadata Specialist
>
> Manuscripts & Archives
>
> Yale University Library
>
> maureen.callahan at yale.edu
>
> 203.432.3627
>
>
>
> Webpage: web.library.yale.edu/mssa
>
> Collections: drs.library.yale.edu
>
>
>
> _______________________________________________
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group at lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20150827/d7e85c1f/attachment.html>