[Archivesspace_Users_Group] Upgrade from 1.3 to 1.5.2 - data issues

Tue Jul 18 13:23:13 EDT 2017

Hello again-

All I need to do to reindex is to run archivesspace.bat as admin and wait, right? Is there something in the log file that I can look for to know the process has been completed? It seems extremely slow.

Is this the sort of thing I should be seeing in archivesspace.out?

Jul 18, 2017 11:31:38 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [collection1] webapp= path=/update params={} {add=[/repositories/2/archival_objects/1, /repositories/2/archival_objects/2, /repositories/2/archival_objects/3, /repositories/2/archival_objects/4, /repositories/2/archival_objects/5, /repositories/2/archival_objects/6, /repositories/2/archival_objects/7, /repositories/2/archival_objects/8, /repositories/2/archival_objects/9, /repositories/2/archival_objects/10, ... (25 adds)]} 0 16
~~~ Indexed 25 of 25307 archival_object records in repository 2 ( added 25 records in  3656.0ms ) ~~~
~~~ Indexed 50 of 25307 archival_object records in repository 2 ( added 25 records in  3078.0ms ) ~~~
Jul 18, 2017 11:31:38 AM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
Jul 18, 2017 11:31:38 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [collection1] webapp= path=/update params={} {add=[/repositories/2/archival_objects/51, /repositories/2/archival_objects/52, /repositories/2/archival_objects/53, /repositories/2/archival_objects/54, /repositories/2/archival_objects/55, /repositories/2/archival_objects/56, /repositories/2/archival_objects/57, /repositories/2/archival_objects/58, /repositories/2/archival_objects/59, /repositories/2/archival_objects/60, ... (354 adds)]} 0 172
~~~ Indexed 75 of 25307 archival_object records in repository 2 ( added 25 records in  3875.0ms ) ~~~
~~~ Indexed 100 of 25307 archival_object records in repository 2 ( added 25 records in  3297.0ms ) ~~~
D, [2017-07-18T11:31:38.423000 #3620] DEBUG -- : Thread-1225772: GET /repositories/2/archival_objects?id_set=101%2C102%2C103%2C104%2C105%2C106%2C107%2C108%2C109%2C110%2C111%2C112%2C113%2C114%2C115%2C116%2C117%2C118%2C119%2C120%2C121%2C122%2C123%2C124%2C125&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object [session: #<Session:0x3f53eb51 @store={:user=>"search_indexer", :login_time=>2017-07-18 11:31:34 -0400, :expirable=>false}, @id="9ff1672a8591fd3b1fd746230b4c0bba11a7048a2418875ab8c4d80491918a79">]
D, [2017-07-18T11:31:38.423000 #3620] DEBUG -- : Thread-351220: GET /repositories/2/archival_objects?id_set=126%2C127%2C128%2C129%2C130%2C131%2C132%2C133%2C134%2C135%2C136%2C137%2C138%2C139%2C140%2C141%2C142%2C143%2C144%2C145%2C146%2C147%2C148%2C149%2C150&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object [session: #<Session:0x50f654db @store={:user=>"search_indexer", :login_time=>2017-07-18 11:31:34 -0400, :expirable=>false}, @id="9ff1672a8591fd3b1fd746230b4c0bba11a7048a2418875ab8c4d80491918a79">]
D, [2017-07-18T11:31:38.439000 #3620] DEBUG -- : Thread-1225772: Post-processed params: {"id_set"=>[101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125], "resolve"=>["location_profile", "container_profile", "container_locations", "subjects", "linked_agents", "linked_records", "classifications", "digital_object"], :repo_id=>2, "modified_since"=>0}
D, [2017-07-18T11:31:38.439000 #3620] DEBUG -- : Thread-351220: Post-processed params: {"id_set"=>[126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150], "resolve"=>["location_profile", "container_profile", "container_locations", "subjects", "linked_agents", "linked_records", "classifications", "digital_object"], :repo_id=>2, "modified_since"=>0}
D, [2017-07-18T11:31:38.439000 #3620] DEBUG -- : Thread-781488: GET /repositories/2/archival_objects?id_set=176%2C177%2C178%2C179%2C180%2C181%2C182%2C183%2C184%2C185%2C186%2C187%2C188%2C189%2C190%2C191%2C192%2C193%2C194%2C195%2C196%2C197%2C198%2C199%2C200&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object [session: #<Session:0x6a539624 @store={:user=>"search_indexer", :login_time=>2017-07-18 11:31:34 -0400, :expirable=>false}, @id="9ff1672a8591fd3b1fd746230b4c0bba11a7048a2418875ab8c4d80491918a79">]
D, [2017-07-18T11:31:38.455000 #3620] DEBUG -- : Thread-781488: Post-processed params: {"id_set"=>[176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200], "resolve"=>["location_profile", "container_profile", "container_locations", "subjects", "linked_agents", "linked_records", "classifications", "digital_object"], :repo_id=>2, "modified_since"=>0}
D, [2017-07-18T11:31:39.158000 #3620] DEBUG -- : Thread-1152130: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"3"}, ["[]\n"]]... in 60204.0ms
D, [2017-07-18T11:31:39.158000 #3620] DEBUG -- : Thread-1102634: GET /repositories/2/archival_objects?id_set=151%2C152%2C153%2C154%2C155%2C156%2C157%2C158%2C159%2C160%2C161%2C162%2C163%2C164%2C165%2C166%2C167%2C168%2C169%2C170%2C171%2C172%2C173%2C174%2C175&resolve%5B%5D=location_profile&resolve%5B%5D=container_profile&resolve%5B%5D=container_locations&resolve%5B%5D=subjects&resolve%5B%5D=linked_agents&resolve%5B%5D=linked_records&resolve%5B%5D=classifications&resolve%5B%5D=digital_object [session: #<Session:0x5328e104 @store={:user=>"search_indexer", :login_time=>2017-07-18 11:31:34 -0400, :expirable=>false}, @id="9ff1672a8591fd3b1fd746230b4c0bba11a7048a2418875ab8c4d80491918a79">]
D, [2017-07-18T11:31:39.158000 #3620] DEBUG -- : Thread-1102634: Post-processed params: {"id_set"=>[151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175], "resolve"=>["location_profile", "container_profile", "container_locations", "subjects", "linked_agents", "linked_records", "classifications", "digital_object"], :repo_id=>2, "modified_since"=>0}
D, [2017-07-18T11:31:39.455000 #3620] DEBUG -- : Thread-1225772: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"66020"}, ["[{\"lock_version\":0,\"position\":100,\"publish\":true,\"ref_id\":\"ref198_n2v\",\"title\":\"Bk. 8, #33 The Catholic Church of Geneva, NY\",\"display_string\":\"Bk. 8, #33 The Catholic Church of Geneva, NY\",\"restrictions_apply\":false,\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2014-09-19T13:20:21Z\",\"system_mtime\":\"2017-07-17T18:12:28Z\",\"user_m... in 1047.0ms
D, [2017-07-18T11:31:39.533000 #3620] DEBUG -- : Thread-351220: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"64653"}, ["[{\"lock_version\":0,\"position\":125,\"publish\":true,\"ref_id\":\"ref228_10q\",\"title\":\"Bk. 12, #59 Geneva Academy and Geneva College [Chronological Table]\",\"display_string\":\"Bk. 12, #59 Geneva Academy and Geneva College [Chronological Table]\",\"restrictions_apply\":false,\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2014-09-19T13:20:21Z\",\"sy... in 1125.0ms
D, [2017-07-18T11:31:39.611000 #3620] DEBUG -- : Thread-781488: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"71425"}, ["[{\"lock_version\":0,\"position\":175,\"publish\":true,\"ref_id\":\"ref287_9b8\",\"title\":\"Bk. 15, #108 Y.M.C.A. Tug of War\",\"display_string\":\"Bk. 15, #108 Y.M.C.A. Tug of War\",\"restrictions_apply\":false,\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2014-09-19T13:20:22Z\",\"system_mtime\":\"2017-07-17T18:12:28Z\",\"user_mtime\":\"2014-09-19T13:2... in 1188.0ms
D, [2017-07-18T11:31:39.673000 #3620] DEBUG -- : Thread-1102634: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"68756"}, ["[{\"lock_version\":0,\"position\":150,\"publish\":true,\"ref_id\":\"ref255_lho\",\"title\":\"Bk. 14, #83 Letters to Former Hobart College President\",\"display_string\":\"Bk. 14, #83 Letters to Former Hobart College President, 1936\",\"restrictions_apply\":false,\"created_by\":\"admin\",\"last_modified_by\":\"admin\",\"create_time\":\"2014-09-19T13:20:22Z\",\"system_mtime\":\"2017-... in 1250.0ms
D, [2017-07-18T11:31:39.939000 #3620] DEBUG -- : Thread-1252000: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"3"}, ["[]\n"]]... in 60969.0ms
Jul 18, 2017 11:31:40 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [collection1] webapp= path=/update params={} {add=[/repositories/2/archival_objects/126, /repositories/2/archival_objects/127, /repositories/2/archival_objects/128, /repositories/2/archival_objects/129, /repositories/2/archival_objects/130, /repositories/2/archival_objects/131, /repositories/2/archival_objects/132, /repositories/2/archival_objects/133, /repositories/2/archival_objects/134, /repositories/2/archival_objects/135, ... (25 adds)]} 0 0
Jul 18, 2017 11:31:40 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [collection1] webapp= path=/update params={} {add=[/repositories/2/archival_objects/151, /repositories/2/archival_objects/152, /repositories/2/archival_objects/153, /repositories/2/archival_objects/154, /repositories/2/archival_objects/155, /repositories/2/archival_objects/156, /repositories/2/archival_objects/157, /repositories/2/archival_objects/158, /repositories/2/archival_objects/159, /repositories/2/archival_objects/160, ... (25 adds)]} 0 0
Jul 18, 2017 11:31:40 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [collection1] webapp= path=/update params={} {add=[/repositories/2/archival_objects/101, /repositories/2/archival_objects/102, /repositories/2/archival_objects/103, /repositories/2/archival_objects/104, /repositories/2/archival_objects/105, /repositories/2/archival_objects/106, /repositories/2/archival_objects/107, /repositories/2/archival_objects/108, /repositories/2/archival_objects/109, /repositories/2/archival_objects/110, ... (25 adds)]} 0 0
~~~ Indexed 125 of 25307 archival_object records in repository 2 ( added 25 records in  2234.0ms ) ~~~
~~~ Indexed 150 of 25307 archival_object records in repository 2 ( added 25 records in  2172.0ms ) ~~~
~~~ Indexed 175 of 25307 archival_object records in repository 2 ( added 25 records in  2203.0ms ) ~~~
D, [2017-07-18T11:31:40.658000 #3620] DEBUG -- : Thread-351220: POST /update_monitor [session: #<Session:0x634bb9a6 @store={:user=>"staff_system", :login_time=>2017-07-18 10:52:15 -0400, :expirable=>false}, @id="5df814ae339a635a5eb39bb8a9ea1767ba5c66c881f67db19056d09c1d981139">]
D, [2017-07-18T11:31:40.658000 #3620] DEBUG -- : Thread-351220: Post-processed params: {:active_edits=>#<JSONModel(:active_edits) {"jsonmodel_type"=>"active_edits", "active_edits"=>[]}>}
D, [2017-07-18T11:31:40.673000 #3620] DEBUG -- : Thread-351220: Responded with [200, {"Content-Type"=>"application/json", "Cache-Control"=>"private, must-revalidate, max-age=0", "Content-Length"=>"3"}, ["{}\n"]]... in 734.0ms
Jul 18, 2017 11:31:40 AM org.apache.solr.update.processor.LogUpdateProcessor finish

AND also

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered search/_components_switch.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered search/_filter.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered search/_inline_results.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered search/results.html.erb within layouts/application (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered C:/archivesspace-v1.5.2/archivesspace/plugins/local/public/views/site/_branding.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered C:/archivesspace-v1.5.2/archivesspace/plugins/local/public/views/site/_header.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered site/_advanced_search.html.erb (16.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered site/_breadcrumb.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO:   Rendered C:/archivesspace-v1.5.2/archivesspace/plugins/local/public/views/site/_footer.html.erb (0.0ms)

Jul 18, 2017 12:55:10 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
INFO: Completed 200 OK in 1141.0ms (Views: 31.0ms)

Thanks- Jamie
315.781.4355

From: Kutzuba, Jamie
Sent: Tuesday, July 18, 2017 11:04 AM
To: Archivesspace Users Group <archivesspace_users_group at lyralists.lyrasis.org>
Subject: RE: [Archivesspace_Users_Group] Upgrade from 1.3 to 1.5.2 - data issues

Hi Chelsea-

Thanks. I’m giving that a go now.

- Jamie
315.781.4355

From: archivesspace_users_group-bounces at lyralists.lyrasis.org<mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org> [mailto:archivesspace_users_group-bounces at lyralists.lyrasis.org] On Behalf Of Chelsea Lobdell
Sent: Tuesday, July 18, 2017 10:25 AM
To: Archivesspace Users Group <archivesspace_users_group at lyralists.lyrasis.org<mailto:archivesspace_users_group at lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Upgrade from 1.3 to 1.5.2 - data issues

Hi Jamie,
TriCo Libraries recently experienced issues with search and browse after a migration from v1.5.3 to v2.0.1. It is possible for the Solr index to get messed up during an upgrade. Below is what Lyrasis recommended I do as a first step. It basically removes all old index data and forces an entire re-index.

stop archivesspace
back up /path/to/archivespace/data/ just in case (cp -a /path/to/archivespace/data/ /path/to/someplace/safe/)
rm -rf /path/to/archivespace/data/*
start archivesspace up again
I suggest trying that and seeing if it helps.
- Chelsea

---------------
Chelsea Lobdell
Library Web Developer/ Swarthmore College
clobdel1 at swarthmore.edu<mailto:clobdel1 at swarthmore.edu> / (610)690-6818

On Tue, Jul 18, 2017 at 9:55 AM, Kutzuba, Jamie <KUTZUBA at hws.edu<mailto:KUTZUBA at hws.edu>> wrote:
Hello-

I upgraded our instance from 1.3.0 to 1.5.2 yesterday in order to move to 2.0. I can run archivesspace.bat and bring up the public and staff interfaces but the staff side is not showing any of the data. On the public side there is no browseable data. Searching on either interface will bring up the archival components (lower-down levels of a finding aid, like each file or item) but not the resource records themselves (collection-level records). If I click on an archival component it does bring me to its resource record, so the resources are still there, but they are not showing up in the searches nor in the browse section.

Did the conversion go awry? Would it be best to roll back or is there something else I can do to resolve this?

Running Windows Server 2012 R2, MySQL 5.6.

Thanks for your help- Jamie

Jamie Kutzuba
Systems Librarian
315.781.4355<tel:(315)%20781-4355>
Warren Hunting Smith Library<http://library.hws.edu/>
Hobart & William Smith Colleges<http://www.hws.edu/>

_______________________________________________
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group at lyralists.lyrasis.org<mailto:Archivesspace_Users_Group at lyralists.lyrasis.org>
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lyralists.lyrasis.org/pipermail/archivesspace_users_group/attachments/20170718/7fcd3fad/attachment.html>