Dockerized HAF fails to replay/sync with shared_memory on host RAM
I have cut the long replay/feed part from zero, only including the last few bits.
5TB NVMe RAID0 16 cores, 24 threads Ubuntu 20.04 (host) Using the latest develop branch. 64GB RAM with 25GB shared memory stored on /dev/shm on host.
Previously, this server synced just fine with shared_memory on disk. However, when I restarted both PSQL feed as well as blockchain replay with shared_memory on RAM, this happened.
2022-09-17T10:27:27.490571 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67900000
2022-09-17T10:27:29.396315 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67901000
2022-09-17T10:27:31.626218 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67902000
2022-09-17T10:27:33.558978 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67903000
2022-09-17T10:27:35.682309 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67904000
2022-09-17T10:27:37.830144 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67905000
2022-09-17T10:27:40.205028 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67906000
2022-09-17T10:27:42.397226 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67907000
2022-09-17T10:27:44.976451 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67908000
2022-09-17T10:27:46.850322 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67909000
2022-09-17T10:27:48.934793 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67910000
2022-09-17T10:27:51.250557 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67911000
2022-09-17T10:27:53.373391 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67912000
2022-09-17T10:27:55.590241 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67913000
2022-09-17T10:27:57.527685 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67914000
2022-09-17T10:27:59.562769 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67915000
2022-09-17T10:28:01.579883 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67916000
2022-09-17T10:28:03.425357 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67917000
2022-09-17T10:28:05.352590 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67918000
2022-09-17T10:28:07.298615 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67919000
2022-09-17T10:28:09.054571 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67920000
2022-09-17T10:28:10.861495 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67921000
2022-09-17T10:28:12.889720 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67922000
2022-09-17T10:28:14.539333 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67923000
2022-09-17T10:28:16.140914 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67924000
2022-09-17T10:28:18.142208 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67925000
2022-09-17T10:28:20.251991 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67926000
2022-09-17T10:28:21.811698 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67927000
2022-09-17T10:28:23.584222 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67928000
2022-09-17T10:28:25.777560 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67929000
2022-09-17T10:28:29.032467 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67930000
2022-09-17T10:28:32.300154 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67931000
2022-09-17T10:28:35.638005 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67932000
2022-09-17T10:28:39.673858 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67933000
2022-09-17T10:28:42.654576 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67934000
2022-09-17T10:28:46.113982 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67935000
2022-09-17T10:28:49.335347 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67936000
2022-09-17T10:28:52.124433 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67937000
2022-09-17T10:28:55.329220 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67938000
2022-09-17T10:28:57.566308 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67939000
2022-09-17T10:28:59.990306 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67940000
2022-09-17T10:29:02.417726 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67941000
2022-09-17T10:29:04.437646 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67942000
2022-09-17T10:29:06.515907 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67943000
2022-09-17T10:29:08.596345 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67944000
2022-09-17T10:29:10.817431 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67945000
2022-09-17T10:29:12.828408 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67946000
2022-09-17T10:29:14.489810 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67947000
2022-09-17T10:29:16.277408 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67948000
2022-09-17T10:29:18.174450 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67949000
2022-09-17T10:29:19.945564 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67950000
2022-09-17T10:29:21.698210 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67951000
2022-09-17T10:29:23.656335 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67952000
2022-09-17T10:29:25.635844 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67953000
2022-09-17T10:29:28.358348 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67954000
2022-09-17T10:29:31.239791 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67955000
2022-09-17T10:29:32.875571 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67956000
2022-09-17T10:29:34.577736 database.cpp:452 reindex ] Done reindexing, elapsed time: 83571.07947399999829940 sec
2022-09-17T10:29:34.577822 sql_serializer.cpp:603 on_post_reindex ] finishing from post reindex
2022-09-17T10:29:34.577843 indexation_state.cpp:237 update_state ] Entering P2P sync...
2022-09-17T10:29:34.870370 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67957000
2022-09-17T10:29:34.886140 data_processor.cpp:153 only_report_batch_fi ] 67957056 commited by Transaction multisig data writer
2022-09-17T10:29:34.886168 data_processor.cpp:153 only_report_batch_fi ] 67957056 commited by Accounts data writer
2022-09-17T10:29:34.892543 reindex_data_dumper.cpp:40 ~reindex_data_dumper ] Reindex dumper is closing....
2022-09-17T10:29:34.892561 data_processor.cpp:185 join ] Trying to resume data processor: Block data writer...
2022-09-17T10:29:34.892569 data_processor.cpp:187 join ] Data processor: Block data writer resumed...
2022-09-17T10:29:34.892598 data_processor.cpp:111 operator() ] Leaving data processor thread: Block data writer
2022-09-17T10:29:34.892683 data_processor.cpp:198 join ] Data processor: Block data writer finished execution...
2022-09-17T10:29:34.892707 data_processor.cpp:185 join ] Trying to resume data processor: Transaction data writer_0...
2022-09-17T10:29:34.892714 data_processor.cpp:187 join ] Data processor: Transaction data writer_0 resumed...
2022-09-17T10:29:34.892739 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction data writer_0
2022-09-17T10:29:34.907957 data_processor.cpp:198 join ] Data processor: Transaction data writer_0 finished execution...
2022-09-17T10:29:34.907996 data_processor.cpp:185 join ] Trying to resume data processor: Transaction data writer_1...
2022-09-17T10:29:34.908003 data_processor.cpp:187 join ] Data processor: Transaction data writer_1 resumed...
2022-09-17T10:29:34.908048 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction data writer_1
2022-09-17T10:29:34.910062 data_processor.cpp:198 join ] Data processor: Transaction data writer_1 finished execution...
2022-09-17T10:29:34.910079 data_processor.cpp:185 join ] Trying to resume data processor: Transaction multisig data writer...
2022-09-17T10:29:34.910084 data_processor.cpp:187 join ] Data processor: Transaction multisig data writer resumed...
2022-09-17T10:29:34.910109 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction multisig data writer
2022-09-17T10:29:34.910218 data_processor.cpp:198 join ] Data processor: Transaction multisig data writer finished execution...
2022-09-17T10:29:34.910233 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_0...
2022-09-17T10:29:34.910240 data_processor.cpp:187 join ] Data processor: Operation data writer_0 resumed...
2022-09-17T10:29:34.911915 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67957056
2022-09-17T10:29:34.922239 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_0
2022-09-17T10:29:34.926095 data_processor.cpp:198 join ] Data processor: Operation data writer_0 finished execution...
2022-09-17T10:29:34.926112 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_1...
2022-09-17T10:29:34.926117 data_processor.cpp:187 join ] Data processor: Operation data writer_1 resumed...
2022-09-17T10:29:34.926132 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_1
2022-09-17T10:29:34.929176 data_processor.cpp:198 join ] Data processor: Operation data writer_1 finished execution...
2022-09-17T10:29:34.929207 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_2...
2022-09-17T10:29:34.929224 data_processor.cpp:187 join ] Data processor: Operation data writer_2 resumed...
2022-09-17T10:29:34.929291 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_2
2022-09-17T10:29:34.932313 data_processor.cpp:198 join ] Data processor: Operation data writer_2 finished execution...
2022-09-17T10:29:34.932349 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_3...
2022-09-17T10:29:34.932367 data_processor.cpp:187 join ] Data processor: Operation data writer_3 resumed...
2022-09-17T10:29:34.932407 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_3
2022-09-17T10:29:34.937179 data_processor.cpp:198 join ] Data processor: Operation data writer_3 finished execution...
2022-09-17T10:29:34.937221 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_4...
2022-09-17T10:29:34.937238 data_processor.cpp:187 join ] Data processor: Operation data writer_4 resumed...
2022-09-17T10:29:34.937262 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_4
2022-09-17T10:29:34.942542 data_processor.cpp:198 join ] Data processor: Operation data writer_4 finished execution...
2022-09-17T10:29:34.942587 data_processor.cpp:185 join ] Trying to resume data processor: Accounts data writer...
2022-09-17T10:29:34.942608 data_processor.cpp:187 join ] Data processor: Accounts data writer resumed...
2022-09-17T10:29:34.942636 data_processor.cpp:111 operator() ] Leaving data processor thread: Accounts data writer
2022-09-17T10:29:34.958263 data_processor.cpp:198 join ] Data processor: Accounts data writer finished execution...
2022-09-17T10:29:34.958424 data_processor.cpp:185 join ] Trying to resume data processor: Account operations data writer_0...
2022-09-17T10:29:34.958476 data_processor.cpp:187 join ] Data processor: Account operations data writer_0 resumed...
2022-09-17T10:29:34.958605 data_processor.cpp:111 operator() ] Leaving data processor thread: Account operations data writer_0
2022-09-17T10:29:34.960037 data_processor.cpp:198 join ] Data processor: Account operations data writer_0 finished execution...
2022-09-17T10:29:34.960098 data_processor.cpp:185 join ] Trying to resume data processor: Account operations data writer_1...
2022-09-17T10:29:34.960136 data_processor.cpp:187 join ] Data processor: Account operations data writer_1 resumed...
2022-09-17T10:29:34.960179 data_processor.cpp:111 operator() ] Leaving data processor thread: Account operations data writer_1
2022-09-17T10:29:34.971308 data_processor.cpp:198 join ] Data processor: Account operations data writer_1 finished execution...
2022-09-17T10:29:34.971511 data_processor.cpp:185 join ] Trying to resume data processor: commiting hive.end_massive_sync...
2022-09-17T10:29:34.971568 data_processor.cpp:187 join ] Data processor: commiting hive.end_massive_sync resumed...
2022-09-17T10:29:34.971677 data_processor.cpp:111 operator() ] Leaving data processor thread: commiting hive.end_massive_sync
2022-09-17T10:29:34.971800 data_processor.cpp:198 join ] Data processor: commiting hive.end_massive_sync finished execution...
2022-09-17T10:29:34.975696 reindex_data_dumper.cpp:42 ~reindex_data_dumper ] Reindex dumper closed
2022-09-17T10:29:34.975779 data_processor.cpp:119 ~data_processor ] ~data_processor: commiting hive.end_massive_sync
2022-09-17T10:29:34.975795 data_processor.cpp:119 ~data_processor ] ~data_processor: Account operations data writer_0
2022-09-17T10:29:34.975802 data_processor.cpp:119 ~data_processor ] ~data_processor: Account operations data writer_1
2022-09-17T10:29:34.975808 data_processor.cpp:119 ~data_processor ] ~data_processor: Accounts data writer
2022-09-17T10:29:34.975815 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_0
2022-09-17T10:29:34.975821 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_1
2022-09-17T10:29:34.975826 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_2
2022-09-17T10:29:34.975834 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_3
2022-09-17T10:29:34.975844 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_4
2022-09-17T10:29:34.975851 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction multisig data writer
2022-09-17T10:29:34.975857 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction data writer_0
2022-09-17T10:29:34.975863 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction data writer_1
2022-09-17T10:29:34.975870 data_processor.cpp:119 ~data_processor ] ~data_processor: Block data writer
2022-09-17T10:29:34.975880 indexes_controler.cpp:95 start_commit_sql ] Dropping disable fk-s...
2022-09-17T10:29:34.975974 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.disable_fk_of_irreversible();'
2022-09-17T10:29:34.976037 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.disable_fk_of_irreversible();' data processor is connecting ...
2022-09-17T10:29:34.976062 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.disable_fk_of_irreversible();' data processor connected successfully ...
2022-09-17T10:29:34.976097 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.disable_fk_of_irreversible();'...
2022-09-17T10:29:34.976110 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.disable_fk_of_irreversible();' resumed...
2022-09-17T10:29:34.985440 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.disable_fk_of_irreversible();`...
2022-09-17T10:29:35.021188 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.disable_fk_of_irreversible();' Saving and dropping of disable fk-s done in 35.68399999999999750 ms
2022-09-17T10:29:35.021247 indexes_controler.cpp:108 operator() ] The disable fk-s have been dropped...
2022-09-17T10:29:35.021334 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.disable_fk_of_irreversible();'
2022-09-17T10:29:35.021439 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.disable_fk_of_irreversible();' finished execution...
2022-09-17T10:29:35.021477 indexes_controler.cpp:66 disable_constraints ] All irreversible blocks tables foreign keys are dropped
2022-09-17T10:29:35.021488 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.disable_fk_of_irreversible();'
2022-09-17T10:29:35.021505 indexes_controler.cpp:26 disable_indexes_depe ] Number of blocks to add is less than threshold for disabling indexes. Indexes won't be disabled. 27933<1000000
2022-09-17T10:29:35.021517 reindex_data_dumper.cpp:12 reindex_data_dumper ] Starting reindexing dump to database with 5 operations and 2 transactions threads
2022-09-17T10:29:35.021625 data_processor.cpp:56 operator() ] Entering data processor thread: commiting hive.end_massive_sync
2022-09-17T10:29:35.021664 data_processor.cpp:56 operator() ] Entering data processor thread: Block data writer
2022-09-17T10:29:35.021709 data_processor.cpp:56 operator() ] Entering data processor thread: Transaction data writer_0
2022-09-17T10:29:35.021765 data_processor.cpp:63 operator() ] Transaction data writer_0 data processor is connecting ...
2022-09-17T10:29:35.021739 data_processor.cpp:56 operator() ] Entering data processor thread: Transaction data writer_1
2022-09-17T10:29:35.021722 data_processor.cpp:63 operator() ] Block data writer data processor is connecting ...
2022-09-17T10:29:35.021794 data_processor.cpp:65 operator() ] Transaction data writer_0 data processor connected successfully ...
2022-09-17T10:29:35.021848 data_processor.cpp:63 operator() ] Transaction data writer_1 data processor is connecting ...
2022-09-17T10:29:35.021844 data_processor.cpp:56 operator() ] Entering data processor thread: Transaction multisig data writer
2022-09-17T10:29:35.021685 data_processor.cpp:63 operator() ] commiting hive.end_massive_sync data processor is connecting ...
2022-09-17T10:29:35.022024 data_processor.cpp:56 operator() ] Entering data processor thread: Operation data writer_3
2022-09-17T10:29:35.021881 data_processor.cpp:56 operator() ] Entering data processor thread: Operation data writer_0
2022-09-17T10:29:35.022120 data_processor.cpp:56 operator() ] Entering data processor thread: Accounts data writer
2022-09-17T10:29:35.021924 data_processor.cpp:56 operator() ] Entering data processor thread: Operation data writer_1
2022-09-17T10:29:35.022231 data_processor.cpp:56 operator() ] Entering data processor thread: Account operations data writer_1
2022-09-17T10:29:35.022279 data_processor.cpp:63 operator() ] Account operations data writer_1 data processor is connecting ...
2022-09-17T10:29:35.022292 data_processor.cpp:65 operator() ] Account operations data writer_1 data processor connected successfully ...
2022-09-17T10:29:35.021974 data_processor.cpp:56 operator() ] Entering data processor thread: Operation data writer_2
2022-09-17T10:29:35.022037 data_processor.cpp:65 operator() ] commiting hive.end_massive_sync data processor connected successfully ...
2022-09-17T10:29:35.022082 data_processor.cpp:63 operator() ] Operation data writer_3 data processor is connecting ...
2022-09-17T10:29:35.022073 data_processor.cpp:56 operator() ] Entering data processor thread: Operation data writer_4
2022-09-17T10:29:35.022668 data_processor.cpp:63 operator() ] Operation data writer_4 data processor is connecting ...
2022-09-17T10:29:35.022679 data_processor.cpp:65 operator() ] Operation data writer_4 data processor connected successfully ...
2022-09-17T10:29:35.022135 data_processor.cpp:63 operator() ] Operation data writer_0 data processor is connecting ...
2022-09-17T10:29:35.022744 data_processor.cpp:65 operator() ] Operation data writer_0 data processor connected successfully ...
2022-09-17T10:29:35.021886 data_processor.cpp:65 operator() ] Block data writer data processor connected successfully ...
2022-09-17T10:29:35.022143 data_processor.cpp:56 operator() ] Entering data processor thread: Account operations data writer_0
2022-09-17T10:29:35.022219 data_processor.cpp:63 operator() ] Accounts data writer data processor is connecting ...
2022-09-17T10:29:35.022989 data_processor.cpp:65 operator() ] Accounts data writer data processor connected successfully ...
2022-09-17T10:29:35.022249 data_processor.cpp:63 operator() ] Operation data writer_1 data processor is connecting ...
2022-09-17T10:29:35.023064 data_processor.cpp:65 operator() ] Operation data writer_1 data processor connected successfully ...
2022-09-17T10:29:35.022506 data_processor.cpp:63 operator() ] Operation data writer_2 data processor is connecting ...
2022-09-17T10:29:35.022632 data_processor.cpp:65 operator() ] Operation data writer_3 data processor connected successfully ...
2022-09-17T10:29:35.023161 data_processor.cpp:65 operator() ] Operation data writer_2 data processor connected successfully ...
2022-09-17T10:29:35.022952 data_processor.cpp:63 operator() ] Account operations data writer_0 data processor is connecting ...
2022-09-17T10:29:35.021978 data_processor.cpp:63 operator() ] Transaction multisig data writer data processor is connecting ...
2022-09-17T10:29:35.023227 data_processor.cpp:65 operator() ] Account operations data writer_0 data processor connected successfully ...
2022-09-17T10:29:35.023250 data_processor.cpp:65 operator() ] Transaction multisig data writer data processor connected successfully ...
2022-09-17T10:29:35.021928 data_processor.cpp:65 operator() ] Transaction data writer_1 data processor connected successfully ...
2022-09-17T10:29:35.026999 indexation_state.cpp:257 update_state ] Entered P2P sync
2022-09-17T10:29:35.027030 chain_plugin.cpp:950 plugin_startup ] P2P enabling after replaying...
2022-09-17T10:29:35.027042 chain_plugin.cpp:709 work ] Started on blockchain with 67957056 blocks, LIB: 67957035
2022-09-17T10:29:35.027052 chain_plugin.cpp:715 work ] Started on blockchain with 67957056 blocks
2022-09-17T10:29:35.027093 chain_plugin.cpp:977 plugin_startup ] Chain plugin initialization finished...
2022-09-17T10:29:35.027110 sql_serializer.cpp:709 plugin_startup ] sql::plugin_startup()
2022-09-17T10:29:35.027122 p2p_plugin.cpp:468 plugin_startup ] P2P plugin startup...
2022-09-17T10:29:35.027230 chain_plugin.cpp:327 operator() ] Write processing thread started.
2022-09-17T10:29:35.034320 p2p_plugin.cpp:484 operator() ] Configuring P2P to listen at 0.0.0.0:2001
2022-09-17T10:29:35.035213 p2p_plugin.cpp:492 operator() ] P2P adding seed node 51.79.10.214:2001
2022-09-17T10:29:35.035271 p2p_plugin.cpp:492 operator() ] P2P adding seed node 178.32.202.159:2001
2022-09-17T10:29:35.035306 p2p_plugin.cpp:492 operator() ] P2P adding seed node 172.67.185.45:2001
2022-09-17T10:29:35.035346 p2p_plugin.cpp:492 operator() ] P2P adding seed node 104.21.43.208:2001
2022-09-17T10:29:35.035395 p2p_plugin.cpp:492 operator() ] P2P adding seed node 188.114.96.12:2001
2022-09-17T10:29:35.035436 p2p_plugin.cpp:492 operator() ] P2P adding seed node 188.114.97.12:2001
2022-09-17T10:29:35.035480 p2p_plugin.cpp:492 operator() ] P2P adding seed node 95.217.192.18:2001
2022-09-17T10:29:35.035574 p2p_plugin.cpp:492 operator() ] P2P adding seed node 91.183.35.138:2001
2022-09-17T10:29:35.035796 p2p_plugin.cpp:492 operator() ] P2P adding seed node 51.79.99.14:2001
2022-09-17T10:29:35.035869 p2p_plugin.cpp:492 operator() ] P2P adding seed node 65.21.199.174:2001
2022-09-17T10:29:35.035925 p2p_plugin.cpp:492 operator() ] P2P adding seed node 195.201.172.94:2001
2022-09-17T10:29:35.035978 p2p_plugin.cpp:492 operator() ] P2P adding seed node 65.21.235.184:2001
2022-09-17T10:29:35.036021 p2p_plugin.cpp:492 operator() ] P2P adding seed node 116.202.168.187:2001
2022-09-17T10:29:35.036066 p2p_plugin.cpp:492 operator() ] P2P adding seed node 88.99.165.91:2001
2022-09-17T10:29:35.036148 p2p_plugin.cpp:492 operator() ] P2P adding seed node 188.114.96.12:2001
2022-09-17T10:29:35.036201 p2p_plugin.cpp:492 operator() ] P2P adding seed node 188.114.97.12:2001
2022-09-17T10:29:35.036279 p2p_plugin.cpp:492 operator() ] P2P adding seed node 95.217.203.90:2016
2022-09-17T10:29:35.036451 p2p_plugin.cpp:492 operator() ] P2P adding seed node 185.130.44.110:2001
2022-09-17T10:29:35.036554 p2p_plugin.cpp:492 operator() ] P2P adding seed node 54.37.87.31:2001
2022-09-17T10:29:35.036653 p2p_plugin.cpp:511 operator() ] Setting parameters
2022-09-17T10:29:35.036764 p2p_plugin.cpp:514 operator() ] Listening to P2P network
2022-09-17T10:29:35.036904 p2p_plugin.cpp:522 operator() ] Connection to P2P network
2022-09-17T10:29:35.036959 p2p_plugin.cpp:524 operator() ] Connected to P2P network
2022-09-17T10:29:35.038082 p2p_plugin.cpp:532 operator() ] P2P node listening at 0.0.0.0:2001
2022-09-17T10:29:35.038161 p2p_plugin.cpp:541 plugin_startup ] P2P Plugin started
2022-09-17T10:29:35.038182 witness_plugin.cpp:641 plugin_startup ] witness plugin: plugin_startup() begin
2022-09-17T10:29:35.038202 witness_plugin.cpp:664 plugin_startup ] No witnesses configured! Please add witness IDs and private keys to configuration.
2022-09-17T10:29:35.038210 witness_plugin.cpp:665 plugin_startup ] witness plugin: plugin_startup() end
2022-09-17T10:29:35.038468 transaction_status_plugin.cpp:307 plugin_startup ] transaction_status: plugin_startup() begin
2022-09-17T10:29:35.038475 webserver_plugin.cpp:198 operator() ] start processing ws thread
2022-09-17T10:29:35.038688 webserver_plugin.cpp:219 operator() ] start listening for http requests on 0.0.0.0:8090
2022-09-17T10:29:35.038703 webserver_plugin.cpp:221 operator() ] start listening for ws requests on 0.0.0.0:8090
2022-09-17T10:29:35.038714 transaction_status_plugin.cpp:321 plugin_startup ] transaction_status: plugin_startup() end
2022-09-17T10:29:35.038727 state_snapshot_plugin.cpp:1466 plugin_startup ] Starting up state_snapshot_plugin...
2022-09-17T10:29:35.038737 wallet_bridge_api_plugin.cpp:20 plugin_startup ] Wallet bridge api plugin initialization...
2022-09-17T10:29:35.038746 wallet_bridge_api.cpp:169 api_startup ] Wallet bridge api initialized. Missing plugins: account_history_api
Entering application main loop...
2022-09-17T10:29:35.042290 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 1
2022-09-17T10:29:35.047146 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 2
2022-09-17T10:29:35.116746 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 3
2022-09-17T10:29:35.127299 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 4
2022-09-17T10:29:35.159113 database.cpp:4235 check_free_memory ] Free memory is now 6G. Current block number: 67957057
2022-09-17T10:29:35.190275 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 5
2022-09-17T10:29:35.199767 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 6
2022-09-17T10:29:35.221144 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:35.426492 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 7
2022-09-17T10:29:35.938151 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 8
2022-09-17T10:29:36.409421 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 9
2022-09-17T10:29:39.226503 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:39.851187 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67958057
2022-09-17T10:29:42.742405 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:43.295678 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67959057
2022-09-17T10:29:45.147381 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 10
2022-09-17T10:29:45.148183 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 11
2022-09-17T10:29:45.195132 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 12
2022-09-17T10:29:45.195238 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 13
2022-09-17T10:29:45.195293 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 14
2022-09-17T10:29:45.195835 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 15
2022-09-17T10:29:45.197116 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 16
2022-09-17T10:29:45.197184 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 17
2022-09-17T10:29:45.201861 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 18
2022-09-17T10:29:45.612684 chain_plugin.cpp:1024 accept_block ] Syncing Blockchain --- Got block: #67960000 time: 2022-09-16T13:40:24 producer: gtg
2022-09-17T10:29:46.028043 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 19
2022-09-17T10:29:46.771100 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:47.348350 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67960057
2022-09-17T10:29:50.770811 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:51.319421 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67961062
2022-09-17T10:29:54.494771 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:55.007993 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67962068
2022-09-17T10:29:55.625079 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 20
2022-09-17T10:29:57.811975 full_transaction.cpp:481 boost_se_body ] full_transaction_cache lock contention, waited 8µs, lock has been in use 1 of 459 times it was used
2022-09-17T10:29:57.811983 full_transaction.cpp:481 boost_se_body ] full_transaction_cache lock contention, waited 14µs, lock has been in use 2 of 460 times it was used2022-09-17T10:29:58.154480 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:29:59.331543 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67963072
2022-09-17T10:30:01.999330 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:02.599994 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67964072
2022-09-17T10:30:05.530262 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:05.990540 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67965073
2022-09-17T10:30:08.693319 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:09.081431 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67966074
2022-09-17T10:30:12.031065 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:12.469854 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67967074
2022-09-17T10:30:15.162257 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:15.633421 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67968074
2022-09-17T10:30:18.163044 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:18.516808 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67969074
2022-09-17T10:30:20.344074 chain_plugin.cpp:1019 accept_block ] Syncing Blockchain --- Got block: #67970000 time: 2022-09-16T22:01:09 producer: stoodkev --- 3473.14µs/block
2022-09-17T10:30:20.938228 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:21.288214 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67970074
2022-09-17T10:30:23.870205 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:24.227002 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67971075
2022-09-17T10:30:27.042410 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:27.434551 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67972076
2022-09-17T10:30:30.046042 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:30.426970 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67973076
2022-09-17T10:30:32.762640 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:33.094389 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67974076
2022-09-17T10:30:35.694925 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:36.009709 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67975079
2022-09-17T10:30:38.650226 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:39.002566 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67976079
2022-09-17T10:30:41.262364 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:41.677925 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67977081
2022-09-17T10:30:44.234709 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:44.608959 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67978083
2022-09-17T10:30:46.802336 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:47.116202 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67979083
2022-09-17T10:30:48.689027 chain_plugin.cpp:1019 accept_block ] Syncing Blockchain --- Got block: #67980000 time: 2022-09-17T06:21:48 producer: steempress --- 2834.50µs/block
2022-09-17T10:30:49.306222 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:49.617337 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67980085
2022-09-17T10:30:51.834213 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:52.131126 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67981085
2022-09-17T10:30:54.550731 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:54.899995 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67982085
2022-09-17T10:30:57.062223 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:57.354874 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67983085
2022-09-17T10:30:59.370623 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:30:59.684544 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67984085
2022-09-17T10:31:01.447581 chain_plugin.cpp:475 operator() ] waiting for work: 0.15%, waiting for locks: 0.00%, processing transactions: 0.00%, processing blocks: 99.83%, unknown: 0.02%
2022-09-17T10:31:01.532157 indexation_state.cpp:285 update_state ] Entering LIVE sync...
2022-09-17T10:31:01.559202 cached_data.h:29 ~cached_data_t ] blocks: 0 trx: 0 operations: 0 total size: 0...
2022-09-17T10:31:01.559316 reindex_data_dumper.cpp:40 ~reindex_data_dumper ] Reindex dumper is closing....
2022-09-17T10:31:01.559381 data_processor.cpp:185 join ] Trying to resume data processor: Block data writer...
2022-09-17T10:31:01.559445 data_processor.cpp:187 join ] Data processor: Block data writer resumed...
2022-09-17T10:31:01.570955 data_processor.cpp:111 operator() ] Leaving data processor thread: Block data writer
2022-09-17T10:31:01.571065 data_processor.cpp:198 join ] Data processor: Block data writer finished execution...
2022-09-17T10:31:01.571085 data_processor.cpp:185 join ] Trying to resume data processor: Transaction data writer_0...
2022-09-17T10:31:01.571093 data_processor.cpp:187 join ] Data processor: Transaction data writer_0 resumed...
2022-09-17T10:31:01.789109 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction data writer_0
2022-09-17T10:31:01.789196 data_processor.cpp:198 join ] Data processor: Transaction data writer_0 finished execution...
2022-09-17T10:31:01.789218 data_processor.cpp:185 join ] Trying to resume data processor: Transaction data writer_1...
2022-09-17T10:31:01.789224 data_processor.cpp:187 join ] Data processor: Transaction data writer_1 resumed...
2022-09-17T10:31:01.789243 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction data writer_1
2022-09-17T10:31:01.789296 data_processor.cpp:198 join ] Data processor: Transaction data writer_1 finished execution...
2022-09-17T10:31:01.789304 data_processor.cpp:185 join ] Trying to resume data processor: Transaction multisig data writer...
2022-09-17T10:31:01.789309 data_processor.cpp:187 join ] Data processor: Transaction multisig data writer resumed...
2022-09-17T10:31:01.789325 data_processor.cpp:111 operator() ] Leaving data processor thread: Transaction multisig data writer
2022-09-17T10:31:01.789676 data_processor.cpp:198 join ] Data processor: Transaction multisig data writer finished execution...
2022-09-17T10:31:01.789719 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_0...
2022-09-17T10:31:01.789731 data_processor.cpp:187 join ] Data processor: Operation data writer_0 resumed...
2022-09-17T10:31:01.813658 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_0
2022-09-17T10:31:01.814105 data_processor.cpp:198 join ] Data processor: Operation data writer_0 finished execution...
2022-09-17T10:31:01.814123 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_1...
2022-09-17T10:31:01.814130 data_processor.cpp:187 join ] Data processor: Operation data writer_1 resumed...
2022-09-17T10:31:01.814166 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_1
2022-09-17T10:31:01.814461 data_processor.cpp:198 join ] Data processor: Operation data writer_1 finished execution...
2022-09-17T10:31:01.814478 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_2...
2022-09-17T10:31:01.814485 data_processor.cpp:187 join ] Data processor: Operation data writer_2 resumed...
2022-09-17T10:31:01.814503 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_2
2022-09-17T10:31:01.814805 data_processor.cpp:198 join ] Data processor: Operation data writer_2 finished execution...
2022-09-17T10:31:01.814821 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_3...
2022-09-17T10:31:01.814829 data_processor.cpp:187 join ] Data processor: Operation data writer_3 resumed...
2022-09-17T10:31:01.856305 block_num_rendezvous_trigger.cpp:40 report_complete_thre ] Dump whole block 67984962
2022-09-17T10:31:01.859934 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_3
2022-09-17T10:31:01.860168 data_processor.cpp:198 join ] Data processor: Operation data writer_3 finished execution...
2022-09-17T10:31:01.860188 data_processor.cpp:185 join ] Trying to resume data processor: Operation data writer_4...
2022-09-17T10:31:01.860194 data_processor.cpp:187 join ] Data processor: Operation data writer_4 resumed...
2022-09-17T10:31:01.860211 data_processor.cpp:111 operator() ] Leaving data processor thread: Operation data writer_4
2022-09-17T10:31:01.860412 data_processor.cpp:198 join ] Data processor: Operation data writer_4 finished execution...
2022-09-17T10:31:01.860446 data_processor.cpp:185 join ] Trying to resume data processor: Accounts data writer...
2022-09-17T10:31:01.860453 data_processor.cpp:187 join ] Data processor: Accounts data writer resumed...
2022-09-17T10:31:01.860469 data_processor.cpp:111 operator() ] Leaving data processor thread: Accounts data writer
2022-09-17T10:31:01.866570 data_processor.cpp:198 join ] Data processor: Accounts data writer finished execution...
2022-09-17T10:31:01.866596 data_processor.cpp:185 join ] Trying to resume data processor: Account operations data writer_0...
2022-09-17T10:31:01.866606 data_processor.cpp:187 join ] Data processor: Account operations data writer_0 resumed...
2022-09-17T10:31:01.868518 data_processor.cpp:111 operator() ] Leaving data processor thread: Account operations data writer_0
2022-09-17T10:31:01.868642 data_processor.cpp:198 join ] Data processor: Account operations data writer_0 finished execution...
2022-09-17T10:31:01.868655 data_processor.cpp:185 join ] Trying to resume data processor: Account operations data writer_1...
2022-09-17T10:31:01.868660 data_processor.cpp:187 join ] Data processor: Account operations data writer_1 resumed...
2022-09-17T10:31:01.868698 data_processor.cpp:111 operator() ] Leaving data processor thread: Account operations data writer_1
2022-09-17T10:31:01.868831 data_processor.cpp:198 join ] Data processor: Account operations data writer_1 finished execution...
2022-09-17T10:31:01.868862 data_processor.cpp:185 join ] Trying to resume data processor: commiting hive.end_massive_sync...
2022-09-17T10:31:01.868868 data_processor.cpp:187 join ] Data processor: commiting hive.end_massive_sync resumed...
2022-09-17T10:31:01.869073 data_processor.cpp:111 operator() ] Leaving data processor thread: commiting hive.end_massive_sync
2022-09-17T10:31:01.869272 data_processor.cpp:198 join ] Data processor: commiting hive.end_massive_sync finished execution...
2022-09-17T10:31:01.870129 reindex_data_dumper.cpp:42 ~reindex_data_dumper ] Reindex dumper closed
2022-09-17T10:31:01.870158 data_processor.cpp:119 ~data_processor ] ~data_processor: commiting hive.end_massive_sync
2022-09-17T10:31:01.870167 data_processor.cpp:119 ~data_processor ] ~data_processor: Account operations data writer_0
2022-09-17T10:31:01.870174 data_processor.cpp:119 ~data_processor ] ~data_processor: Account operations data writer_1
2022-09-17T10:31:01.870180 data_processor.cpp:119 ~data_processor ] ~data_processor: Accounts data writer
2022-09-17T10:31:01.870200 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_0
2022-09-17T10:31:01.870205 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_1
2022-09-17T10:31:01.870211 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_2
2022-09-17T10:31:01.870226 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_3
2022-09-17T10:31:01.870232 data_processor.cpp:119 ~data_processor ] ~data_processor: Operation data writer_4
2022-09-17T10:31:01.870238 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction multisig data writer
2022-09-17T10:31:01.870244 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction data writer_0
2022-09-17T10:31:01.870249 data_processor.cpp:119 ~data_processor ] ~data_processor: Transaction data writer_1
2022-09-17T10:31:01.870254 data_processor.cpp:119 ~data_processor ] ~data_processor: Block data writer
2022-09-17T10:31:01.870263 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.870329 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );'
2022-09-17T10:31:01.870371 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );' data processor is connecting ...
2022-09-17T10:31:01.870395 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );' data processor connected successfully ...
2022-09-17T10:31:01.870449 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.870575 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );'
2022-09-17T10:31:01.870647 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );' data processor is connecting ...
2022-09-17T10:31:01.870685 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );' data processor connected successfully ...
2022-09-17T10:31:01.870747 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.870850 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );'
2022-09-17T10:31:01.870922 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );' data processor is connecting ...
2022-09-17T10:31:01.870959 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );' data processor connected successfully ...
2022-09-17T10:31:01.871021 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.871123 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );'
2022-09-17T10:31:01.871210 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );' data processor is connecting ...
2022-09-17T10:31:01.871267 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );' data processor connected successfully ...
2022-09-17T10:31:01.871351 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.871490 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );'2022-09-17T10:31:01.871589 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.operations' );' data processor is connecting ...
2022-09-17T10:31:01.871657 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.operations' );' data processor connected successfully ...
2022-09-17T10:31:01.871731 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.871848 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );'
2022-09-17T10:31:01.871925 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );' data processor is connecting ...
2022-09-17T10:31:01.871961 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );' data processor connected successfully ...
2022-09-17T10:31:01.872022 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T10:31:01.872124 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );'
2022-09-17T10:31:01.872192 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );' data processor is connecting ...
2022-09-17T10:31:01.872241 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );' data processor connected successfully ...
2022-09-17T10:31:01.872301 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );'...2022-09-17T10:31:01.872324 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );' resumed...
2022-09-17T10:31:01.875339 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.operations' );`...
2022-09-17T10:31:01.875339 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.blocks' );`...
2022-09-17T10:31:01.875722 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.transactions' );`...
2022-09-17T10:31:01.875772 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.irreversible_data' );`...
2022-09-17T10:31:01.875721 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );`...
2022-09-17T10:31:01.876013 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.accounts' );`...
2022-09-17T10:31:01.876228 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_indexes( 'hive.account_operations' );`...
2022-09-17T10:31:01.890373 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );' Creating of enable indexes done in 14.50900000000000034 ms
2022-09-17T10:31:01.890465 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T10:31:04.656246 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );' Creating of enable indexes done in 2780.33300000000008367 ms
2022-09-17T10:31:04.656289 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T10:31:09.103495 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );' Creating of enable indexes done in 7227.44899999999961437 ms
2022-09-17T10:31:09.103559 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T10:31:16.060809 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 18
2022-09-17T10:31:25.213491 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 19
2022-09-17T10:31:25.961460 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 20
2022-09-17T10:31:35.082715 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 6
2022-09-17T10:31:35.083892 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 7
2022-09-17T10:31:35.151152 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 8
2022-09-17T10:31:35.156596 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 9
2022-09-17T10:31:35.649717 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 10
2022-09-17T10:31:36.437551 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 11
2022-09-17T10:31:45.080036 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 12
2022-09-17T10:31:45.080719 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 13
2022-09-17T10:31:45.086730 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 14
2022-09-17T10:31:45.089656 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 15
2022-09-17T10:31:45.090052 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 16
2022-09-17T10:31:45.179937 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 17
2022-09-17T10:31:45.226550 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 18
2022-09-17T10:31:45.226874 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 19
2022-09-17T10:31:45.231338 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 20
2022-09-17T10:33:03.736416 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );' Creating of enable indexes done in 121861.00400000000081491 ms
2022-09-17T10:33:03.736465 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T10:33:03.738177 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );'
2022-09-17T10:33:03.738779 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );' finished execution...
2022-09-17T10:33:03.738801 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );'...
2022-09-17T10:33:03.738810 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );' resumed...
2022-09-17T10:33:03.738841 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );'
2022-09-17T10:33:03.738939 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );' finished execution...
2022-09-17T10:33:03.738972 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );'...
2022-09-17T10:33:03.738980 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );' resumed...
2022-09-17T11:21:50.383480 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );' Creating of enable indexes done in 3048507.68500000005587935 ms
2022-09-17T11:21:50.383524 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T11:21:50.385173 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );'
2022-09-17T11:21:50.385254 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );' finished execution...
2022-09-17T11:21:50.385269 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );'...
2022-09-17T11:21:50.385276 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );' resumed...
2022-09-17T11:21:50.385326 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );'
2022-09-17T11:21:50.385499 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );' finished execution...
2022-09-17T11:21:50.385519 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );'...
2022-09-17T11:21:50.385534 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );' resumed...
2022-09-17T12:52:21.993869 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );' Creating of enable indexes done in 8480117.56499999947845936 ms
2022-09-17T12:52:21.993910 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T12:53:38.955819 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_indexes( 'hive.operations' );' Creating of enable indexes done in 8557080.44600000046193600 ms
2022-09-17T12:53:38.955877 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T12:53:38.957302 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );'
2022-09-17T12:53:38.957510 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );' finished execution...
2022-09-17T12:53:38.957563 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );'...
2022-09-17T12:53:38.957574 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );' resumed...
2022-09-17T12:53:38.957622 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );'
2022-09-17T12:53:38.957752 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );' finished execution...
2022-09-17T12:53:38.957775 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );'...
2022-09-17T12:53:38.957785 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );' resumed...
2022-09-17T12:53:38.957809 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );'
2022-09-17T12:53:38.957948 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );' finished execution...
2022-09-17T12:53:38.957980 indexes_controler.cpp:56 enable_indexes ] All irreversible blocks tables indexes are re-created
2022-09-17T12:53:38.957994 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.account_operations' );'
2022-09-17T12:53:38.958006 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.accounts' );'
2022-09-17T12:53:38.958018 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.operations' );'
2022-09-17T12:53:38.958031 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions_multisig' );'
2022-09-17T12:53:38.958043 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.transactions' );'
2022-09-17T12:53:38.958054 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.irreversible_data' );'
2022-09-17T12:53:38.958066 data_processor.cpp:119 ~data_processor ] ~data_processor: Query processor: `SELECT hive.restore_indexes( 'hive.blocks' );'
2022-09-17T12:53:38.958427 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.959168 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );'
2022-09-17T12:53:38.960061 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );' data processor is connecting ...
2022-09-17T12:53:38.960111 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );' data processor connected successfully ...
2022-09-17T12:53:38.960184 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.960316 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions' );'
2022-09-17T12:53:38.960360 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions' );' data processor is connecting ...
2022-09-17T12:53:38.960372 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions' );' data processor connected successfully ...
2022-09-17T12:53:38.960442 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.960544 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions_multisig' );'
2022-09-17T12:53:38.960608 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions_multisig' );' data processor is connecting ...
2022-09-17T12:53:38.960648 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions_multisig' );' data processor connected successfully ...
2022-09-17T12:53:38.960783 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.960897 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.operations' );'
2022-09-17T12:53:38.960987 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.operations' );' data processor is connecting ...
2022-09-17T12:53:38.961022 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.operations' );' data processor connected successfully ...
2022-09-17T12:53:38.961062 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.961216 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.account_operations' );'
2022-09-17T12:53:38.961329 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.account_operations' );' data processor is connecting ...
2022-09-17T12:53:38.961345 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.account_operations' );' data processor connected successfully ...
2022-09-17T12:53:38.961408 indexes_controler.cpp:95 start_commit_sql ] Creating enable indexes...
2022-09-17T12:53:38.961559 data_processor.cpp:56 operator() ] Entering data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.accounts' );'
2022-09-17T12:53:38.961636 data_processor.cpp:63 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.accounts' );' data processor is connecting ...
2022-09-17T12:53:38.961666 data_processor.cpp:65 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.accounts' );' data processor connected successfully ...
2022-09-17T12:53:38.961701 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );'...
2022-09-17T12:53:38.961738 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );' resumed...
2022-09-17T12:53:38.967154 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.operations' );`...
2022-09-17T12:53:38.967185 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );`...
2022-09-17T12:53:38.967208 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.transactions_multisig' );`...
2022-09-17T12:53:38.967348 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.transactions' );`...
2022-09-17T12:53:38.967791 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.account_operations' );`...
2022-09-17T12:53:38.967858 indexes_controler.cpp:101 operator() ] Attempting to execute query: `SELECT hive.restore_foreign_keys( 'hive.accounts' );`...
2022-09-17T12:53:38.988589 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );' Creating of enable indexes done in 21.34700000000000131 ms
2022-09-17T12:53:38.988641 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T12:53:38.989013 data_processor.cpp:111 operator() ] Leaving data processor thread: Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );'
2022-09-17T12:53:38.989093 data_processor.cpp:198 join ] Data processor: Query processor: `SELECT hive.restore_foreign_keys( 'hive.irreversible_data' );' finished execution...
2022-09-17T12:53:38.989115 data_processor.cpp:185 join ] Trying to resume data processor: Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions' );'...
2022-09-17T12:53:38.989122 data_processor.cpp:187 join ] Data processor: Query processor: `SELECT hive.restore_foreign_keys( 'hive.transactions' );' resumed...
2022-09-17T13:08:55.205756 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 19
2022-09-17T13:09:05.343937 chain_plugin.cpp:1004 connection_count_cha ] peer_count changed: 20
2022-09-17T13:09:15.414554 full_transaction.cpp:481 boost_se_body ] full_transaction_cache lock contention, waited 52µs, lock has been in use 3 of 3987 times it was used
2022-09-17T13:10:16.699988 data_processor.cpp:212 handle_exception ] Data processor Query processor: `SELECT hive.restore_foreign_keys( 'hive.operations' );' detected SQL statement execution failure. Failing statement: `SELECT hive.restore_foreign_keys( 'hive.operations' );'.
2022-09-17T13:10:16.700026 data_processor.cpp:16 kill_node ] An error occured and HAF is stopping synchronization...
2022-09-17T13:10:16.700458 application.cpp:93 handle_signal ] _last_signal_code: 2
2022-09-17T13:10:16.700483 application.cpp:84 generate_interrupt_r ] interrupt requested!
2022-09-17T13:10:16.701008 webserver_plugin.cpp:619 plugin_pre_shutdown ] Shutting down webserver_plugin...
2022-09-17T13:10:16.703688 webserver_plugin.cpp:234 operator() ] ws io service exit
2022-09-17T13:10:16.704101 p2p_plugin.cpp:547 plugin_pre_shutdown ] Shutting down P2P Plugin...
2022-09-17T13:10:16.704155 shutdown_mgr.hpp:56 wait ] Processing of 'shutdown-state type: HIVE_P2P_BLOCK_HANDLER' in progress...
2022-09-17T13:10:16.804943 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 1 ...
2022-09-17T13:10:16.905074 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 2 ...
2022-09-17T13:10:17.005218 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 3 ...
2022-09-17T13:10:17.105363 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 4 ...
2022-09-17T13:10:17.205505 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 5 ...
2022-09-17T13:10:17.305633 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 6 ...
2022-09-17T13:10:17.405790 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 7 ...
2022-09-17T13:10:17.505948 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 8 ...
2022-09-17T13:10:17.606111 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 9 ...
2022-09-17T13:10:17.706244 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 10 ...
2022-09-17T13:10:17.806389 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 11 ...
2022-09-17T13:10:17.906523 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 12 ...
2022-09-17T13:10:18.006653 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 13 ...
2022-09-17T13:10:18.106794 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 14 ...
2022-09-17T13:10:18.206927 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 15 ...
2022-09-17T13:10:18.307089 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 16 ...
2022-09-17T13:10:18.407245 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 17 ...
2022-09-17T13:10:18.507377 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 18 ...
2022-09-17T13:10:18.607518 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 19 ...
2022-09-17T13:10:18.707663 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 20 ...
2022-09-17T13:10:18.807788 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 21 ...
2022-09-17T13:10:18.907918 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 22 ...
2022-09-17T13:10:19.008054 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 23 ...
2022-09-17T13:10:19.108181 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 24 ...
2022-09-17T13:10:19.208323 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 25 ...
2022-09-17T13:10:19.308462 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 26 ...
2022-09-17T13:10:19.408598 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 27 ...
2022-09-17T13:10:19.508736 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 28 ...
2022-09-17T13:10:19.608862 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 29 ...
2022-09-17T13:10:19.708983 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 30 ...
2022-09-17T13:10:19.809111 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 31 ...
2022-09-17T13:10:19.909250 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 32 ...
2022-09-17T13:10:20.009390 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 33 ...
2022-09-17T13:10:20.109522 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 34 ...
2022-09-17T13:10:20.209650 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 35 ...
2022-09-17T13:10:20.309807 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 36 ...
2022-09-17T13:10:20.409968 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 37 ...
2022-09-17T13:10:20.510122 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 38 ...
2022-09-17T13:10:20.610257 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 39 ...
2022-09-17T13:10:20.710398 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 40 ...
2022-09-17T13:10:20.810535 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 41 ...
2022-09-17T13:10:20.910668 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 42 ...
2022-09-17T13:10:21.010802 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 43 ...
2022-09-17T13:10:21.110924 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 44 ...
2022-09-17T13:10:21.211064 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 45 ...
2022-09-17T13:10:21.311187 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 46 ...
2022-09-17T13:10:21.411313 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 47 ...
2022-09-17T13:10:21.511443 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 48 ...
2022-09-17T13:10:21.611563 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 49 ...
2022-09-17T13:10:21.711711 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 50 ...
2022-09-17T13:10:21.811900 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 51 ...
2022-09-17T13:10:21.912164 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 52 ...
2022-09-17T13:10:22.012393 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 53 ...
2022-09-17T13:10:22.112633 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 54 ...
2022-09-17T13:10:22.212870 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 55 ...
2022-09-17T13:10:22.313115 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 56 ...
2022-09-17T13:10:22.413376 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 57 ...
2022-09-17T13:10:22.513607 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 58 ...
2022-09-17T13:10:22.613876 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 59 ...
2022-09-17T13:10:22.714086 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 60 ...
2022-09-17T13:10:22.814326 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 61 ...
2022-09-17T13:10:22.914536 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 62 ...
2022-09-17T13:10:23.014748 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 63 ...
2022-09-17T13:10:23.114967 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 64 ...
2022-09-17T13:10:23.215171 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 65 ...
2022-09-17T13:10:23.315390 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 66 ...
2022-09-17T13:10:23.415611 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 67 ...
2022-09-17T13:10:23.515831 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 68 ...
2022-09-17T13:10:23.616064 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 69 ...
2022-09-17T13:10:23.716281 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 70 ...
2022-09-17T13:10:23.816482 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 71 ...
2022-09-17T13:10:23.916705 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 72 ...
2022-09-17T13:10:24.016917 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 73 ...
2022-09-17T13:10:24.117131 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 74 ...
2022-09-17T13:10:24.217341 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 75 ...
2022-09-17T13:10:24.317556 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 76 ...
2022-09-17T13:10:24.417770 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 77 ...
2022-09-17T13:10:24.517996 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 78 ...
2022-09-17T13:10:24.618222 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 79 ...
2022-09-17T13:10:24.718442 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 80 ...
2022-09-17T13:10:24.818657 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 81 ...
2022-09-17T13:10:24.918882 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 82 ...
2022-09-17T13:10:25.019108 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 83 ...
2022-09-17T13:10:25.119326 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 84 ...
2022-09-17T13:10:25.219546 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 85 ...
2022-09-17T13:10:25.319763 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 86 ...
2022-09-17T13:10:25.419978 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 87 ...
2022-09-17T13:10:25.520195 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 88 ...
2022-09-17T13:10:25.620417 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 89 ...
2022-09-17T13:10:25.720644 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 90 ...
2022-09-17T13:10:25.820859 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 91 ...
2022-09-17T13:10:25.921163 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 92 ...
2022-09-17T13:10:26.021436 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 93 ...
2022-09-17T13:10:26.121695 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 94 ...
2022-09-17T13:10:26.221942 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 95 ...
2022-09-17T13:10:26.322159 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 96 ...
2022-09-17T13:10:26.422321 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 97 ...
2022-09-17T13:10:26.522515 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 98 ...
2022-09-17T13:10:26.622742 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 99 ...
2022-09-17T13:10:26.722971 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 100 ...
2022-09-17T13:10:26.823189 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 101 ...
2022-09-17T13:10:26.923403 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 102 ...
2022-09-17T13:10:27.023623 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 103 ...
2022-09-17T13:10:27.123844 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 104 ...
2022-09-17T13:10:27.224067 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 105 ...
2022-09-17T13:10:27.324288 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 106 ...
2022-09-17T13:10:27.424512 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 107 ...
2022-09-17T13:10:27.524734 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 108 ...
2022-09-17T13:10:27.624950 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 109 ...
2022-09-17T13:10:27.725203 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 110 ...
2022-09-17T13:10:27.825412 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 111 ...
2022-09-17T13:10:27.925634 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 112 ...
2022-09-17T13:10:28.025854 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 113 ...
2022-09-17T13:10:28.126096 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 114 ...
2022-09-17T13:10:28.226385 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 115 ...
2022-09-17T13:10:28.326592 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 116 ...
2022-09-17T13:10:28.426720 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 117 ...
2022-09-17T13:10:28.526930 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 118 ...
2022-09-17T13:10:28.627153 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 119 ...
2022-09-17T13:10:28.727388 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 120 ...
2022-09-17T13:10:28.827609 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 121 ...
2022-09-17T13:10:28.927829 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 122 ...
2022-09-17T13:10:29.028045 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 123 ...
2022-09-17T13:10:29.128298 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 124 ...
2022-09-17T13:10:29.228508 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 125 ...
2022-09-17T13:10:29.328715 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 126 ...
2022-09-17T13:10:29.428932 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 127 ...
2022-09-17T13:10:29.529151 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 128 ...
2022-09-17T13:10:29.629360 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 129 ...
2022-09-17T13:10:29.729560 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 130 ...
2022-09-17T13:10:29.829775 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 131 ...
2022-09-17T13:10:29.929985 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 132 ...
2022-09-17T13:10:30.030214 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 133 ...
2022-09-17T13:10:30.130612 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 134 ...
2022-09-17T13:10:30.230935 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 135 ...
2022-09-17T13:10:30.331152 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 136 ...
2022-09-17T13:10:30.431455 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 137 ...
2022-09-17T13:10:30.531825 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 138 ...
2022-09-17T13:10:30.632143 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 139 ...
2022-09-17T13:10:30.732403 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 140 ...
2022-09-17T13:10:30.832630 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 141 ...
2022-09-17T13:10:30.932839 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 142 ...
2022-09-17T13:10:31.033052 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 143 ...
2022-09-17T13:10:31.133259 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 144 ...
2022-09-17T13:10:31.233473 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 145 ...
2022-09-17T13:10:31.333756 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 146 ...
2022-09-17T13:10:31.434017 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 147 ...
2022-09-17T13:10:31.534229 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 148 ...
2022-09-17T13:10:31.634440 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 149 ...
2022-09-17T13:10:31.734690 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 150 ...
2022-09-17T13:10:31.834909 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 151 ...
2022-09-17T13:10:31.935126 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 152 ...
2022-09-17T13:10:32.035339 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 153 ...
2022-09-17T13:10:32.135537 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 154 ...
2022-09-17T13:10:32.235714 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 155 ...
2022-09-17T13:10:32.335920 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 156 ...
2022-09-17T13:10:32.436120 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 157 ...
2022-09-17T13:10:32.536330 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 158 ...
2022-09-17T13:10:32.636539 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 159 ...
2022-09-17T13:10:32.736756 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 160 ...
2022-09-17T13:10:32.836960 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 161 ...
2022-09-17T13:10:32.937167 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 162 ...
2022-09-17T13:10:33.037402 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 163 ...
2022-09-17T13:10:33.137599 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 164 ...
2022-09-17T13:10:33.237812 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 165 ...
2022-09-17T13:10:33.338092 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 166 ...
2022-09-17T13:10:33.438301 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 167 ...
2022-09-17T13:10:33.538490 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 168 ...
2022-09-17T13:10:33.638692 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 169 ...
2022-09-17T13:10:33.739003 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 170 ...
2022-09-17T13:10:33.839289 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 171 ...
2022-09-17T13:10:33.939507 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 172 ...
2022-09-17T13:10:34.039729 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 173 ...
2022-09-17T13:10:34.139953 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 174 ...
2022-09-17T13:10:34.240192 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 175 ...
2022-09-17T13:10:34.340432 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 176 ...
2022-09-17T13:10:34.440713 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 177 ...
2022-09-17T13:10:34.541011 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 178 ...
2022-09-17T13:10:34.641233 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 179 ...
2022-09-17T13:10:34.741472 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 180 ...
2022-09-17T13:10:34.841690 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 181 ...
2022-09-17T13:10:34.941896 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 182 ...
2022-09-17T13:10:35.042096 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 183 ...
2022-09-17T13:10:35.142299 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 184 ...
2022-09-17T13:10:35.242486 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 185 ...
2022-09-17T13:10:35.342672 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 186 ...
2022-09-17T13:10:35.442863 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 187 ...
2022-09-17T13:10:35.543069 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 188 ...
2022-09-17T13:10:35.643279 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 189 ...
2022-09-17T13:10:35.743481 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 190 ...
2022-09-17T13:10:35.843670 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 191 ...
2022-09-17T13:10:35.943882 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 192 ...
2022-09-17T13:10:36.044088 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 193 ...
2022-09-17T13:10:36.144307 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 194 ...
2022-09-17T13:10:36.244516 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 195 ...
2022-09-17T13:10:36.344730 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 196 ...
2022-09-17T13:10:36.444938 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 197 ...
2022-09-17T13:10:36.545141 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 198 ...
2022-09-17T13:10:36.645361 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 199 ...
2022-09-17T13:10:36.745598 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 200 ...
2022-09-17T13:10:36.845854 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 201 ...
2022-09-17T13:10:36.946059 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 202 ...
2022-09-17T13:10:37.046260 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 203 ...
2022-09-17T13:10:37.146481 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 204 ...
2022-09-17T13:10:37.246615 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 205 ...
2022-09-17T13:10:37.346814 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 206 ...
2022-09-17T13:10:37.447032 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 207 ...
2022-09-17T13:10:37.547254 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 208 ...
2022-09-17T13:10:37.647486 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 209 ...
2022-09-17T13:10:37.747714 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 210 ...
2022-09-17T13:10:37.847934 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 211 ...
2022-09-17T13:10:37.948157 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 212 ...
2022-09-17T13:10:38.048380 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 213 ...
2022-09-17T13:10:38.148596 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 214 ...
2022-09-17T13:10:38.248811 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 215 ...
2022-09-17T13:10:38.349041 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 216 ...
2022-09-17T13:10:38.350763 indexes_controler.cpp:104 operator() ] Query processor: `SELECT hive.restore_foreign_keys( 'hive.accounts' );' Creating of enable indexes done in 1019382.83900000003632158 ms
2022-09-17T13:10:38.350790 indexes_controler.cpp:108 operator() ] The enable indexes have been created...
2022-09-17T13:10:38.449268 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 217 ...
2022-09-17T13:10:38.549495 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 218 ...
2022-09-17T13:10:38.649717 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 219 ...
2022-09-17T13:10:38.749921 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 220 ...
2022-09-17T13:10:38.850131 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 221 ...
2022-09-17T13:10:38.950359 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 222 ...
2022-09-17T13:10:39.050569 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 223 ...
2022-09-17T13:10:39.150788 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 224 ...
2022-09-17T13:10:39.250991 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 225 ...
2022-09-17T13:10:39.351206 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 226 ...
2022-09-17T13:10:39.451417 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 227 ...
2022-09-17T13:10:39.551612 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 228 ...
2022-09-17T13:10:39.651828 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 229 ...
2022-09-17T13:10:39.752039 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 230 ...
2022-09-17T13:10:39.852257 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 231 ...
2022-09-17T13:10:39.952479 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 232 ...
2022-09-17T13:10:40.052715 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 233 ...
2022-09-17T13:10:40.152919 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 234 ...
2022-09-17T13:10:40.253125 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 235 ...
2022-09-17T13:10:40.353341 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 236 ...
2022-09-17T13:10:40.453561 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 237 ...
2022-09-17T13:10:40.553784 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 238 ...
2022-09-17T13:10:40.654002 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 239 ...
2022-09-17T13:10:40.754204 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 240 ...
2022-09-17T13:10:40.854350 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 241 ...
2022-09-17T13:10:40.954560 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 242 ...
2022-09-17T13:10:41.054758 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 243 ...
2022-09-17T13:10:41.154960 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 244 ...
2022-09-17T13:10:41.255192 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 245 ...
2022-09-17T13:10:41.355428 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 246 ...
2022-09-17T13:10:41.455642 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 247 ...
2022-09-17T13:10:41.555862 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 248 ...
2022-09-17T13:10:41.656083 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 249 ...
2022-09-17T13:10:41.756300 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 250 ...
2022-09-17T13:10:41.856529 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 251 ...
2022-09-17T13:10:41.956751 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 252 ...
2022-09-17T13:10:42.056971 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 253 ...
2022-09-17T13:10:42.157181 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 254 ...
2022-09-17T13:10:42.257388 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 255 ...
2022-09-17T13:10:42.357585 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 256 ...
2022-09-17T13:10:42.458130 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 257 ...
2022-09-17T13:10:42.558341 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 258 ...
2022-09-17T13:10:42.658528 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 259 ...
2022-09-17T13:10:42.758721 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 260 ...
2022-09-17T13:10:42.859074 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 261 ...
2022-09-17T13:10:42.959631 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 262 ...
2022-09-17T13:10:43.060183 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 263 ...
2022-09-17T13:10:43.160897 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 264 ...
2022-09-17T13:10:43.261442 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 265 ...
2022-09-17T13:10:43.361685 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 266 ...
2022-09-17T13:10:43.462059 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 267 ...
2022-09-17T13:10:43.562473 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 268 ...
2022-09-17T13:10:43.662705 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 269 ...
2022-09-17T13:10:43.762839 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 270 ...
2022-09-17T13:10:43.862965 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 271 ...
2022-09-17T13:10:43.963092 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 272 ...
2022-09-17T13:10:44.063222 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 273 ...
2022-09-17T13:10:44.163351 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 274 ...
2022-09-17T13:10:44.263480 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 275 ...
2022-09-17T13:10:44.363603 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 276 ...
2022-09-17T13:10:44.463730 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 277 ...
2022-09-17T13:10:44.563872 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 278 ...
2022-09-17T13:10:44.664003 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 279 ...
2022-09-17T13:10:44.764139 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 280 ...
2022-09-17T13:10:44.864276 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 281 ...
2022-09-17T13:10:44.964411 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 282 ...
2022-09-17T13:10:45.064544 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 283 ...
2022-09-17T13:10:45.164688 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 284 ...
2022-09-17T13:10:45.264818 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 285 ...
2022-09-17T13:10:45.364976 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 286 ...
2022-09-17T13:10:45.465137 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 287 ...
2022-09-17T13:10:45.565289 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 288 ...
2022-09-17T13:10:45.665433 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 289 ...
2022-09-17T13:10:45.765575 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 290 ...
2022-09-17T13:10:45.865717 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 291 ...
2022-09-17T13:10:45.965858 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 292 ...
2022-09-17T13:10:46.066004 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 293 ...
2022-09-17T13:10:46.166148 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 294 ...
2022-09-17T13:10:46.266290 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 295 ...
2022-09-17T13:10:46.366409 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 296 ...
2022-09-17T13:10:46.466531 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 297 ...
2022-09-17T13:10:46.566631 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 298 ...
2022-09-17T13:10:46.666743 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 299 ...
2022-09-17T13:10:46.766854 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 300 ...
2022-09-17T13:10:46.866960 shutdown_mgr.hpp:65 wait ] finishing: timeout, future status: 1, attempt: 301 ...
Before shutting down...
application shutdown: unknown error exception.
Leaving application main loop...
terminate called without an active exception
Edited by Deathwing