Unable to reach head block in live sync after resuming from failed after-initial-sync
Full hive sync
resumed after VACUUM ANALYZE
issues (fixed in c0f54431) is not able to catch up with the HEAD BLOCK for some reason.
update_posts_rshares
65029 INFO - hive.indexer.blocks - [PROCESS MULTI] Flushing data in 1 thread
65030 INFO - hive.indexer.reputations - Written total reputation data records: 798754
65034 INFO - hive.indexer.blocks - [PROCESS MULTI] Tables updating in live synchronization
65034 INFO - hive.utils.timer - update_active_starting_from_posts_on_block executed in 0.0584 s
66104 INFO - hive.indexer.blocks - SELECT update_posts_rshares(56700774, 56701773) executed in: 1070.1970 s
66104 INFO - hive.indexer.blocks - SELECT update_hive_posts_children_count(56700774, 56701773) executed in: 0.1089 s
66104 INFO - hive.indexer.blocks - SELECT update_hive_posts_root_id(56700774,56701773) executed in: 0.0127 s
66104 INFO - hive.indexer.blocks - SELECT update_hive_posts_api_helper(56700774,56701773) executed in: 0.2052 s
66105 INFO - hive.indexer.blocks - SELECT update_feed_cache(56700774, 56701773) executed in: 0.0611 s
66105 INFO - hive.indexer.blocks - SELECT update_hive_posts_mentions(56700774, 56701773) executed in: 0.2134 s
66109 INFO - hive.indexer.blocks - SELECT update_notification_cache(56700774, 56701773, False) executed in: 4.0719 s
66109 INFO - hive.indexer.blocks - SELECT update_follow_count(56700774, 56701773) executed in: 0.1189 s
66111 INFO - hive.indexer.blocks - SELECT update_account_reputations(56700774, 56701773, False) executed in: 1.9829 s
66111 INFO - hive.indexer.blocks - SELECT update_hive_blocks_consistency_flag(56700774, 56701773) executed in: 0.0243 s
66111 INFO - hive.utils.timer - on_live_blocks_processed executed in 1077.0562 s
66111 INFO - hive.indexer.blocks - [PROCESS MULTI] 1000 blocks in 1085.5306s
66111 INFO - hive.indexer.sync - [FAST SYNC] Got block 56701773 @ 2021-08-20T15:49:12 (0/s, 0rps, 648076848wps) -- eta 04h 34m 37s
66111 INFO - hive.indexer.sync - [FAST SYNC] Time elapsed: 5443.394781s
66111 INFO - hive.indexer.sync - [FAST SYNC] Current system time: 06:01:31
66111 INFO - hive.indexer.sync - memory usage report: physical_memory = 4181.06 MB, virtual_memory = 5343.32 MB, shared_memory = 5.37 MB
66111 INFO - hive.utils.stats - ####################
66111 INFO - hive.utils.stats - Operations present in the processed blocks
66111 INFO - hive.utils.stats - `OperationType.Comment`: Processed 1110 times in 1.69423 seconds
66111 INFO - hive.utils.stats - `OperationType.CustomJson`: Processed 67935 times in 0.53507 seconds
66111 INFO - hive.utils.stats - `VirtualOperationType.EffectiveCommentVote`: Processed 11064 times in 0.20389 seconds
66111 INFO - hive.utils.stats - `OperationType.CommentOption`: Processed 315 times in 0.18202 seconds
66111 INFO - hive.utils.stats - `OperationType.AccountCreate`: Processed 338 times in 0.17478 seconds
66111 INFO - hive.utils.stats - `OperationType.CreateClaimedAccount`: Processed 32 times in 0.04126 seconds
66111 INFO - hive.utils.stats - `OperationType.Vote`: Processed 11134 times in 0.04097 seconds
66111 INFO - hive.utils.stats - `OperationType.Transfer`: Processed 1439 times in 0.00463 seconds
66111 INFO - hive.utils.stats - `VirtualOperationType.CommentPayoutUpdate`: Processed 1067 times in 0.00366 seconds
66111 INFO - hive.utils.stats - `OperationType.DeleteComment`: Processed 3 times in 0.00256 seconds
66111 INFO - hive.utils.stats - `VirtualOperationType.AuthorReward`: Processed 213 times in 0.00073 seconds
66111 INFO - hive.utils.stats - `VirtualOperationType.CommentReward`: Processed 213 times in 0.00055 seconds
66111 INFO - hive.utils.stats - `OperationType.AccountUpdate`: Processed 59 times in 0.00024 seconds
66111 INFO - hive.utils.stats - `OperationType.AccountUpdate2`: Processed 16 times in 0.00007 seconds
66111 INFO - hive.utils.stats - Current time for processing operations time: 2.8847s.
66111 INFO - hive.utils.stats - ####################
66111 INFO - hive.utils.stats - Flushing times
66111 INFO - hive.utils.stats - `Blocks`: Pushed 1000 records in 0.0211 seconds
66111 INFO - hive.utils.stats - Current flushing time: 0.0211s.
66111 INFO - hive.utils.stats - ####################
66111 INFO - hive.utils.stats - Waiting times
66111 INFO - hive.utils.stats - `block_consumer_vop`: Waited 0.0021 seconds
66111 INFO - hive.utils.stats - `block_consumer_block`: Waited 0.0020 seconds
66111 INFO - hive.utils.stats - Current waiting time: 0.0041s.
66111 INFO - hive.indexer.sync - Calculated time: 2.9098 s.
66111 INFO - hive.indexer.hive_rpc.massive_blocks_data_provider_hive_rpc - vops_queue.qsize: 1500 blocks_queue.qsize: 1500