Fresh synch dies after enum_virtual_ops tries (#111) · Issues · hive / hivemind

Fresh synch dies after enum_virtual_ops tries

Latest develop 934f2316, despite API node being operational and on the same machine.
INFO - hive.indexer.sync - Awaiting any vops to process...
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 6. {'jussi-id': None, 'secs': 0.006, 'try': 6} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 7. {'jussi-id': None, 'secs': 0.005, 'try': 7} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 8. {'jussi-id': None, 'secs': 0.005, 'try': 8} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 9. {'jussi-id': None, 'secs': 0.005, 'try': 9} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 10. {'jussi-id': None, 'secs': 0.005, 'try': 10} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 11. {'jussi-id': None, 'secs': 0.006, 'try': 11} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 12. {'jussi-id': None, 'secs': 0.005, 'try': 12} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 13. {'jussi-id': None, 'secs': 0.005, 'try': 13} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 14. {'jussi-id': None, 'secs': 0.005, 'try': 14} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 15. {'jussi-id': None, 'secs': 0.005, 'try': 15} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 16. {'jussi-id': None, 'secs': 0.005, 'try': 16} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 17. {'jussi-id': None, 'secs': 0.005, 'try': 17} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 18. {'jussi-id': None, 'secs': 0.005, 'try': 18} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 19. {'jussi-id': None, 'secs': 0.005, 'try': 19} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 20. {'jussi-id': None, 'secs': 0.005, 'try': 20} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 21. {'jussi-id': None, 'secs': 0.005, 'try': 21} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 22. {'jussi-id': None, 'secs': 0.005, 'try': 22} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 23. {'jussi-id': None, 'secs': 0.005, 'try': 23} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 24. {'jussi-id': None, 'secs': 0.005, 'try': 24} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 0.0s. try 25. {'jussi-id': None, 'secs': 0.005, 'try': 25} - RPCError("assert_exception[-32003]: `Assert Exception:s.IsNotFound(): `  in account_history_api.enum_virtual_ops({'block_range_begin': 13838263, 'block_range_end': 13839001, 'group_by_block': True, 'include_reversible': True, 'operation_begin': '9223372039796934648', 'limit': 1000, 'filter': 12584970})",)
ERROR - hive.indexer.sync - Exception caught during fetching vops...
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/hivemind-0.0.1+934f2316-py3.6.egg/hive/indexer/sync.py", line 80, in _vops_provider
    vops = node.enum_virtual_ops(conf, lbound, to)
  File "/usr/local/lib/python3.6/dist-packages/hivemind-0.0.1+934f2316-py3.6.egg/hive/steem/client.py", line 218, in enum_virtual_ops
    , "group_by_block": True, "include_reversible": True, "operation_begin": resume_on_operation, "limit": 1000, "filter": tracked_ops_filter
  File "/usr/local/lib/python3.6/dist-packages/hivemind-0.0.1+934f2316-py3.6.egg/hive/steem/client.py", line 271, in __exec
    result = self._client["default"].exec(method, params)
  File "/usr/local/lib/python3.6/dist-packages/hivemind-0.0.1+934f2316-py3.6.egg/hive/steem/http_client.py", line 186, in exec
    raise Exception("abort %s after %d tries" % (method, tries))
Exception: abort enum_virtual_ops after 25 tries
Edited Nov 20, 2020 by Jolly Pirate