hivemind issueshttps://gitlab.syncad.com/hive/hivemind/-/issues2024-02-05T18:32:35Zhttps://gitlab.syncad.com/hive/hivemind/-/issues/229Community Owner was able to change its role2024-02-05T18:32:35ZHowoCommunity Owner was able to change its roleIf you are an owner it should be impossible to set a different role if the account role is owner:
https://gitlab.syncad.com/hive/hivemind/-/blob/develop/hive/indexer/community.py?ref_type=heads#L582
Yet this community managed to do it...If you are an owner it should be impossible to set a different role if the account role is owner:
https://gitlab.syncad.com/hive/hivemind/-/blob/develop/hive/indexer/community.py?ref_type=heads#L582
Yet this community managed to do it: https://peakd.com/c/hive-161465/about
with this tx:
https://hiveblocks.com/tx/015cd5ce5c9013d428d1382a75812b243b866408HowoHowohttps://gitlab.syncad.com/hive/hivemind/-/issues/222Using haf_api_node, hivemind block processor died on 'docker compose up` afte...2024-03-27T18:59:17ZDan NotesteinUsing haf_api_node, hivemind block processor died on 'docker compose up` after prev shutdown (was in massive sync at shutdown time), probably C-locale test relatedThis could be some side-effact of tested software: I was using version that creates database with "C-locale". I will try to dup the issue later after the system is freed up. I have a snapshot of the original conditions, but need to finis...This could be some side-effact of tested software: I was using version that creates database with "C-locale". I will try to dup the issue later after the system is freed up. I have a snapshot of the original conditions, but need to finish long running test of hafbe first.
```
syncad@steem-14:/haf-pool/syncad/haf_api_node$ docker logs haf-world-hivemind-block-processing-1
[Entrypoint] 2023-12-13 00:23:33,878+00:00 INFO [global] (main) Hivemind arguments: --database-url=postgresql://hivemind@haf/haf_block_log sync
[Entrypoint] 2023-12-13 00:23:33,878+00:00 INFO [global] (main) Hivemind arguments: sync
[Entrypoint] 2023-12-13 00:23:33,879+00:00 INFO [global] (main) Using PostgreSQL instance: postgresql://hivemind@haf/haf_block_log
[Entrypoint] 2023-12-13 00:23:33,881+00:00 INFO [run_hive] (main) Starting Hivemind...
INFO - hive.conf:212 - The database instance is created...
INFO - hive.db.adapter:48 - A database offers maximum connections: 100. Required 15 connections.
INFO - hive.db.adapter:90 - Closing database connection: 'root'
INFO - hive.db.adapter:108 - Disposing SQL engine
INFO - hive.conf:261 - The database is disconnected...
INFO - hive.conf:212 - The database instance is created...
INFO - hive.indexer.sync:52 - Entering HAF mode synchronization
INFO - hive.db.db_state:44 - [MASSIVE] Welcome to hive!
INFO - hive.db.db_state:55 - [MASSIVE] Continue with massive sync...
INFO - hive.indexer.sync:67 - hivemind_version : 2.0.0dev1
INFO - hive.indexer.sync:68 - hivemind_git_rev : c8a8ec7aac1c45e243fbaa6befa93c626cbb78bc
INFO - hive.indexer.sync:69 - hivemind_git_date : 2023-11-08 22:44:15
INFO - hive.indexer.sync:71 - database_schema_version : 34
INFO - hive.indexer.sync:72 - database_patch_date : 2023-12-12 02:44:03.345787
INFO - hive.indexer.sync:73 - database_patched_to_revision : 9d2cc15bea71a39139abdf49569e0eac6dd0b970
INFO - hive.indexer.sync:75 - last_block_from_view : 492000
INFO - hive.indexer.sync:76 - last_imported_block : 492000
INFO - hive.indexer.sync:77 - last_completed_block : 1
INFO - hive.indexer.hive_db.haf_functions:34 - Context already attached - attaching skipped.
INFO - hive.indexer.sync:89 - Using HAF database as block data provider, pointed by url: 'postgresql://hivemind@haf/haf_block_log'
INFO - hive.indexer.sync:99 - Last imported block is: 492000
INFO - hive.indexer.sync:186 - Querying for next block for app context...
INFO - hive.indexer.sync:188 - Next block range from hive.app_next_block is: <None:None>
INFO - hive.indexer.sync:99 - Last imported block is: 492000
INFO - hive.indexer.sync:186 - Querying for next block for app context...
INFO - hive.indexer.sync:188 - Next block range from hive.app_next_block is: <492001:80973941>
INFO - hive.indexer.sync:117 - target_head_block: 80973941
INFO - hive.indexer.sync:118 - test_max_block: None
INFO - hive.indexer.sync:122 - [MASSIVE] *** MASSIVE blocks processing ***
INFO - hive.db.db_state:274 - Dropping foreign keys
INFO - hive.db.db_state:280 - Dropped foreign keys: 0.0189 s
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_reputation_data
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_posts
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_votes
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_follows
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_reblogs
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_feed_cache
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_posts_api_helper
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_communities
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_subscriptions
INFO - hive.db.db_state:202 - [MASSIVE] Begin pre-massive sync hooks for table hive_notification_cache
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_author_id_created_at_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_reblogs.hive_reblogs_created_at_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_author_id_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_reputation_data.hive_reputation_data_block_num_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_follows.hive_follows_following_state_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_votes.hive_votes_post_id_voter_id_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_reblogs'
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_community_id_is_pinned_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts_api_helper.hive_posts_api_helper_author_s_permlink_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_follows.hive_follows_block_num_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_reputation_data'
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_votes.hive_votes_block_num_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_feed_cache.hive_feed_cache_block_num_idx
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_reblogs
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_block_num_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_communities.hive_communities_block_num_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_notification_cache.hive_notification_cache_block_num_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_follows.hive_follows_follower_state_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_subscriptions.hive_subscriptions_block_num_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_posts_api_helper'
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_reputation_data
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_votes.hive_votes_voter_id_last_update_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_feed_cache.hive_feed_cache_created_at_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_community_id_not_is_pinned_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_communities'
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_follows.hive_follows_created_at_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_notification_cache.hive_notification_cache_dst_score_idx
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_posts_api_helper
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_votes.hive_votes_voter_id_post_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_subscriptions.hive_subscriptions_community_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_feed_cache.hive_feed_cache_post_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_block_num_created_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_follows.hive_follows_follower_following_state_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_notification_cache'
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_communities
INFO - hive.db.adapter:90 - Closing database connection: 'hive_votes'
INFO - hive.db.adapter:90 - Closing database connection: 'hive_subscriptions'
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_feed_cache.hive_feed_cache_account_id_created_at_post_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_payout_plus_pending_payout_id_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_follows'
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_notification_cache
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_votes
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_subscriptions
INFO - hive.db.adapter:90 - Closing database connection: 'hive_feed_cache'
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_cashout_time_id_idx
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_follows
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_feed_cache
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_payout_at_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_updated_at_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_community_id_not_is_paidout_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_category_id_payout_plus_pending_payout_depth_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_payout_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_root_id_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_depth_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_promoted_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_sc_trend_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_parent_id_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_tags_ids_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_sc_hot_id_idx
INFO - hive.db.db_state:209 - Drop index hivemind_app.hive_posts.hive_posts_community_id_id_idx
INFO - hive.db.adapter:90 - Closing database connection: 'hive_posts'
INFO - hive.db.db_state:232 - [MASSIVE] End pre-massive sync hooks for table hive_posts
INFO - hive.db.db_state:422 - [MASSIVE] 10 threads finished creating indexes. Real elapsed time: 0.025
INFO - hive.db.db_state:254 - === DROPPING INDEXES ===
INFO - hive.utils.stats:162 - ####################
INFO - hive.utils.stats:300 - Total DROPPING indexes time
INFO - hive.utils.stats:156 - `hive_posts`: Processed final operations in 0.0243 seconds
INFO - hive.utils.stats:156 - `hive_votes`: Processed final operations in 0.0196 seconds
INFO - hive.utils.stats:156 - `hive_follows`: Processed final operations in 0.0195 seconds
INFO - hive.utils.stats:156 - `hive_feed_cache`: Processed final operations in 0.0184 seconds
INFO - hive.utils.stats:156 - `hive_reputation_data`: Processed final operations in 0.0168 seconds
INFO - hive.utils.stats:156 - `hive_subscriptions`: Processed final operations in 0.0150 seconds
INFO - hive.utils.stats:156 - `hive_communities`: Processed final operations in 0.0145 seconds
INFO - hive.utils.stats:156 - `hive_notification_cache`: Processed final operations in 0.0141 seconds
INFO - hive.utils.stats:156 - `hive_posts_api_helper`: Processed final operations in 0.0138 seconds
INFO - hive.utils.stats:156 - `hive_reblogs`: Processed final operations in 0.0130 seconds
INFO - hive.utils.stats:302 - Current final processing time: 0.1691s.
INFO - hive.db.db_state:256 - Elapsed time: 0.0357s. Calculated elapsed time: 0.1691s. Difference: -0.1334s
INFO - hive.db.db_state:260 - === DROPPING INDEXES ===
INFO - hive.db.db_state:289 - [MASSIVE] Finish pre-massive sync hooks
INFO - hive.indexer.hive_db.haf_functions:25 - Trying to detach app context...
INFO - hive.indexer.hive_db.haf_functions:27 - App context detaching done.
INFO - hive.indexer.sync:137 - [MASSIVE] Attempting to process block range: <492001:80973941>
INFO - hive.indexer.blocks:142 - End-of-sync LIB is set to 80973941, last block that guarantees cashout at end of sync is 80772341
INFO - hive.indexer.hive_db.massive_blocks_data_provider:266 - blocks_data_queue.qsize: 0
INFO - hive.indexer.hive_db.massive_blocks_data_provider:267 - operations_queue.qsize: 0
INFO - hive.indexer.hive_db.massive_blocks_data_provider:268 - blocks_queue.qsize: 0
INFO - hive.indexer.hive_db.massive_blocks_data_provider:274 - Awaiting any blocks to process... 0
ERROR - hive.indexer.sync:237 - Exception caught during fetching blocks data
Traceback (most recent call last):
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/sync.py", line 235, in _blocks_data_provider
raise exception
File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/hive_db/massive_blocks_data_provider.py", line 57, in thread_body_get_data
data_rows = self._db.query_all(stmt, is_prepared=True)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/db/adapter.py", line 171, in query_all
return res.fetchall()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/result.py", line 1072, in fetchall
return self._allrows()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/result.py", line 401, in _allrows
rows = self._fetchall_impl()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 1819, in _fetchall_impl
return self.cursor_strategy.fetchall(self, self.cursor)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 995, in fetchall
self.handle_exception(result, dbapi_cursor, e)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 955, in handle_exception
result.connection._handle_dbapi_exception(
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2138, in _handle_dbapi_exception
util.raise_(exc_info[1], with_traceback=exc_info[2])
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
raise exception
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 991, in fetchall
rows = dbapi_cursor.fetchall()
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 61: ordinal not in range(128)
INFO - hive.indexer.sync:256 - === TOTAL STATS ===
INFO - hive.utils.stats:162 - ####################
INFO - hive.utils.stats:342 - Total waiting times
INFO - hive.utils.stats:344 - Total waiting time: 0.0000s.
INFO - hive.utils.stats:162 - ####################
INFO - hive.utils.stats:257 - Total flush times
INFO - hive.utils.stats:259 - Total flushing time: 0.0000s.
INFO - hive.utils.stats:162 - ####################
INFO - hive.utils.stats:205 - All operations present in the processed blocks
INFO - hive.utils.stats:207 - Total time for processing operations time: 0.0000s.
INFO - hive.indexer.sync:261 - Elapsed time: 1.0217s. Calculated elapsed time: 0.0000s. Difference: 1.0217s
INFO - hive.indexer.sync:263 - Highest block processing rate: 0.0000 bps. 0:0
INFO - hive.indexer.sync:266 - Lowest block processing rate: 0.0000 bps. 0:0
INFO - hive.indexer.sync:267 - === TOTAL STATS ===
INFO - hive.indexer.sync:71 - Exiting HAF mode synchronization
WARNING - hive.server.common.payout_stats:16 - Rebuilding payout_stats_view in separate transaction
INFO - hive.indexer.sync:76 - LAST IMPORTED BLOCK IS: 492000
INFO - hive.indexer.sync:77 - LAST COMPLETED BLOCK IS: 1
INFO - hive.indexer.hive_db.haf_functions:37 - Trying to attach app context with block number: 492000
INFO - hive.indexer.hive_db.haf_functions:39 - App context attaching done.
INFO - hive.db.adapter:90 - Closing database connection: 'PostDataCache'
INFO - hive.db.adapter:90 - Closing database connection: 'Reputations'
INFO - hive.db.adapter:90 - Closing database connection: 'Votes'
INFO - hive.db.adapter:90 - Closing database connection: 'Follow'
INFO - hive.db.adapter:90 - Closing database connection: 'Posts'
INFO - hive.db.adapter:90 - Closing database connection: 'Reblog'
INFO - hive.db.adapter:90 - Closing database connection: 'Notify'
INFO - hive.db.adapter:90 - Closing database connection: 'Accounts'
INFO - hive.db.adapter:90 - Closing database connection: 'PayoutStats'
INFO - hive.db.adapter:90 - Closing database connection: 'Mentions'
INFO - hive.db.adapter:90 - Closing database connection: 'root'
INFO - hive.db.adapter:108 - Disposing SQL engine
INFO - hive.conf:261 - The database is disconnected...
Traceback (most recent call last):
File "/home/hivemind/.hivemind-venv/bin/hive", line 8, in <module>
sys.exit(run())
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/cli.py", line 73, in run
launch_mode(mode, conf)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/cli.py", line 87, in launch_mode
sync.run()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/sync.py", line 138, in run
self._catchup_irreversible_block(is_massive_sync=True)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/sync.py", line 194, in _catchup_irreversible_block
self._process_blocks_from_provider(
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/sync.py", line 350, in _process_blocks_from_provider
raise block_data_provider_exception
File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/sync.py", line 235, in _blocks_data_provider
raise exception
File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/indexer/hive_db/massive_blocks_data_provider.py", line 57, in thread_body_get_data
data_rows = self._db.query_all(stmt, is_prepared=True)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/hive/db/adapter.py", line 171, in query_all
return res.fetchall()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/result.py", line 1072, in fetchall
return self._allrows()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/result.py", line 401, in _allrows
rows = self._fetchall_impl()
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 1819, in _fetchall_impl
return self.cursor_strategy.fetchall(self, self.cursor)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 995, in fetchall
self.handle_exception(result, dbapi_cursor, e)
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 955, in handle_exception
result.connection._handle_dbapi_exception(
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2138, in _handle_dbapi_exception
util.raise_(exc_info[1], with_traceback=exc_info[2])
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
raise exception
File "/home/hivemind/.hivemind-venv/lib/python3.8/site-packages/sqlalchemy/engine/cursor.py", line 991, in fetchall
rows = dbapi_cursor.fetchall()
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 61: ordinal not in range(128)
```JulyHivemindhttps://gitlab.syncad.com/hive/hivemind/-/issues/214Duplicate pipelines2024-03-08T13:07:03ZKonrad BotorDuplicate pipelinesSometimes pipelines are run for both merge requests and branchesSometimes pipelines are run for both merge requests and branchesKonrad BotorKonrad Botorhttps://gitlab.syncad.com/hive/hivemind/-/issues/184`valid_account` function does not work2022-07-13T08:52:45ZKrzysztof Mochockikmochocki@syncad.com`valid_account` function does not work[Here is copy-pasted implementation of account name validation from hived](https://godbolt.org/z/d687Tsqvx). I've wrote several examples of valid and invalid account names and unfortunately all of them are valid on [hivemind side](https:...[Here is copy-pasted implementation of account name validation from hived](https://godbolt.org/z/d687Tsqvx). I've wrote several examples of valid and invalid account names and unfortunately all of them are valid on [hivemind side](https://onlinegdb.com/BZpekkgip)Krzysztof Mochockikmochocki@syncad.comKrzysztof Mochockikmochocki@syncad.comhttps://gitlab.syncad.com/hive/hivemind/-/issues/175Bug with hivemind synchronization.2021-11-26T13:05:52ZRadosław MasłowskiBug with hivemind synchronization.A problem with synchronization with 'node' has been found. Synchronization only takes place on a 'node' that produce 21 or more blocks. If the synchronization is started earlier than the 'node' produces 21 blocks, the synchronization is ...A problem with synchronization with 'node' has been found. Synchronization only takes place on a 'node' that produce 21 or more blocks. If the synchronization is started earlier than the 'node' produces 21 blocks, the synchronization is not performed and the following information is displayed:
`INFO - hive.indexer.sync - [LIVE SYNC] Entering listen with HM head: 0`
After a dozen or so seconds, a warning is displayed, even if the 'node' previously generates the missing blocks:
`WARNING - hive.steem.http_client - enum_virtual_ops[1] failed in 30.0s. try 1. {'secs': 30.031, 'try': 1} - ReadTimeoutError("HTTPConnectionPool(host='127.0.0.1', port=44281): Read timed out. (read timeout=30)")
`
This situation take place in testnet, in situation that can't appear on production, so this bug have low priority.https://gitlab.syncad.com/hive/hivemind/-/issues/161installation fails because of PEP5172021-08-28T18:10:49ZGandalfinstallation fails because of PEP517While installing hivemind on Ubuntu 20.04 LTS in a way that's listed in the docs:
`python3 -m pip install --no-cache-dir --verbose --user -e .[dev]`
(btw why `[dev]`? that's not something I'd expect for prod env)
I'm getting:
```
Ru...While installing hivemind on Ubuntu 20.04 LTS in a way that's listed in the docs:
`python3 -m pip install --no-cache-dir --verbose --user -e .[dev]`
(btw why `[dev]`? that's not something I'd expect for prod env)
I'm getting:
```
Running setup.py develop for hivemind
Running command /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/hive/hivemind/setup.py'"'"'; __file__='"'"'/home/hive/hivemind/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps --user --prefix=
running develop
WARNING: The user site-packages directory is disabled.
error: can't create or remove files in install directory
The following error occurred while trying to add or remove files in the
installation directory:
[Errno 13] Permission denied: '/usr/local/lib/python3.8/dist-packages/test-easy-install-23138.write-test'
The installation directory you specified (via --install-dir, --prefix, or
the distutils default setting) was:
/usr/local/lib/python3.8/dist-packages/
Perhaps your account does not have write access to this directory? If the
installation directory is a system-owned directory, you may need to sign in
as the administrator or "root" account. If you do not have administrative
access to this machine, you may wish to choose a different installation
directory, preferably one that is listed in your PYTHONPATH environment
variable.
For information on other options, you may wish to consult the
documentation at:
https://setuptools.readthedocs.io/en/latest/easy_install.html
Please make the appropriate changes for your system and try again.
Rolling back uninstall of hivemind
```
seems that [PEP517](https://www.scivision.dev/python-pip-devel-user-install/) might be causing problems here, getting rid of `pyproject.toml` saves the day, but that's not a viable solution
See:
https://github.com/pypa/pip/issues/7953
Python people were like:<br>
> _- We have a dozen of ways to install software and that might be confusing for sane people..._<br>
> _\*thinking\*_<br>
> _- Let's make another one!_<br>GandalfGandalfhttps://gitlab.syncad.com/hive/hivemind/-/issues/142Master's version+revision and troubles when moving from develop2021-02-12T08:56:08ZGandalfMaster's version+revision and troubles when moving from developSteps to reproduce:
Full sync from scratch using develop's `1.24rc0+24a73d01`,
then checkout `HEAD` of `master`, `build`/`install`, at this point it reports `0.0.1+46906b99`
run `db_upgrade.sh`, then try to continue with `hive sync`
``...Steps to reproduce:
Full sync from scratch using develop's `1.24rc0+24a73d01`,
then checkout `HEAD` of `master`, `build`/`install`, at this point it reports `0.0.1+46906b99`
run `db_upgrade.sh`, then try to continue with `hive sync`
```
INFO - hive.indexer.sync - Using hived url: `{"default":"http://127.0.0.1:8091"}'
INFO - hive.steem.client - Endpoint default will be routed to node http://127.0.0.1:8091
INFO - hive.steem.http_client - using node: http://127.0.0.1:8091
INFO - hive.indexer.sync - hivemind_version : 0.0.1
INFO - hive.indexer.sync - hivemind_git_rev : 46906b99
INFO - hive.indexer.sync - database_schema_version : 18
INFO - hive.db.db_state - [INIT] Welcome to hive!
Traceback (most recent call last):
File "/home/hive/.local/bin/hive", line 11, in <module>
load_entry_point('hivemind==0.0.1+46906b99', 'console_scripts', 'hive')()
File "/home/hive/.local/lib/python3.6/site-packages/hivemind-0.0.1+46906b99-py3.6.egg/hive/cli.py", line 69, in run
launch_mode(mode, conf)
File "/home/hive/.local/lib/python3.6/site-packages/hivemind-0.0.1+46906b99-py3.6.egg/hive/cli.py", line 79, in launch_mode
Sync(conf=conf).run()
File "/home/hive/.local/lib/python3.6/site-packages/hivemind-0.0.1+46906b99-py3.6.egg/hive/indexer/sync.py", line 259, in run
DbState.initialize()
File "/home/hive/.local/lib/python3.6/site-packages/hivemind-0.0.1+46906b99-py3.6.egg/hive/db/db_state.py", line 53, in initialize
cls._check_migrations()
File "/home/hive/.local/lib/python3.6/site-packages/hivemind-0.0.1+46906b99-py3.6.egg/hive/db/db_state.py", line 417, in _check_migrations
raise Exception("dbv cannot be 0; reindex required")
Exception: dbv cannot be 0; reindex required
```https://gitlab.syncad.com/hive/hivemind/-/issues/138Empty feed when loading community 'muted' posts2021-01-30T11:20:29ZSergioEmpty feed when loading community 'muted' postsYou can check here: https://hive.blog/muted/hive-156509
![image](/uploads/40955f4f508ba3653fdddad09fb55022/image.png)You can check here: https://hive.blog/muted/hive-156509
![image](/uploads/40955f4f508ba3653fdddad09fb55022/image.png)https://gitlab.syncad.com/hive/hivemind/-/issues/121Duplicate index in hivemind database2020-12-14T16:59:08ZDan NotesteinDuplicate index in hivemind databasepghero reports
On hive_posts
hive_posts_payout_plus_pending_payout_id_idx (id)
is covered by
hive_posts_pkey (id)
From a quick glance at the code, it looks like hive_posts_pkey is probably some legacy index that didn't get dropped by db...pghero reports
On hive_posts
hive_posts_payout_plus_pending_payout_id_idx (id)
is covered by
hive_posts_pkey (id)
From a quick glance at the code, it looks like hive_posts_pkey is probably some legacy index that didn't get dropped by db_upgrade.https://gitlab.syncad.com/hive/hivemind/-/issues/117Community Subscriptions bug2020-12-10T19:10:11Zgood-karmaCommunity Subscriptions bug`{ "id": 1, "jsonrpc": "2.0", "method": "bridge.list_all_subscriptions", "params": {"account": "demo.com"} }`
This account should at least have 3 subscriptions but for some reason, above call gives only 1 result. https://hiveblocks.com/...`{ "id": 1, "jsonrpc": "2.0", "method": "bridge.list_all_subscriptions", "params": {"account": "demo.com"} }`
This account should at least have 3 subscriptions but for some reason, above call gives only 1 result. https://hiveblocks.com/@demo.comAndrzej LisakAndrzej Lisakhttps://gitlab.syncad.com/hive/hivemind/-/issues/115Wrong date in notifications for new 'mentions' when editing a post2021-01-17T20:05:59ZSergioWrong date in notifications for new 'mentions' when editing a postWhen a post is edited adding a mention to an account the notification report the post created date (and not the updated date).
You can view it here: https://hive.blog/@asgarth/notifications
![image](/uploads/6bb61e5215337cbf819d293e237...When a post is edited adding a mention to an account the notification report the post created date (and not the updated date).
You can view it here: https://hive.blog/@asgarth/notifications
![image](/uploads/6bb61e5215337cbf819d293e2374d208/image.png)MarcinMarcinhttps://gitlab.syncad.com/hive/hivemind/-/issues/105Bug with get_follow_list2020-11-23T08:49:09ZDan NotesteinBug with get_follow_listThis problem occurs with current production hivemind (deployed Saturday) and the previous version (I briefly swapped to an old hivemind to verify the same issue). It doesn't happen with anyx.io.
`curl 'https://api.hive.blog/' --data-b...This problem occurs with current production hivemind (deployed Saturday) and the previous version (I briefly swapped to an old hivemind to verify the same issue). It doesn't happen with anyx.io.
`curl 'https://api.hive.blog/' --data-binary '{"id":162,"jsonrpc":"2.0","method":"bridge.get_follow_list","params":{"observer":"hive.blog","follow_type":"blacklisted"}}'`
reports:
`{"jsonrpc":"2.0","error":{"code":-32000,"message":"Server error","data":"TypeError: 'coroutine' object is not subscriptable"},"id":162}`https://gitlab.syncad.com/hive/hivemind/-/issues/101Wrong result returned by 'get_followers' API call2020-11-11T20:35:16ZSergioWrong result returned by 'get_followers' API callBefore one of the last updates the following API call would have returned 'asgarth' as a follower (because the account is following 'jarvie').
Request:
```
{"id":2,"jsonrpc":"2.0","method":"call","params":["follow_api","get_followers",[...Before one of the last updates the following API call would have returned 'asgarth' as a follower (because the account is following 'jarvie').
Request:
```
{"id":2,"jsonrpc":"2.0","method":"call","params":["follow_api","get_followers",["jarvie","asgarth","blog",1]]}
```
But now the result look like this:
```
{"jsonrpc":"2.0","result":[{"follower":"viking-ventures","following":"jarvie","what":["blog"]}],"id":2}
```
Expected response:
```
{"jsonrpc":"2.0","result":[{"follower":"asgarth","following":"jarvie","what":["blog"]}],"id":2}
```
So the first result is skipped.https://gitlab.syncad.com/hive/hivemind/-/issues/97Post edit operation improperly handles list of tags2020-12-09T20:27:12ZBartek WronaPost edit operation improperly handles list of tagsPost edit operation shall overwrite set of tags specified for given post, but currently set of tags is each time merged.
See edits of post: `sweetsssj/a-chinese-twist-on-japanese-cuisine`Post edit operation shall overwrite set of tags specified for given post, but currently set of tags is each time merged.
See edits of post: `sweetsssj/a-chinese-twist-on-japanese-cuisine`MarcinMarcinhttps://gitlab.syncad.com/hive/hivemind/-/issues/94Reblogs are not showing properly2020-11-09T22:02:27ZDeathwinghi@deathwing.meReblogs are not showing properlyThis is happening in the head of develop. (https://gitlab.syncad.com/hive/hivemind/-/commit/294e2411acc69b695dc7696a6b425ae3b7bc04a6)
Explanation: If you are looking at your own following feed, you can see other accounts you are not fol...This is happening in the head of develop. (https://gitlab.syncad.com/hive/hivemind/-/commit/294e2411acc69b695dc7696a6b425ae3b7bc04a6)
Explanation: If you are looking at your own following feed, you can see other accounts you are not following, these are actually reblogged by people you follow. However, Hivemind does not always report whether if a post was reblogged or not.
Reblogs do show up:
![image](/uploads/420a73c5d08f6a57b3dcb46eb200e66f/image.png)
Reblogs don't show up:
![image](/uploads/26a7ca579dfaf425571b097cdb07fc69/image.png)https://gitlab.syncad.com/hive/hivemind/-/issues/86Pinned/muted posts not working after HF242021-01-12T00:57:53ZSergioPinned/muted posts not working after HF24In communities pinned/muted posts don't work and are not correctly reported (in the post `stats` attribute).In communities pinned/muted posts don't work and are not correctly reported (in the post `stats` attribute).https://gitlab.syncad.com/hive/hivemind/-/issues/82Comment counter is broken2020-11-05T06:11:12ZDeathwinghi@deathwing.meComment counter is brokenIn various frontends (tested hive.blog, peakd and decency) comment counters for posts that have more than `1` comment will always show up as `1` if the post does not have any comment, it shows up as `0` normally, however, even if there a...In various frontends (tested hive.blog, peakd and decency) comment counters for posts that have more than `1` comment will always show up as `1` if the post does not have any comment, it shows up as `0` normally, however, even if there are 50 comments, it only says `1` comment.https://gitlab.syncad.com/hive/hivemind/-/issues/72Postgres warning about wrong collation in recursive_deps2021-01-05T15:27:12ZWojciech BarcikPostgres warning about wrong collation in recursive_depsReported by good-karma 2020-10-09.
Postgres emits warning:
```
recursive query "recursive_deps" column 1 has collation "default" in non-recursive term but collation "C" overall
LINE 6: select p_view_schema, p_view_name, null::varcha...Reported by good-karma 2020-10-09.
Postgres emits warning:
```
recursive query "recursive_deps" column 1 has collation "default" in non-recursive term but collation "C" overall
LINE 6: select p_view_schema, p_view_name, null::varchar, 0....
```Wojciech BarcikWojciech Barcikhttps://gitlab.syncad.com/hive/hivemind/-/issues/59Error in 'list_community_roles' API call2021-01-25T20:06:29ZSergioError in 'list_community_roles' API callThis API call simply fails if the `last` parameter is specified:
https://gitlab.syncad.com/hive/hivemind/-/blob/master/hive/server/hive_api/community.py#L190
I think it has never been tested because this query cannot work:
https://gitl...This API call simply fails if the `last` parameter is specified:
https://gitlab.syncad.com/hive/hivemind/-/blob/master/hive/server/hive_api/community.py#L190
I think it has never been tested because this query cannot work:
https://gitlab.syncad.com/hive/hivemind/-/blob/master/hive/server/hive_api/community.py#L198
as the 'name' column does not exist on that table.
This is the error reported by this call:
```
{"id":5,"jsonrpc":"2.0","method":"bridge.list_community_roles","params":{"community":"hive-156509","limit":50,"last":"ykroys"}}
```
error:
```
UndefinedColumn: column "name" does not exist↵LINE 1: SELECT role_id FROM hive_roles WHERE name = 'ykroys'
```https://gitlab.syncad.com/hive/hivemind/-/issues/158Empty results when loading posts for specific tags2021-04-07T20:54:42ZSergioEmpty results when loading posts for specific tagsThis page is empty (and should not be): https://hive.blog/created/hive-engine
This is the Hivemind call:
```
{"id":7,"jsonrpc":"2.0","method":"bridge.get_ranked_posts","params":{"tag":"hive-engine","sort":"created","limit":21,"start_aut...This page is empty (and should not be): https://hive.blog/created/hive-engine
This is the Hivemind call:
```
{"id":7,"jsonrpc":"2.0","method":"bridge.get_ranked_posts","params":{"tag":"hive-engine","sort":"created","limit":21,"start_author":null,"start_permlink":null,"observer":"asgarth-dev"}}
```
To double check that there are posts in Hivemind this is the query I used:
```
select *
from hive_tag_data t
join hive_post_tags pt on t.id = pt.tag_id
join hive_posts p on p.id = pt.post_id
where t.tag = 'hive-engine'
and p.created_at > '2020-03-22'
and p."depth" = 0;
```Krzysztof Mochockikmochocki@syncad.comKrzysztof Mochockikmochocki@syncad.com