errors dont always appear in artifacts
For example here is artifact last_run.log from pipeline https://gitlab.syncad.com/hive/haf/-/jobs/562841 job test_pg_dump.py::test_pg_dump[pg_restore_from_toc]
2023-05-24 09:13:10,556 [INFO] Preparing database postgresql://haf_admin@hfm-only-instance:5432/haf_block_log-0_7660c25815f445718fc2a278fbd1a353 (conftest.py:69)
2023-05-24 09:13:10,742 [INFO] ApiNode0: Running ApiNode0, replaying and waiting for close... (node.py:568)
2023-05-24 09:13:10,743 [DEBUG] ApiNode0: Notifications server is listening on 127.0.0.1:41721... (node.py:191)
2023-05-24 09:13:10,744 [DEBUG] ApiNode0: /builds/hive/haf/haf-testnet-binaries/hived -d . --force-replay --stop-replay-at-block=30 --exit-before-sync (node.py:93)
2023-05-24 09:13:10,844 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:10', 'name': 'hived_status', 'value': {'current_status': 'starting'}} (node.py:228)
2023-05-24 09:13:10,889 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:10', 'name': 'webserver listening', 'value': {'address': '0.0.0.0', 'port': 35205, 'type': 'HTTP'}} (node.py:228)
2023-05-24 09:13:10,889 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:10', 'name': 'hived_status', 'value': {'current_status': 'replaying'}} (node.py:228)
2023-05-24 09:13:10,890 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:10', 'name': 'webserver listening', 'value': {'address': '0.0.0.0', 'port': 36263, 'type': 'WS'}} (node.py:228)
2023-05-24 09:13:11,309 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'finished replaying'}} (node.py:228)
2023-05-24 09:13:11,310 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'interrupted'}} (node.py:228)
2023-05-24 09:13:11,312 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'finished syncing'}} (node.py:228)
2023-05-24 09:13:11,314 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'finished syncing'}} (node.py:228)
2023-05-24 09:13:11,315 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'finished syncing'}} (node.py:228)
2023-05-24 09:13:11,316 [INFO] ApiNode0: Received message: {'time': '2023-05-24T09:13:11', 'name': 'hived_status', 'value': {'current_status': 'P2P stopped'}} (node.py:228)
2023-05-24 09:13:11,817 [DEBUG] ApiNode0: Notifications server closed (node.py:242)
2023-05-24 09:13:11,847 [INFO] ApiNode0: Run completed, testnet build commit=37daff86 (node.py:656)
2023-05-24 09:13:11,851 [INFO] Preparing database postgresql://haf_admin@hfm-only-instance:5432/haf_block_log-test_pg_dump_target_23905439dc0c420cb29cca75e9d7ba08 (conftest.py:69)
2023-05-24 09:13:12,498 [DEBUG] ApiNode0: Notifications server closed (node.py:242)
But there is not information whether this job passed or failed. After inspecting log on gitlab website https://gitlab.syncad.com/hive/haf/-/jobs/562841 we can see that this is fail (FAILED test_pg_dump.py::test_pg_dump[pg_restore_from_toc] - AssertionError: E...) there is error description on gitlab pipeline website but not in log file. By the way notifications are not very useful, I would decrease logging level to TRACE for notofications.
Edited by Marcin Sobczyk