process_openapi.py supports --version <version> and --swagger-json <path> parameters to point version and swagger json output path

Bartek Wrona authored 2 months ago and Bartek Wrona committed 2 weeks ago

process_openapi.py generates rewrite rules in the inverted order (from most specific to less) to propely match calls by ngnix during processing

- improved logging
- writing all generated files to specified output directory to avoid overwriting original sources

Removed Dockerfile.jmeter (shared base job definition: .jmeter_benchmark_job and image stored in the ccc repo is used now for testing)

block_api_tests job refactored into 2 jobs: one preforming a replay to produce data, second performing benchmark on started haf instance

.prepare_haf_data_5m base job definition can have parametrized directory where it should generate data

haf-local-tools Python deps update: pandas = "2.2.3", psycopg2-binary = "2.9.10", sqlalchemy = "2.0.39"

sqlserializer reads and sets the  synchronization state
in sync_state column of hafd.havie_state.

methods added:
hive.get_sync_state()
hive.set_sync_state() - only accessible for hived

Handle cases where current block being processed is only in the blocks_reversible table (avoid returning 0 for a block).

 - hive: develop (4cd3fc3d23f4074be91a11f00a7a6035405faaf8)

autovacuum settings that can only be set in postgres.conf, reduce default work_mem to 64MB, plus small tweaks

 - hive: develop (74eb54442330ace71c37a43b464aee6b1bd4dae2)

previously only state providers shadow tables were excluded, what cause
problems when haf with installed context with registered tables was
updated.

Currently state providers creates tables in hafd schema. All tables in
hafd schemas are taken to db hash computation, but hashes for state
providers are computed differently, ans should not affect hafd hash
schema.