As a longterm alternative to putting blocklog on compressed drive, we also have eric's code for maintaining a compressed blocklog: 319GB compressed / 575GB nocompr.
| Machine | test | #blocks | filesystem | size | time taken | jmeter benchmark |
|---|---|---|---|---|---|---|
| shed14 test1 | 2TB 980Pro;shared mem same nvme | 62M | ZFS lz4; compr=2.15x | 1.2TB+361GB blocklog | 12hr+7hr reindex | summary=20004 in 00:08:11=40.7/s Avg:243 Min:17 Max:5076 |
| steem11 test1 | 2x2TB 980Pro ZFS raid; blocklog HDD; shared mem HDD | 62M | ZFS nocompr | 2.7TB+550GB (blocklog) | 20.45hr+6.8hr reindex | summary=20004 in 00:07:48=42.7/s Avg:231 Min:17 Max:5212 |
| steem10 test1 | 2x2TB 980Pro MD raid; 2TB nvme(MP600Pro) blocklog shared memory on nvme raid | 62M | ZFS nocompr | 2.7TB+550GB blocklog | 12.3hr+6.1hr reindex | summary=20004 in 00:06:25=52.0/s Avg:189 Min:16 Max:5231 |
| shed14 test2 | 2x2TB MP600ProXT MD raid shared memory on nvme raid | 62M | ext4 | 2.7TB+550GB blocklog | 11.75hr+5.25hr reindex | summary=20004 in 00:05:58=55.9/s Avg:176 Min:16 Max:5061 |
| steem11 test2 | 2x2TB 980Pro MD raid; blocklog on 16TB HDD; shared memory on /dev/shm | 62M | ZFS lz4; compr=2.34x | 1.3TB+530GB blocklog | 11.7hr+7hr reindex | summary=20004 in 00:08:26=39.5/s Avg:251 Min:16 Max:5237 |
| steem10 test2 |
2x2TB 980Pro ZFS raid;2TB nvme(MP600Pro) blocklog shared memory /dev/shm |
62M | ZFS lz4; compr=2.34x | 1.2TB+530GB blocklog | 10.4hr+5.5hr reindex | summary=20004 in 00:07:06=46.9/s Avg:211 Min:15 Max:4937 |
| shed14 test3 | 2TB 980Pro shared mem /dev/shm | 62M | ZFS lz4; compr=2.15x | 1.2TB+381GB | 10.8hr+6hr reindex | summary=20004 in 00:06:23=52.3/s Avg:189 Min:17 Max:3657 |
| steem10: test3 | 2x2TB 980Pro MD raid; 2TB nvme(MP600Pro) blocklog shared going to /dev/shm | 62M | ZFS nocompr | 2.7TB+550GB for blocklog | 10.8hr+6.2hr reindex | summary=20004 in 00:06:15=53.3/s Avg:185 Min:15 Max:3974 |
| steem11 test3 |
2x2TB 980Pro MD raid; blocklog on 16TB magnetic drive shared memory going to /dev/shm
|
62M | ZFS nocompr | 2.7TB+550GB blocklog | 11.7hr+7hr reindex | summary=20004 in 00:05:46=57.8/s Avg:170 Min:16 Max:3844 |
| shed14 test4 | 2TB 980Pro shared mem /dev/shm | 62M | ZFS lz4; compr=1.93x; recordsize to 16k(default 128k) | 1.3 TB+381GB blocklog | 11.1hr+10.5hr reindex | summary=20004 in 00:05:58=55.8/s Avg:177 Min:16 Max:4149 |
| steem11 test4 | 2x2TB 980Pro MD raid; blocklog HDD; shared mem /dev/shm /var/lib/postgresql nvme | 62M | ZFS nocompr | 2.7TB+531GB blocklog | 10.5hr+6.5hr reindex | summary= 20004 in 00:06:32=+51.0/s Avg:193 Min:18 Max:4008 |
| steem10 test4 | 2x2TB 980Pro MD raid; blocklog 2TB MP600Pro; /var/log/postresql on /hafpool shared mem /dev/shm | 62M | ZFS nocompr | 2.7TB+531GB blocklog | 10.07hr+6.5hr reindex | summary =20004 in 00:06:22 =52.4/s Avg:188 Min:14 Max:4109 |
| steem10 test5 | 2x2TB 980Pro MD raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/llib/postresql noatime hafpool nocompr | 62M | ZFS nocompr | expected 2.7TB+531GB blocklog | 10.15hr+ 7hr reindex | summary =20004 in 00:05:55 = 56.3/s Avg: 175 Min: 17 Max: 3906 |
| steem11 test5 | 2x2TB 980Pro MD raid noatime; blocklog HDD; shared mem /dev/shm; /var/lib/postgresql noatime hafpool nocompr | 62M | ZFS lz4: compr: 2.34x | expected 1.2TB+531GB blocklog | 10.35hr+5.5hr reindex | summary = 20004 in 00:07:10 = 46.6/s Avg: 213 Min: 18 Max: 4895 |
| shed14 test5 | 2TB 980Pro; shared mem /dev/shm /var/lib/postgresql nvme | 62M | ZFS lz4: compr: 2.39x reverted recordsize to 128k | 1.2TB+381GB blocklog | 10.5hr+6hr reindex | summary=20004 in 00:09:41=34.4/s Avg:288 Min:17 Max:4748 |
| shed14 test6 | 2x2TB XtPro(/xtpool) ZFS raid; shared mem /dev/shm /var/lib/postgresql /hafpool | 62M | ZFS nocompr | 2.7TB+382GB blocklog (compressed on /hafpool/datadir-haf) | 10.56hr+6.16hr reindex | summary = 20004 in 00:09:24 = 35.4/s Avg: 277 Min: 18 Max: 5517 |
| shed14 test7 | 2x2TB XtPro(/xtpool) MD raid noatime; shared mem /dev/shm /var/lib/postgresql /hafpool | 62M | ZFS nocompr | 2.7TB+382GB blocklog (compressed on hafpool) | 10.26hr+6.4hr to reindex |
Test1: summary = 20004 in 00:06:25 = 51.9/s Avg: 190 Min: 17 Max: 6414 Test2: summary = 20004 in 00:06:28 = 51.6/s Avg: 192 Min: 17 Max: 5015 |
|
Steem-10 test6 |
2x2TB 980Pro MD raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/llib/postresql noatime hafpool nocompr | 62M | ZFS lz4: compr:2.32x | 1.2TB + 531GB for blocklog | 9.78hr+5.66hr to reindex |
Test1: summary = 20004 in 00:09:13 = 36.2/s Avg: 274 Min: 18 Max: 7713 |
|
Steem-11 test6 |
2x2TB 980Pro MD raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql noatime | 62M | zfs nocompr | N/A | N/A | N/A |
|
Steem-10 test7 |
2x2TB 980Pro MD raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/llib/postresql noatime hafpool nocompr | 62M | ZFS lz4: compr=2.32 | 1.2TB+531GB for blocklog | 10hr+6.44hr to reindex |
Test1: summary = 20004 in 00:08:50 = 37.8/s Avg: 262 Min: 18 Max: 775 Test 2: summary = 20004 in 00:05:32 = 60.2/s Avg: 163 Min: 18 Max: 7127 |
|
Steem-11 test7 |
2x2TB 980Pro MD raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql noatime hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off |
62M | no compress | 2.7TB+531TB for blocklog | 10.73hr+7.45hr to reindex |
Test1: summary = 20004 in 00:06:03 = 55.1/s Avg: 179 Min: 18 Max: 4002 Test2 summary = 20004 in 00:05:11 = 64.2/s Avg: 153 Min: 17 Max: 3723 |
|
Steem-10 test8 |
2x2TB 980Pro MD raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off
|
62M |
ZFS lz4: compr=2.32x (/var/lib/postgress is compressed) |
1.2TB+531GB for blocklog | 10.25hr+7hr to reindex |
Test1: summary = 20004 in 00:09:09 = 36.4/s Avg: 272 Min: 18 Max: 8249 Test2 summary = 20004 in 00:05:20 = 62.6/s Avg: 157 Min: 18 Max: 3726 |
| Shed14 test8 | 2x2TB XtPro(/xtpool) MD raid; shared mem /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off | 62M | ZFS uncompressed | in progress | 10.58hr+7.33hr to reindex |
Test1: summary = 20004 in 00:09:09 = 36.5/s Avg: 270 Min: 17 Max: 4504 Test2 summary = 20004 in 00:06:31 = 51.2/s Avg: 193 Min: 16 Max: 5732 |
|
Steem-11 test8 |
2x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off |
62M | ZFS lz4: compr=2.32x | 1.2TB+531GB for blocklog | 9.92hr+5.25hr to reindex |
Test1: summary = 20004 in 00:06:40 = 50.0/s Avg: 197 Min: 17 Max: 4774 Test2 summary = 20004 in 00:05:13 = 63.9/s Avg: 154 Min: 18 Max: 3757 |
|
Steem-10 test9 |
2x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M | ZFS nocompress | 2.7TB+531GB for blocklog | 9.7hr+6hr to reindex |
Test1: summary = 20004 in 00:05:48 = 57.5/s Avg: 172 Min: 17 Max: 3808 Test2 summary = 20004 in 00:04:45 = 70.1/s Avg: 141 Min: 18 Max: 3782 |
|
Shed14 test9 |
2x2TB XtPro(/xtpool) zfs raid; shared mem /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off | 62M | ZFS lz4: compr=2.32x | 1.2TB+382GB for blocklog | 10.46hr+6hr to reindex |
Test1: summary=20004 in 00:09:16=36.0/s Avg:276 Min:17 Max:5593 Test2 summary=20004 in 00:07:21=45.4/s Avg:219 Min:16 Max:5961 |
|
Steem-11 test9 |
2x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off, zfs_arc_max-modified(32GB) |
62M | ZFS lz4: compr=??? | 10hr+5.3hr reindex | summary=20004 in 00:06:59=47.8/s Avg:208 Min:18 Max:5230 summary=20004 in 00:05:56=56.2/s Avg:175 Min:18 Max:4872 wal_compr_summary=20004 in 00:05:22=62.2/s Avg:158 Min:18 Max:3817 | |
|
Steem-10 test10 |
2x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on | 62M | ZFS uncompressed | 9.47hr+6.25hr reindex | summary=20004 in 00:05:52=56.8/s Avg:173 Min:18 Max:3690 summary=20004 in 00:05:56=56.2/s Avg:175 Min:18 Max:4872 wal_compr_summary=20004 in 00:04:25=75.6/s Avg:130 Min:19 Max:3814 | |
|
Shed14 test10 |
2x2TB XtPro(/xtpool) zfs raid; shared mem /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M | ZFS lz4: compr=2.09x | 10.44hr+5.93hr reindex | summary=20004 in 00:09:20=35.7/s Avg:275 Min:16 Max:5077 summary=20004 in 00:07:07=46.9/s Avg:211 Min:17 Max:5543 | |
|
Shed14 test11 |
2x2TB XtPro(/xtpool) zfs raid; shared mem /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off psql-track-operations = custom_json_operation psql-track-body-operations = ["custom_json_operation","sm_.*"] |
62M | ZFS lz4 | 359G (288G operations, 191G transactions, 48G account_operations) | 11.1hr+1.1hr reindex | N/A |
|
Steem-10 test11 |
2x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgresql.conf) | 62M | ZFS lz4: compr=1.89x | 1.8TB + 531GB for blocklog | 10.08hr+5.51hr to reindex |
summary = 20004 in 00:06:47 = 49.1/s Avg: 201 Min: 17 Max: 4801 summary = 20004 in 00:05:44 = 58.1/s Avg: 170 Min: 18 Max: 4597 |
|
Steem-11 test10 |
2x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off (postgreql.conf), zfs_arc_max-modified(32GB) |
62M | ZFS uncompressed | 2.7TB + 531GB for blocklog | 10.25hr+8.6hr to reindex |
summary = 20004 in 00:06:03 = 55.1/s Avg: 179 Min: 15 Max: 3846 summary = 20004 in 00:06:00 = 55.6/s Avg: 177 Min: 20 Max: 3717 |
|
Steem-10 test12 |
2x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgresql.conf) | 62M |
ZFS lz4: compr=1.89x |
1.2TB+531GB for blocklog | 9.97Hr+5.35Hr to reindex |
summary = 20004 in 00:06:46 = 49.3/s Avg: 201 Min: 19 Max: 4905 summary = 20004 in 00:05:36 = 59.5/s Avg: 166 Min: 18 Max: 4671 summary = 20004 in 00:05:09 = 64.7/s Avg: 152 Min: 18 Max: 3576 |
|
Steem-11 test11 |
2x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgreql.conf) |
62M | ZFS lz4: compr=2.32x | 1.2TB+531GB for blocklog | 10.3Hr+7.52Hr to reindex |
summary = 20004 in 00:06:39 = 50.2/s Avg: 197 Min: 18 Max: 4929 summary = 20004 in 00:05:14 = 63.6/s Avg: 154 Min: 18 Max: 3709 test 3 yielded the same results (63.6/s) |
|
Steem-10 test13 |
2x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgresql.conf) zfs sync=disabled |
62M | ZFS lz4: compr=2.33x | 1.2TB+531GB for blocklog | 9.88Hr+5.33Hr to reindex | |
|
Steem-11 test12 |
2x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgreql.conf) zfs sync=disabled |
62M | ZFS lz4: compr=2.32x | 1.2TB+531GB for blocklog | 10.3Hr+7.5Hr to reindex | |
|
Steem-10 test13 |
3x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgresql.conf) zfs sync=disabled |
62M |
ZFS lz4: compr=2.32x |
1.2TB+531GB for blocklog | 9.72Hr+5Hr to reindex |
summary = 20004 in 00:06:34 = 50.8/s Avg: 195 Min: 18 Max: 4877 summary = 20004 in 00:05:05 = 65.6/s Avg: 150 Min: 18 Max: 3522 |
|
Steem-11 test12 |
4x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql noatime, hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgreql.conf) zfs sync=disabled |
62M |
ZFS lz4: compr=2.32x |
1.2TB+531GB for blocklog | 10.4Hr+7Hr to reindex |
summary = 20004 in 00:06:38 = 50.3/s Avg: 196 Min: 18 Max: 4844 summary = 20004 in 00:05:09 = 64.6/s Avg: 152 Min: 17 Max: 3749 |
|
Steem-10 test14 |
3x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgresql.conf) zfs sync=disabled |
62M |
ZFS lz4: compr=2.51x |
1TB(1004GB)+531GB for blocklog | 10.03Hr+4.78Hr to reindex | N/A (test failure) |
|
Steem-11 test13 |
4x2TB 980Pro zfs raid noatime; blocklog HDD; shared mem hafpool; /var/lib/postgresql noatime, hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgreql.conf) zfs sync=disabled |
62M |
ZFS lz4: compr=2.51x |
1TB(1005GB)+531GB for blockog | 10.2Hr + 7.5Hr to reindex | N/A (test failure) |
|
Shed14 Test 12 |
2x2TB XtPro(/xtpool) zfs raid noatime; shared mem in "blockchain" file, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M |
ZFS zstd: compr=3.07x (Ubuntu 22.04LTS, Postgresql14) |
1TB(1007GB) including blocklog | 12.9Hr+8.9Hr to reindex | |
|
Shed14 Test 13 |
2x2TB XtPro(/xtpool) zfs raid noatime; shared mem in /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M |
ZFS zstd: compr=3.06x (Ubuntu 22.04LTS, Postgresql14) |
695GB+314GB for blocklog | 10.9Hr+8Hr to reindex |
summary = 20004 in 00:12:36 = 26.5/s Avg: 376 Min: 14 Max: 9948 summary = 20004 in 00:12:11 = 27.4/s Avg: 363 Min: 14 Max: 9950 |
|
Steem-10 test 15 |
3x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgresql.conf) zfs sync=disabled |
62M | ZFS lz4: compr=2.51x | 1TB(1004GB)+531GB for blocklog | 9.9Hr+5.16Hr to reindex |
summary = 20004 in 00:06:26 = 51.9/s Avg: 190 Min: 16 Max: 4942 summary = 20004 in 00:05:06 = 65.5/s Avg: 150 Min: 16 Max: 3663 |
|
Steem-11 test14 |
3x2TB 980Pro zfs raid noatime; blocklog NVME(Samsung 980); shared mem hafpool; /var/lib/postgresql noatime, hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgreql.conf) zfs sync=disabled |
62M | ZFS lz4: compr=2.29x | 1.3TB + 531GB for blocklog | 10.35Hr+7.75Hr to reindex |
summary = 20004 in 00:06:29 = 51.4/s Avg: 191 Min: 17 Max: 4621 summary = 20004 in 00:05:09 = 64.7/s Avg: 152 Min: 19 Max: 3781 |
|
Shed14 Test14 |
2x2TB XtPro(/xtpool) zfs raid noatime; shared mem in /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M |
ZFS zstd-fast: compr=2.91x (Ubuntu 22.04LTS, Postgresql14) |
746GB+314GB for blocklog | 10.58Hr+6Hr to reindex | |
|
Steem-10 Test16 |
3x2TB 980Pro zfs raid noatime; blocklog 2TB MP600Pro; shared mem /dev/shm; /var/lib/postresql noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=on(postgresql.conf) zfs sync=disabled, psql TOAST compr=lz4 |
62M |
ZFS zstd-9: compr=??? (Ubuntu 22.04LTS, Postgresql14) |
653GB+531GB for blocklog | 10.6Hr + 7.66Hr to reindex | summary = 20004 in 00:12:23 = 26.9/s Avg: 368 Min: 14 Max: 10362 |
|
Steem-11 Test15 |
3x2TB 980Pro zfs raid noatime; blocklog NVME(Samsung 980); shared mem /dev/shm; /var/lib/postgresql noatime, hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgreql.conf)zfs sync=disabled |
62M |
ZFS zstd-19: compr=??? (Ubuntu 22.04LTS, Postgresql14) |
N/A (Test took far too long, killed preemptively) | N/A (Test took far too long, killed preemptively) | N/A (Test took far too long, killed preemptively) |
|
Shed14 Test15 |
4x2TB XtPro(/xtpool) zfs raid noatime; shared mem in /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M |
ZFS zstd-fast: compr=? (Ubuntu 22.04LTS, Postgresql14) |
747GB+305GB blocklog | 10.7Hr+7.9Hr to reindex | summary = 20004 in 00:11:41 = 28.5/s Avg: 348 Min: 14 Max: 9304 |
|
Shed14 Test16 |
4x2TB XtPro(/xtpool) zfs raid noatime; shared mem in /dev/shm, /var/lib/postgresql/xt-pool, noatime, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off | 62M |
ZFS lz4 (Ubuntu 22.04LTS, Postgresql14) |
1006G+305G | 10.37hr+4.17hr | summary=20004 in 00:06:25=52.0/s Avg:189 Min:15 Max:4158 |
|
Steem-10 Blocklog Compression |
Compress_block_log 1x2TB nvme (Samsung 980 Pro) ext4, atime=on |
??? | (Ubuntu 22.04LTS, Postgresql14) | 531G to 295G, 44.4% space savings | 11.1hr | Total bytes if all blocks compressed by compression method: zstd: 350954189789 brotli: 315734867014 deflate: 345475220135 |
|
Steem-11 Test 16 |
3x2TB 980Pro zfs raid noatime; blocklog NVME(Samsung 980); shared mem /dev/shm; /var/lib/postgresql noatime, hafpool nocompr, full_page_writes=off, wal_init_zero=off, wal_recycle=off, fsync=off(postgreql.conf)zfs sync=disabled |
62M |
ZFS lz4: compr=??? (Ubuntu 22.04LTS, Postgresql14) |
1006G+531G blocklog on /blocklog | 9.97hr+4.28hr | summary = 20004 in 00:06:35 = 50.6/s Avg: 194 Min: 14 Max: 4121 |