Changes

Page history
Update benchmarks authored by Dan Notestein's avatar Dan Notestein
Show whitespace changes
Inline Side-by-side
benchmarks.md
View page @ b906e3b2
......@@ -16,32 +16,24 @@ As a longterm alternative to putting block_log on compressed drive, we also have
<th>Load test results</th>
</tr>
<tr>
<td>Shed14: test 1</td>
<td>shed14 test 1</td>
<td>
single 2TB nvme test (Samsung 980 Pro)
shared memory went to /hafpool/datadir-haf/blockchain on the nvme
2TB nvme(980 Pro);shared mem on same nvme
</td>
<td>62,000,000</td>
<td>ZFS lz4; comp. ratio = 2.15x</td>
<td>1.5 TB (includes blocklog)</td>
<td>12 Hrs + 7 Hrs adding new indexes</td>
<td>1.2TB+361GB block_log</td>
<td>12hrs+7hrs reindexing</td>
<td>
/hafpool:
/haf_database_store: **1.2**Tb
/datadir-haf: **361**Gb
</td>
<td>summary = 20004 in 00:08:11 = 40.7/s Avg: 243 Min: 17 Max: 5076 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:08:11 = 40.7/s Avg: 243 Min: 17 Max: 5076</td>
</tr>
<tr>
<td>Steem-11: test 1</td>
<td>steem-11 test 1</td>
<td>
2 x 2TB nvme (Samsung 980 pro) & 16TB HDD to hold the block log; unraided
2x2TB nvme(980 pro) unraided;16TB HDD block log
shared memory went to /storage1/datadir-haf/blockchain on the magnetic drive
</td>
......@@ -52,123 +44,77 @@ shared memory went to /storage1/datadir-haf/blockchain on the magnetic drive
<td>
<div>
/hafpool:
/haf_database_store: **2.6** Tb
/storage1:
/datadir-haf: **549** Gb
</div></td>
<td>summary = 20004 in 00:07:48 = 42.7/s Avg: 231 Min: 17 Max: 5212 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:07:48 = 42.7/s Avg: 231 Min: 17 Max: 5212</td>
</tr>
<tr>
<td>Steem-10: test 1</td>
<td>steem-10 test 1</td>
<td>
2 x 2TB nvme (samsung 980 pro) raided & 1 x 2TB nvme (MP600 Pro) to hold block log
shared memory went to /storage1/datadir-haf/blockchain on the nvme raid
2x2TB nvme(980 pro) raided; 2TB nvme(MP600 Pro) block log
shared memory on nvme raid
</td>
<td>62,000,000</td>
<td>ZFS uncompressed</td>
<td>2.7 TB + 550 (blocklog)</td>
<td>12.3 Hrs + 6.1 Hrs to add indexes</td>
<td>2.7TB+550GB blocklog</td>
<td>12.3hrs+6.1hrs reindexing</td>
<td>
/hafpool:
/haf_database_store: **2.7**Tb
/storage2
/datadir-haf: **549**Gb
</td>
<td>summary = 20004 in 00:06:25 = 52.0/s Avg: 189 Min: 16 Max: 5231 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:06:25 = 52.0/s Avg: 189 Min: 16 Max: 5231</td>
</tr>
<tr>
<td>Shed14: test 2</td>
<td>shed14 test 2</td>
<td>
2x2TB nvme(MP600 Pro XT) raided
shared memory went to /storage1/datadir-haf/blockchain on the nvme raid
shared memory on nvme raid
</td>
<td>62,000,000</td>
<td>ext4</td>
<td>3.5TB (blocklog included)</td>
<td>11.75 Hrs + 5.25 Hrs to add indexes</td>
<td>2.7TB+550GB blocklog</td>
<td>11.75hrs+5.25hrs reindexing</td>
<td>
<div>
/hafpool:
/haf_database_store: **2.7**Tb
/datadir-haf: **555**Gb
</div></td>
<td>summary = 20004 in 00:05:58 = 55.9/s Avg: 176 Min: 16 Max: 5061 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:05:58 = 55.9/s Avg: 176 Min: 16 Max: 5061</td>
</tr>
<tr>
<td>Steem-11: test 2</td>
<td>2 x 2TB nvme (samsung 980 Pro) raided; block log on 16TB magnetic drive shared memory going to /dev/shm</td>
<td>steem-11 test 2</td>
<td>2x2TB nvme(980 Pro) raided; blocklog on 16TB HDD; shared memory on /dev/shm</td>
<td>62,000,000</td>
<td>ZFS lz4; comp. ratio = 2.34x</td>
<td>1.3 TB + 530 for blocklog</td>
<td>11.7 Hrs + 7 Hrs to add indexes</td>
<td>1.3TB+530GB blocklog</td>
<td>11.7hrs+7hrs reindexing</td>
<td>
<div>
/hafpool:
/haf_database_store: **1.2**Tb
/storage1:
/datadir-haf: **531**Gb
/dev/shm: **19**Gb
</div></td>
<td>summary = 20004 in 00:08:26 = 39.5/s Avg: 251 Min: 16 Max: 5237 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:08:26 = 39.5/s Avg: 251 Min: 16 Max: 5237</td>
</tr>
<tr>
<td>Steem-10: test 2</td>
<td>steem-10 test 2</td>
<td>
2x2TB nvme(980 pro) unraided;2TB nvme(mp600 Pro) block_log
2 x 2TB nvme (samsung 980 pro) & 1 x 2TB nvme (mp600 Pro) to store block log
shared data going to /dev/shm
shared memory /dev/shm
</td>
<td>62,000,000</td>
<td>ZFS lz4; comp. ratio = 2.34x</td>
<td>1.2 TB + 530GB for blocklog</td>
<td>10.4 Hrs + 5.5 Hrs to add indexes</td>
<td>1.2TB+530GB blocklog</td>
<td>10.4hrs+5.5hrs reindexing</td>
<td>
/hafpool:
/haf_database_store: **1.2**TB
/storage2:
/datadir-haf: **531** Gb
/dev/shm: **19**Gb
</td>
<td>summary = 20004 in 00:07:06 = 46.9/s Avg: 211 Min: 15 Max: 4937 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:07:06 = 46.9/s Avg: 211 Min: 15 Max: 4937</td>
</tr>
<tr>
<td>Shed14: test 3</td>
<td>1 x 2TB nvme (samsung 980 pro) shared data going to /dev/shm</td>
<td>2TB nvme(980 pro) shared mem /dev/shm</td>
<td>62,000,000</td>
<td>ZFS lz4; comp. ratio = 2.15x</td>
<td>1.5 TB (including blocklog)</td>
<td>1.2TB+381GB</td>
<td>10.8 Hrs + 6 Hrs to add indexes</td>
<td>
......@@ -180,7 +126,7 @@ shared data going to /dev/shm
/dev/shm: **19**Gb
</td>
<td>summary = 20004 in 00:06:23 = 52.3/s Avg: 189 Min: 17 Max: 3657 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:06:23 = 52.3/s Avg: 189 Min: 17 Max: 3657</td>
</tr>
<tr>
<td>Steem-10: test 3</td>
......@@ -205,7 +151,7 @@ shared going to /dev/shm
/dev/shm: **19**Gb
</div></td>
<td>summary = 20004 in 00:06:15 = 53.3/s Avg: 185 Min: 15 Max: 3974 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:06:15 = 53.3/s Avg: 185 Min: 15 Max: 3974</td>
</tr>
<tr>
<td>Steem-11: test 3</td>
......@@ -229,7 +175,7 @@ shared going to /dev/shm
/dev/shm: **19**Gb
</div></td>
<td>summary = 20004 in 00:05:46 = 57.8/s Avg: 170 Min: 16 Max: 3844 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:05:46 = 57.8/s Avg: 170 Min: 16 Max: 3844</td>
</tr>
<tr>
<td>Shed14: test 4</td>
......@@ -247,16 +193,8 @@ changed ZFS to write in 16k blocks instead of the default 128k
<div>
/hafpool:
/haf_database_store: **1.3**TB
/datadir-haf: **381** Gb
/dev/shm: **18**Gb
</div></td>
<td>summary = 20004 in 00:05:58 = 55.8/s Avg: 177 Min: 16 Max: 4149 Err: 0 (0.00%)</td>
<td>summary = 20004 in 00:05:58 = 55.8/s Avg: 177 Min: 16 Max: 4149</td>
</tr>
<tr>
<td>
......@@ -355,7 +293,7 @@ shared going to /dev/shm</td>
<div>
not needed
</div></td>
<td>N/A (test had already been reset)</td>
<td>summary = 20004 in 00:06:22 = 52.4/s Avg: 188 Min: 14 Max: 4109 Err: 0 (0.00%)</td>
</tr>
<tr>
<td>Steem-11</td>
......
......