[PATCH v2 00/10] makedumpfile: parallel processing
"Zhou, Wenjian/周文剑"
zhouwj-fnst at cn.fujitsu.com
Wed Jun 24 19:25:26 PDT 2015
Hello Atsushi Kumagai,
I test this patch set in several machines and the following is the benchmark.
These tables show the time that makedumpfile spends. And the unit is second.
"core-data" in the table means the context in the vmcore.
For example:
core-data's value is 256. It means that in the vmcore, 256 * 8 bits of each page
are set to 1.
threads-num in the table means how many threads are used. 0 means original single thread
implementation.
"-l" in the table means producing lzo format vmcore
"-c" in the table means producing kdump-compressed format vmcore
###################################
- System: PRIMERGY RX300 S6
- CPU: Intel(R) Xeon(R) CPU x5660
- memory: 16GB
###################################
************ makedumpfile -d 0 ******************
core-data 0 256 512 768 1024 1280 1536 1792 2048 2304 2560 2816 3072 3328 3584 3840
threads-num
-l
0 11 112 163 168 167 167 167 167 170 169 167 166 167 168 169 113
4 5 111 158 166 167 167 167 166 169 170 166 166 167 167 158 111
8 5 111 158 167 169 170 167 169 169 170 167 168 168 168 159 111
12 6 111 158 168 167 167 169 168 170 169 167 168 167 167 161 114
-c
0 54 544 643 666 589 517 468 405 408 429 491 528 592 676 654 527
4 60 179 210 216 206 220 209 214 211 222 220 208 209 210 245 177
8 43 113 146 169 179 215 195 211 199 195 216 197 185 165 158 109
12 44 106 142 162 169 171 168 173 174 171 200 173 177 165 139 107
************ makedumpfile -d 1 ******************
core-data 0 256 512 768 1024 1280 1536 1792 2048 2304 2560 2816 3072 3328 3584 3840
threads-num
-l
0 10 137 163 167 167 167 167 167 171 170 166 166 166 168 169 138
4 5 111 158 166 167 166 167 166 170 171 166 167 166 166 159 111
8 5 114 159 167 167 169 167 167 169 169 169 167 168 167 160 111
12 6 113 159 168 167 168 167 168 169 170 168 168 167 168 159 112
-c
0 53 522 645 663 591 512 470 401 412 413 479 532 587 666 648 524
4 57 205 244 216 208 217 216 225 221 225 223 217 213 209 246 174
8 41 118 154 176 191 213 219 223 212 210 222 207 198 176 164 118
12 43 111 148 174 189 194 191 182 178 173 204 196 194 170 150 112
************ makedumpfile -d 7 ******************
core-data 0 256 512 768 1024 1280 1536 1792 2048 2304 2560 2816 3072 3328 3584 3840
threads-num
-l
0 10 144 199 168 167 167 167 167 171 169 167 166 166 168 169 144
4 5 110 158 167 167 167 166 166 170 169 166 166 166 166 159 110
8 5 111 159 167 166 170 167 166 169 169 168 167 167 167 159 110
12 6 111 159 167 167 166 168 167 169 169 168 167 167 167 160 111
-c
0 52 523 642 659 592 511 490 402 410 422 464 525 591 666 647 529
4 58 177 210 213 208 224 217 228 223 229 227 216 210 212 215 175
8 41 116 152 178 191 213 219 225 216 211 221 211 196 180 158 116
12 41 111 151 176 192 187 192 190 174 175 218 186 189 172 151 112
************ makedumpfile -d 31 ******************
core-data 0 256 512 768 1024 1280 1536 1792 2048 2304 2560 2816 3072 3328 3584 3840
threads-num
-l
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
4 2 2 2 3 3 3 2 3 3 3 3 2 3 3 3 3
8 2 3 3 2 3 3 3 3 3 3 3 3 3 3 3 3
12 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3
-c
0 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3
4 4 5 5 4 5 5 5 5 4 5 5 5 4 4 5 5
8 4 4 4 3 4 4 4 4 4 4 4 4 4 4 4 4
12 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
###################################
- System: PRIMERGY RX300 S7
- CPU: Intel(R) Xeon(R) CPU E5-2620
- memory: 32GB
###################################
************ makedumpfile -d 0 ******************
core-data 0 256 512 768 1024 1280 1536 1792
threads-num
-l
0 23 211 246 255 252 252 253 257
4 14 168 234 250 253 251 251 252
12 17 165 237 250 251 251 253 253
-c
0 117 1210 1620 1699 1443 1294 1235 1051
4 161 438 525 543 506 465 484 415
12 131 211 245 250 246 248 260 265
************ makedumpfile -d 7 ******************
core-data 0 256 512 768 1024 1280 1536 1792
threads-num
-l
0 24 215 253 256 255 254 257 255
4 14 165 235 247 249 250 252 253
12 16 169 237 251 255 253 252 250
-c
0 120 1202 1625 1698 1434 1274 1223 1040
4 157 438 533 542 507 461 479 400
12 132 204 242 248 242 244 257 263
###################################
- System: PRIMEQUEST 1800E
- CPU: Intel(R) Xeon(R) CPU E7540
- memory: 32GB
###################################
************ makedumpfile -d 0 ******************
core-data 0 256 512 768 1024 1280 1536 1792
threads-num
-l
0 34 282 245 179 179 179 179 180
4 63 143 224 230 220 212 207 204
8 65 129 200 225 235 235 225 220
12 67 149 186 211 222 229 237 236
-c
0 158 1505 2119 2129 1707 1483 1440 1273
4 207 589 672 673 636 564 536 514
8 176 327 377 387 367 336 314 291
12 191 272 295 306 288 259 257 240
************ makedumpfile -d 7 ******************
core-data 0 256 512 768 1024 1280 1536 1792
threads-num
-l
0 34 270 248 187 188 187 187 187
4 63 154 186 188 189 189 190 190
8 64 131 220 218 197 186 187 188
12 65 159 198 232 229 207 190 188
-c
0 154 1508 2089 2133 1792 1660 1462 1312
4 203 594 684 701 627 592 535 503
8 172 326 377 393 366 334 313 286
12 182 273 295 308 283 258 249 237
************ makedumpfile -d 31 ******************
core-data 0 256 512 768 1024 1280 1536 1792
threads-num
-l
0 2 1 1 2 1 2 2 2
4 48 48 48 48 49 48 48 49
8 48 49 48 49 48 47 49 48
12 49 50 49 49 49 48 50 49
-c
0 10 9 10 10 9 10 9 9
4 52 53 52 52 53 52 53 52
8 51 51 52 52 52 51 51 52
12 53 52 52 53 52 51 52 52
On 06/19/2015 04:56 PM, Zhou Wenjian wrote:
> This patch set implements parallel processing by means of multiple threads.
> With this patch set, it is available to use multiple threads to read
> and compress pages. This parallel process will save time.
> This feature only supports creating dumpfile in kdump-compressed format from
> vmcore in kdump-compressed format or elf format. Currently, sadump and
> xen kdump are not supported.
>
> Qiao Nuohan (10):
> Add readpage_kdump_compressed_parallel
> Add mappage_elf_parallel
> Add readpage_elf_parallel
> Add read_pfn_parallel
> Add function to initial bitmap for parallel use
> Add filter_data_buffer_parallel
> Add write_kdump_pages_parallel to allow parallel process
> Initial and free data used for parallel process
> Make makedumpfile available to read and compress pages parallelly
> Add usage and manual about multiple threads process
>
> Makefile | 2 +
> erase_info.c | 29 ++-
> erase_info.h | 2 +
> makedumpfile.8 | 24 ++
> makedumpfile.c | 1096 +++++++++++++++++++++++++++++++++++++++++++++++++++++++-
> makedumpfile.h | 80 ++++
> print_info.c | 16 +
> 7 files changed, 1246 insertions(+), 3 deletions(-)
>
>
> _______________________________________________
> kexec mailing list
> kexec at lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/kexec
--
Thanks
Zhou Wenjian
More information about the kexec
mailing list