5581 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,680,634 Req/Sec: 135.65 Records Added: 0 DB Size: 18.49GB Load: 17%
7493 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,792,680 Req/Sec: 112.94 Records Added: 0 DB Size: 18.49GB Load: 16%
5553 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,917,756 Req/Sec: 114.23 Records Added: 0 DB Size: 18.49GB Load: 24%
6086 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,030,876 Req/Sec: 139.78 Records Added: 0 DB Size: 18.49GB Load: 22%
5118 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,144,677 Req/Sec: 125.64 Records Added: 0 DB Size: 18.49GB Load: 21%
6844 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,253,036 Req/Sec: 126.15 Records Added: 0 DB Size: 18.49GB Load: 18%
6224 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,392,354 Req/Sec: 140.78 Records Added: 0 DB Size: 18.49GB Load: 17%
5584 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,514,421 Req/Sec: 125.28 Records Added: 0 DB Size: 18.49GB Load: 18%
5362 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,627,549 Req/Sec: 111.41 Records Added: 0 DB Size: 18.49GB Load: 27%
7069 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,741,082 Req/Sec: 139.01 Records Added: 0 DB Size: 18.49GB Load: 30%
5691 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,851,502 Req/Sec: 151.64 Records Added: 0 DB Size: 18.49GB Load: 26%
5617 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,969,698 Req/Sec: 170.73 Records Added: 0 DB Size: 18.49GB Load: 32%
5229 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,084,644 Req/Sec: 111.6 Records Added: 0 DB Size: 18.49GB Load: 25%
6836 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,201,022 Req/Sec: 127.17 Records Added: 0 DB Size: 18.49GB Load: 29%
5802 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,315,806 Req/Sec: 152 Records Added: 0 DB Size: 18.49GB Load: 31%
5874 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,427,417 Req/Sec: 149.78 Records Added: 0 DB Size: 18.49GB Load: 32%
5270 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,543,217 Req/Sec: 111.85 Records Added: 0 DB Size: 18.49GB Load: 26%
7904 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,649,930 Req/Sec: 127.49 Records Added: 0 DB Size: 18.49GB Load: 30%
5724 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,754,472 Req/Sec: 116 Records Added: 0 DB Size: 18.49GB Load: 31%
5776 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,859,522 Req/Sec: 128.23 Records Added: 486,047 DB Size: 18.50GB Load: 70%
5325 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,955,371 Req/Sec: 103.43 Records Added: 442,165 DB Size: 18.50GB Load: 62%
7056 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,058,501 Req/Sec: 111.32 Records Added: 528,525 DB Size: 18.52GB Load: 56%
5784 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,158,821 Req/Sec: 118.57 Records Added: 579,023 DB Size: 18.53GB Load: 50%
5605 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,261,847 Req/Sec: 99.27 Records Added: 679,373 DB Size: 18.53GB Load: 52%
5629 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,354,070 Req/Sec: 140.98 Records Added: 498,504 DB Size: 18.54GB Load: 67%
7290 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,464,583 Req/Sec: 109.31 Records Added: 424,720 DB Size: 18.53GB Load: 78%
5593 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,563,603 Req/Sec: 118.36 Records Added: 415,288 DB Size: 18.55GB Load: 76%
5709 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,657,363 Req/Sec: 107.84 Records Added: 431,891 DB Size: 18.55GB Load: 123%
5446 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,748,554 Req/Sec: 104.38 Records Added: 291,132 DB Size: 18.56GB Load: 68%
6828 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,844,584 Req/Sec: 117.19 Records Added: 361,798 DB Size: 18.55GB Load: 60%
6225 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,945,812 Req/Sec: 116.05 Records Added: 390,803 DB Size: 18.58GB Load: 86%
5556 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,046,691 Req/Sec: 93.56 Records Added: 343,563 DB Size: 18.58GB Load: 54%
5659 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,148,500 Req/Sec: 106.9 Records Added: 352,964 DB Size: 18.59GB Load: 62%
7707 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,250,517 Req/Sec: 107.5 Records Added: 401,196 DB Size: 18.60GB Load: 73%
5860 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,345,744 Req/Sec: 95.02 Records Added: 615,010 DB Size: 18.61GB Load: 79%
5705 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,438,680 Req/Sec: 105.04 Records Added: 292,778 DB Size: 18.62GB Load: 67%
5348 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,530,383 Req/Sec: 87.86 Records Added: 364,856 DB Size: 18.63GB Load: 58%
6754 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,616,462 Req/Sec: 90.95 Records Added: 501,453 DB Size: 18.63GB Load: 62%
5620 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,709,023 Req/Sec: 103.05 Records Added: 511,364 DB Size: 18.65GB Load: 66%
5707 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,810,010 Req/Sec: 115.78 Records Added: 412,676 DB Size: 18.66GB Load: 61%
5424 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,906,744 Req/Sec: 98.19 Records Added: 419,315 DB Size: 18.65GB Load: 79%
8051 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,006,875 Req/Sec: 98.35 Records Added: 477,635 DB Size: 18.66GB Load: 54%
5750 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,103,997 Req/Sec: 128.71 Records Added: 0 DB Size: 18.66GB Load: 25%
5951 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,201,484 Req/Sec: 111.57 Records Added: 0 DB Size: 18.66GB Load: 20%
5104 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,315,511 Req/Sec: 116.7 Records Added: 0 DB Size: 18.62GB Load: 18%
6891 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,407,132 Req/Sec: 106.2 Records Added: 0 DB Size: 18.62GB Load: 20%
5625 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,496,697 Req/Sec: 87.8 Records Added: 0 DB Size: 18.62GB Load: 21%
6091 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,597,398 Req/Sec: 121.13 Records Added: 0 DB Size: 18.62GB Load: 22%
5276 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,716,288 Req/Sec: 111.63 Records Added: 0 DB Size: 18.62GB Load: 19%
8181 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,825,254 Req/Sec: 99.51 Records Added: 0 DB Size: 18.62GB Load: 21%
5902 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,939,875 Req/Sec: 148.1 Records Added: 0 DB Size: 18.62GB Load: 17%
6300 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,052,149 Req/Sec: 99.15 Records Added: 0 DB Size: 18.62GB Load: 18%
5546 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,160,232 Req/Sec: 116.85 Records Added: 0 DB Size: 18.62GB Load: 37%
7254 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,267,061 Req/Sec: 106.35 Records Added: 0 DB Size: 18.62GB Load: 25%
6071 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,383,798 Req/Sec: 122.64 Records Added: 0 DB Size: 18.62GB Load: 42%
5896 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,500,851 Req/Sec: 124.94 Records Added: 0 DB Size: 18.61GB Load: 32%
5886 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,606,785 Req/Sec: 137.04 Records Added: 0 DB Size: 18.61GB Load: 22%
8276 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,724,064 Req/Sec: 111.31 Records Added: 250,448 DB Size: 18.61GB Load: 51%
6060 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,827,551 Req/Sec: 110.52 Records Added: 710,728 DB Size: 18.63GB Load: 61%
6064 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,922,310 Req/Sec: 88.68 Records Added: 92,913 DB Size: 18.63GB Load: 51%
6035 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,015,525 Req/Sec: 89.8 Records Added: 0 DB Size: 18.63GB Load: 26%
6847 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,112,826 Req/Sec: 98.79 Records Added: 0 DB Size: 18.63GB Load: 26%
6169 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,209,274 Req/Sec: 107.17 Records Added: 0 DB Size: 18.63GB Load: 18%
6124 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,303,263 Req/Sec: 107.98 Records Added: 0 DB Size: 18.63GB Load: 21%
5990 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,407,169 Req/Sec: 128.72 Records Added: 0 DB Size: 18.63GB Load: 15%
9091 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,512,257 Req/Sec: 97.34 Records Added: 0 DB Size: 18.63GB Load: 17%
6487 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,617,425 Req/Sec: 107.26 Records Added: 0 DB Size: 18.61GB Load: 16%
6179 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,722,064 Req/Sec: 115.86 Records Added: 0 DB Size: 18.61GB Load: 30%
6085 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,818,610 Req/Sec: 98.95 Records Added: 0 DB Size: 18.61GB Load: 19%
7084 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,918,768 Req/Sec: 118.19 Records Added: 0 DB Size: 18.61GB Load: 22%
6369 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,011,186 Req/Sec: 110.31 Records Added: 0 DB Size: 18.61GB Load: 21%
6352 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,112,316 Req/Sec: 117.55 Records Added: 0 DB Size: 18.61GB Load: 20%
5649 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,209,679 Req/Sec: 98.16 Records Added: 0 DB Size: 18.61GB Load: 20%
8359 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,309,203 Req/Sec: 99.25 Records Added: 0 DB Size: 18.61GB Load: 20%
6001 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,400,431 Req/Sec: 109.96 Records Added: 0 DB Size: 18.61GB Load: 20%
6715 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,507,442 Req/Sec: 91.41 Records Added: 0 DB Size: 18.61GB Load: 22%
6353 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,599,014 Req/Sec: 101.8 Records Added: 0 DB Size: 18.61GB Load: 21%
6582 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,696,674 Req/Sec: 95.41 Records Added: 0 DB Size: 18.61GB Load: 20%
6110 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,783,089 Req/Sec: 86 Records Added: 0 DB Size: 18.61GB Load: 25%
6124 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,870,453 Req/Sec: 88.05 Records Added: 0 DB Size: 18.61GB Load: 19%
6593 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,958,965 Req/Sec: 90.36 Records Added: 0 DB Size: 18.61GB Load: 22%
7483 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,038,476 Req/Sec: 95.14 Records Added: 0 DB Size: 18.61GB Load: 25%
5861 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,119,480 Req/Sec: 99.89 Records Added: 0 DB Size: 18.61GB Load: 27%
6277 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,201,958 Req/Sec: 102.22 Records Added: 0 DB Size: 18.61GB Load: 17%
6440 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,292,563 Req/Sec: 89.02 Records Added: 0 DB Size: 18.61GB Load: 16%
6618 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,380,857 Req/Sec: 95.14 Records Added: 0 DB Size: 18.61GB Load: 20%
6259 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,469,087 Req/Sec: 100.38 Records Added: 0 DB Size: 18.61GB Load: 17%
5531 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,554,009 Req/Sec: 84.82 Records Added: 0 DB Size: 18.61GB Load: 21%
7218 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,640,575 Req/Sec: 99.44 Records Added: 0 DB Size: 18.61GB Load: 17%
6628 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,736,292 Req/Sec: 103.74 Records Added: 0 DB Size: 18.62GB Load: 19%
6387 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,824,953 Req/Sec: 81.42 Records Added: 0 DB Size: 18.59GB Load: 53%
5578 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,917,811 Req/Sec: 110.04 Records Added: 0 DB Size: 18.59GB Load: 22%
6271 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,014,088 Req/Sec: 107.81 Records Added: 0 DB Size: 18.59GB Load: 19%
6343 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,104,035 Req/Sec: 100.45 Records Added: 0 DB Size: 18.59GB Load: 21%
5906 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,191,994 Req/Sec: 85.53 Records Added: 0 DB Size: 18.59GB Load: 16%
5564 URLs added in the last 15 minutes.
[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,278,196 Req/Sec: 95.59 Records Added: 0 DB Size: 18.59GB Load: 18%