5581 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,680,634 Req/Sec: 135.65 Records Added: 0 DB Size: 18.49GB Load: 17% 7493 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,792,680 Req/Sec: 112.94 Records Added: 0 DB Size: 18.49GB Load: 16% 5553 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 502,917,756 Req/Sec: 114.23 Records Added: 0 DB Size: 18.49GB Load: 24% 6086 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,030,876 Req/Sec: 139.78 Records Added: 0 DB Size: 18.49GB Load: 22% 5118 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,144,677 Req/Sec: 125.64 Records Added: 0 DB Size: 18.49GB Load: 21% 6844 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,253,036 Req/Sec: 126.15 Records Added: 0 DB Size: 18.49GB Load: 18% 6224 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,392,354 Req/Sec: 140.78 Records Added: 0 DB Size: 18.49GB Load: 17% 5584 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,514,421 Req/Sec: 125.28 Records Added: 0 DB Size: 18.49GB Load: 18% 5362 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,627,549 Req/Sec: 111.41 Records Added: 0 DB Size: 18.49GB Load: 27% 7069 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,741,082 Req/Sec: 139.01 Records Added: 0 DB Size: 18.49GB Load: 30% 5691 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,851,502 Req/Sec: 151.64 Records Added: 0 DB Size: 18.49GB Load: 26% 5617 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 503,969,698 Req/Sec: 170.73 Records Added: 0 DB Size: 18.49GB Load: 32% 5229 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,084,644 Req/Sec: 111.6 Records Added: 0 DB Size: 18.49GB Load: 25% 6836 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,201,022 Req/Sec: 127.17 Records Added: 0 DB Size: 18.49GB Load: 29% 5802 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,315,806 Req/Sec: 152 Records Added: 0 DB Size: 18.49GB Load: 31% 5874 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,427,417 Req/Sec: 149.78 Records Added: 0 DB Size: 18.49GB Load: 32% 5270 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,543,217 Req/Sec: 111.85 Records Added: 0 DB Size: 18.49GB Load: 26% 7904 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,649,930 Req/Sec: 127.49 Records Added: 0 DB Size: 18.49GB Load: 30% 5724 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,754,472 Req/Sec: 116 Records Added: 0 DB Size: 18.49GB Load: 31% 5776 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,859,522 Req/Sec: 128.23 Records Added: 486,047 DB Size: 18.50GB Load: 70% 5325 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 504,955,371 Req/Sec: 103.43 Records Added: 442,165 DB Size: 18.50GB Load: 62% 7056 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,058,501 Req/Sec: 111.32 Records Added: 528,525 DB Size: 18.52GB Load: 56% 5784 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,158,821 Req/Sec: 118.57 Records Added: 579,023 DB Size: 18.53GB Load: 50% 5605 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,261,847 Req/Sec: 99.27 Records Added: 679,373 DB Size: 18.53GB Load: 52% 5629 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,354,070 Req/Sec: 140.98 Records Added: 498,504 DB Size: 18.54GB Load: 67% 7290 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,464,583 Req/Sec: 109.31 Records Added: 424,720 DB Size: 18.53GB Load: 78% 5593 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,563,603 Req/Sec: 118.36 Records Added: 415,288 DB Size: 18.55GB Load: 76% 5709 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,657,363 Req/Sec: 107.84 Records Added: 431,891 DB Size: 18.55GB Load: 123% 5446 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,748,554 Req/Sec: 104.38 Records Added: 291,132 DB Size: 18.56GB Load: 68% 6828 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,844,584 Req/Sec: 117.19 Records Added: 361,798 DB Size: 18.55GB Load: 60% 6225 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 505,945,812 Req/Sec: 116.05 Records Added: 390,803 DB Size: 18.58GB Load: 86% 5556 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,046,691 Req/Sec: 93.56 Records Added: 343,563 DB Size: 18.58GB Load: 54% 5659 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,148,500 Req/Sec: 106.9 Records Added: 352,964 DB Size: 18.59GB Load: 62% 7707 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,250,517 Req/Sec: 107.5 Records Added: 401,196 DB Size: 18.60GB Load: 73% 5860 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,345,744 Req/Sec: 95.02 Records Added: 615,010 DB Size: 18.61GB Load: 79% 5705 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,438,680 Req/Sec: 105.04 Records Added: 292,778 DB Size: 18.62GB Load: 67% 5348 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,530,383 Req/Sec: 87.86 Records Added: 364,856 DB Size: 18.63GB Load: 58% 6754 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,616,462 Req/Sec: 90.95 Records Added: 501,453 DB Size: 18.63GB Load: 62% 5620 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,709,023 Req/Sec: 103.05 Records Added: 511,364 DB Size: 18.65GB Load: 66% 5707 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,810,010 Req/Sec: 115.78 Records Added: 412,676 DB Size: 18.66GB Load: 61% 5424 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 506,906,744 Req/Sec: 98.19 Records Added: 419,315 DB Size: 18.65GB Load: 79% 8051 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,006,875 Req/Sec: 98.35 Records Added: 477,635 DB Size: 18.66GB Load: 54% 5750 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,103,997 Req/Sec: 128.71 Records Added: 0 DB Size: 18.66GB Load: 25% 5951 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,201,484 Req/Sec: 111.57 Records Added: 0 DB Size: 18.66GB Load: 20% 5104 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,315,511 Req/Sec: 116.7 Records Added: 0 DB Size: 18.62GB Load: 18% 6891 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,407,132 Req/Sec: 106.2 Records Added: 0 DB Size: 18.62GB Load: 20% 5625 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,496,697 Req/Sec: 87.8 Records Added: 0 DB Size: 18.62GB Load: 21% 6091 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,597,398 Req/Sec: 121.13 Records Added: 0 DB Size: 18.62GB Load: 22% 5276 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,716,288 Req/Sec: 111.63 Records Added: 0 DB Size: 18.62GB Load: 19% 8181 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,825,254 Req/Sec: 99.51 Records Added: 0 DB Size: 18.62GB Load: 21% 5902 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 507,939,875 Req/Sec: 148.1 Records Added: 0 DB Size: 18.62GB Load: 17% 6300 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,052,149 Req/Sec: 99.15 Records Added: 0 DB Size: 18.62GB Load: 18% 5546 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,160,232 Req/Sec: 116.85 Records Added: 0 DB Size: 18.62GB Load: 37% 7254 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,267,061 Req/Sec: 106.35 Records Added: 0 DB Size: 18.62GB Load: 25% 6071 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,383,798 Req/Sec: 122.64 Records Added: 0 DB Size: 18.62GB Load: 42% 5896 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,500,851 Req/Sec: 124.94 Records Added: 0 DB Size: 18.61GB Load: 32% 5886 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,606,785 Req/Sec: 137.04 Records Added: 0 DB Size: 18.61GB Load: 22% 8276 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,724,064 Req/Sec: 111.31 Records Added: 250,448 DB Size: 18.61GB Load: 51% 6060 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,827,551 Req/Sec: 110.52 Records Added: 710,728 DB Size: 18.63GB Load: 61% 6064 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 508,922,310 Req/Sec: 88.68 Records Added: 92,913 DB Size: 18.63GB Load: 51% 6035 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,015,525 Req/Sec: 89.8 Records Added: 0 DB Size: 18.63GB Load: 26% 6847 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,112,826 Req/Sec: 98.79 Records Added: 0 DB Size: 18.63GB Load: 26% 6169 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,209,274 Req/Sec: 107.17 Records Added: 0 DB Size: 18.63GB Load: 18% 6124 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,303,263 Req/Sec: 107.98 Records Added: 0 DB Size: 18.63GB Load: 21% 5990 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,407,169 Req/Sec: 128.72 Records Added: 0 DB Size: 18.63GB Load: 15% 9091 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,512,257 Req/Sec: 97.34 Records Added: 0 DB Size: 18.63GB Load: 17% 6487 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,617,425 Req/Sec: 107.26 Records Added: 0 DB Size: 18.61GB Load: 16% 6179 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,722,064 Req/Sec: 115.86 Records Added: 0 DB Size: 18.61GB Load: 30% 6085 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,818,610 Req/Sec: 98.95 Records Added: 0 DB Size: 18.61GB Load: 19% 7084 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 509,918,768 Req/Sec: 118.19 Records Added: 0 DB Size: 18.61GB Load: 22% 6369 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,011,186 Req/Sec: 110.31 Records Added: 0 DB Size: 18.61GB Load: 21% 6352 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,112,316 Req/Sec: 117.55 Records Added: 0 DB Size: 18.61GB Load: 20% 5649 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,209,679 Req/Sec: 98.16 Records Added: 0 DB Size: 18.61GB Load: 20% 8359 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,309,203 Req/Sec: 99.25 Records Added: 0 DB Size: 18.61GB Load: 20% 6001 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,400,431 Req/Sec: 109.96 Records Added: 0 DB Size: 18.61GB Load: 20% 6715 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,507,442 Req/Sec: 91.41 Records Added: 0 DB Size: 18.61GB Load: 22% 6353 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,599,014 Req/Sec: 101.8 Records Added: 0 DB Size: 18.61GB Load: 21% 6582 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,696,674 Req/Sec: 95.41 Records Added: 0 DB Size: 18.61GB Load: 20% 6110 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,783,089 Req/Sec: 86 Records Added: 0 DB Size: 18.61GB Load: 25% 6124 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,870,453 Req/Sec: 88.05 Records Added: 0 DB Size: 18.61GB Load: 19% 6593 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 510,958,965 Req/Sec: 90.36 Records Added: 0 DB Size: 18.61GB Load: 22% 7483 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,038,476 Req/Sec: 95.14 Records Added: 0 DB Size: 18.61GB Load: 25% 5861 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,119,480 Req/Sec: 99.89 Records Added: 0 DB Size: 18.61GB Load: 27% 6277 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,201,958 Req/Sec: 102.22 Records Added: 0 DB Size: 18.61GB Load: 17% 6440 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,292,563 Req/Sec: 89.02 Records Added: 0 DB Size: 18.61GB Load: 16% 6618 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,380,857 Req/Sec: 95.14 Records Added: 0 DB Size: 18.61GB Load: 20% 6259 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,469,087 Req/Sec: 100.38 Records Added: 0 DB Size: 18.61GB Load: 17% 5531 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,554,009 Req/Sec: 84.82 Records Added: 0 DB Size: 18.61GB Load: 21% 7218 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,640,575 Req/Sec: 99.44 Records Added: 0 DB Size: 18.61GB Load: 17% 6628 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,736,292 Req/Sec: 103.74 Records Added: 0 DB Size: 18.62GB Load: 19% 6387 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,824,953 Req/Sec: 81.42 Records Added: 0 DB Size: 18.59GB Load: 53% 5578 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 511,917,811 Req/Sec: 110.04 Records Added: 0 DB Size: 18.59GB Load: 22% 6271 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,014,088 Req/Sec: 107.81 Records Added: 0 DB Size: 18.59GB Load: 19% 6343 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,104,035 Req/Sec: 100.45 Records Added: 0 DB Size: 18.59GB Load: 21% 5906 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,191,994 Req/Sec: 85.53 Records Added: 0 DB Size: 18.59GB Load: 16% 5564 URLs added in the last 15 minutes. [DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 512,278,196 Req/Sec: 95.59 Records Added: 0 DB Size: 18.59GB Load: 18%