#newsgrabberbot 2017-11-14,Tue

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
newsbuddy6849 URLs added in the last 15 minutes. [00:13]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,167,931 Req/Sec: 59.3 Records Added: 0 DB Size: 20.02GB Load: 15% [00:13]
.... (idle for 15mn)
newsbuddy5660 URLs added in the last 15 minutes. [00:28]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,215,844 Req/Sec: 55.22 Records Added: 0 DB Size: 20.02GB Load: 16% [00:28]
.... (idle for 15mn)
newsbuddy6759 URLs added in the last 15 minutes. [00:43]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,256,232 Req/Sec: 50.43 Records Added: 0 DB Size: 20.02GB Load: 29% [00:43]
.... (idle for 15mn)
newsbuddy5438 URLs added in the last 15 minutes. [00:58]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,298,973 Req/Sec: 52.29 Records Added: 0 DB Size: 20.02GB Load: 13% [00:58]
.... (idle for 15mn)
newsbuddy5733 URLs added in the last 15 minutes. [01:13]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,352,338 Req/Sec: 71.79 Records Added: 0 DB Size: 20.02GB Load: 16% [01:13]
.... (idle for 15mn)
newsbuddy5178 URLs added in the last 15 minutes. [01:28]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,434,444 Req/Sec: 99.59 Records Added: 0 DB Size: 20.02GB Load: 16% [01:28]
.... (idle for 15mn)
newsbuddy8173 URLs added in the last 15 minutes. [01:43]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,522,613 Req/Sec: 98.76 Records Added: 0 DB Size: 20.02GB Load: 29% [01:43]
.... (idle for 15mn)
newsbuddy5766 URLs added in the last 15 minutes. [01:58]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,608,734 Req/Sec: 98.59 Records Added: 0 DB Size: 20.02GB Load: 20% [01:58]
.... (idle for 15mn)
newsbuddy5534 URLs added in the last 15 minutes. [02:13]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,682,460 Req/Sec: 91.84 Records Added: 0 DB Size: 20.02GB Load: 17% [02:13]
.... (idle for 16mn)
newsbuddy5475 URLs added in the last 15 minutes. [02:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,756,921 Req/Sec: 56.44 Records Added: 0 DB Size: 20.02GB Load: 31% [02:29]
.... (idle for 15mn)
newsbuddy5941 URLs added in the last 15 minutes. [02:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,835,343 Req/Sec: 94.07 Records Added: 0 DB Size: 20.02GB Load: 39% [02:44]
.... (idle for 15mn)
newsbuddy5658 URLs added in the last 15 minutes. [02:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,917,993 Req/Sec: 96.35 Records Added: 0 DB Size: 20.02GB Load: 27% [02:59]
.... (idle for 15mn)
newsbuddy5520 URLs added in the last 15 minutes. [03:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 674,988,230 Req/Sec: 46.39 Records Added: 0 DB Size: 20.02GB Load: 18% [03:14]
.... (idle for 15mn)
newsbuddy5424 URLs added in the last 15 minutes. [03:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,065,293 Req/Sec: 70.63 Records Added: 0 DB Size: 20.02GB Load: 17% [03:29]
.... (idle for 15mn)
newsbuddy6378 URLs added in the last 15 minutes. [03:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,145,551 Req/Sec: 101.14 Records Added: 0 DB Size: 20.02GB Load: 27% [03:44]
.... (idle for 15mn)
newsbuddy5798 URLs added in the last 15 minutes. [03:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,219,799 Req/Sec: 80.49 Records Added: 0 DB Size: 20.02GB Load: 15% [03:59]
.... (idle for 15mn)
newsbuddy5118 URLs added in the last 15 minutes. [04:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,290,556 Req/Sec: 74 Records Added: 0 DB Size: 20.02GB Load: 14% [04:14]
.... (idle for 15mn)
newsbuddy5416 URLs added in the last 15 minutes. [04:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,359,737 Req/Sec: 94.1 Records Added: 0 DB Size: 20.02GB Load: 17% [04:29]
.... (idle for 15mn)
newsbuddy6102 URLs added in the last 15 minutes. [04:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,416,815 Req/Sec: 37.18 Records Added: 0 DB Size: 20.02GB Load: 26% [04:44]
.... (idle for 15mn)
newsbuddy5567 URLs added in the last 15 minutes. [04:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,492,448 Req/Sec: 59.02 Records Added: 0 DB Size: 20.02GB Load: 16% [04:59]
.... (idle for 15mn)
newsbuddy5107 URLs added in the last 15 minutes. [05:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,556,697 Req/Sec: 70.66 Records Added: 0 DB Size: 20.02GB Load: 14% [05:14]
.... (idle for 15mn)
newsbuddy5450 URLs added in the last 15 minutes. [05:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,637,862 Req/Sec: 86.87 Records Added: 0 DB Size: 20.02GB Load: 15% [05:29]
.... (idle for 15mn)
newsbuddy6979 URLs added in the last 15 minutes. [05:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,704,375 Req/Sec: 60.23 Records Added: 0 DB Size: 20.02GB Load: 31% [05:44]
.... (idle for 15mn)
newsbuddy6620 URLs added in the last 15 minutes. [05:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,762,841 Req/Sec: 65.21 Records Added: 0 DB Size: 20.02GB Load: 19% [05:59]
.... (idle for 15mn)
newsbuddy5483 URLs added in the last 15 minutes. [06:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,831,087 Req/Sec: 92.49 Records Added: 0 DB Size: 20.02GB Load: 21% [06:14]
.... (idle for 15mn)
newsbuddy5456 URLs added in the last 15 minutes. [06:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,900,124 Req/Sec: 67.88 Records Added: 0 DB Size: 20.02GB Load: 33% [06:29]
.... (idle for 15mn)
newsbuddy6182 URLs added in the last 15 minutes. [06:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 675,974,289 Req/Sec: 78.67 Records Added: 0 DB Size: 20.02GB Load: 26% [06:44]
.... (idle for 15mn)
newsbuddy5540 URLs added in the last 15 minutes. [06:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,036,480 Req/Sec: 75.93 Records Added: 0 DB Size: 20.02GB Load: 20% [06:59]
.... (idle for 15mn)
newsbuddy5559 URLs added in the last 15 minutes. [07:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,105,375 Req/Sec: 108.16 Records Added: 0 DB Size: 20.02GB Load: 17% [07:14]
.... (idle for 15mn)
newsbuddy5196 URLs added in the last 15 minutes. [07:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,185,216 Req/Sec: 93.21 Records Added: 0 DB Size: 20.02GB Load: 17% [07:29]
.... (idle for 15mn)
newsbuddy7603 URLs added in the last 15 minutes. [07:44]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,258,238 Req/Sec: 50.18 Records Added: 0 DB Size: 20.02GB Load: 27% [07:44]
.... (idle for 15mn)
newsbuddy6223 URLs added in the last 15 minutes. [07:59]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,326,671 Req/Sec: 78.48 Records Added: 0 DB Size: 20.02GB Load: 18% [07:59]
.... (idle for 15mn)
newsbuddy5634 URLs added in the last 15 minutes. [08:14]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,404,632 Req/Sec: 93.54 Records Added: 0 DB Size: 20.02GB Load: 16% [08:14]
.... (idle for 15mn)
newsbuddy5513 URLs added in the last 15 minutes. [08:29]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,470,170 Req/Sec: 54.09 Records Added: 0 DB Size: 20.02GB Load: 17% [08:30]
.... (idle for 15mn)
newsbuddy6099 URLs added in the last 15 minutes. [08:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,526,355 Req/Sec: 74.21 Records Added: 0 DB Size: 20.02GB Load: 20% [08:45]
.... (idle for 15mn)
newsbuddy5842 URLs added in the last 15 minutes. [09:00]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,593,318 Req/Sec: 74.35 Records Added: 0 DB Size: 20.02GB Load: 17% [09:00]
.... (idle for 15mn)
newsbuddy5200 URLs added in the last 15 minutes. [09:15]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,660,110 Req/Sec: 87.8 Records Added: 0 DB Size: 20.02GB Load: 18% [09:15]
.... (idle for 15mn)
newsbuddy5412 URLs added in the last 15 minutes. [09:30]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,725,955 Req/Sec: 78.25 Records Added: 0 DB Size: 20.02GB Load: 14% [09:30]
.... (idle for 15mn)
newsbuddy7270 URLs added in the last 15 minutes. [09:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,785,126 Req/Sec: 62.53 Records Added: 0 DB Size: 20.02GB Load: 28% [09:45]
.... (idle for 15mn)
newsbuddy5947 URLs added in the last 15 minutes. [10:00]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,848,865 Req/Sec: 72.17 Records Added: 0 DB Size: 20.02GB Load: 24% [10:00]
.... (idle for 15mn)
newsbuddy5710 URLs added in the last 15 minutes. [10:15]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,905,855 Req/Sec: 62.3 Records Added: 0 DB Size: 20.02GB Load: 21% [10:15]
.... (idle for 15mn)
newsbuddy5410 URLs added in the last 15 minutes. [10:30]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 676,962,038 Req/Sec: 54.97 Records Added: 0 DB Size: 20.02GB Load: 20% [10:30]
.... (idle for 15mn)
newsbuddy6519 URLs added in the last 15 minutes. [10:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,018,711 Req/Sec: 60.26 Records Added: 0 DB Size: 20.02GB Load: 25% [10:45]
.... (idle for 15mn)
newsbuddy5852 URLs added in the last 15 minutes. [11:00]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,060,754 Req/Sec: 45.23 Records Added: 0 DB Size: 20.02GB Load: 16% [11:00]
.... (idle for 15mn)
newsbuddy6129 URLs added in the last 15 minutes. [11:15]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,114,630 Req/Sec: 71.5 Records Added: 0 DB Size: 20.02GB Load: 16% [11:15]
.... (idle for 15mn)
newsbuddy6518 URLs added in the last 15 minutes. [11:30]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,171,401 Req/Sec: 51.75 Records Added: 0 DB Size: 20.02GB Load: 18% [11:30]
.... (idle for 15mn)
newsbuddy6934 URLs added in the last 15 minutes. [11:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,233,471 Req/Sec: 51.5 Records Added: 0 DB Size: 20.02GB Load: 24% [11:45]
.... (idle for 15mn)
newsbuddy6629 URLs added in the last 15 minutes. [12:00]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,285,985 Req/Sec: 44.99 Records Added: 0 DB Size: 20.02GB Load: 16% [12:00]
.... (idle for 15mn)
newsbuddy6579 URLs added in the last 15 minutes. [12:15]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,336,861 Req/Sec: 66.25 Records Added: 0 DB Size: 20.02GB Load: 21% [12:15]
.... (idle for 15mn)
newsbuddy5959 URLs added in the last 15 minutes. [12:30]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,396,960 Req/Sec: 60.59 Records Added: 0 DB Size: 20.02GB Load: 17% [12:30]
.... (idle for 15mn)
newsbuddy6406 URLs added in the last 15 minutes. [12:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,455,103 Req/Sec: 42.07 Records Added: 73,102 DB Size: 20.02GB Load: 34% [12:45]
.... (idle for 15mn)
newsbuddy6139 URLs added in the last 15 minutes. [13:00]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,505,349 Req/Sec: 65.15 Records Added: 516,762 DB Size: 20.03GB Load: 63% [13:00]
.... (idle for 15mn)
newsbuddy5412 URLs added in the last 15 minutes. [13:15]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,571,629 Req/Sec: 87.16 Records Added: 424,954 DB Size: 20.03GB Load: 58% [13:15]
.... (idle for 15mn)
newsbuddy3118 URLs added in the last 15 minutes. [13:30]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,628,727 Req/Sec: 61.05 Records Added: 625,113 DB Size: 20.04GB Load: 59% [13:30]
.... (idle for 15mn)
newsbuddy6074 URLs added in the last 15 minutes. [13:45]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,684,751 Req/Sec: 53.22 Records Added: 404,213 DB Size: 20.04GB Load: 70% [13:46]
.... (idle for 15mn)
newsbuddy3726 URLs added in the last 15 minutes. [14:01]
NewsDeDup[DEDUPE STATUS] 4 threads alive! - Req Time: 0.09 Total Req: 677,741,354 Req/Sec: 75.7 Records Added: 442,038 DB Size: 20.05GB Load: 71% [14:01]
***NewsDeDup has quit IRC (Remote host closed the connection) [14:15]
newsbuddy3379 URLs added in the last 15 minutes. [14:16]
.... (idle for 15mn)
3228 URLs added in the last 15 minutes. [14:31]
***NewsDeDup has joined #newsgrabberbot [14:40]
jrwr3228 URLs added in the last 15 minutes
3228 URLs added in the last 15 minutes.
[14:40]
NewsDeDup[DEDUPE STATUS] 4 threads Records Added: 936,688 DB Size: 20.05GB Load: 64% [CDN] 118.3 r/s 90% 14.8G EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:40]
***NewsDeDup has quit IRC (Remote host closed the connection)
NewsDeDup has joined #newsgrabberbot
[14:40]
jrwr3228 URLs added in the last 15 minutes. [14:42]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 16,533 || DB Size: 20.06GB || Load: 59% [CDN] 110.7 r/s 90% hit 14.8G BW ||EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:42]
***NewsDeDup has quit IRC (Remote host closed the connection)
NewsDeDup has joined #newsgrabberbot
[14:42]
jrwr3228 URLs added in the last 15 minutes. [14:43]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 21,264 || DB Size: 20.06GB || Load: 62% || [CDN] 104.9 r/s 90% hit 14.8G BW ||EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:43]
jrwrHCross2:
there you go
:)
[14:43]
***NewsDeDup has quit IRC (Remote host closed the connection) [14:46]
newsbuddy4069 URLs added in the last 15 minutes. [14:46]
***NewsDeDup has joined #newsgrabberbot [14:46]
jrwr4069 URLs added in the last 15 minutes. [14:47]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 71,620 || DB Size: 20.06GB || Load: 66% || [CDN] 95.2 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:47]
***NewsDeDup has quit IRC (Remote host closed the connection)
NewsDeDup has joined #newsgrabberbot
[14:47]
jrwr4069 URLs added in the last 15 minutes. [14:48]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 26,472 || DB Size: 20.06GB || Load: 63% || [CDN] 93.7 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:48]
jrwr4069 URLs added in the last 15 minutes. [14:48]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 3,936 || DB Size: 20.06GB || Load: 62% || [CDN] 9291.9 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:48]
jrwrcool that is working
4069 URLs added in the last 15 minutes.
[14:48]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 8,516 || DB Size: 20.06GB || Load: 69% || [CDN] 4028.3 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:49]
***NewsDeDup has quit IRC (Remote host closed the connection)
NewsDeDup has joined #newsgrabberbot
[14:49]
jrwr4069 URLs added in the last 15 minutes. [14:50]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 13,496 || DB Size: 20.06GB || Load: 68% || [CDN] 89.9 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:50]
jrwr4069 URLs added in the last 15 minutes. [14:50]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 1,841 || DB Size: 20.06GB || Load: 68% || [CDN] 16453.3 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:50]
jrwr38257537 38258216
wait
are we default or something
these numbers are insane
thats the raw request amounts coming from the API
4069 URLs added in the last 15 minutes.
[14:50]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 20,822 || DB Size: 20.06GB || Load: 63% || [CDN] 1208.2 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:52]
jrwr4069 URLs added in the last 15 minutes. [14:55]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 44,673 || DB Size: 20.06GB || Load: 73% || [CDN] 710.6 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:55]
jrwr4069 URLs added in the last 15 minutes. [14:57]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 92,937 || DB Size: 20.06GB || Load: 52% || [CDN] 1004.6 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [14:57]
newsbuddy3383 URLs added in the last 15 minutes. [15:01]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 82,225 || DB Size: 20.06GB || Load: 64% || [CDN] 715.9 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [15:01]
.... (idle for 15mn)
newsbuddy3200 URLs added in the last 15 minutes. [15:16]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 382,887 || DB Size: 20.06GB || Load: 54% || [CDN] 220.5 r/s 90% hit 14.8G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [15:16]
.... (idle for 15mn)
newsbuddy3881 URLs added in the last 15 minutes. [15:31]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 451,453 || DB Size: 20.07GB || Load: 61% || [CDN] 280.4 r/s 90% hit 14.9G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [15:31]
.... (idle for 15mn)
newsbuddy4908 URLs added in the last 15 minutes. [15:46]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 430,210 || DB Size: 20.09GB || Load: 72% || [CDN] 336.3 r/s 90% hit 14.9G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [15:46]
.... (idle for 15mn)
newsbuddy3772 URLs added in the last 15 minutes. [16:01]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 316,626 || DB Size: 20.09GB || Load: 55% || [CDN] 400 r/s 90% hit 14.9G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [16:01]
.... (idle for 15mn)
newsbuddy3755 URLs added in the last 15 minutes. [16:16]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 324,408 || DB Size: 20.10GB || Load: 57% || [CDN] 481.3 r/s 90% hit 14.9G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [16:16]
.... (idle for 15mn)
newsbuddy3430 URLs added in the last 15 minutes. [16:31]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 339,137 || DB Size: 20.09GB || Load: 62% || [CDN] 593.7 r/s 90% hit 15G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [16:31]
.... (idle for 15mn)
newsbuddy4101 URLs added in the last 15 minutes. [16:46]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 406,966 || DB Size: 20.10GB || Load: 83% || [CDN] 745.9 r/s 90% hit 15G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [16:46]
.... (idle for 15mn)
newsbuddy3624 URLs added in the last 15 minutes. [17:01]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 339,565 || DB Size: 20.10GB || Load: 71% || [CDN] 876.9 r/s 90% hit 15.1G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [17:01]
.... (idle for 15mn)
newsbuddy3218 URLs added in the last 15 minutes. [17:16]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 410,602 || DB Size: 20.11GB || Load: 56% || [CDN] 1024.5 r/s 90% hit 15.1G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [17:16]
.... (idle for 15mn)
newsbuddy4699 URLs added in the last 15 minutes. [17:31]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 443,938 || DB Size: 20.11GB || Load: 64% || [CDN] 1158.3 r/s 90% hit 15.2G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [17:31]
.... (idle for 15mn)
newsbuddy4440 URLs added in the last 15 minutes. [17:46]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 565,253 || DB Size: 20.12GB || Load: 71% || [CDN] 1281.1 r/s 90% hit 15.2G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [17:46]
.... (idle for 15mn)
newsbuddy4195 URLs added in the last 15 minutes. [18:01]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 384,987 || DB Size: 20.12GB || Load: 65% || [CDN] 1427.7 r/s 90% hit 15.2G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [18:02]
.... (idle for 15mn)
newsbuddy3545 URLs added in the last 15 minutes. [18:17]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 492,849 || DB Size: 20.13GB || Load: 55% || [CDN] 1579.8 r/s 90% hit 15.3G BW || EU: London, UK: 90% EU: Frankfurt, DE: 7% [18:17]
.... (idle for 15mn)
newsbuddy3749 URLs added in the last 15 minutes. [18:32]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 351,580 || DB Size: 20.14GB || Load: 64% || [CDN] 1703.3 r/s 90% hit 15.3G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [18:32]
.... (idle for 15mn)
newsbuddy3551 URLs added in the last 15 minutes. [18:47]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 482,897 || DB Size: 20.14GB || Load: 57% || [CDN] 1857.8 r/s 90% hit 15.4G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [18:47]
.... (idle for 15mn)
newsbuddy3786 URLs added in the last 15 minutes. [19:02]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 498,932 || DB Size: 20.15GB || Load: 62% || [CDN] 2006.5 r/s 90% hit 15.5G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [19:02]
.... (idle for 15mn)
newsbuddy3194 URLs added in the last 15 minutes. [19:17]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 412,490 || DB Size: 20.15GB || Load: 54% || [CDN] 2155.4 r/s 90% hit 15.5G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [19:17]
.... (idle for 15mn)
newsbuddy4615 URLs added in the last 15 minutes. [19:32]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 372,241 || DB Size: 20.16GB || Load: 18% || [CDN] 2299.1 r/s 90% hit 15.6G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [19:32]
.... (idle for 15mn)
newsbuddy4637 URLs added in the last 15 minutes. [19:47]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 316,515 || DB Size: 20.16GB || Load: 72% || [CDN] 2450.8 r/s 90% hit 15.6G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [19:47]
***NewsDeDup has quit IRC (Remote host closed the connection)
NewsDeDup has joined #newsgrabberbot
[19:55]
jrwr4637 URLs added in the last 15 minutes. [19:57]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 316,937 || DB Size: 20.17GB || Load: 68% || [CDN] 115.9 r/s 90% hit 15.6G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [19:57]
newsbuddy4909 URLs added in the last 15 minutes. [20:04]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 202,037 || DB Size: 20.17GB || Load: 49% || [CDN] 128.3 r/s 90% hit 15.7G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [20:04]
.... (idle for 15mn)
newsbuddy3594 URLs added in the last 15 minutes. [20:19]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 578,264 || DB Size: 20.17GB || Load: 54% || [CDN] 123.8 r/s 90% hit 15.7G BW || EU: London, UK: 89% EU: Frankfurt, DE: 8% [20:19]
.... (idle for 19mn)
newsbuddy4958 URLs added in the last 15 minutes. [20:38]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 390,001 || DB Size: 20.18GB || Load: 7% || [CDN] 114.3 r/s 90% hit 15.7G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [20:38]
.... (idle for 17mn)
newsbuddy3824 URLs added in the last 15 minutes. [20:55]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 12% || [CDN] 107.7 r/s 90% hit 15.8G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [20:55]
...... (idle for 25mn)
newsbuddy5546 URLs added in the last 15 minutes. [21:20]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 14% || [CDN] 96.7 r/s 90% hit 15.8G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [21:20]
.... (idle for 16mn)
newsbuddy4504 URLs added in the last 15 minutes. [21:36]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 7% || [CDN] 133 r/s 90% hit 15.9G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [21:36]
..... (idle for 24mn)
newsbuddy5798 URLs added in the last 15 minutes. [22:00]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 5% || [CDN] 143.1 r/s 90% hit 16G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [22:00]
.... (idle for 16mn)
newsbuddy3762 URLs added in the last 15 minutes. [22:16]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 5% || [CDN] 134.1 r/s 90% hit 16G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [22:16]
...... (idle for 29mn)
newsbuddy6841 URLs added in the last 15 minutes. [22:45]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 9% || [CDN] 119.1 r/s 90% hit 16.1G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [22:45]
.... (idle for 15mn)
newsbuddy2811 URLs added in the last 15 minutes. [23:00]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 7% || [CDN] 94.9 r/s 90% hit 16.1G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [23:00]
.... (idle for 18mn)
newsbuddy3485 URLs added in the last 15 minutes. [23:18]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 6% || [CDN] 111.8 r/s 90% hit 16.2G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [23:18]
.... (idle for 15mn)
newsbuddy3504 URLs added in the last 15 minutes. [23:33]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 4% || [CDN] 99.6 r/s 90% hit 16.2G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [23:33]
.... (idle for 15mn)
newsbuddy3211 URLs added in the last 15 minutes. [23:48]
NewsDeDup[DEDUPE STATUS] 4 threads || Records Added: 0 || DB Size: 20.18GB || Load: 9% || [CDN] 107.4 r/s 90% hit 16.3G BW || EU: London, UK: 88% EU: Frankfurt, DE: 9% [23:48]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)