[00:09] *** Coderjo_ is now known as Coderjo [00:15] *** j08nY has quit IRC (Remote host closed the connection) [01:08] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [01:13] *** wabu_ has quit IRC (Read error: Operation timed out) [01:14] *** Sk1d has joined #archiveteam-bs [01:16] *** schbirid2 has joined #archiveteam-bs [01:19] *** username1 has quit IRC (Read error: Operation timed out) [01:21] *** Selavi has quit IRC (Read error: Operation timed out) [01:22] *** logchfoo0 has quit IRC (Ping timeout: 255 seconds) [01:23] *** logchfoo1 starts logging #archiveteam-bs at Sat May 20 01:23:42 2017 [01:23] *** logchfoo1 has joined #archiveteam-bs [01:27] *** RedType_ has joined #archiveteam-bs [01:29] *** wabu has joined #archiveteam-bs [01:29] *** achip has quit IRC (west.us.hub irc.Prison.NET) [01:29] *** RedType has quit IRC (west.us.hub irc.Prison.NET) [01:33] *** ndizzie has joined #archiveteam-bs [01:33] *** johnny5 has joined #archiveteam-bs [01:33] *** dboard has quit IRC (Read error: Operation timed out) [01:33] *** ranma_ has quit IRC (Read error: Operation timed out) [01:33] *** TC01 has quit IRC (Read error: Operation timed out) [01:33] *** luckcolor has quit IRC (Read error: Operation timed out) [01:33] *** luckcolor has joined #archiveteam-bs [01:33] *** yakfish has quit IRC (Read error: Operation timed out) [01:34] *** wabu has quit IRC (Read error: Operation timed out) [01:34] *** TC01 has joined #archiveteam-bs [01:34] *** yakfish has joined #archiveteam-bs [01:34] *** atomicthu has quit IRC (Read error: Operation timed out) [01:34] *** jspiros has quit IRC (Read error: Operation timed out) [01:34] *** SadDM has quit IRC (Read error: Operation timed out) [01:34] *** acridAxid has quit IRC (Read error: Operation timed out) [01:34] *** balrog has quit IRC (Read error: Operation timed out) [01:34] *** eprillios has quit IRC (Read error: Operation timed out) [01:34] *** jtn2 has quit IRC (Read error: Operation timed out) [01:34] *** tapedrive has quit IRC (Read error: Operation timed out) [01:34] *** chfoo has quit IRC (Read error: Operation timed out) [01:34] *** swebb has quit IRC (Ping timeout: 246 seconds) [01:34] *** trs80 has quit IRC (Ping timeout: 246 seconds) [01:35] *** tapedrive has joined #archiveteam-bs [01:35] *** PotcFdk has quit IRC (Ping timeout: 246 seconds) [01:35] *** rocode has quit IRC (Ping timeout: 246 seconds) [01:35] *** eprillios has joined #archiveteam-bs [01:36] *** SpaffGarg has quit IRC (Read error: Operation timed out) [01:36] *** wabu has joined #archiveteam-bs [01:36] *** kyounko|2 has quit IRC (Read error: Operation timed out) [01:36] *** ndiddy has quit IRC (Ping timeout: 492 seconds) [01:36] *** johnny4 has quit IRC (Ping timeout: 492 seconds) [01:37] *** balrog has joined #archiveteam-bs [01:37] *** jtn2 has joined #archiveteam-bs [01:40] *** fusl has quit IRC (Read error: Operation timed out) [01:41] *** REiN^ has quit IRC (Read error: Operation timed out) [01:41] *** cf has quit IRC (Write error: Broken pipe) [01:41] *** TC01 has quit IRC (Read error: Operation timed out) [01:41] *** swebb has joined #archiveteam-bs [01:41] *** JAA has quit IRC (Read error: Operation timed out) [01:41] *** marvinw has quit IRC (Write error: Broken pipe) [01:42] *** chfoo has joined #archiveteam-bs [01:42] *** TC01 has joined #archiveteam-bs [01:42] *** dxrt has quit IRC (Read error: Operation timed out) [01:42] *** brayden has quit IRC (Read error: Connection reset by peer) [01:43] *** brayden has joined #archiveteam-bs [01:43] *** Mayonaise has quit IRC (Read error: Operation timed out) [01:43] *** dxrt has joined #archiveteam-bs [01:44] *** ranma_ has joined #archiveteam-bs [01:45] *** tfgbd_znc has quit IRC (Read error: Operation timed out) [01:45] *** htw has quit IRC (Ping timeout: 609 seconds) [01:45] *** cf has joined #archiveteam-bs [01:46] *** SpaffGarg has joined #archiveteam-bs [01:46] *** wp494 has quit IRC (Read error: Operation timed out) [01:46] *** wp494 has joined #archiveteam-bs [01:46] *** mundus201 has joined #archiveteam-bs [01:47] *** Petri152 has quit IRC (Write error: Broken pipe) [01:47] *** htw has joined #archiveteam-bs [01:47] *** Mayonaise has joined #archiveteam-bs [01:47] *** phuzion has quit IRC (Read error: Connection reset by peer) [01:47] *** acridAxid has joined #archiveteam-bs [01:48] *** atomicthu has joined #archiveteam-bs [01:48] *** SketchCow has quit IRC (Read error: Connection reset by peer) [01:48] *** mundus20- has quit IRC (Quit: ZNC - http://znc.in) [01:50] *** alfiepate has quit IRC (Ping timeout: 268 seconds) [01:50] *** tammy_ has quit IRC (Ping timeout: 268 seconds) [01:50] *** Aoede has quit IRC (Ping timeout: 268 seconds) [01:51] *** JensRex has quit IRC (Read error: Connection reset by peer) [01:51] *** rocode has joined #archiveteam-bs [01:51] *** alfie has joined #archiveteam-bs [01:51] *** phuzion has joined #archiveteam-bs [01:51] *** tfgbd_znc has joined #archiveteam-bs [01:51] *** bwn has quit IRC (Ping timeout: 268 seconds) [01:51] *** Simpbrain has quit IRC (Ping timeout: 268 seconds) [01:51] *** Hecatz has quit IRC (Ping timeout: 268 seconds) [01:51] *** Aoede has joined #archiveteam-bs [01:52] *** joepie91 has quit IRC (Ping timeout: 268 seconds) [01:52] *** fusl has joined #archiveteam-bs [01:53] *** bsmith093 has quit IRC (Ping timeout: 268 seconds) [01:53] *** marvinw has joined #archiveteam-bs [01:53] *** bwn has joined #archiveteam-bs [01:53] *** SketchCow has joined #archiveteam-bs [01:53] *** medowar has quit IRC (Ping timeout: 268 seconds) [01:54] *** dboard has joined #archiveteam-bs [01:54] *** JAA has joined #archiveteam-bs [01:55] *** mundus201 has quit IRC (Quit: ZNC - http://znc.in) [01:55] *** REiN^ has joined #archiveteam-bs [01:55] *** Petri152 has joined #archiveteam-bs [01:58] *** Hecatz has joined #archiveteam-bs [01:58] *** PotcFdk has joined #archiveteam-bs [01:58] *** joepie91 has joined #archiveteam-bs [02:03] *** Simpbrain has joined #archiveteam-bs [02:03] *** Hecatz has quit IRC (Ping timeout: 268 seconds) [02:06] *** medowar has joined #archiveteam-bs [02:07] *** Hecatz has joined #archiveteam-bs [02:07] *** JensRex has joined #archiveteam-bs [02:10] *** bsmith093 has joined #archiveteam-bs [02:15] *** ndizzie has quit IRC () [02:34] *** SadDM has joined #archiveteam-bs [02:35] *** jspiros has joined #archiveteam-bs [02:48] *** mundus201 has joined #archiveteam-bs [02:48] *** achip has joined #archiveteam-bs [03:04] *** mundus201 has quit IRC (west.us.hub irc.Prison.NET) [03:04] *** achip has quit IRC (west.us.hub irc.Prison.NET) [03:06] *** mundus20- has joined #archiveteam-bs [04:58] *** fie has joined #archiveteam-bs [05:13] *** dboard has quit IRC (Read error: Connection reset by peer) [05:14] *** dboard has joined #archiveteam-bs [05:25] *** trs80 has joined #archiveteam-bs [06:38] *** antomatic has quit IRC (Read error: Operation timed out) [07:21] *** Specular has joined #archiveteam-bs [07:23] is there any info on whether sli.mg was archived? I noticed some images were but since there's no wiki entry on it not sure if that was something done here or what [07:46] *** Gfy has quit IRC (Ping timeout: 250 seconds) [08:44] doubt it [08:44] did it go titsup? [08:53] *** schbirid2 has quit IRC (Quit: Leaving) [09:00] *** j08nY has joined #archiveteam-bs [09:06] *** Panasonic has quit IRC (Read error: Operation timed out) [09:07] *** GE has joined #archiveteam-bs [09:24] wp494, yeah. Was sometime near the start of the year I believe. [09:25] btw do archivists ever encounter issues from their ISPs when doing massive crawls? Or is it only the occasional issues with sites themselves? [09:26] I mean things like detecting copyrighted material or the bandwidth load and such [09:36] that's network neutrality there [09:39] *** schbirid has joined #archiveteam-bs [09:44] *** PurpleSym sets mode: +o swebb [09:44] *** swebb sets mode: +o SadDM [09:44] *** swebb sets mode: +o SketchCow [09:44] *** swebb sets mode: +o brayden [09:45] *** PurpleSym sets mode: +o arkiver [09:45] *** marvinw is now known as ivan [09:51] Specular: Ive had an issue before with an ISP being unhappy with the bandwidth usage on a crawling server [09:52] HCross2, did they do anything or was it just a warning? [09:52] Specular: they capped my port in the end [09:52] Specular: I've crawled on GCE and gotten my API project nuked from orbit with no warning. [09:52] oh.. and rang me at 6am to moan [09:52] I've crawled on online.net and OVH and never had an abuse@ forwarded to me. [09:52] *** antomatic has joined #archiveteam-bs [09:52] Specular: to be fair.. I was doing 100+TB a month on a 20 euro server [09:52] *** swebb sets mode: +o antomatic [09:53] Specular: online.net forced me to stop using 1gbit and upload no faster than my "guaranteed bandwidth" rate of 200mbit [09:53] ^ same here [09:54] ArchiveBot got one abuse@ email after it hit some bot trap linked to from brian krebs' blog [09:54] ivan: was it this? http://paste.nerds.io/reqasubevo.vhdl [09:54] HCross2: yeah, same thing [09:54] I moved to OVH about an hour later and not had an issue since [09:55] I fired up some scaleways :-) [09:55] they don't notice when the bandwidth is spread out over multiple scaleways [09:55] im paying triple what I was... but its worth it [10:02] what's the "os" in "warc.os.cdx"? [10:06] *** trs80 has quit IRC (Ping timeout: 246 seconds) [10:26] *** Stilett0 has joined #archiveteam-bs [10:29] *** Stiletto has quit IRC (Read error: Operation timed out) [10:39] *** BlueMaxim has quit IRC (Read error: Operation timed out) [10:44] *** Akiva has joined #archiveteam-bs [10:59] *** brayden has quit IRC (Read error: Connection reset by peer) [11:00] *** antomati_ has joined #archiveteam-bs [11:00] *** swebb sets mode: +o antomati_ [11:00] *** brayden has joined #archiveteam-bs [11:00] *** swebb sets mode: +o brayden [11:01] *** antomatic has quit IRC (Read error: Operation timed out) [11:05] *** antomatic has joined #archiveteam-bs [11:05] *** swebb sets mode: +o antomatic [11:05] *** antomati_ has quit IRC (Read error: Operation timed out) [11:11] *** antomatic has quit IRC (Ping timeout: 245 seconds) [11:16] *** antomatic has joined #archiveteam-bs [11:16] *** swebb sets mode: +o antomatic [12:02] *** brayden has quit IRC (Quit: Leaving) [12:03] *** trs80 has joined #archiveteam-bs [12:05] *** brayden has joined #archiveteam-bs [12:05] *** swebb sets mode: +o brayden [12:35] *** Stilett0 has quit IRC (Ping timeout: 246 seconds) [12:45] *** wabu_ has joined #archiveteam-bs [12:45] *** wabu has quit IRC (Read error: Connection reset by peer) [12:46] *** antomatic has quit IRC (Read error: Operation timed out) [12:50] *** GE has quit IRC (Remote host closed the connection) [13:03] *** antomatic has joined #archiveteam-bs [13:03] *** swebb sets mode: +o antomatic [13:05] *** antomati_ has joined #archiveteam-bs [13:05] *** swebb sets mode: +o antomati_ [13:07] *** antomatic has quit IRC (Ping timeout: 250 seconds) [13:09] *** antomati_ is now known as antomatic [13:53] *** GLaDOS has quit IRC (Remote host closed the connection) [13:56] *** GLaDOS has joined #archiveteam-bs [14:07] *** brayden has quit IRC (Read error: Connection reset by peer) [14:26] *** balrog has quit IRC (Read error: Operation timed out) [14:27] *** chazchaz has quit IRC (Read error: Operation timed out) [14:28] *** atlogbot has quit IRC (Read error: Operation timed out) [14:30] *** balrog has joined #archiveteam-bs [14:30] *** swebb sets mode: +o balrog [14:30] *** chazchaz has joined #archiveteam-bs [14:32] *** atlogbot has joined #archiveteam-bs [14:36] *** ndiddy has joined #archiveteam-bs [14:53] *** GE has joined #archiveteam-bs [15:08] *** Akiva has quit IRC (Remote host closed the connection) [15:10] *** Akiva has joined #archiveteam-bs [15:10] *** Akiva has quit IRC (Remote host closed the connection) [15:11] *** Akiva has joined #archiveteam-bs [15:49] *** Akiva has quit IRC (Ping timeout: 245 seconds) [15:56] *** pizzaiolo has joined #archiveteam-bs [16:06] *** dboard has quit IRC (Read error: Operation timed out) [16:06] *** SadDM has quit IRC (Read error: Operation timed out) [16:07] *** jspiros has quit IRC (Read error: Operation timed out) [16:07] *** trs80 has quit IRC (Ping timeout: 246 seconds) [16:52] *** pizzaiolo has quit IRC (Read error: Connection reset by peer) [17:07] *** SadDM has joined #archiveteam-bs [17:07] *** swebb sets mode: +o SadDM [17:07] *** jspiros has joined #archiveteam-bs [17:08] *** trs80 has joined #archiveteam-bs [17:10] *** dboard has joined #archiveteam-bs [17:57] *** pizzaiolo has joined #archiveteam-bs [18:12] *** Specular has quit IRC (Quit: Leaving) [18:45] *** icedice has joined #archiveteam-bs [19:16] *** Btrezz has quit IRC (Ping timeout: 250 seconds) [19:30] *** GE has quit IRC (Remote host closed the connection) [19:40] *** MrRadar has quit IRC (Quit: leaving) [19:44] *** MrRadar has joined #archiveteam-bs [19:51] *** icedice2 has joined #archiveteam-bs [19:54] *** icedice has quit IRC (Ping timeout: 245 seconds) [20:05] *** Simpbrain has quit IRC (Ping timeout: 245 seconds) [20:05] *** Simpbrain has joined #archiveteam-bs [20:11] *** GE has joined #archiveteam-bs [22:01] *** brayden has joined #archiveteam-bs [22:01] *** swebb sets mode: +o brayden [22:18] *** icedice2 has quit IRC (Quit: Leaving) [22:21] *** JensRex has quit IRC (Remote host closed the connection) [22:21] *** JensRex has joined #archiveteam-bs [22:33] *** BlueMaxim has joined #archiveteam-bs [23:19] *** schbirid has quit IRC (Quit: Leaving) [23:34] *** GE has quit IRC (Remote host closed the connection)