[00:11] *** lytv has quit IRC (Ping timeout: 258 seconds) [00:15] *** lytv has joined #archiveteam [00:22] *** mistym has quit IRC (Remote host closed the connection) [00:25] *** philpem has quit IRC (Ping timeout: 252 seconds) [00:32] *** BlueMaxim has quit IRC (Quit: Leaving) [00:35] *** lytv has quit IRC (Ping timeout: 306 seconds) [00:37] *** lytv has joined #archiveteam [00:37] *** RichardG has quit IRC (Read error: Connection reset by peer) [00:37] *** mistym has joined #archiveteam [00:44] *** RichardG has joined #archiveteam [00:50] *** BlueMaxim has joined #archiveteam [01:01] *** Start-mob has quit IRC (Remote host closed the connection) [01:01] *** Start-mob has joined #archiveteam [01:04] *** Start-mob has quit IRC (Remote host closed the connection) [01:11] *** atgnag has joined #archiveteam [01:12] So, for future reference, how do we prevent this from happening? https://web.archive.org/web/20150122193851im_/http://toic.org/media/attach/2012/reverse-ssh-port-forwarding/current.png [01:13] Explanation: Apparently cloudflare believes the Internet Archive's bot is hotlinking pictures when attempting to download them. [01:13] hmmmm [01:13] this merits investigation [01:14] Or, at least that's what happened at the time. [01:14] I think I'll see if I can reproduce it. [01:15] Also, does the Internet Archive bot also use wpull? [01:18] no they use their own [01:18] All right. [01:19] https://github.com/internetarchive/heritrix3 I believe [01:25] *** JesseW has joined #archiveteam [01:29] *** mistym has quit IRC (Remote host closed the connection) [01:30] *** mistym has joined #archiveteam [01:32] *** JesseW has quit IRC (Ping timeout: 255 seconds) [01:32] *** atgnag has quit IRC (Ping timeout: 240 seconds) [01:33] *** BlueMaxim has quit IRC (west.us.hub irc.eversible.com) [01:33] *** signius has quit IRC (west.us.hub irc.eversible.com) [01:33] *** zhongfu has quit IRC (west.us.hub irc.eversible.com) [01:33] *** Rickster has quit IRC (west.us.hub irc.eversible.com) [01:33] *** SN4T14_ has quit IRC (west.us.hub irc.eversible.com) [01:33] *** PepsiMax has quit IRC (west.us.hub irc.eversible.com) [01:33] *** Fusl has quit IRC (west.us.hub irc.eversible.com) [01:33] *** Famicoman has quit IRC (west.us.hub irc.eversible.com) [01:33] *** xmc has quit IRC (west.us.hub irc.eversible.com) [01:33] *** dan- has quit IRC (west.us.hub irc.eversible.com) [01:33] *** SN4T14 has joined #archiveteam [01:34] *** JesseW has joined #archiveteam [01:34] *** garyrh has quit IRC (Read error: Operation timed out) [01:34] *** useretail has quit IRC (Read error: Operation timed out) [01:35] *** SimpBrai1 has joined #archiveteam [01:36] *** bsmith093 has quit IRC (Read error: Operation timed out) [01:36] *** wyatt8740 has quit IRC (Read error: Operation timed out) [01:36] *** sivoais_ has joined #archiveteam [01:37] *** nico_32_ has joined #archiveteam [01:38] *** Froggypwn has quit IRC (Read error: Operation timed out) [01:38] *** bsmith093 has joined #archiveteam [01:38] *** laxity has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** SimpBrain has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** sivoais has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** db48x has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** Whisper_ has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** Kenshin has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** nico_32 has quit IRC (hub.efnet.us irc.Prison.NET) [01:38] *** sunnymilk has quit IRC (hub.efnet.us irc.Prison.NET) [01:39] *** mistym has quit IRC (Remote host closed the connection) [01:39] *** Froggypwn has joined #archiveteam [01:40] *** zhongfu_ has joined #archiveteam [01:41] *** mistym has joined #archiveteam [01:42] *** tephra_ has joined #archiveteam [01:42] *** Whisper has joined #archiveteam [01:42] *** daniel1 has joined #archiveteam [01:44] *** mistym has quit IRC (Remote host closed the connection) [01:44] *** signius has joined #archiveteam [01:44] *** Rickster has joined #archiveteam [01:44] *** PepsiMax has joined #archiveteam [01:44] *** Fusl has joined #archiveteam [01:44] *** Famicoman has joined #archiveteam [01:44] *** xmc has joined #archiveteam [01:44] *** dan- has joined #archiveteam [01:44] *** irc.eversible.com sets mode: +o xmc [01:44] *** swebb sets mode: +o xmc [01:45] *** RKenshin has joined #archiveteam [01:47] *** tephra has quit IRC (hub.se irc.underworld.no) [01:47] *** Aranje has quit IRC (hub.se irc.underworld.no) [01:47] *** Atluxity has quit IRC (hub.se irc.underworld.no) [01:47] *** raylee has quit IRC (hub.se irc.underworld.no) [01:47] *** wm_ has quit IRC (hub.se irc.underworld.no) [01:48] *** mistym has joined #archiveteam [01:49] *** useretail has joined #archiveteam [01:53] *** RKenshin is now known as Kenshin [01:54] DFJustin: thanks, will look [01:54] *** wm_ has joined #archiveteam [01:56] *** marvinw has quit IRC (Read error: Operation timed out) [01:56] *** ripvanwin has quit IRC (Read error: Operation timed out) [01:56] *** aMunster has quit IRC (Write error: Broken pipe) [01:57] *** sunnymilk has joined #archiveteam [01:58] *** marvinw has joined #archiveteam [02:00] *** aMunster has joined #archiveteam [02:00] *** Stiletto has joined #archiveteam [02:02] *** Stiletto has quit IRC (Client Quit) [02:02] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [02:02] *** Stiletto has joined #archiveteam [02:05] *** aMunster has quit IRC (Remote host closed the connection) [02:07] *** xtr-201 has quit IRC (Ping timeout: 370 seconds) [02:07] *** ripvanwin has joined #archiveteam [02:07] *** raylee has joined #archiveteam [02:08] *** zenguy_pc has joined #archiveteam [02:08] *** zenguy_pc has quit IRC (Excess Flood) [02:09] *** wyatt8740 has joined #archiveteam [02:10] *** aMunster has joined #archiveteam [02:18] *** McGEE has joined #archiveteam [02:35] *** mistym has quit IRC (Remote host closed the connection) [02:43] *** Mayonaise has quit IRC (Read error: Operation timed out) [02:45] *** lytv has quit IRC (Read error: Operation timed out) [02:45] *** ete_ has quit IRC (Read error: Connection reset by peer) [02:45] *** lytv has joined #archiveteam [02:50] *** Mayonaise has joined #archiveteam [03:00] *** mistym has joined #archiveteam [03:25] *** diacope has joined #archiveteam [03:36] *** xtr-201 has joined #archiveteam [03:36] *** JesseW has left [03:47] *** SimpBrai1 has quit IRC (Ping timeout: 306 seconds) [03:48] *** BlueMaxim has joined #archiveteam [04:31] *** aaaaaaaaa has quit IRC (Leaving) [04:36] *** garyrh has joined #archiveteam [04:49] *** Atluxity has joined #archiveteam [04:50] *** bzc6p_ has joined #archiveteam [04:50] *** swebb sets mode: +o bzc6p_ [04:56] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [05:37] *** McGEE has quit IRC (Quit: Connection closed for inactivity) [05:44] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [05:46] * BoBeR182 24[20Banshee 2.9 : 18playing24] 25The Light 20by 25test their logik 20on 25Be 24(25☆☆☆☆☆24) [06:09] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [06:12] *** Froggypwn has joined #archiveteam [06:12] *** GLaDOS has joined #archiveteam [06:23] BoBeR182: please stop advertising your music [06:24] kk [06:25] *** Rickster has quit IRC (Quit: ZNC - http://znc.in) [06:29] *** Rickster has joined #archiveteam [06:30] *** mistym has quit IRC (Remote host closed the connection) [06:31] *** mistym has joined #archiveteam [06:31] *** mistym has quit IRC (Remote host closed the connection) [06:39] *** sirdancea has quit IRC (Read error: Operation timed out) [06:42] *** Stilett0 has joined #archiveteam [06:45] *** Stiletto has quit IRC (Ping timeout: 370 seconds) [06:48] *** primus104 has joined #archiveteam [07:32] *** mistym has joined #archiveteam [07:41] *** Aranje has joined #archiveteam [07:47] *** mistym has quit IRC (Read error: Operation timed out) [07:47] *** Boltsie has joined #archiveteam [07:52] *** Aranje has quit IRC (Remote host closed the connection) [07:53] *** Aranje has joined #archiveteam [08:02] *** schbirid has joined #archiveteam [09:22] *** bzc6p_ is now known as bzc6p [10:05] *** primus104 has quit IRC (Leaving.) [10:46] *** Aranje has quit IRC (Ping timeout: 240 seconds) [10:59] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [10:59] *** Fusl has quit IRC (Ping timeout: 606 seconds) [11:01] *** koo5 has joined #archiveteam [11:11] *** mistym has joined #archiveteam [11:20] *** Fusl has joined #archiveteam [11:21] *** mistym has quit IRC (Read error: Operation timed out) [11:56] *** primus104 has joined #archiveteam [12:21] *** chazchaz has quit IRC (Read error: Operation timed out) [12:40] *** sankin has joined #archiveteam [12:55] *** sankin has quit IRC (Leaving.) [13:00] *** garyrh has quit IRC (Remote host closed the connection) [13:11] *** RichardG_ has joined #archiveteam [13:13] *** Stilett0 has quit IRC (Read error: Operation timed out) [13:13] *** sankin has joined #archiveteam [13:17] *** RichardG has quit IRC (Read error: Operation timed out) [14:00] *** Start has quit IRC (Disconnected.) [14:01] *** mistym has joined #archiveteam [14:15] *** mistym has quit IRC (Ping timeout: 840 seconds) [14:31] *** mistym has joined #archiveteam [14:38] *** Start has joined #archiveteam [14:42] *** mistym has quit IRC (Remote host closed the connection) [14:47] *** Stiletto has joined #archiveteam [14:48] Also get better music [14:54] i considered saying "your music sucks", but i refrained... glad i wasnt the only one. :D [14:58] *** mistym has joined #archiveteam [15:00] Yeah, impulse control isn't my thing on here [15:00] FOS is 48% full but mostly because I had to restart halo uploads. [15:12] *** koo5 has quit IRC (Read error: Operation timed out) [15:13] SketchCow: folks inquire how Pomf upload/waybacking is going [15:13] *** duder has joined #archiveteam [15:14] *** duder has quit IRC (Quit: Page closed) [15:16] *** Aranje has joined #archiveteam [15:19] *** chazchaz has joined #archiveteam [15:23] Folks need to calm the fuck down [15:24] I don't like that crowd, they don't understand us, and it's exhausting [15:24] A script has been shoving their crap into the wayback for a week. Ostensibly it will continue to. [15:26] *** garyrh has joined #archiveteam [15:28] I show 19 more 20gb compressed packs of emotionally stunted artwork left to be installed [15:47] *** McGEE has joined #archiveteam [15:50] *** Start has quit IRC (Disconnected.) [15:55] Also, congrats, shoving POMF into a single directory on POMF blew up the inodes so that's taking time to fix. [15:55] *** mistym has quit IRC (Remote host closed the connection) [15:58] *** Start has joined #archiveteam [16:11] *** mistym has joined #archiveteam [16:45] *** Start has quit IRC (Disconnected.) [16:48] *** SimpBrain has joined #archiveteam [16:54] *** schbirid2 has joined #archiveteam [16:59] *** philpem has joined #archiveteam [17:00] *** aaaaaaaaa has joined #archiveteam [17:00] *** swebb sets mode: +o aaaaaaaaa [17:01] *** schbirid has quit IRC (Read error: Operation timed out) [17:01] *** Mayonaise has quit IRC (Read error: Operation timed out) [17:05] *** Mayonaise has joined #archiveteam [17:17] *** habi has joined #archiveteam [17:22] *** bzc6p_ has joined #archiveteam [17:22] *** swebb sets mode: +o bzc6p_ [17:27] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [17:27] *** SN4T14 has quit IRC (Read error: Connection reset by peer) [17:28] *** SN4T14 has joined #archiveteam [17:42] *** signius has quit IRC (Remote host closed the connection) [17:50] *** bzc6p_ is now known as bzc6p [17:54] *** Emcy has quit IRC (Ping timeout: 265 seconds) [17:54] *** Start has joined #archiveteam [17:57] *** Start has quit IRC (Client Quit) [17:57] *** Start has joined #archiveteam [17:57] *** jmc_ has joined #archiveteam [17:59] *** jmc has quit IRC (Ping timeout: 370 seconds) [18:00] *** signius has joined #archiveteam [18:02] *** Start has quit IRC (Disconnected.) [18:07] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [18:07] *** Froggypwn has joined #archiveteam [18:11] * ersi_ pets FOS [18:37] *** lytv has quit IRC (Ping timeout: 606 seconds) [18:46] *** Emcy has joined #archiveteam [18:52] POMF uploads continuing, HALO uploads continuing [18:52] POMF ingestion ended. [18:52] Shenmue 3 has now surpassed two stretch goals [18:53] crazy how quick it got funded [18:53] not really, also why is sony just giving free money to kickstarter? [18:54] Well, it had an excellent announcement platform. [18:54] Sony is giving free money to kickstarter beause Sony is getting free money from fans that are greater amounts than even proe-orders [19:02] if studios want to do their own kickstarter type thing "We'll make this game once it reaches $x" and we'll forget all the stupid advertising budget, then lets do this. Also, to #archiveteam-bs ! [19:04] *** lytv has joined #archiveteam [19:17] *** McGEE has quit IRC (Quit: Connection closed for inactivity) [19:20] *** nertzy has quit IRC (Read error: Operation timed out) [19:35] *** SimpBrain has quit IRC (Ping timeout: 258 seconds) [20:00] *** habi has left [20:26] *** Morbus has quit IRC (Quit: http://www.disobey.com/) [20:27] *** schbirid2 has quit IRC (Quit: Leaving) [20:29] *** Morbus has joined #archiveteam [20:52] *** lytv has quit IRC (Read error: Connection reset by peer) [20:54] *** sankin has quit IRC (Leaving.) [20:55] ** Slow down HALO ingestion by, say, a third please [20:56] ok [20:57] it's at 8 per minute now [20:57] it was at 25 [21:05] By a third, not to a third [21:05] It was just a bit much while I clean up POMF and get through the backlog of halos [21:05] And I see sourceforge and lastfm are sort of starting [21:07] oops, it's now at 18 [21:14] *** goekesmi has quit IRC (Quit: leaving) [21:18] "Today, the ruling came out and it's a disaster. In short, websites can be declared liable for things people post in comments. As we explained last year, the details of the case were absolutely crazy. The court had found that even if a website took down comments after people complained, it could still be held liable because it should have anticipated bad comments in the first place." [21:18] https://www.techdirt.com/articles/20150616/11252831361/huge-loss-free-speech-europe-human-rights-court-says-sites-liable-user-comments.shtml [21:18] (AT relevance: this may very well result in a bunch of shit getting shut down... aside from just being overall fucked) [21:24] SketchCow: so I'd say full size of all podcasts (not hosted) on instacast is 8 to 13 TB [21:30] That's a lot. I think we should grab the metadata of instacast [21:30] Ok, we'll only do the metadata then [21:30] will do that with archivebot, too small for a project [21:30] I do agree "podcasts" as a project are worth it [21:31] Hmm. [21:31] Well, if we grabbed them as WARCs [21:31] Well, wait [21:31] This site just has a bit of everything [21:31] I'd say grab the metadata of instacast [21:31] Then we analyze it to get "a list of podcast sites out there" [21:32] And then archivebot the shit out of it over time [21:32] That seems smarter [21:32] Yes, let's do that [21:32] It might be a nice continuous warrior project? [21:33] Right [21:33] ok [21:33] Will grab it and get a list of sites ready, will probably put it somewhere on the wiki [21:34] *** nertzy has joined #archiveteam [21:34] I also just started a constant halo pump, so the system will put them in queue for the uploading to archive.org faster. [21:34] Maybe I can get us down in terms of disk space quicker [21:35] Sounds good, we'll need it for SourceForge [21:36] Grab scripts are pretty much ready, just testing some more to be sure [21:36] Scripts for git, svn, etc. are also almost ready [21:59] *** koo5 has joined #archiveteam [21:59] *** Pokeball9 has joined #archiveteam [21:59] Hello is anyone here,did yahoo kill this? [22:02] yahoo has not yet killed archiveteam [22:02] i'm sure they're working on it [22:03] *** lytv has joined #archiveteam [22:13] *** Stiletto has quit IRC (Read error: Operation timed out) [22:16] *** Riviera has joined #archiveteam [22:18] *** goekesmi has joined #archiveteam [22:22] *** RichardG has joined #archiveteam [22:25] *** ZeroDogg has joined #archiveteam [22:25] *** Nemo_bis_ has joined #archiveteam [22:25] *** dugo_ has joined #archiveteam [22:26] *** Zebranky_ has joined #archiveteam [22:27] *** lrkj_ has joined #archiveteam [22:27] *** Riviera_ has joined #archiveteam [22:28] *** Pokeball9 has quit IRC (Ping timeout: 240 seconds) [22:28] *** lhobas_ has joined #archiveteam [22:28] *** ersi_ has quit IRC (Remote host closed the connection) [22:28] *** RichardG_ has quit IRC (Remote host closed the connection) [22:28] *** Zero_Dogg has quit IRC (Write error: Connection reset by peer) [22:28] *** sivoais_ has quit IRC (Write error: Connection reset by peer) [22:28] *** nox has quit IRC (Write error: Connection reset by peer) [22:28] *** dugo has quit IRC (Write error: Connection reset by peer) [22:28] *** Nemo_bis has quit IRC (Write error: Connection reset by peer) [22:28] *** Zebranky has quit IRC (Write error: Connection reset by peer) [22:28] *** Fletcher has quit IRC (Read error: Connection reset by peer) [22:28] *** Rickster has quit IRC (Read error: Connection reset by peer) [22:28] *** lhobas has quit IRC (Read error: Connection reset by peer) [22:28] *** marvinw has quit IRC (Read error: Connection reset by peer) [22:28] *** Riviera has quit IRC (Read error: Connection reset by peer) [22:28] *** johtso has quit IRC (Read error: Connection reset by peer) [22:28] *** diacope has quit IRC (Read error: Connection reset by peer) [22:28] *** johtso has joined #archiveteam [22:28] *** Ctrl-S_ has joined #archiveteam [22:28] *** Riviera_ is now known as Riviera [22:28] *** deathy_ has joined #archiveteam [22:28] *** deathy_ has quit IRC (hub.se efnet.port80.se) [22:28] *** Ctrl-S_ has quit IRC (hub.se efnet.port80.se) [22:28] *** johtso has quit IRC (hub.se efnet.port80.se) [22:28] *** philpem has quit IRC (hub.se efnet.port80.se) [22:28] *** GLaDOS has quit IRC (hub.se efnet.port80.se) [22:28] *** daniel1 has quit IRC (hub.se efnet.port80.se) [22:28] *** balrog has quit IRC (hub.se efnet.port80.se) [22:28] *** Elegance has quit IRC (hub.se efnet.port80.se) [22:28] *** Sue_ has quit IRC (hub.se efnet.port80.se) [22:28] *** Muad-Dib has quit IRC (hub.se efnet.port80.se) [22:28] *** _bryan has quit IRC (hub.se efnet.port80.se) [22:28] *** Ctrl-S has quit IRC (hub.se efnet.port80.se) [22:28] *** russss__ has quit IRC (hub.se efnet.port80.se) [22:28] *** deathy has quit IRC (hub.se efnet.port80.se) [22:28] *** codl_ has quit IRC (hub.se efnet.port80.se) [22:28] *** kniffy has quit IRC (hub.se efnet.port80.se) [22:28] *** Kazzy has quit IRC (hub.se efnet.port80.se) [22:28] *** lrkj has quit IRC (hub.se efnet.port80.se) [22:28] *** Lord_Nigh has quit IRC (hub.se efnet.port80.se) [22:29] *** marvinw has joined #archiveteam [22:37] *** ersi has joined #archiveteam [22:37] *** swebb sets mode: +o ersi [22:39] *** nox has joined #archiveteam [22:41] *** Start has joined #archiveteam [22:54] *** Start has quit IRC (Disconnected.) [22:54] *** Start has joined #archiveteam [23:20] *** BlueMaxim has joined #archiveteam [23:34] *** kniffy has joined #archiveteam [23:51] *** pokeball9 has joined #archiveteam [23:54] *** Sue_ has joined #archiveteam [23:54] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [23:54] is anyone here help out a new archivist? im doing a 4chan-ish project,and need some pointers,but i am not really skill with programming/command line stuff [23:54] *** Froggypwn has joined #archiveteam [23:56] is this place ded then? [23:57] not at all [23:58] Not even. [23:58] oh ok,would u be able to help me out kniffy ? [23:58] sadly, no, i'm not a programmer :o [23:59] what is it you're trying to do