#archiveteam 2015-03-20,Fri

↑back Search

Time Nickname Message
00:21 πŸ”— bsmith093 has joined #archiveteam
00:22 πŸ”— bsmith093 iv'e never been very clear on this. if IA gets hit with a dmca for something, do they delete it or just dark it for a few decades?
00:23 πŸ”— bsmith093 SketchCow, yipdw
00:24 πŸ”— c_b2 has joined #archiveteam
00:27 πŸ”— c_b has quit IRC (Read error: Operation timed out)
00:27 πŸ”— c_b2 is now known as c_b
00:31 πŸ”— balrog bsmith093: dark it indefinitely, afaik
00:32 πŸ”— mistym has quit IRC (Remote host closed the connection)
00:34 πŸ”— goekesmi Based on some of the interviews, I get the impression that it might be available if you show up at the physical site.
00:36 πŸ”— godane has quit IRC (Quit: Leaving.)
00:37 πŸ”— xmc has joined #archiveteam
00:51 πŸ”— godane has joined #archiveteam
01:08 πŸ”— godane has quit IRC (Ping timeout: 370 seconds)
01:21 πŸ”— philpem has quit IRC (Ping timeout: 260 seconds)
02:03 πŸ”— godane has joined #archiveteam
02:10 πŸ”— ohhdemgir has quit IRC (Read error: Operation timed out)
02:11 πŸ”— ohhdemgir has joined #archiveteam
02:18 πŸ”— nertzy has quit IRC (Leaving)
02:23 πŸ”— nertzy has joined #archiveteam
02:35 πŸ”— c_b has quit IRC (Quit: c_b)
02:35 πŸ”— Ymgve has quit IRC ()
02:40 πŸ”— xmc has quit IRC (Quit: [X])
02:42 πŸ”— xmc has joined #archiveteam
02:51 πŸ”— primus104 has quit IRC (Leaving.)
02:52 πŸ”— schbirid has quit IRC (Read error: Operation timed out)
02:58 πŸ”— xmc has quit IRC (Quit: [X])
03:02 πŸ”— nertzy has quit IRC (Quit: This computer has gone to sleep)
03:02 πŸ”— schbirid has joined #archiveteam
03:30 πŸ”— xmc has joined #archiveteam
04:08 πŸ”— aaaaaaaaa has quit IRC (Leaving)
04:12 πŸ”— balrog has quit IRC (Ping timeout: 512 seconds)
04:44 πŸ”— jmathai has joined #archiveteam
04:45 πŸ”— jmathai Anyone around who can throttle one of the warriors?
04:50 πŸ”— jmathai If someone comes by that can…could you pause the warriors that are downloading from Trovebox? Our load balancers are returning a 500 β€œover capacity” error.
04:55 πŸ”— chfoo it was already paused for a while. the scripts went awry on some items
04:55 πŸ”— chfoo there isn't a remote kill switch unfortunately
04:57 πŸ”— yipdw "The warriors...can be programmed for exponential growth."
04:58 πŸ”— jmathai chfoo: so are they currently crawling the site?
04:59 πŸ”— jmathai A couple days ago Arkiver2 had cut them to 1/2 capacity for us
04:59 πŸ”— chfoo the tracker limit is to 0. nothing is supposed to be crawling right now
04:59 πŸ”— chfoo but we think some scripts are just stuck in a loop
05:00 πŸ”— chfoo until the process is oom killed or the warrior is rebooted
05:07 πŸ”— mistym has joined #archiveteam
05:09 πŸ”— jmathai chfoo: okay, thanks.
05:09 πŸ”— jmathai Hopefully tomorrow I can let Arkiver2 know to resume at a lower load.
05:11 πŸ”— chfoo jmathai: if the load keep going up, perhaps any request with "ArchiveTeam" user-agent should be served with 429 to get the scripts to quit. we can use a different user-agent knowing that you know it is not malicious
05:12 πŸ”— jmathai chfoo: thanks. good tip.
05:13 πŸ”— chfoo it feels weird suggesting a user-agent ban on archiveteam
05:14 πŸ”— xmc :/ :\ :/ :\
05:22 πŸ”— jmathai has quit IRC (Read error: Connection reset by peer)
05:41 πŸ”— BlueMaxim has quit IRC (Quit: Leaving)
05:43 πŸ”— balrog_ has joined #archiveteam
05:48 πŸ”— ersi sad trombone
05:49 πŸ”— Ctrl-S does the useragent have the script version in it?
05:49 πŸ”— Ctrl-S like ArchiveTeam-Warrior-STIENAME-DATESTAMP_OF_CODE
05:56 πŸ”— ersi All of the scripts are open and available at https://github.com/ArchiveTeam/
05:56 πŸ”— ersi so have a dig
06:01 πŸ”— Ctrl-S k
06:03 πŸ”— balrog_ is now known as balrog
06:03 πŸ”— SketchCow sets mode: +oooo antomatic balrog bsmith093 Cameron_D
06:03 πŸ”— SketchCow sets mode: +oooo closure Coderjoe dcmorton DFJustin
06:03 πŸ”— SketchCow sets mode: +oo chfoo xmc
06:03 πŸ”— Ctrl-S looks like this uses default wpull UA https://github.com/ArchiveTeam/example-wpull-seesaw-project/blob/master/pipeline.py
06:13 πŸ”— rejon has quit IRC (Read error: Operation timed out)
06:16 πŸ”— yipdw Ctrl-S: in general, no
06:16 πŸ”— yipdw well
06:17 πŸ”— yipdw a lot of the projects either imitate a browser user-agent or cycle through a list. some of them set user-agent to just "ArchiveTeam"
06:18 πŸ”— yipdw the pipeline version is often found in the first WARC record
06:19 πŸ”— yipdw typically the [PROJECT]-dld-script-version header
06:33 πŸ”— BlueMaxim has joined #archiveteam
07:08 πŸ”— mistym has quit IRC (Remote host closed the connection)
07:52 πŸ”— JMC has joined #archiveteam
07:53 πŸ”— BlueMaxim has quit IRC (Ping timeout: 512 seconds)
07:53 πŸ”— JMC hello?
07:53 πŸ”— BlueMaxim has joined #archiveteam
08:01 πŸ”— spacetom has joined #archiveteam
08:02 πŸ”— spacetom has left
08:02 πŸ”— ersi Hi??
08:17 πŸ”— Rotab ???
08:24 πŸ”— JMC ah, there we go
08:24 πŸ”— JMC so, weird question
08:25 πŸ”— JMC can I link to 4chan? It's not a "oh lol" kinf od stuff, but rather, I made a thread there.
08:25 πŸ”— JMC I can explain here... it will just take, you know, longer
08:26 πŸ”— Atluxity you can link to 4chan, but I can't open it for some hours as I at work
08:26 πŸ”— Atluxity *I'm
08:27 πŸ”— Ctrl-S what's the thread about?
08:27 πŸ”— JMC fair enough
08:27 πŸ”— JMC So, there used to be this things back in the early internet days called DeskMates. Some were dull, some were kind of hawt. They were done by a company named oska.
08:28 πŸ”— JMC http://i.4cdn.org/g/1426837548560s.jpg <- you know, the ones with this chick (SFW)
08:28 πŸ”— JMC Problem is, oska is gone and idiots had their demos downloading directly from their servers (which are now gone) so its impossible to download the demos, and that's what you need so a popular torrent that's still hanging around works. (won't link to the torrent because that's dum)
08:28 πŸ”— JMC Problem is, without the demos the torrent doesn't work.
08:28 πŸ”— JMC So, does anybody still has the original demo files somewhere, or knows where to get it? I know its a long shot, but it doesn't hurt to ask.
08:29 πŸ”— JMC The main problem is that there's a certain file called "Manager.exe" that apparently ran everything
08:29 πŸ”— JMC even if you get all the files, and the only working demo out there (Oska 2.0) the thing doesn't work.
08:30 πŸ”— JMC so, in my head, a solution might be to get ALL the files from the demo AND THEN go from there
08:30 πŸ”— JMC but, you know, this stuff is quite old (90s old) so...
08:30 πŸ”— JMC the thread pointed me here, actually
08:36 πŸ”— JMC I know its an INSANE longshot (and for equally insanely obscure stuff) but hey, why not? :P
08:41 πŸ”— Emcy_ has joined #archiveteam
08:43 πŸ”— Start has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— Emcy has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— xtr-201 has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— SadDM has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— Froggypwn has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— useretail has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— matthusby has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— Jonimus has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:43 πŸ”— will has quit IRC (ircd.shaw.ca irc.shaw.ca)
08:44 πŸ”— JMC yikes. Netsplit?
08:44 πŸ”— Rotab uhu
08:46 πŸ”— primus104 has joined #archiveteam
08:49 πŸ”— JMC anybody has any idea what I'm talking about, btw?
09:02 πŸ”— Start has joined #archiveteam
09:02 πŸ”— SadDM has joined #archiveteam
09:02 πŸ”— Froggypwn has joined #archiveteam
09:02 πŸ”— useretail has joined #archiveteam
09:02 πŸ”— matthusby has joined #archiveteam
09:02 πŸ”— Jonimus has joined #archiveteam
09:02 πŸ”— will has joined #archiveteam
09:03 πŸ”— JMC wb
09:26 πŸ”— primus104 has quit IRC (Leaving.)
10:16 πŸ”— schbirid has quit IRC (Read error: Operation timed out)
10:19 πŸ”— schbirid has joined #archiveteam
10:50 πŸ”— Ymgve has joined #archiveteam
10:50 πŸ”— BlueMaxim has quit IRC (Read error: Connection reset by peer)
10:51 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
10:54 πŸ”— dashcloud has joined #archiveteam
11:09 πŸ”— Morbus has quit IRC (Quit: http://www.disobey.com/)
11:14 πŸ”— Morbus has joined #archiveteam
11:42 πŸ”— joepie91_ JMC: there's no problem with linking to torrents here, or anything really :P
11:44 πŸ”— joepie91_ (in fact, you should probably make sure that the contents of the torrent are archived - torrents are not good archival media)
13:06 πŸ”— nox its a real bitch youtube keeps blocking ovh downloading of videos
13:06 πŸ”— nox want to keep everything on my box and now its a pain constantly
13:14 πŸ”— Rotab really, do they? :/
13:15 πŸ”— nox ya i get a captcha like all the time and never used to
13:16 πŸ”— nox see the problem on youtube-dl github issues page also
13:54 πŸ”— scyther has joined #archiveteam
14:04 πŸ”— VADemon has joined #archiveteam
14:15 πŸ”— johtso has joined #archiveteam
14:23 πŸ”— hive-mind has quit IRC (Ping timeout: 260 seconds)
14:35 πŸ”— mistym has joined #archiveteam
15:17 πŸ”— hive-mind has joined #archiveteam
15:40 πŸ”— swebb op please.
15:41 πŸ”— signius__ has quit IRC (Read error: Operation timed out)
15:43 πŸ”— DFJustin http://www.csmonitor.com/Books/chapter-and-verse/2015/0320/Vanuatu-asks-the-world-please-send-books
15:44 πŸ”— mistym has quit IRC (Remote host closed the connection)
15:50 πŸ”— signius__ has joined #archiveteam
15:57 πŸ”— mistym has joined #archiveteam
16:04 πŸ”— primus104 has joined #archiveteam
16:23 πŸ”— JMC joepie91_: here's what's going on in a nutshell
16:23 πŸ”— JMC http://boards.4chan.org/g/thread/47104359
16:30 πŸ”— JMC more specific info in the torrent right here:
16:30 πŸ”— JMC https://thepiratebay.se/torrent/3430667/
16:34 πŸ”— aaaaaaaaa has joined #archiveteam
17:19 πŸ”— mistym_ has joined #archiveteam
17:23 πŸ”— Arkiver2 is now known as arkiver
17:24 πŸ”— mistym has quit IRC (Read error: Operation timed out)
17:37 πŸ”— lag has joined #archiveteam
17:57 πŸ”— habi has joined #archiveteam
18:02 πŸ”— habi has left
18:13 πŸ”— Start arkiver: could you start on last.fm after we begin rapidshare discovery?
18:13 πŸ”— Start SketchCow mentioned that they'll be switching codebases in april, and that some user generated material may die
18:18 πŸ”— Stiletto has joined #archiveteam
18:25 πŸ”— arkiver last.fm going away?? O.o
18:25 πŸ”— arkiver ah ok
18:25 πŸ”— arkiver I'll get last.fm going
18:27 πŸ”— nertzy has joined #archiveteam
18:31 πŸ”— Ravenloft has joined #archiveteam
18:33 πŸ”— Rotab whoa, what?
18:34 πŸ”— Rotab oh
18:39 πŸ”— russss has quit IRC (Ping timeout: 260 seconds)
18:39 πŸ”— fresco___ has quit IRC (Ping timeout: 260 seconds)
19:03 πŸ”— nertzy has quit IRC (Quit: This computer has gone to sleep)
19:15 πŸ”— VADemon has quit IRC (Quit: left4dead)
19:17 πŸ”— VADemon has joined #archiveteam
19:29 πŸ”— lytv has quit IRC (Quit: Leaving)
19:39 πŸ”— lytv has joined #archiveteam
19:42 πŸ”— chfoo sets mode: +o swebb
19:42 πŸ”— swebb sets mode: +o SadDM
19:43 πŸ”— svchfoo1 has joined #archiveteam
19:43 πŸ”— chfoo sets mode: +o svchfoo1
19:45 πŸ”— russss has joined #archiveteam
19:45 πŸ”— fresco___ has joined #archiveteam
19:47 πŸ”— SN4T14__ has joined #archiveteam
19:48 πŸ”— godane has quit IRC (Ping timeout: 512 seconds)
19:54 πŸ”— SN4T14_ has quit IRC (Ping timeout: 512 seconds)
20:02 πŸ”— jmathai has joined #archiveteam
20:02 πŸ”— nertzy has joined #archiveteam
20:02 πŸ”— jmathai has quit IRC (Connection closed)
20:15 πŸ”— sandrine_ has joined #archiveteam
20:17 πŸ”— sandrine_ has quit IRC (Client Quit)
20:18 πŸ”— nertzy has quit IRC (Quit: This computer has gone to sleep)
20:29 πŸ”— godane has joined #archiveteam
20:35 πŸ”— mistym_ has quit IRC (Remote host closed the connection)
20:39 πŸ”— svchfoo2 has joined #archiveteam
20:39 πŸ”— chfoo sets mode: +o svchfoo2
20:43 πŸ”— schbirid has quit IRC (Leaving)
20:46 πŸ”— Peetz0r_ is now known as Peetz0r
21:00 πŸ”— BlueMaxim has joined #archiveteam
21:06 πŸ”— johtso has quit IRC (Quit: Connection closed for inactivity)
21:19 πŸ”— mistym has joined #archiveteam
21:33 πŸ”— Start has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— SadDM has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— Froggypwn has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— useretail has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— matthusby has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— Jonimus has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:33 πŸ”— will has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:35 πŸ”— Start has joined #archiveteam
21:35 πŸ”— SadDM has joined #archiveteam
21:35 πŸ”— Froggypwn has joined #archiveteam
21:35 πŸ”— useretail has joined #archiveteam
21:35 πŸ”— matthusby has joined #archiveteam
21:35 πŸ”— Jonimus has joined #archiveteam
21:35 πŸ”— will has joined #archiveteam
21:35 πŸ”— irc.shaw.ca sets mode: +o SadDM
21:35 πŸ”— swebb sets mode: +o SadDM
21:36 πŸ”— scyther has quit IRC (Leaving)
21:40 πŸ”— Start has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— SadDM has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— Froggypwn has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— useretail has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— matthusby has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— Jonimus has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:40 πŸ”— will has quit IRC (ircd.shaw.ca irc.shaw.ca)
21:47 πŸ”— MorbusIff has joined #archiveteam
21:50 πŸ”— RKenshin has joined #archiveteam
21:50 πŸ”— Morbus has quit IRC (hub.efnet.us irc.Prison.NET)
21:50 πŸ”— bsmith093 has quit IRC (hub.efnet.us irc.Prison.NET)
21:50 πŸ”— Zebranky has quit IRC (hub.efnet.us irc.Prison.NET)
21:50 πŸ”— Kenshin has quit IRC (hub.efnet.us irc.Prison.NET)
21:50 πŸ”— patrickod has quit IRC (hub.efnet.us irc.Prison.NET)
21:50 πŸ”— oli has quit IRC (hub.efnet.us irc.Prison.NET)
21:51 πŸ”— oli_ has joined #archiveteam
21:52 πŸ”— ben__ has joined #archiveteam
21:52 πŸ”— Start has joined #archiveteam
21:52 πŸ”— SadDM has joined #archiveteam
21:52 πŸ”— Froggypwn has joined #archiveteam
21:52 πŸ”— useretail has joined #archiveteam
21:52 πŸ”— matthusby has joined #archiveteam
21:52 πŸ”— Jonimus has joined #archiveteam
21:52 πŸ”— will has joined #archiveteam
21:52 πŸ”— irc.shaw.ca sets mode: +o SadDM
21:52 πŸ”— swebb sets mode: +o SadDM
21:54 πŸ”— Zebranky_ has joined #archiveteam
22:00 πŸ”— patricko- has joined #archiveteam
22:05 πŸ”— oli_ is now known as oli
22:06 πŸ”— RKenshin is now known as Kenshin
22:18 πŸ”— kyan has joined #archiveteam
22:38 πŸ”— Sanqui are there plans to archive the japanese geocities?
22:41 πŸ”— Start not that i'm aware of, although we probably should start soon
22:41 πŸ”— Start i'm somewhat amazed that yahoo hasn't killed it yet
22:42 πŸ”— Sanqui as a side note, does anybody know of a browser extension that helps see if a site is on archive.org?
22:43 πŸ”— Sanqui especially for 404s, parked domains, or just pure dead sites
22:55 πŸ”— patricko- is now known as patrickod
22:58 πŸ”— patrickod is now known as patricko-
22:58 πŸ”— patricko- is now known as patrickod
23:01 πŸ”— DFJustin yahoo japan is run pretty independently I think
23:04 πŸ”— patrickod is now known as patricko-
23:07 πŸ”— Sanqui you know what I've also been wanting for a long time? an extension that would warc every single page I visit
23:08 πŸ”— yipdw https://webrecorder.io/ is close
23:12 πŸ”— Sanqui yeah, but it's manual
23:12 πŸ”— Sanqui and also a proxy
23:14 πŸ”— ohhdemgir if you stretched out an average personοΏ½s skin over a football field, you would be arrested and no one would like you or trust you anymore
23:34 πŸ”— patricko- is now known as patrickod
23:40 πŸ”— primus_ has quit IRC (Quit: Leaving)
23:52 πŸ”— lag has quit IRC (Quit: Leaving)
irclogger-viewer