#archiveteam-bs 2017-07-26,Wed

↑back Search

Time Nickname Message
00:00 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
00:06 🔗 Stiletto has quit IRC ()
00:09 🔗 kristian_ has joined #archiveteam-bs
00:17 🔗 schbirid has quit IRC (Ping timeout: 255 seconds)
00:26 🔗 nyany has quit IRC (Leaving)
00:29 🔗 schbirid has joined #archiveteam-bs
00:30 🔗 Stiletti has joined #archiveteam-bs
00:31 🔗 Stiletti is now known as Stiletto
00:59 🔗 bitspill All of my Roblox workers are either on 500 errors or rsync max connections(120)
01:04 🔗 kristian_ has quit IRC (Quit: Leaving)
01:22 🔗 nyany has joined #archiveteam-bs
01:46 🔗 j08nY has quit IRC (Remote host closed the connection)
01:56 🔗 schbirid has quit IRC (Ping timeout: 255 seconds)
02:02 🔗 wp494 chfoo, any way you can nudge your rsync connection max up a bit
02:04 🔗 wp494 oh wait it's on FOS
02:04 🔗 wp494 nvm
02:04 🔗 wp494 I'm dumb
02:09 🔗 schbirid has joined #archiveteam-bs
02:16 🔗 kristian_ has joined #archiveteam-bs
02:19 🔗 TheLovina has quit IRC (Read error: Operation timed out)
02:20 🔗 TheLovina has joined #archiveteam-bs
02:36 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
02:37 🔗 ld1 has joined #archiveteam-bs
03:03 🔗 kristian_ has quit IRC (Quit: Leaving)
03:22 🔗 mundus201 http://www.archiveteam.org/ is returning 509
03:36 🔗 schbirid has quit IRC (Read error: Operation timed out)
03:48 🔗 schbirid has joined #archiveteam-bs
03:51 🔗 pizzaiolo has quit IRC (Quit: pizzaiolo)
03:53 🔗 wp494 wait a bit
03:53 🔗 wp494 try again
04:11 🔗 Stiletto has quit IRC ()
04:33 🔗 schbirid has quit IRC (Read error: Operation timed out)
04:45 🔗 schbirid has joined #archiveteam-bs
04:47 🔗 Sk1d has quit IRC (Ping timeout: 194 seconds)
04:52 🔗 Sk1d has joined #archiveteam-bs
05:03 🔗 mundus201 been nearly 2 hours now
05:51 🔗 schbirid has quit IRC (Ping timeout: 255 seconds)
06:04 🔗 schbirid has joined #archiveteam-bs
06:21 🔗 Honno has joined #archiveteam-bs
06:25 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
06:27 🔗 ld1 has joined #archiveteam-bs
06:28 🔗 Aoede Is there a channel for Roblox?
06:57 🔗 wp494 nope, this is it
06:57 🔗 Aoede okay, thanks
07:23 🔗 midas archiveteam, running out of bandwith sinds 2017 ;)
07:25 🔗 wp494 and rsync connections on FOS too
07:26 🔗 wp494 (BTW SketchCow, any chance of upping the limit a bit or is 120 all we're getting?)
08:02 🔗 midas that box is probably dying under that load anyway
08:05 🔗 wp494 possibly
08:05 🔗 wp494 might need another target that can handle much higher
08:22 🔗 j08nY has joined #archiveteam-bs
08:27 🔗 schbirid has quit IRC (Ping timeout: 255 seconds)
08:41 🔗 schbirid has joined #archiveteam-bs
08:44 🔗 tuluu has quit IRC (Ping timeout: 260 seconds)
09:14 🔗 kurt_ has quit IRC (Read error: Operation timed out)
09:14 🔗 Igloo_ has quit IRC (Read error: Operation timed out)
09:15 🔗 mgrytbak has quit IRC (Read error: Operation timed out)
09:15 🔗 tapedrive has quit IRC (Read error: Operation timed out)
09:16 🔗 tapedrive has joined #archiveteam-bs
09:16 🔗 kurt has joined #archiveteam-bs
09:16 🔗 Igloo has joined #archiveteam-bs
09:17 🔗 ItsYoda has quit IRC (Quit: rippppp to the yoda you used to know!)
09:17 🔗 mgrytbak has joined #archiveteam-bs
09:21 🔗 Hecatz has quit IRC (Ping timeout: 268 seconds)
09:23 🔗 ItsYoda has joined #archiveteam-bs
09:24 🔗 schbirid has quit IRC (Read error: Operation timed out)
09:25 🔗 Hecatz has joined #archiveteam-bs
09:34 🔗 zhongfu has quit IRC (Ping timeout: 260 seconds)
09:37 🔗 schbirid has joined #archiveteam-bs
09:38 🔗 Ravenloft has quit IRC (Ping timeout: 260 seconds)
09:38 🔗 zhongfu has joined #archiveteam-bs
09:55 🔗 schbirid2 has joined #archiveteam-bs
09:55 🔗 sun_shine has joined #archiveteam-bs
09:56 🔗 efsnable has joined #archiveteam-bs
09:57 🔗 sun_shine I'm interested in archiving a pyramid scheme's website
09:58 🔗 schbirid has quit IRC (Read error: Operation timed out)
09:59 🔗 sun_shine Said pyramid scheme has "virtual parties", the IDs of which are incremented integers. Over the past month the average is 1 party every 11.4 seconds.
10:00 🔗 sun_shine The URLs to archive follow a pattern like http://example.scam/{user_id}/party/{party_id}/view
10:02 🔗 sun_shine but a GET request to http://example.scam/party/{party_id}/view will return a 302 to the correct URL with the username
10:08 🔗 sun_shine My question is somewhat about whether this is worth pointing ArchiveBot at and then secondarily how to best handle either a range or just a list of URLs covering a given time period.
10:13 🔗 DFJustin has quit IRC (Ping timeout: 260 seconds)
10:14 🔗 DFJustin has joined #archiveteam-bs
10:14 🔗 swebb sets mode: +o DFJustin
10:16 🔗 BlueMaxim has quit IRC (Read error: Operation timed out)
10:16 🔗 BlueMaxim has joined #archiveteam-bs
10:26 🔗 bitBaron has quit IRC (Read error: Operation timed out)
10:27 🔗 ja0Hai has quit IRC (Ping timeout: 260 seconds)
10:27 🔗 ja0Hai has joined #archiveteam-bs
10:44 🔗 zhongfu has quit IRC (Ping timeout: 260 seconds)
10:45 🔗 zhongfu has joined #archiveteam-bs
10:51 🔗 zhongfu has quit IRC (Read error: Connection reset by peer)
10:52 🔗 zhongfu has joined #archiveteam-bs
11:02 🔗 midas you can add a list of urls using !archiveonly < https://www.example.com/some-file.txt
11:02 🔗 midas https://archivebot.readthedocs.io/en/latest/commands.html#archiveonly-file
11:04 🔗 midas cc sun_shine
11:17 🔗 sun_shine has quit IRC (Ping timeout: 245 seconds)
11:50 🔗 GLaDOS im working on bringing up another rsync target
11:59 🔗 j08nY has quit IRC (Quit: Leaving)
12:11 🔗 BlueMaxim has quit IRC (Quit: Leaving)
12:14 🔗 username1 has joined #archiveteam-bs
12:17 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
12:24 🔗 SketchCow 120 is about all we can do.
12:24 🔗 SketchCow That machine gets mega-hit all the time.
12:29 🔗 schbirid2 has joined #archiveteam-bs
12:30 🔗 username1 has quit IRC (Read error: Operation timed out)
12:48 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
12:49 🔗 ld1 has joined #archiveteam-bs
12:51 🔗 SketchCow My guy who usually gives me 10-15 new CD-ROMs with images every two weeks, stumbled on a collection of Russian Warez CDs.
12:51 🔗 SketchCow We already have a lot of Russian Warez CDs, but this one, Triada, is complete and massive.
12:52 🔗 SketchCow He has a stupid fast pipe to us, it's usually a case of uploading the materials pretty quickly.
12:52 🔗 SketchCow But he's been at it over a day and a half.
12:52 🔗 SketchCow 151 CDs and DVDs, and 180gb so far.
12:56 🔗 GLaDOS wow, that's pretty damn neat
13:25 🔗 TheLovina has quit IRC (Ping timeout: 1208 seconds)
13:35 🔗 Stiletti has joined #archiveteam-bs
13:42 🔗 Darkstar I remember there was a way to view the job log (derive tasks etc.) of an item that was uploaded to IA. anyone know which URL I need to reach this?
13:46 🔗 Darkstar it was a site with a couple tables with small, colored cells which contained links to the raw job logs etc. Maybe it was even external to archive.org, I'm not sure
13:55 🔗 midas nope, it's on the https://monitor.archive.org/ page
13:57 🔗 midas my bad, wrong box
13:58 🔗 username1 has joined #archiveteam-bs
14:00 🔗 midas but i think you might need admin rights for it
14:01 🔗 Darkstar no, I have definitely seen these logs for some of my uploads before
14:02 🔗 PurpleSym Darkstar: archive.org/history/<item> ?
14:02 🔗 midas got a link to your upload?
14:02 🔗 Darkstar yes, exactly. thanks @PurpleSym!
14:03 🔗 midas the only one i know is https://catalogd.archive.org/ :x
14:05 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
14:05 🔗 username1 has quit IRC (Read error: Operation timed out)
14:08 🔗 schbirid has joined #archiveteam-bs
14:08 🔗 Stiletto has joined #archiveteam-bs
14:11 🔗 Stiletti has quit IRC (Ping timeout: 260 seconds)
14:21 🔗 mls I'll drop some concurrent on Roblox until another rsync target becomes available
14:24 🔗 Darkstar Hm, who is this Jeff Kaplan and why does he mark perfectly valid KryoFlux dumps on archive.org as "spam"? ;-)
14:24 🔗 Darkstar (not my upload though, so I'm probably not the right person to contact him about it)
14:25 🔗 efsnable dorkstar
14:26 🔗 midas Jeff is the dude @ archive.org
14:27 🔗 efsnable hi midas
14:27 🔗 efsnable remember me
14:28 🔗 efsnable u lesbo freak
14:28 🔗 Darkstar midas: "the dude"? I thought that's Jason :)
14:29 🔗 midas efsnable: no, should i?
14:29 🔗 GLaDOS i think we have a soundcloud employee in here..
14:30 🔗 GLaDOS or that guy that runs/ran twitpic
14:30 🔗 GLaDOS can't tell, they're all so, so angry
14:30 🔗 midas oh yeah the twitpic dude, he was really angry
14:30 🔗 midas i liked him
14:31 🔗 efsnable im gay
14:32 🔗 midas i don't care what you are.
14:32 🔗 efsnable i sell weed to elementary school kids
14:32 🔗 midas i dont care what you do either
14:33 🔗 efsnable they caught me
14:33 🔗 efsnable im going to prison soon
14:33 🔗 efsnable for 5 years
14:33 🔗 midas ok
14:33 🔗 efsnable midas r u a chick ?
14:34 🔗 efsnable can i suck u
14:35 🔗 yipdw sets mode: +b *!bossgt100@70.39.109.163
14:35 🔗 efsnable was kicked by yipdw (efsnable)
14:37 🔗 mls Aw I'm too late with the popcorn
14:37 🔗 * mls *sulks*
14:42 🔗 midas ty yipdw
14:43 🔗 kittymeow has joined #archiveteam-bs
14:43 🔗 DFJustin Darkstar: I poked jason
14:44 🔗 kittymeow Does anyone know a good way of archiving a page that needs a login/cookie with an external site like archive.is or webcitation or wayback
14:44 🔗 DFJustin kaplan is an (the only?) admin who has to go through all the tons of crap coming in daily, sometimes he makes a mistake
14:45 🔗 Darkstar DFJustin: thanks. this is about samna-ami-kryoflux by the way. I didn't realize that there is actually a real person sifting through all the uploads all day long :)
14:45 🔗 kittymeow Where sure a single person logged on can save it, but then there's no way to know if that person edited the page they archived to add or change stuff
14:45 🔗 kittymeow so it'd be really good if there was anything like that that would act as a proxy or something and then archive it
14:46 🔗 kittymeow While you are logged in
14:47 🔗 DFJustin hmm can https://webrecorder.io/ do that? (I haven't tried)
14:48 🔗 kittymeow example https://register.thesecretworld.com/account/paidservice/ctrl/offer the whole of the http://tswshop.funcom.com site is only visible while logged in, but it contains prices
14:48 🔗 kittymeow thanks I'll try
14:50 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
14:51 🔗 ld1 has joined #archiveteam-bs
14:52 🔗 kittymeow "Webrecorder MaintenanceWebrecorder is being upgraded!Please come back soon!" :(
14:52 🔗 yipdw you can run it on your own computers
14:53 🔗 yipdw https://github.com/webrecorder/webrecorder
14:54 🔗 godane has quit IRC (Quit: Leaving.)
14:54 🔗 PurpleSym sets mode: +o midas
14:55 🔗 kittymeow I use https://addons.mozilla.org/addon/scrapbook for stuff like that it's really good.. but the point is if it's on client side instead of a remote site, it's hard to prove with controversial or money related stuff that the person archiving it didn't edit it before sharing the archive files
14:59 🔗 qw3rty3 has joined #archiveteam-bs
15:03 🔗 kittymeow This could apply to a lot of politiucal stuff on facebook etc too, more and more stuff is locked behind "you need an account to view this" as corporations get more confident of a monpoly that they know people will feel forced to do it
15:04 🔗 Zebranky has quit IRC (Ping timeout: 633 seconds)
15:04 🔗 Zebranky has joined #archiveteam-bs
15:07 🔗 GLaDOS oh boy, instantly the uploads start
15:08 🔗 schbirid has quit IRC (Read error: Operation timed out)
15:11 🔗 mls GLaDOS: Oh so you've noticed eh? ;-)
15:11 🔗 GLaDOS well the second i added combine harvester as a target, about 150 pipelines connected
15:12 🔗 mls Isn't there a round robin or load balancing thingamabob?
15:13 🔗 GLaDOS there is in the tracker, but it only works if there's more than one target
15:13 🔗 GLaDOS before it was only FOS
15:14 🔗 mls Ah right, I see now (actually paying attention to the wall of text)
15:14 🔗 GLaDOS so hopefully that should keep things smooth
15:14 🔗 Jonimus kittymeow: actually I think https://www.taricorp.net/2016/web-history-warc/ this might be interesting to you, it uses your firefox cookies to get data from sites that require login.
15:16 🔗 mls I don't know what the current threshold is on the tracker, but I have a guess it's enough to congest both rsync targets like easy looking at the avg upload size
15:16 🔗 GLaDOS well right now the limit is at 150 items/minute, i'm not sure why it's set at that so i'm leaving it
15:17 🔗 GLaDOS may i suggest #robloxd
15:18 🔗 mls By all means
15:21 🔗 Stiletto has quit IRC ()
15:22 🔗 schbirid has joined #archiveteam-bs
15:24 🔗 schbirid2 has joined #archiveteam-bs
15:26 🔗 schbirid has quit IRC (Read error: Operation timed out)
15:27 🔗 ld1 JAA: Lots of `.woff` are being pulled. Maybe doubles that could be left out.
15:28 🔗 ld1 cc arkiver
15:31 🔗 qw3rty3 has quit IRC (Nettalk6 - www.ntalk.de)
15:34 🔗 schbirid2 has quit IRC (Ping timeout: 255 seconds)
15:40 🔗 pizzaiolo has joined #archiveteam-bs
15:41 🔗 pizzaiolo has left
15:46 🔗 schbirid2 has joined #archiveteam-bs
15:50 🔗 Stiletti has joined #archiveteam-bs
15:52 🔗 godane has joined #archiveteam-bs
15:52 🔗 svchfoo1 sets mode: +o godane
16:10 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
16:10 🔗 ld1 has joined #archiveteam-bs
16:36 🔗 Stiletti is now known as Stiletto
17:02 🔗 username1 has joined #archiveteam-bs
17:06 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
17:18 🔗 xmc also i pay an unknowable amount of money to host the tracker and a few archivebot pipelines :)
17:20 🔗 SketchCow Huzzah
17:23 🔗 Retroity has joined #archiveteam-bs
17:31 🔗 pizzaiolo has joined #archiveteam-bs
17:32 🔗 Retroity has quit IRC (Quit: Page closed)
17:45 🔗 ReimuHaku has quit IRC (Ping timeout: 250 seconds)
17:51 🔗 ReimuHaku has joined #archiveteam-bs
17:57 🔗 ReimuHaku has quit IRC (Ping timeout: 245 seconds)
18:03 🔗 ReimuHaku has joined #archiveteam-bs
18:14 🔗 ndiddy-pi has joined #archiveteam-bs
18:14 🔗 ndiddy has quit IRC (Read error: Connection reset by peer)
18:14 🔗 ndiddy-pi is now known as ndiddy
18:17 🔗 ReimuHaku has quit IRC (Ping timeout: 245 seconds)
18:19 🔗 RichardG has quit IRC (Ping timeout: 370 seconds)
18:22 🔗 ReimuHaku has joined #archiveteam-bs
18:29 🔗 Aranje has joined #archiveteam-bs
19:02 🔗 ld1_ has joined #archiveteam-bs
19:05 🔗 ld1 has quit IRC (Ping timeout: 260 seconds)
19:13 🔗 ld1_ is now known as ld1
20:24 🔗 username1 has quit IRC (Ping timeout: 255 seconds)
20:26 🔗 balrog has quit IRC (Ping timeout: 260 seconds)
20:37 🔗 username1 has joined #archiveteam-bs
20:44 🔗 username1 has quit IRC (Quit: Leaving)
20:45 🔗 Stiletto has quit IRC (Read error: Operation timed out)
21:27 🔗 godane has quit IRC (Ping timeout: 260 seconds)
21:40 🔗 godane has joined #archiveteam-bs
21:41 🔗 svchfoo1 sets mode: +o godane
22:18 🔗 svchfoo3 has quit IRC (Quit: Closing)
22:25 🔗 RichardG has joined #archiveteam-bs
22:39 🔗 SilSte has quit IRC (Read error: Operation timed out)
22:50 🔗 SilSte has joined #archiveteam-bs
22:54 🔗 Silvan has joined #archiveteam-bs
22:54 🔗 Silvan has quit IRC (Read error: Connection reset by peer)
22:55 🔗 SilSte has quit IRC (Read error: Operation timed out)
23:01 🔗 SilSte has joined #archiveteam-bs
23:24 🔗 ranma "Anyways.. while I know the MAME effort has been going on a long time, and in most cases they have been left alone by the original manufacturer/IP Rights Holder, they really need to be careful with what they're doing now; these manufaturers still have big legal departments, are more than willing to go for the throat, and companies like Namco and Nintendo in particular don't fool around
23:24 🔗 ranma with this stuff. Copying ROMs is one thing, but when you're cracking the custom ASICs and other security devices they designed into the game hardware to prevent more or less what they're actually trying to do? That's one step away from producing knock-offs of the actual game. It's been a long time since I was involved in the coin-op game industry, but I'm sure that there are still plenty
23:24 🔗 ranma of countries that would welcome with open arms even arcade games from 10 to 20 years ago, being better than what they have right now."
23:25 🔗 ranma i hope those rippers are at least doing a minimal job to stay anonymous
23:25 🔗 ranma from https://arstechnica.com/gaming/2017/07/mame-devs-are-cracking-open-arcade-chips-to-get-around-drm/
23:26 🔗 ranma nothing pisses me off more than when, say, a ROM translation or fan project reskinning/new content creators get shut down with a C & D
23:26 🔗 ranma because they didn't even like try to stay anonymous
23:49 🔗 zyphlar has joined #archiveteam-bs
23:59 🔗 Odd0002 has joined #archiveteam-bs

irclogger-viewer