#archiveteam-bs 2018-11-11,Sun

↑back Search

Time Nickname Message
00:10 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
00:15 πŸ”— Sk1d has joined #archiveteam-bs
00:23 πŸ”— Smiley has joined #archiveteam-bs
00:27 πŸ”— logchfoo2 starts logging #archiveteam-bs at Sun Nov 11 00:27:07 2018
00:27 πŸ”— logchfoo2 has joined #archiveteam-bs
00:27 πŸ”— unlobito has quit IRC (Read error: Operation timed out)
00:27 πŸ”— unlobito has joined #archiveteam-bs
00:27 πŸ”— PhrackD has quit IRC (Read error: Operation timed out)
00:28 πŸ”— arkiver has joined #archiveteam-bs
00:28 πŸ”— svchfoo1 sets mode: +o arkiver
00:28 πŸ”— Jusque has quit IRC (Read error: Operation timed out)
00:29 πŸ”— qw3rty116 has quit IRC (Read error: Operation timed out)
00:30 πŸ”— wacky has joined #archiveteam-bs
00:31 πŸ”— twoTBHetz all my stuff is in here https://honeypot.xn--schg-noa.de/workspace.zip
00:31 πŸ”— Flashfire I am suspicious of that url........
00:32 πŸ”— JAA Mmhm, a honeypot.
00:32 πŸ”— twoTBHetz well it was an unused url i have certificates for
00:33 πŸ”— Jusque has joined #archiveteam-bs
00:33 πŸ”— twoTBHetz i am still very much in panic mode
00:33 πŸ”— twoTBHetz because the way i was blocked
00:35 πŸ”— twoTBHetz if somebody could talk with me about his experience pissing of some hoster and what happened it might help me sleep
00:35 πŸ”— twoTBHetz will i end in prison?
00:35 πŸ”— Flashfire I scammed nokia out of over $1000 and I sleep fine
00:35 πŸ”— Flashfire You bruteforced a website
00:35 πŸ”— Flashfire dont be scared
00:36 πŸ”— twoTBHetz the way they blocked me spockedd me out
00:38 πŸ”— twoTBHetz almost all servers with an name larger than koumpilaw.com ignored me suddenly the ones smalles were fine
00:38 πŸ”— Ravenloft has joined #archiveteam-bs
00:38 πŸ”— Flashfire Were you using a home IP?
00:38 πŸ”— twoTBHetz nope Hetzner
00:38 πŸ”— Flashfire Then chill
00:38 πŸ”— twoTBHetz and a physical machine
00:39 πŸ”— astrid happens all the time
00:39 πŸ”— twoTBHetz with an reverse dns wich resolves to my last name
00:39 πŸ”— astrid you'll be okay
00:39 πŸ”— twoTBHetz xn--schg-noa.de is my last name hehe
00:39 πŸ”— Flashfire lol
00:39 πŸ”— Flashfire You will be fine
00:39 πŸ”— twoTBHetz it resolves to schΓ€g(.de)
00:39 πŸ”— JAA Yeah, don't worry about it.
00:39 πŸ”— twoTBHetz Great wheew
00:44 πŸ”— twoTBHetz i also made a graph of prograss1 1/2 hours in
00:45 πŸ”— twoTBHetz http://i.imgur.com/auhQ5GD.png
00:49 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
00:50 πŸ”— twoTBHetz nice linear graph of 500 discovered endangered pages per minute then little bump because i ran s second download with 1000 parallel connections, i think that is when they cared. 13 minutes later flatliner. The descreasing in progress is an artefact of my counting + parrallel downloading
00:55 πŸ”— Sk1d has joined #archiveteam-bs
00:58 πŸ”— Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805])
01:01 πŸ”— Pixi has quit IRC (Read error: Operation timed out)
01:04 πŸ”— fredgido has quit IRC (Read error: Connection reset by peer)
01:04 πŸ”— Odd0002_ has joined #archiveteam-bs
01:07 πŸ”— Pixi has joined #archiveteam-bs
01:08 πŸ”— Dimtree has joined #archiveteam-bs
01:08 πŸ”— fredgido has joined #archiveteam-bs
01:10 πŸ”— Fusl_ has quit IRC (Ping timeout: 600 seconds)
01:10 πŸ”— Fusl_ has joined #archiveteam-bs
01:11 πŸ”— twoTBHetz Flashfire, how did you learn that they did verify cards back then
01:11 πŸ”— Odd0002 has quit IRC (Ping timeout: 600 seconds)
01:11 πŸ”— Odd0002_ is now known as Odd0002
01:11 πŸ”— Flashfire Emails saying that my payments were overdue when I occasionally checked the dumped emails
01:15 πŸ”— RedType has joined #archiveteam-bs
01:15 πŸ”— twoTBHetz i can ifewith this detail i can infer the story
01:16 πŸ”— fredgido has quit IRC (Read error: Connection reset by peer)
01:16 πŸ”— sknebel has quit IRC (Read error: Connection reset by peer)
01:16 πŸ”— sknebel has joined #archiveteam-bs
01:17 πŸ”— twoTBHetz Flashfire, that story kinda makes me sad. What will be left to hack for our childreen?
01:18 πŸ”— fredgido has joined #archiveteam-bs
01:20 πŸ”— PotcFdk has joined #archiveteam-bs
01:20 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
01:21 πŸ”— kyounko has quit IRC (Ping timeout: 492 seconds)
01:21 πŸ”— wmvhater has joined #archiveteam-bs
01:21 πŸ”— qw3rty116 has joined #archiveteam-bs
01:22 πŸ”— squires has joined #archiveteam-bs
01:22 πŸ”— JTL has joined #archiveteam-bs
01:22 πŸ”— TigerbotH has joined #archiveteam-bs
01:22 πŸ”— PhrackD has joined #archiveteam-bs
01:22 πŸ”— REiN^ has joined #archiveteam-bs
01:22 πŸ”— kiska1 has joined #archiveteam-bs
01:22 πŸ”— Albardin has joined #archiveteam-bs
01:24 πŸ”— Sk1d has joined #archiveteam-bs
01:28 πŸ”— sep332 has joined #archiveteam-bs
01:30 πŸ”— fredgido has quit IRC (Read error: Connection reset by peer)
01:35 πŸ”— fredgido has joined #archiveteam-bs
01:37 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
01:39 πŸ”— VerifiedJ has quit IRC (Quit: Leaving)
01:40 πŸ”— Sk1d has joined #archiveteam-bs
01:47 πŸ”— twoTBHetz the fools unblocked me i let it run over night
01:47 πŸ”— JAA twoTBHetz: It's probably just an automated system which is triggered by a rate limit and bans those IPs for 24 hours or whatever.
01:52 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
01:57 πŸ”— Sk1d has joined #archiveteam-bs
02:03 πŸ”— twoTBHetz JAA tomorow morning will upload my last contribution to this project and be off for a while .. i did spend way to much time on this this week.
02:05 πŸ”— twoTBHetz you are a nice crowd
02:05 πŸ”— JAA twoTBHetz: Nice. Can you write up a summary of what you've done and how far you got so far? There has been discussion about this in different channels, revised URL lists, etc...
02:05 πŸ”— twoTBHetz mhh yes when somebody else gets it in to the wiki.
02:07 πŸ”— twoTBHetz the zip i posted contains all the logs but i understand why you dono want to parse that.
02:08 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
02:08 πŸ”— twoTBHetz JAA is there a fixed form/template or do you just want some rambling summary
02:09 πŸ”— JAA twoTBHetz: Rambling is fine as long as it's more or less coherent. :-)
02:10 πŸ”— twoTBHetz is LISP (programming lanugage) seen as coherent here
02:10 πŸ”— twoTBHetz ;)
02:12 πŸ”— JAA Coherent and unreadable ;-)))))
02:13 πŸ”— Sk1d has joined #archiveteam-bs
02:16 πŸ”— twoTBHetz you are gonne have some fun
02:21 πŸ”— Martle_ is now known as Martle
02:22 πŸ”— twoTBHetz JAA submission via transfer.sh?
02:26 πŸ”— JAA twoTBHetz: Sure, whatever you prefer.
02:32 πŸ”— jodizzle betamax: I wrote a scraper for https://vote-usa.org/forresearch.aspx to try and get more midterm stuff. The site seems like a goldmine, it's well structured and it has social media and website links for candidates in all US states across multiple elections, sometimes down to the county level.
02:33 πŸ”— jodizzle Pretty big historical archive too, it seems to go back to 2004.
02:33 πŸ”— jodizzle Currently I'm snscraping a whole bunch of twitters. I'll update the wiki about all this at some point.
02:50 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
02:51 πŸ”— Ryz has joined #archiveteam-bs
02:55 πŸ”— Sk1d has joined #archiveteam-bs
03:11 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
03:15 πŸ”— Sk1d has joined #archiveteam-bs
03:30 πŸ”— Flashback has quit IRC (Ping timeout: 265 seconds)
03:30 πŸ”— kiskabak has quit IRC (Ping timeout: 265 seconds)
03:30 πŸ”— kiskabak has joined #archiveteam-bs
03:30 πŸ”— Stilett0 has joined #archiveteam-bs
03:32 πŸ”— Stiletto has quit IRC (Read error: Operation timed out)
03:32 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
03:32 πŸ”— Flashback has joined #archiveteam-bs
03:35 πŸ”— Sk1d has joined #archiveteam-bs
03:48 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
03:51 πŸ”— Sk1d has joined #archiveteam-bs
04:03 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
04:08 πŸ”— Sk1d has joined #archiveteam-bs
04:24 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
04:28 πŸ”— Sk1d has joined #archiveteam-bs
04:39 πŸ”— qw3rty117 has joined #archiveteam-bs
04:45 πŸ”— qw3rty116 has quit IRC (Read error: Operation timed out)
04:54 πŸ”— odemg has quit IRC (Ping timeout: 260 seconds)
05:01 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
05:05 πŸ”— Sk1d has joined #archiveteam-bs
05:07 πŸ”— odemg has joined #archiveteam-bs
05:13 πŸ”— Ravenloft has quit IRC (Read error: Connection reset by peer)
05:18 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
05:23 πŸ”— Sk1d has joined #archiveteam-bs
05:34 πŸ”— dashcloud has quit IRC (Ping timeout: 252 seconds)
05:34 πŸ”— dashcloud has joined #archiveteam-bs
05:36 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
05:38 πŸ”— Sk1d has joined #archiveteam-bs
05:43 πŸ”— Ryz Any links on archiving Defy Media content as per #archiveteam ?
05:47 πŸ”— Ryz Defy Media has: http://www.break.com/ - http://www.mademan.com/ - http://addictinggames.com/ - http://www.shockwave.com - there's also the website itself http://defymedia.com/
05:50 πŸ”— Martle I'm going to get started on their YouTube presence.
05:55 πŸ”— Mayonaise has quit IRC (Read error: Operation timed out)
05:55 πŸ”— ivan has quit IRC (Read error: Operation timed out)
05:55 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
05:55 πŸ”— JAA has quit IRC (Read error: Operation timed out)
05:55 πŸ”— balrog has quit IRC (Read error: Operation timed out)
05:55 πŸ”— zyphlar has quit IRC (Read error: Operation timed out)
05:55 πŸ”— jspiros has quit IRC (Read error: Operation timed out)
05:56 πŸ”— Petri152 has quit IRC (Ping timeout: 246 seconds)
05:56 πŸ”— ivan has joined #archiveteam-bs
05:57 πŸ”— svchfoo1 has quit IRC (Ping timeout: 246 seconds)
05:57 πŸ”— Sk1d has joined #archiveteam-bs
05:57 πŸ”— c4rc4s has quit IRC (Read error: Operation timed out)
05:58 πŸ”— balrog has joined #archiveteam-bs
05:58 πŸ”— swebb sets mode: +o balrog
05:58 πŸ”— Stilett0 has quit IRC (Read error: Operation timed out)
05:59 πŸ”— Stiletto has joined #archiveteam-bs
06:11 πŸ”— Mayonaise has joined #archiveteam-bs
06:11 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
06:13 πŸ”— davidar has joined #archiveteam-bs
06:15 πŸ”— eientei95 Ryz: Should we be also doing bot stuff regarding https://en.wikipedia.org/wiki/Category:Television_channels_and_stations_disestablished_in_2018 https://en.wikipedia.org/wiki/Category:Television_channels_and_stations_disestablished_in_2019 etc.?
06:16 πŸ”— Sk1d has joined #archiveteam-bs
06:16 πŸ”— Ryz Yeah, that sounds archive-worthy, I don't run the bot responsible for making the lists though~
06:17 πŸ”— Ryz Speaking of bot stuff, I wanna do something like...products that are discontinued or something
06:18 πŸ”— Ryz Well not 'do something', more like a bot suggestion
06:22 πŸ”— Ryz !archive http://www.irene-hilda.com/ --explain "https://www.archiveteam.org/index.php?title=Deaths_in_2015"
06:22 πŸ”— Ryz Whoops
06:28 πŸ”— eientei95 Yeah, that'd be cool
06:28 πŸ”— eientei95 WHo runs the bot anyway...
06:28 πŸ”— Flashfire Voynichcr
06:33 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
06:36 πŸ”— Sk1d has joined #archiveteam-bs
06:48 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
06:50 πŸ”— eientei95 Ryz: To curate a game needs a metadata text file, screenshot of the game in action and a logo for the game, plus the game and any files it needs
06:52 πŸ”— Sk1d has joined #archiveteam-bs
06:55 πŸ”— c4rc4s has joined #archiveteam-bs
06:55 πŸ”— zyphlar has joined #archiveteam-bs
06:56 πŸ”— Petri152 has joined #archiveteam-bs
06:56 πŸ”— JAA has joined #archiveteam-bs
06:56 πŸ”— swebb sets mode: +o JAA
06:56 πŸ”— bakJAA sets mode: +o JAA
06:56 πŸ”— Ryz Hmm, how often do games get submitted per day through curation?
06:58 πŸ”— eientei95 14 just today
06:58 πŸ”— eientei95 http://bluemaxima.org/flashpoint/datahub/Game_Master_List
06:58 πŸ”— svchfoo1 has joined #archiveteam-bs
06:59 πŸ”— svchfoo3 sets mode: +o svchfoo1
07:00 πŸ”— eientei95 Currently 8,298 games submitted
07:00 πŸ”— Ryz Surely there must be a huge backlog of untested games
07:00 πŸ”— jspiros has joined #archiveteam-bs
07:04 πŸ”— Ryz I have a backlog of seemingly countless links to game portals that have Adobe Flash games, just sitting there for 2-3 years and occasionally cleaned up to remove dud ones
07:09 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
07:10 πŸ”— Ryz Pour a bottle for the countlesss Adobe Flash and Shockwave game portals that have disappeared: https://en.wikipedia.org/w/index.php?title=Game_portal&oldid=43742233
07:10 πŸ”— Ryz There's more checking on the revision history
07:12 πŸ”— Sk1d has joined #archiveteam-bs
07:15 πŸ”— zyphlar has quit IRC (Read error: Operation timed out)
07:16 πŸ”— zyphlar has joined #archiveteam-bs
07:16 πŸ”— eientei95 [20:00:12] <Ryz> Surely there must be a huge backlog of untested games
07:16 πŸ”— eientei95 certainly
07:18 πŸ”— eientei95 Ryz: It's because of that why we have multiple requested channels and are very much welcome to anyone who could help
07:19 πŸ”— Ryz Is it in a Discord server I recall?
07:25 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
07:28 πŸ”— Sk1d has joined #archiveteam-bs
07:31 πŸ”— Ryz Oh! eientei95 - if there's one Adobe Flash game that needs to be archived, it's Acno Energizer, not only because it's a Boulder Dash-like game in some aspect, but because of tons and tons of online levels that need to be mined out
07:31 πŸ”— eientei95 Ryz: Link plz
07:31 πŸ”— Ryz http://www.acno.tv/acno/
07:31 πŸ”— eientei95 Also yeah, online level mining is something we do as well
07:31 πŸ”— Ryz If Happy Wheels can be archived with those countless online usermade levels, this one should too
07:32 πŸ”— Ryz There was supposed to be a sequel, checking their forum a long time ago, but it never surfaced to release
07:34 πŸ”— eientei95 Ryz: https://discord.gg/MXsDGR
07:36 πŸ”— Ryz The one thing I hated about Acno's Energizer, which gets aggravating overtime, is how the way selecting usermade levels functions
08:05 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
08:09 πŸ”— Sk1d has joined #archiveteam-bs
08:40 πŸ”— VADemon has joined #archiveteam-bs
08:40 πŸ”— VADemon_ has quit IRC (Read error: Connection reset by peer)
08:41 πŸ”— dxrt_ has joined #archiveteam-bs
08:41 πŸ”— dxrt sets mode: +o dxrt_
09:15 πŸ”— VoynichCr eientei95: Ryz: i will add that TV disestablished categires in the next run
09:15 πŸ”— eientei95 Cool, thanks
09:16 πŸ”— eientei95 VoynichCr: That's one fo a few subcategories of the category linked to from the Archiveteam wiki page
09:19 πŸ”— VoynichCr currently bot checked recursively 2 levels from here https://en.wikipedia.org/wiki/Category:2018_disestablishments
09:20 πŸ”— VoynichCr i will put 4 levels now
09:21 πŸ”— VoynichCr anyway if articles haven't an official URL, bot won't add anything to table
09:23 πŸ”— schbirid has joined #archiveteam-bs
09:26 πŸ”— eientei95 Nice
09:31 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
09:32 πŸ”— Mateon1 has quit IRC (Ping timeout: 633 seconds)
09:32 πŸ”— Mateon1 has joined #archiveteam-bs
09:33 πŸ”— Mateon1 has quit IRC (Remote host closed the connection)
09:34 πŸ”— Mateon1 has joined #archiveteam-bs
09:36 πŸ”— Sk1d has joined #archiveteam-bs
09:44 πŸ”— eientei95 That mixology.pw link from that site... it only redirects you if the User Agent doesn't contain 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/53736 (KHTML'
09:45 πŸ”— eientei95 If you replace the `(X11; Linux x86_64)` part with `(Windows NT 6.1; Win64; x64; rv:52.9)` it gives you redirecting JS code
09:46 πŸ”— BlueMax has quit IRC (Quit: Leaving)
09:50 πŸ”— PurpleSym betamax: Facebook is done and uploaded: https://archive.org/details/chromebot-us-midterms-2018-facebook
09:54 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
09:59 πŸ”— Sk1d has joined #archiveteam-bs
10:11 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
10:16 πŸ”— Sk1d has joined #archiveteam-bs
11:07 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
11:10 πŸ”— Sk1d has joined #archiveteam-bs
11:19 πŸ”— jodizzle PurpleSym: Were you planning on doing chromebot for all the 2018 midterm social media, or just the ones betamax initially sent?
11:25 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
11:27 πŸ”— Sk1d has joined #archiveteam-bs
11:33 πŸ”— twoTBHetz has quit IRC (Quit: Leaving)
11:39 πŸ”— Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805])
11:45 πŸ”— PurpleSym jodizzle: I don’t have anything besides betamax’s lists. What is missing from them?
13:42 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
13:46 πŸ”— Sk1d has joined #archiveteam-bs
13:51 πŸ”— hdch has joined #archiveteam-bs
14:23 πŸ”— VerifiedJ has joined #archiveteam-bs
14:55 πŸ”— alex__ has joined #archiveteam-bs
15:07 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
15:13 πŸ”— Sk1d has joined #archiveteam-bs
15:27 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
15:29 πŸ”— Sk1d has joined #archiveteam-bs
16:03 πŸ”— Pixi has quit IRC (Read error: Connection reset by peer)
16:24 πŸ”— Pixi has joined #archiveteam-bs
16:45 πŸ”— godane so i got some good news
16:46 πŸ”— godane good news is i don't think virtualbox slowing down the scans
16:46 πŸ”— godane i think its vuescan over time
16:46 πŸ”— godane even closing does nothing
16:47 πŸ”— godane turning scanner on and off does nothing
16:47 πŸ”— godane removing usb and power plug does nothing
16:48 πŸ”— godane i have seen book explore from plustek does one scan at full speed
16:49 πŸ”— godane my problem is book explore is not saving it and i don't see a simple scan button in that app
16:52 πŸ”— Mateon1 has quit IRC (Read error: Operation timed out)
16:52 πŸ”— Mateon1 has joined #archiveteam-bs
17:11 πŸ”— wp494 has quit IRC (Ping timeout: 260 seconds)
17:11 πŸ”— wp494 has joined #archiveteam-bs
17:19 πŸ”— godane has quit IRC (Quit: Leaving.)
17:28 πŸ”— godane has joined #archiveteam-bs
17:43 πŸ”— jodizzle PurpleSym: I sent along some more lists of my own, the result of my own attempts at crawling vote411, that I deduped from betamax's lists.
17:44 πŸ”— jodizzle I think betamax stuffed my lists in archivebot, but I could give them to you if you want to chromebot them.
17:45 πŸ”— jodizzle I also have some more lists that I'm gonna drop soon that come from the crawling of a different site (those are probably going to be big, the site was very big and well-structured).
17:50 πŸ”— branden has joined #archiveteam-bs
17:54 πŸ”— kiska ivan: Can you please wrap up your grab site instance on kiskaAus please? I want to nuke the entire machine, I think my RAID array is failing
17:55 πŸ”— ivan kiska: can I have 24 hours or do you prefer I finish right now
17:55 πŸ”— kiska You have until AB finishes
17:56 πŸ”— ivan how long is that? :-)
17:56 πŸ”— kiska Which I think will be 2-3 weeks away
17:56 πŸ”— ivan haha ok
17:56 πŸ”— kiska fanfiction.net has 52m items remaining
18:03 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
18:07 πŸ”— PurpleSym jodizzle: I’d like to get SketchCow’s approval first before grabbing more stuff. The current grabs are already quite big (91G for Facebook, 140G+ for Twitter).
18:08 πŸ”— icedice has joined #archiveteam-bs
18:08 πŸ”— Sk1d has joined #archiveteam-bs
18:09 πŸ”— kiska ivan: You can wrap it up in 24 hrs or you can wrap it up as soon as the last job finishes on AB
18:10 πŸ”— ivan alright
18:16 πŸ”— jodizzle PurpleSym: Sounds good.
18:17 πŸ”— kiska ivan: I am just giving advanced notice, I'll alert you when I expect that there'll be 2-3 days remaining on AB, but yeah you can continue using the pipe if you want to
18:18 πŸ”— kiska I would recommend smaller lists in case I don't give such notice ie I forget
18:24 πŸ”— Ryz has joined #archiveteam-bs
18:28 πŸ”— ivan thanks. yeah, I use small lists
18:34 πŸ”— icedice has quit IRC (Quit: Leaving)
18:40 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
18:45 πŸ”— Sk1d has joined #archiveteam-bs
18:47 πŸ”— Ryz Found on 2018 November 05, from: https://old.reddit.com/r/opendirectories/comments/9tunlr/big_ol_pile_of_music_various_artists/ - search "/wp-content/uploads/" as another way to find open directories
19:02 πŸ”— icedice has joined #archiveteam-bs
19:07 πŸ”— Sanqui DISCORD ARCHIVAL STRATEGIES??
19:19 πŸ”— icedice You need an account there that is invited to the specific Discord servers you want to archive if you want to do it with ArchiveBot
19:20 πŸ”— moufu archivebot can archive discord servers?
19:21 πŸ”— icedice No
19:22 πŸ”— icedice It might not be impossible though
19:22 πŸ”— icedice But that's for someone else to figure out
19:22 πŸ”— schbirid2 has joined #archiveteam-bs
19:23 πŸ”— schbirid has quit IRC (Read error: Operation timed out)
19:23 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
19:23 πŸ”— JAA Almost certainly impossible with the current version of ArchiveBot at least.
19:23 πŸ”— icedice I thought you guys were trying to figure out how to make discordapp.com compatible with ArchiveBot
19:23 πŸ”— JAA It requires logging in, right?
19:24 πŸ”— icedice Yup
19:24 πŸ”— icedice And they have 2FA
19:24 πŸ”— icedice And IP logging for logins
19:25 πŸ”— icedice So the IP addresses have to be verified by the user
19:27 πŸ”— Sk1d has joined #archiveteam-bs
19:39 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
19:39 πŸ”— Ryz Someone playing a mobile game called "The Elder Scrolls Travels: Stormhold" on stream - https://youtu.be/VoozfLkGncs?t=575
19:40 πŸ”— Ryz ...Twas on a browsing spree of looking YouTube videos involving J2ME games
19:44 πŸ”— Sk1d has joined #archiveteam-bs
19:46 πŸ”— uzerus has joined #archiveteam-bs
20:20 πŸ”— Sanqui I'm looking for a solution that's an independent script
20:23 πŸ”— icedice Sanqui: There is an open source Discord client called BetterDiscord that allows users to write and run their own plugins
20:23 πŸ”— icedice https://github.com/JsSucks/BetterDiscordApp
20:23 πŸ”— icedice Maybe something could be done with that?
20:26 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
20:27 πŸ”— icedice There seems to also be some stuff here: https://github.com/search?q=archive+Discord
20:30 πŸ”— Sk1d has joined #archiveteam-bs
20:32 πŸ”— Sanqui https://github.com/tsudoko/pullcord seems to be the most comprehensive and reasonable
20:32 πŸ”— Sanqui (ie not a browser plugin or something with a gui)
20:32 πŸ”— SketchCow PurpleSym: What are these
20:33 πŸ”— Sanqui moral question: can logs from discords with public invite links be posted publicly on the internet
20:33 πŸ”— Sanqui (+noindex)
20:38 πŸ”— PurpleSym SketchCow: We’re archiving social media accounts of candidates in the 2018 US midterm election.
20:39 πŸ”— PurpleSym betamax put together a list of 971 Twitter and 2257 Facebook accounts which I am running through a local chromebot instance.
20:40 πŸ”— PurpleSym jodizzle is now offering lists with more accounts.
20:40 πŸ”— moufu Sanqui: I wrote that, if something breaks it's my fault
20:40 πŸ”— moufu you can ping me if you don't understand something etc
20:41 πŸ”— Sanqui moufu: confidence just grew by 100%
20:42 πŸ”— moufu the code is pretty ugly but it's been working well for me
20:42 πŸ”— Sanqui I just need to learn to use go ;D
20:42 πŸ”— SketchCow Yeah, go for it
20:42 πŸ”— Sanqui so just quick question, no incremental mode I'm guessing
20:43 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
20:43 πŸ”— moufu it's incremental by design if we mean the same thing
20:44 πŸ”— moufu you can run it after the initial fetch to get new history entries
20:44 πŸ”— Sanqui oh, awesome
20:48 πŸ”— Sanqui moufu: i'm a go illiterate and `go install` has failed me
20:48 πŸ”— Sk1d has joined #archiveteam-bs
20:50 πŸ”— moufu `go get github.com/tsudoko/pullcord/...` works here
20:54 πŸ”— Sanqui moufu: https://pastebin.com/raw/q4EgZJ9a
20:56 πŸ”— Sanqui wait
20:56 πŸ”— Sanqui if I appended the ..., it exits with no output, but I still get no `pullcord`
20:57 πŸ”— moufu it should be in $GOPATH/bin
20:57 πŸ”— moufu you can append that to your $PATH
20:58 πŸ”— Sanqui okay, got it
20:58 πŸ”— Sanqui any option to pass password by env variable?
20:59 πŸ”— Sanqui `2018/11/11 21:59:24 login failed:account has 2FA enabled`
20:59 πŸ”— Sanqui damn
21:01 πŸ”— moufu no such thing is implemented, you could do -pass $(cat $file_with_password) I guess, but that would still make your password visible in the process list
21:01 πŸ”— Sanqui not a big worry
21:01 πŸ”— moufu yeah I'm not sure if there's a way around that, you could make a secondary account without 2fa to use for fetching
21:01 πŸ”— moufu you could try logging in with the token directly, but I don't know if it'd change anything
21:02 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
21:04 πŸ”— Sanqui moufu: no possibility to exclude files/attachments?
21:05 πŸ”— C4K3 has quit IRC (Quit: leaving)
21:06 πŸ”— moufu nope
21:06 πŸ”— Sk1d has joined #archiveteam-bs
21:07 πŸ”— Sanqui consider it a feature request, then ;)
21:08 πŸ”— Sanqui in general, it would be cool to have a "light mode", which is only textual data, and be able to download files for it later
21:09 πŸ”— moufu seems like a good idea, I'll think about it
21:10 πŸ”— moufu not sure how easy it would be with the current state of the code, I haven't touched it in a while
21:10 πŸ”— schbirid2 has quit IRC (Remote host closed the connection)
21:10 πŸ”— C4K3 has joined #archiveteam-bs
21:11 πŸ”— Sanqui thanks. no worries. it's cool to have something that's comprehensive and easy to run.
21:12 πŸ”— Sanqui moufu: just one last query; have you run this on huge servers without getting banned?
21:14 πŸ”— moufu I haven't tried it on servers larger than a few hundred members
21:15 πŸ”— Sanqui alright, cheers
21:26 πŸ”— uzerus has quit IRC (Ping timeout: 255 seconds)
21:36 πŸ”— BlueMax has joined #archiveteam-bs
21:37 πŸ”— Sanqui we're missing an AT forum or mailing list
21:37 πŸ”— Sanqui for long-form discussions
21:38 πŸ”— Sanqui on topics such as "morality of publishing discord logs"
21:42 πŸ”— hdch i think if it were a really big server it'd probably be fine, but maybe with smaller public servers it might be iffy
21:43 πŸ”— Sanqui on irc the implicit agreement is that you don't publish logs, but the privacy story is different on discord
21:43 πŸ”— Sanqui where everybody who joins gains access to years of logs
21:55 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
21:58 πŸ”— Sk1d has joined #archiveteam-bs
22:07 πŸ”— Lord_Nigh Sanqui: i thought you could set up a discord channel so nobody sees logs before the time they joined?
22:07 πŸ”— Lord_Nigh or am i wrong about that
22:08 πŸ”— Sanqui I admin several Discords and have never seen that option
22:08 πŸ”— Sanqui Ah, the "Read Message History" permission, I suppose
22:09 πŸ”— hdch you can set it so they can't see the channel history at all, and when you have it set to that people can see messages that are sent since the first time they viewed the channel, though it clears out again once you close discord
22:09 πŸ”— hdch yeah that
22:09 πŸ”— Sanqui Sounds inconvenient enough that nobody will use it
22:10 πŸ”— Sanqui But it it were, say, the past week of history, I believe people would be more keen to set it
22:10 πŸ”— hdch i think i've seen it used maybe once
22:14 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
22:19 πŸ”— Sanqui https://www.archiveteam.org/index.php?title=Discord
22:19 πŸ”— Sk1d has joined #archiveteam-bs
22:24 πŸ”— alex__ has quit IRC (Ping timeout: 260 seconds)
22:31 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
22:36 πŸ”— Sk1d has joined #archiveteam-bs
22:52 πŸ”— alex__ has joined #archiveteam-bs
22:53 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
22:57 πŸ”— Sk1d has joined #archiveteam-bs
23:00 πŸ”— arbin has quit IRC (Remote host closed the connection)
23:01 πŸ”— arbin has joined #archiveteam-bs
23:05 πŸ”— moufu Sanqui: you probably know that already, but collecting user data such as messages without their consent is against the discord tos
23:05 πŸ”— moufu might be worth mentioning on the wiki page
23:06 πŸ”— Sanqui definitely worth it
23:06 πŸ”— Sanqui but see also: robots.txt
23:06 πŸ”— JAA loltos
23:08 πŸ”— moufu Β―\_(ツ)_/Β―
23:09 πŸ”— moufu I just don't want people complaining they got banned because they didn't know
23:09 πŸ”— Sanqui can you find it specifically in the tos?
23:09 πŸ”— Sanqui https://discordapp.com/terms
23:09 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
23:09 πŸ”— Sanqui i only found "develop, distribute, or publicly inform other members of "auto" software programs, "macro" software programs or other "cheat utility" software program or applications in violation of the applicable license agreements;"
23:09 πŸ”— Sanqui which is vague as hell
23:10 πŸ”— moufu (iii) use data mining, robots, spiders, or similar data gathering and extraction tools on the Service
23:10 πŸ”— Sanqui thanks
23:12 πŸ”— moufu "violate the contractual, personal, ... (including rights of privacy or publicity)" might be relevant too
23:12 πŸ”— moufu I'm not a lawyer though etc
23:12 πŸ”— Sanqui we're not lawyers, we're renegades
23:14 πŸ”— Sk1d has joined #archiveteam-bs
23:15 πŸ”— uzerus has joined #archiveteam-bs
23:16 πŸ”— Martle_ has joined #archiveteam-bs
23:16 πŸ”— moufu there's https://discordapp.com/developers/docs/legal too (2.4 End User Data)
23:17 πŸ”— Sanqui man, that's scary stuff
23:18 πŸ”— JAA This kind of shit is the reason why I don't use such services.
23:18 πŸ”— Martle has quit IRC (Ping timeout: 252 seconds)
23:21 πŸ”— Sanqui then again, websites have "don't archive" in their tos too and we don't give a shit, why should discord get special treatment
23:21 πŸ”— Martle_ is now known as Martle
23:23 πŸ”— Martle_ has joined #archiveteam-bs
23:26 πŸ”— Martle has quit IRC (Ping timeout: 252 seconds)
23:27 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
23:28 πŸ”— Martle_ has quit IRC (Client Quit)
23:32 πŸ”— Sk1d has joined #archiveteam-bs
23:45 πŸ”— Sk1d has quit IRC (Read error: Operation timed out)
23:50 πŸ”— Sk1d has joined #archiveteam-bs
23:55 πŸ”— Stilett0 has joined #archiveteam-bs
23:58 πŸ”— Stiletto has quit IRC (Read error: Operation timed out)
23:59 πŸ”— C4K3 has quit IRC (Ping timeout: 260 seconds)
irclogger-viewer