#archiveteam-bs 2020-07-13,Mon

↑back Search

Time Nickname Message
00:04 🔗 BlueMax has joined #archiveteam-bs
00:04 🔗 BlueMaxim has joined #archiveteam-bs
00:08 🔗 BlueMaxim has quit IRC (Client Quit)
00:13 🔗 BlueMax has quit IRC (Quit: Leaving)
00:13 🔗 BlueMax has joined #archiveteam-bs
00:49 🔗 xit has quit IRC (Quit: Connection closed for inactivity)
01:24 🔗 katocala has quit IRC (Ping timeout: 496 seconds)
01:25 🔗 katocala has joined #archiveteam-bs
01:34 🔗 lennier2 has joined #archiveteam-bs
01:40 🔗 lennier1 has quit IRC (Ping timeout: 492 seconds)
01:40 🔗 lennier2 is now known as lennier1
02:49 🔗 HP_Archiv has joined #archiveteam-bs
03:21 🔗 DogsRNice has quit IRC (Read error: Connection reset by peer)
03:30 🔗 SketchCow Neither size or unique URLs
03:30 🔗 SketchCow The biggest is Alexa Internet.
03:31 🔗 VADemon has joined #archiveteam-bs
03:42 🔗 DLoader_ has joined #archiveteam-bs
03:47 🔗 Raccoon has quit IRC (Ping timeout: 745 seconds)
03:53 🔗 DLoader has quit IRC (Ping timeout: 745 seconds)
03:53 🔗 DLoader_ is now known as DLoader
04:20 🔗 Ryz SketchCow, how much does Alexa Internet contribute to the overall daily content ingestion into WBM? By perecentage and by the filesize?
04:23 🔗 vitzli has joined #archiveteam-bs
04:54 🔗 Raccoon has joined #archiveteam-bs
05:34 🔗 SketchCow Yeah..... I'm not going to go into that.
05:35 🔗 SketchCow I'll just tell you, they contribute more.
05:38 🔗 Raccoon has quit IRC (Ping timeout: 745 seconds)
05:39 🔗 vitzli has quit IRC (Leaving)
05:58 🔗 kiska1825 has quit IRC (Remote host closed the connection)
05:58 🔗 Ryz has quit IRC (Remote host closed the connection)
05:59 🔗 Ryz has joined #archiveteam-bs
05:59 🔗 kiska1825 has joined #archiveteam-bs
07:08 🔗 PovAddict has joined #archiveteam-bs
07:08 🔗 nicolas17 has quit IRC (Read error: Connection reset by peer)
08:00 🔗 jshoard has joined #archiveteam-bs
08:11 🔗 atomicthu has quit IRC (Read error: Operation timed out)
08:40 🔗 atomicthu has joined #archiveteam-bs
09:24 🔗 atomicthu has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.)
09:27 🔗 atomicthu has joined #archiveteam-bs
09:49 🔗 Tugboat has joined #archiveteam-bs
09:49 🔗 qw3rty has joined #archiveteam-bs
10:08 🔗 BeefyBoot has joined #archiveteam-bs
10:09 🔗 BeefyBoot hey y'all please let me know if this isn't a good place to ask for such
10:09 🔗 BeefyBoot recently a large number of subreddits were banned by the admins of Reddit. Full list here: https://redd.it/hi41t2
10:09 🔗 BeefyBoot I'd be interested to know if there's any way to retrieve top posts from a banned sub
10:10 🔗 BeefyBoot Especially for NSFW ones, archive.org doesn't seem to be grabbing content from reddit.com/r/xyzsubname/top/all because of the NSFW confirmation being on top
11:59 🔗 BlueMax has quit IRC (Quit: Leaving)
12:47 🔗 maxfan8 has quit IRC (Ping timeout: 260 seconds)
12:58 🔗 maxfan8 has joined #archiveteam-bs
12:59 🔗 PovAddict you mean retrieve from reddit? once it's banned, it's gone...
13:00 🔗 PovAddict as for archiving it, that's being tracked https://www.archiveteam.org/index.php?title=Reddit and the project has a dedicated IRC channel
13:38 🔗 Raccoon has joined #archiveteam-bs
13:53 🔗 BeefyBoot ty
14:10 🔗 jshoard has quit IRC (Leaving)
14:17 🔗 godane has quit IRC (Read error: Operation timed out)
14:18 🔗 godane has joined #archiveteam-bs
14:54 🔗 fredgido has joined #archiveteam-bs
14:56 🔗 hook54321 has quit IRC ()
14:57 🔗 hook54321 has joined #archiveteam-bs
14:58 🔗 fredgido_ has quit IRC (Ping timeout: 744 seconds)
15:12 🔗 maxfan8 has quit IRC (Quit: WeeChat 2.8)
15:12 🔗 maxfan8 has joined #archiveteam-bs
15:19 🔗 maxfan8 has quit IRC (WeeChat 2.8)
15:19 🔗 maxfan8 has joined #archiveteam-bs
15:26 🔗 Arcorann_ has quit IRC (Read error: Operation timed out)
15:57 🔗 SketchCow UrbanDictionary surviving as long as it has was a bit of a miracle/obtuseness. It's been worth a mirroring for years.
15:58 🔗 SketchCow Also, "SJWitis" for "I realize half my site is offensive shit" is... poor
16:00 🔗 BeefyBoot urbandictionary already had an obscure moderation system in place for the last handful of years at least
16:00 🔗 SketchCow Mega obscure. Made them 10% less 4channy
16:02 🔗 BeefyBoot All I can say about the moderation system was that a couple memey entries I had made were irrelevant by the time they looked over them to decide if they would be approved
16:04 🔗 BeefyBoot It's likely that a lot of content had already started being cut out by the time moderation made it into the site. Not sure if they were removing older racist terms from that time also.
16:39 🔗 VADemon BeefyBoot: try https://github.com/pushshift/api
16:43 🔗 BeefyBoot VADemon: it was already suggested to me in the IRC for https://www.archiveteam.org/index.php?title=Reddit :D
16:43 🔗 BeefyBoot but thanks a ton
16:46 🔗 VADemon has quit IRC (left4dead)
17:02 🔗 HP_Archiv has quit IRC (Quit: Leaving)
17:19 🔗 VerifiedJ has joined #archiveteam-bs
17:19 🔗 Frogging I think there's value in *describing* racist terms, as distinct from overt racism
17:21 🔗 Frogging the quality of definitions on UD is er... variable
17:21 🔗 Frogging to say the least :p
18:14 🔗 godane has quit IRC (Ping timeout: 265 seconds)
18:21 🔗 SketchCow UD is a really good example of an early 2000s site that just didn't die
18:29 🔗 godane has joined #archiveteam-bs
19:01 🔗 Ryz How are we gonna archive https://www.urbandictionary.com/ ? It might be too big for AB~ Unsure if qwarc would work
19:02 🔗 Frogging sounds like a good candidate for scripts
19:03 🔗 VoynichCr has left
19:03 🔗 JAA Ryz: I intend to try it once I finish my current iteration of qwarc dev work.
19:06 🔗 VoynichCr has joined #archiveteam-bs
19:36 🔗 BeefyBoot has quit IRC (Quit: Connection closed for inactivity)
19:45 🔗 mtntmnky has quit IRC (Read error: Operation timed out)
19:56 🔗 i0npulse has quit IRC (Ping timeout: 265 seconds)
20:22 🔗 VerifiedJ has quit IRC (Quit: Leaving)
21:07 🔗 JAA So it turns out that downloads.dell.com has indices for the subdirectories, just not the main dir. E.g. http://downloads.dell.com/FOLDER01478021M/
21:08 🔗 JAA I'll make sure everything in all known directories is archived after the AB job is done.
21:12 🔗 JAA For the record, it's case-insensitive: https://downloads.dell.com/manuals/ == https://downloads.dell.com/Manuals/
21:13 🔗 JAA Actually, nevermind that regarding listing the main dir: ftp://ftp.ins.dell.com/ (warning, *HUGE*)
21:26 🔗 godane has quit IRC (Ping timeout: 272 seconds)
21:40 🔗 godane has joined #archiveteam-bs
22:31 🔗 lennier2 has joined #archiveteam-bs
22:34 🔗 katocala has quit IRC (Ping timeout: 265 seconds)
22:38 🔗 lennier1 has quit IRC (Read error: Operation timed out)
22:38 🔗 lennier2 is now known as lennier1
22:38 🔗 katocala has joined #archiveteam-bs
22:58 🔗 VADemon has joined #archiveteam-bs
23:10 🔗 Arcorann_ has joined #archiveteam-bs
23:10 🔗 Arcorann_ has quit IRC (Remote host closed the connection)
23:11 🔗 Arcorann_ has joined #archiveteam-bs

irclogger-viewer