[00:06] *** klg has quit IRC (Read error: Operation timed out) [00:06] *** Terbium_ has quit IRC (Read error: Operation timed out) [00:07] *** treora_ has quit IRC (Read error: Operation timed out) [00:09] chain of URL shorteners? Are people trying to make things extra brittle? [00:10] *** MrRadar2 has quit IRC (Read error: Operation timed out) [00:15] *** logchfoo2 has quit IRC (Ping timeout: 276 seconds) [00:27] *** logchfoo4 starts logging #urlteam at Tue Dec 31 00:27:07 2019 [00:27] *** logchfoo4 has joined #urlteam [00:28] *** systwi_ has quit IRC (Ping timeout: 622 seconds) [00:51] people have been making things brittle since the beginning of computers! [00:57] *** MrRadar2 has joined #urlteam [01:08] *** systwi has joined #urlteam [01:08] *** Wingy has joined #urlteam [01:12] *** klg has joined #urlteam [01:36] brittle, yes, but intentionally chaining things in ways that are almost intended to break? I guess that's kind of what DRM is...though... [01:49] *** VADemon_ has joined #urlteam [01:53] *** VADemon has quit IRC (Read error: Operation timed out) [01:55] *** Zerote_ has joined #urlteam [01:55] *** Zerote has quit IRC (Read error: Operation timed out) [02:08] *** chfoo has quit IRC (Read error: Operation timed out) [02:08] swebb are you running through the URL shortners that Archive team are or different ones? [02:08] *** chfoo has joined #urlteam [02:09] *** kiska has joined #urlteam [02:10] *** svchfoo1 sets mode: +o kiska [02:10] *** svchfoo3 sets mode: +o kiska [02:18] JAA Somebody2 tracker appears to be locked up again :( [02:53] 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get [02:59] atphoenix: My ISP doesn't care about my bandwidth. I've been ingesting the 2% twitter spritzer stream since 2011. I host a plex server for friends and family and I've *always* got something hitting the internet - it's *never* idle and I've never heard anything from my ISP. I have residential 1Gbit internet through my city, not Comcast or a triditional ISP. [03:00] Datechnom: I'm crawling every url that was in 2% of all tweets from 2019 from Jan - Nov. It will bring up lots of url-shorteners. That's the whole idea - to see what url shorteners were used in 2019 to add them to the urlteam's list of shorteners to crawl. [03:02] I've crawled 1M urls in the last 3.25 hours. [03:05] Ahhhh nice as. Great work swebb [03:05] Is there anyway we can get involved and help swebb?? [03:06] Nah, no need really. I could spin up crawlers in AWS or something if I was being IP banned, but that doesn't seem to be hapenning, so I'm good. [03:07] I just started writing all of the code for this project this morning. [03:07] and it seems to be munching through the initial crawl dataset pretty nicely. [03:07] Thanks for the offer though. [03:08] JAA: swebb that is delightful! [03:08] Datechnom: checking [03:09] it's the bitly IPv6 problem again [03:09] lower seq #: 8909860200 [03:10] fixed [03:10] Somebody2 anyway we can get those cleared out to stop it from happening? [03:10] Happening nearly everyday [03:14] Datechnom: it's a software bug; it needs an updated version of Python, I think. [03:14] check the channel history... (which I'm going to do just now) [03:14] Ahhh ok i understand. [03:14] Think JAA said something about it like you daid [03:14] Said** [03:14] yep [03:15] http://archive.fart.website/bin/irclogger_log/urlteam?date=2019-12-28,Sat [03:16] Datechnom: how's your Python? [03:16] Love to have your help fixing that... [03:25] Python isnt my strong suite. I know enough to make really basic scripts and thats all lol [03:25] heh, no worries [03:25] I'm looking into it now [03:26] You can repay me by *researching more shorteners* :-) [03:35] I repay by buying more servers to run the script ;) [04:06] Datechnom: that works too!! [04:08] Somebody2 haha i hope so :) [04:15] but we do need to keep in balance, and we can certainly use more research [04:17] You mean discovering more url shortners? [04:42] Datechnom: looking at the wiki page and gathering the data necessary to start running the shortener in the Warrior [04:59] chfoo: Can you approve and deploy this fix for the IPv6 error: https://github.com/ArchiveTeam/terroroftinytown/pull/73 [05:01] *** odemg has quit IRC (Ping timeout: 246 seconds) [05:15] *** odemg has joined #urlteam [05:58] *** mtntmnky has joined #urlteam [06:01] *** mtntmnky_ has quit IRC (Remote host closed the connection) [06:11] *** Wingy has quit IRC (Read error: Operation timed out) [06:13] *** kiska has quit IRC (Read error: Operation timed out) [06:13] *** systwi_ has joined #urlteam [06:13] *** Wingy has joined #urlteam [06:14] *** kiska has joined #urlteam [06:14] *** svchfoo1 sets mode: +o kiska [06:14] *** svchfoo3 sets mode: +o kiska [06:19] *** systwi has quit IRC (Ping timeout: 622 seconds) [06:31] *** logchfoo0 starts logging #urlteam at Tue Dec 31 06:31:38 2019 [06:31] *** logchfoo0 has joined #urlteam [06:31] *** Dj-Wawa has quit IRC (Read error: Operation timed out) [06:31] *** odemg has quit IRC (Ping timeout: 246 seconds) [06:32] *** swebb has joined #urlteam [06:32] *** odemg has joined #urlteam [06:32] *** eythian has quit IRC (Ping timeout: 246 seconds) [06:32] *** jodizzle has quit IRC (Ping timeout: 246 seconds) [06:33] *** eythian has joined #urlteam [06:33] *** luckcolor has joined #urlteam [06:34] *** Dj-Wawa has joined #urlteam [06:40] *** jodizzle has joined #urlteam [06:45] *** Mayonaise has joined #urlteam [06:47] *** jodizzle has quit IRC (Quit: ZNC 1.7.1 - https://znc.in) [06:51] *** treora has joined #urlteam [07:31] *** kiska18 has joined #urlteam [07:31] *** svchfoo3 sets mode: +o kiska18 [07:33] *** JAA has joined #urlteam [07:33] *** AlsoJAA sets mode: +o JAA [08:08] *** jodizzle has joined #urlteam [08:34] *** systwi_ is now known as systwi [10:49] *** Smiley has joined #urlteam [10:51] *** SmileyG has quit IRC (Ping timeout: 496 seconds) [10:54] *** Flashfire has joined #urlteam [15:47] *** SmileyG has joined #urlteam [15:52] *** Smiley has quit IRC (Read error: Operation timed out) [16:29] *** SmileyG has quit IRC (Read error: Connection reset by peer) [16:49] *** logchfoo0 starts logging #urlteam at Tue Dec 31 16:49:02 2019 [16:49] *** logchfoo0 has joined #urlteam [16:49] tracker is updated to the latest [17:01] *** Smiley has joined #urlteam [17:12] *** Smiley has quit IRC (Read error: Connection reset by peer) [17:18] *** Smiley has joined #urlteam [17:33] *** Smiley has quit IRC (Read error: Connection reset by peer) [17:43] *** Smiley has joined #urlteam [17:50] *** SmileyG has joined #urlteam [17:51] *** Smiley has quit IRC (Read error: Connection reset by peer) [18:06] *** SmileyG has quit IRC (Remote host closed the connection) [18:06] *** Smiley has joined #urlteam [18:14] *** Smiley has quit IRC (Read error: Connection reset by peer) [18:14] *** Smiley has joined #urlteam [18:35] *** Smiley has quit IRC (Remote host closed the connection) [18:35] *** Smiley has joined #urlteam [18:50] *** Smiley has quit IRC (Read error: Connection reset by peer) [18:50] *** Smiley has joined #urlteam [18:56] *** Smiley has quit IRC (Read error: Connection reset by peer) [18:58] *** Smiley has joined #urlteam [18:58] chfoo: thanks [18:58] *** Smiley has quit IRC (Read error: Connection reset by peer) [19:08] *** Smiley has joined #urlteam [19:10] *** Smiley has quit IRC (Read error: Connection reset by peer) [19:28] *** Smiley has joined #urlteam [19:29] *** Smiley has quit IRC (Remote host closed the connection) [19:33] *** Smiley has joined #urlteam [19:34] *** Smiley has quit IRC (Read error: Connection reset by peer) [19:38] *** Smiley has joined #urlteam [19:51] *** Smiley has quit IRC (Remote host closed the connection) [19:52] *** Smiley has joined #urlteam [19:52] *** Smiley has quit IRC (Read error: Connection reset by peer) [19:57] *** Smiley has joined #urlteam [19:59] *** Smiley has quit IRC (Read error: Connection reset by peer) [20:12] *** Smiley has joined #urlteam [20:13] *** Smiley has quit IRC (Read error: Connection reset by peer) [20:17] *** Smiley has joined #urlteam [20:18] *** Smiley has quit IRC (Read error: Connection reset by peer) [20:27] *** Smiley has joined #urlteam [20:27] *** Smiley has quit IRC (Read error: Connection reset by peer) [20:32] *** Smiley has joined #urlteam [20:39] *** Smiley has quit IRC (Remote host closed the connection) [20:54] *** Smiley has joined #urlteam [20:59] *** SmileyG has joined #urlteam [21:01] *** SmileyG has quit IRC (Remote host closed the connection) [21:08] *** Smiley has quit IRC (Ping timeout: 745 seconds) [21:29] *** Smiley has joined #urlteam [21:30] *** mtntmnky has quit IRC (Remote host closed the connection) [21:30] *** mtntmnky has joined #urlteam [21:32] *** Smiley has quit IRC (Read error: Connection reset by peer) [21:34] *** Smiley has joined #urlteam [21:34] *** ivan has quit IRC (Quit: Leaving) [21:35] *** ivan has joined #urlteam [21:36] *** svchfoo3 sets mode: +o ivan [21:40] *** Smiley has quit IRC (Ping timeout: 276 seconds) [21:48] *** ivan has quit IRC (Ping timeout: 745 seconds) [21:53] *** ivan has joined #urlteam [21:53] *** svchfoo3 sets mode: +o ivan [23:04] Thanks for deploying the fix :)