#urlteam 2019-04-05,Fri

↑back Search

Time Nickname Message
00:08 πŸ”— Zerote has quit IRC (Ping timeout: 260 seconds)
00:17 πŸ”— Flashfire 35.200.144.89 leaving that there for later investigations
00:25 πŸ”— Zerote has joined #urlteam
00:33 πŸ”— Flashfire Hello Zerote what brings you here?
00:35 πŸ”— Smiley has joined #urlteam
00:35 πŸ”— Flashfire Hiya Smiley
00:36 πŸ”— SmileyG has quit IRC (Read error: Operation timed out)
00:37 πŸ”— tech234a has joined #urlteam
00:39 πŸ”— Zerote Just lurking, mostly
00:39 πŸ”— Flashfire Fair enough
00:39 πŸ”— Flashfire I am going to try and welcome people when I can
00:40 πŸ”— Flashfire welcome tech234a
01:56 πŸ”— Zerote has quit IRC (Ping timeout: 260 seconds)
02:05 πŸ”— tech234a Thanks
02:05 πŸ”— Flashfire So what brings you here friend?
02:06 πŸ”— tech234a I was around for G+, and goo.gl was shutting down and I wanted to see what was going on
02:07 πŸ”— Flashfire Do you want an explanation or rundown roughly of the project or did the wiki do a good enough job?
02:08 πŸ”— tech234a From what I understand, this project is working on storing copies of short URL redirection information on IA
02:08 πŸ”— Flashfire Thats basically it
02:08 πŸ”— tech234a I also believe that goo.gl URLs are not being archived yet (?)
02:08 πŸ”— Flashfire Right now it is bruteforced and stored in txt documents
02:08 πŸ”— tech234a Ahh... got it
02:09 πŸ”— Flashfire Actually we should be starting on the goo.gl project soon
02:09 πŸ”— tech234a Cool
02:09 πŸ”— Flashfire The documents are released properly if the shortener goes down but are still available in the mean time as the torrents
02:10 πŸ”— tech234a Ok
02:10 πŸ”— Flashfire We plan to one day have these as Dark Warc files that will be ingested into wayback if a shortener goes down
02:10 πŸ”— tech234a Good to know
02:10 πŸ”— Flashfire (but I dont have the coding knowledge or time to do it) Right now I am supposed to be doing an assessment
02:11 πŸ”— tech234a Of goo.gl?
02:11 πŸ”— Flashfire Though if you find any new url shorteners that arent on the wiki feel free to drop them here and ping me or one of the other ops
02:11 πŸ”— Flashfire No a school assignment lol
02:11 πŸ”— tech234a Ah... cool
02:12 πŸ”— tech234a Do you need help discovering URLs too?
02:12 πŸ”— Flashfire I mean if you have new url shorteners then just drop them here.
02:12 πŸ”— Flashfire Check the wiki and the unsorted page of the wiki
02:12 πŸ”— tech234a Ok
02:12 πŸ”— Flashfire Urlteam and Urlteam/Unsorted
02:12 πŸ”— Flashfire I think they are called
02:12 πŸ”— tech234a Thanks
02:13 πŸ”— Flashfire all good
02:13 πŸ”— Flashfire I am still trying to figure out where Cyrillic and Emojis fit into alphabetical order as well so if you have any insights lol
02:14 πŸ”— tech234a I'm not sure about that myself :)
02:14 πŸ”— Flashfire actually tech234a if you are bored with time on your hands you can find out which Cyrillic Alphabets http://Ρ‡ΠΎΡ‡.Ρ€Ρ„/
02:14 πŸ”— Flashfire http://сёр.Ρ€Ρ„/ use
02:14 πŸ”— Flashfire Those 2 url shorteners
02:14 πŸ”— Flashfire I have been lazy about doing it myself so its up to you
02:15 πŸ”— tech234a I'm a little busy right now, but I have a script that discovers URLs from CommonCrawl - I can grab those for you
02:15 πŸ”— tech234a This won't be the first time that script has come in handy
02:16 πŸ”— Flashfire if you want to DM me a list of urls that it has discovered I can look through it for short URLs if I have spare time
02:16 πŸ”— warmwaffl has joined #urlteam
02:16 πŸ”— Flashfire any little bit helps
02:16 πŸ”— tech234a Ok, cool!
02:56 πŸ”— tech234a Flashfire: Here are ~4 million URLs pulled from CommonCrawl relating to goo.gl https://drive.google.com/open?id=1tZBCWjtRWT9AWfZIVsTWMliDejTKmfUe
02:57 πŸ”— Flashfire Ill take a look
03:05 πŸ”— Hani has quit IRC (Read error: Connection reset by peer)
03:07 πŸ”— Fusl has quit IRC (Ping timeout: 265 seconds)
03:10 πŸ”— KingNerd has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— kiska has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— Flashfire has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— seatsea has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— driib has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— tech234a has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— odemg has quit IRC (efnet.portlane.se se.hub)
03:10 πŸ”— Jens has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— zhongfu has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— bakJAA has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— t3 has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— jornbaer has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Jusque has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— mr_archiv has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— abstract has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— phuzion has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— N4Y has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— gandalf has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— hook54321 has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— horkermon has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Fusl_ has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— chr1sm has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— HCross has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— pnJay has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— diggan has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— JSharp has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Ctrl-S_ has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— deathy has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— kpcyrd has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Hecatz has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Muad-Dib has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— nyany has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— svchfoo3 has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— MrRadar2 has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— treora has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— BnAboyZ has quit IRC (efnet.portlane.se se.hub)
03:11 πŸ”— Dallas has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— eythian has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— pikami has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— warmwaffl has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Smiley has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Frogging has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— ivan has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— JAA has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— svchfoo1 has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— lunik1 has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— marked has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— hiiva has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— VADemon_ has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Kagee has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— yano has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— MrRadar has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Somebody2 has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— arkiver has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— joepie91 has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— swebb has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— chfoo has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Cameron_D has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Soulflare has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Matthww_ has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— mtntmnky has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— TigerbotH has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— Mayonaise has quit IRC (efnet.portlane.se se.hub)
03:12 πŸ”— kiska1 has quit IRC (efnet.portlane.se se.hub)
03:13 πŸ”— Kaz has quit IRC (Ping timeout: 265 seconds)
03:15 πŸ”— Kaz has joined #urlteam
03:17 πŸ”— kiskabak has quit IRC (Ping timeout: 265 seconds)
03:17 πŸ”— kiskabak has joined #urlteam
03:17 πŸ”— Fusl__ has joined #urlteam
03:17 πŸ”— Hani has joined #urlteam
03:17 πŸ”— warmwaffl has joined #urlteam
03:17 πŸ”— tech234a has joined #urlteam
03:17 πŸ”— Smiley has joined #urlteam
03:17 πŸ”— VADemon_ has joined #urlteam
03:17 πŸ”— odemg has joined #urlteam
03:17 πŸ”— Jens has joined #urlteam
03:17 πŸ”— MrRadar2 has joined #urlteam
03:17 πŸ”— nyany has joined #urlteam
03:17 πŸ”— seatsea has joined #urlteam
03:17 πŸ”— treora has joined #urlteam
03:17 πŸ”— BnAboyZ has joined #urlteam
03:17 πŸ”— Dallas has joined #urlteam
03:17 πŸ”— mtntmnky has joined #urlteam
03:17 πŸ”— TigerbotH has joined #urlteam
03:17 πŸ”— Mayonaise has joined #urlteam
03:17 πŸ”— eythian has joined #urlteam
03:17 πŸ”— KingNerd has joined #urlteam
03:17 πŸ”— kiska has joined #urlteam
03:17 πŸ”— Flashfire has joined #urlteam
03:17 πŸ”— Frogging has joined #urlteam
03:17 πŸ”— Matthww_ has joined #urlteam
03:17 πŸ”— zhongfu has joined #urlteam
03:17 πŸ”— marked has joined #urlteam
03:17 πŸ”— kiska1 has joined #urlteam
03:17 πŸ”— Kagee has joined #urlteam
03:17 πŸ”— ivan has joined #urlteam
03:17 πŸ”— bakJAA has joined #urlteam
03:17 πŸ”— svchfoo3 has joined #urlteam
03:17 πŸ”— svchfoo1 has joined #urlteam
03:17 πŸ”— se.hub sets mode: +oooo Flashfire bakJAA svchfoo3 svchfoo1
03:17 πŸ”— pikami has joined #urlteam
03:17 πŸ”— yano has joined #urlteam
03:17 πŸ”— t3 has joined #urlteam
03:17 πŸ”— JAA has joined #urlteam
03:17 πŸ”— lunik1 has joined #urlteam
03:17 πŸ”— hiiva has joined #urlteam
03:17 πŸ”— MrRadar has joined #urlteam
03:17 πŸ”— Somebody2 has joined #urlteam
03:17 πŸ”— arkiver has joined #urlteam
03:17 πŸ”— joepie91 has joined #urlteam
03:17 πŸ”— swebb has joined #urlteam
03:17 πŸ”— jornbaer has joined #urlteam
03:17 πŸ”— Jusque has joined #urlteam
03:17 πŸ”— mr_archiv has joined #urlteam
03:17 πŸ”— abstract has joined #urlteam
03:17 πŸ”— se.hub sets mode: +ooo JAA Somebody2 arkiver
03:17 πŸ”— driib has joined #urlteam
03:17 πŸ”— phuzion has joined #urlteam
03:17 πŸ”— N4Y has joined #urlteam
03:17 πŸ”— Muad-Dib has joined #urlteam
03:17 πŸ”— Hecatz has joined #urlteam
03:17 πŸ”— kpcyrd has joined #urlteam
03:17 πŸ”— deathy has joined #urlteam
03:17 πŸ”— Ctrl-S_ has joined #urlteam
03:17 πŸ”— HCross has joined #urlteam
03:17 πŸ”— chr1sm has joined #urlteam
03:17 πŸ”— diggan has joined #urlteam
03:17 πŸ”— pnJay has joined #urlteam
03:17 πŸ”— JSharp has joined #urlteam
03:17 πŸ”— Fusl_ has joined #urlteam
03:17 πŸ”— horkermon has joined #urlteam
03:17 πŸ”— hook54321 has joined #urlteam
03:17 πŸ”— gandalf has joined #urlteam
03:17 πŸ”— Soulflare has joined #urlteam
03:17 πŸ”— Cameron_D has joined #urlteam
03:17 πŸ”— chfoo has joined #urlteam
03:17 πŸ”— se.hub sets mode: +ooo HCross hook54321 chfoo
03:20 πŸ”— tech234a Flashfire: ~3.7 million bit.ly URLs https://drive.google.com/open?id=1ozXk6mx8lBw5IVLnLxmdoIN1Hu3qDLKz
03:21 πŸ”— Flashfire Bitly we currently have running through the warriors but thats still useful to look through
03:22 πŸ”— tech234a I'll see what I can pull for TinyURL
03:23 πŸ”— Flashfire See if you have anything for stuff that hasnt been proccessed through the warrior
03:23 πŸ”— tech234a Such as?
03:23 πŸ”— Flashfire https://www.archiveteam.org/index.php?title=URLTeam#Alive
03:23 πŸ”— Flashfire anything from there that isnt also in https://www.archiveteam.org/index.php?title=URLTeam#Warrior_projects
03:24 πŸ”— tech234a Ok
03:24 πŸ”— Flashfire for example cl.ly is in the alive section but not the warrior section
03:29 πŸ”— odemg has quit IRC (Ping timeout: 615 seconds)
03:30 πŸ”— Flashfire sets mode: +o Kaz
03:36 πŸ”— odemg has joined #urlteam
03:36 πŸ”— tech234a Flashfire: ~900k tinyurl.com URLs https://drive.google.com/open?id=1LUCQUZamqDlq0uTQe9ybLQHEWZmLp5Ol
03:36 πŸ”— tech234a cl.ly next
03:37 πŸ”— Flashfire WOW
03:43 πŸ”— tech234a Hmm... my script is acting slightly funny with cl.ly, probably because of the low number of URLs that were discovered. Looking into it...
03:59 πŸ”— tech234a Flashfire: So it wasn't able to retrieve anything for cl.ly even though a few URLs showed up in the logs. If you can get me a comma or new-line separated list of domains to check, I can run it tomorrow.
04:00 πŸ”— tech234a (There is a small bug in the script where it might drop up to 56 URLs per service.)
04:08 πŸ”— VADemon__ has joined #urlteam
04:12 πŸ”— VADemon_ has quit IRC (Read error: Operation timed out)
04:14 πŸ”— Fusl__ is now known as Fusl
04:24 πŸ”— warmwaffl has quit IRC (Remote host closed the connection)
04:27 πŸ”— Flashfire ok
06:01 πŸ”— DustinV has joined #urlteam
06:34 πŸ”— DustinV has quit IRC (Read error: Operation timed out)
07:15 πŸ”— Flashfire http://accntu.re a bitly alias
08:07 πŸ”— tech234a has quit IRC (Quit: Connection closed for inactivity)
08:15 πŸ”— Zerote has joined #urlteam
12:23 πŸ”— tech234a has joined #urlteam
12:44 πŸ”— flugga has joined #urlteam
12:51 πŸ”— flugga has quit IRC (Quit: Page closed)
13:03 πŸ”— morgan_ has joined #urlteam
14:31 πŸ”— Zerote has quit IRC (Ping timeout: 260 seconds)
14:33 πŸ”— tech234a has quit IRC (Quit: Connection closed for inactivity)
14:56 πŸ”— tech234a has joined #urlteam
16:12 πŸ”— VADemon__ is now known as VADemon
16:13 πŸ”— VADemon Flashfire: cyrillic and alphabetical sorting WHERE? What language or what purpose? I am a native русский speaker, auto-qualified for the job :)
16:14 πŸ”— kiska1 has quit IRC (Read error: Operation timed out)
16:15 πŸ”— kiska1 has joined #urlteam
16:21 πŸ”— kiska1 has quit IRC (Ping timeout (120 seconds))
16:21 πŸ”— kiska1 has joined #urlteam
16:41 πŸ”— syn_ has joined #urlteam
16:42 πŸ”— syn_ has quit IRC (Client Quit)
17:20 πŸ”— Zerote has joined #urlteam
17:23 πŸ”— tech234a has quit IRC (Quit: Connection closed for inactivity)
17:43 πŸ”— warrior88 has joined #urlteam
17:47 πŸ”— warrior88 hello
17:47 πŸ”— warrior88 I'm getting "Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get." errors
17:48 πŸ”— warrior88 I'm hoping someone here can help with that
17:48 πŸ”— warrior88 I'm pretty sure it's a server side issue
17:49 πŸ”— Veeb0rg has joined #urlteam
17:50 πŸ”— Veeb0rg hey. new here got a issue/question..
17:51 πŸ”— Veeb0rg keep getting Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get.
17:53 πŸ”— warrior88 Veeb0rg: same for me
17:53 πŸ”— warrior88 I believe it's a server side problem
17:54 πŸ”— Veeb0rg guess the other question should be is there any advantage in increasing the core and memory available to the vm?
17:54 πŸ”— Veeb0rg core count
18:56 πŸ”— Zerote has quit IRC (Ping timeout: 260 seconds)
19:08 πŸ”— JackTerok has joined #urlteam
19:09 πŸ”— JackTerok Hi guys. Just found this project today and im trying to set it up. Im getting Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get.
19:10 πŸ”— JackTerok Is that a problem on my end?
19:13 πŸ”— tech234a has joined #urlteam
19:14 πŸ”— morgan_ Probably not. I'm having the same error
19:15 πŸ”— marked 4x independent reports of 507 errors now
19:15 πŸ”— JackTerok Ok Thx
19:16 πŸ”— morgan_ And the tracker says "0 scans per second"
19:16 πŸ”— morgan_ https://tracker.archiveteam.org:1338/
19:26 πŸ”— JAA Looking into it.
19:28 πŸ”— JAA Somebody2: dlvr-it is throwing a lot of "terroroftinytown.client.errors.UnexpectedNoResult: Unexpectedly did not get a body result" errors.
19:29 πŸ”— JAA Disabled dlvr-it auto-queue and cleared the errors.
19:29 πŸ”— JackTerok Its working \o/
19:34 πŸ”— Zerote has joined #urlteam
20:03 πŸ”— JackTerok has quit IRC (Quit: Page closed)
20:13 πŸ”— SmileyG has joined #urlteam
20:14 πŸ”— Smiley has quit IRC (Read error: Operation timed out)
20:22 πŸ”— Veeb0rg Is there any advantage to giving the VM more cpu cores or ram?
20:22 πŸ”— JAA Veeb0rg: For URLTeam, no. This project uses near-zero resources.
20:23 πŸ”— Veeb0rg oh, well i set it to 16cores and 16gb ram anyway. since there is nothing else running on the box anyway
20:57 πŸ”— Veeb0rg has quit IRC (Quit: Page closed)
21:42 πŸ”— tech234a has quit IRC (Quit: Connection closed for inactivity)
21:58 πŸ”— VADemon you dont even need more than 2-4 cores and 2GB of ram in any way you would use it ^_^
22:13 πŸ”— warrior88 has quit IRC (Ping timeout: 260 seconds)
23:15 πŸ”— Freiner has joined #urlteam
23:22 πŸ”— tech234a has joined #urlteam
23:23 πŸ”— Freiner has quit IRC (Quit: Page closed)
23:49 πŸ”— Zerote has quit IRC (Ping timeout: 260 seconds)

irclogger-viewer