| Time |
Nickname |
Message |
|
00:08
π
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |
|
00:17
π
|
Flashfire |
35.200.144.89 leaving that there for later investigations |
|
00:25
π
|
|
Zerote has joined #urlteam |
|
00:33
π
|
Flashfire |
Hello Zerote what brings you here? |
|
00:35
π
|
|
Smiley has joined #urlteam |
|
00:35
π
|
Flashfire |
Hiya Smiley |
|
00:36
π
|
|
SmileyG has quit IRC (Read error: Operation timed out) |
|
00:37
π
|
|
tech234a has joined #urlteam |
|
00:39
π
|
Zerote |
Just lurking, mostly |
|
00:39
π
|
Flashfire |
Fair enough |
|
00:39
π
|
Flashfire |
I am going to try and welcome people when I can |
|
00:40
π
|
Flashfire |
welcome tech234a |
|
01:56
π
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |
|
02:05
π
|
tech234a |
Thanks |
|
02:05
π
|
Flashfire |
So what brings you here friend? |
|
02:06
π
|
tech234a |
I was around for G+, and goo.gl was shutting down and I wanted to see what was going on |
|
02:07
π
|
Flashfire |
Do you want an explanation or rundown roughly of the project or did the wiki do a good enough job? |
|
02:08
π
|
tech234a |
From what I understand, this project is working on storing copies of short URL redirection information on IA |
|
02:08
π
|
Flashfire |
Thats basically it |
|
02:08
π
|
tech234a |
I also believe that goo.gl URLs are not being archived yet (?) |
|
02:08
π
|
Flashfire |
Right now it is bruteforced and stored in txt documents |
|
02:08
π
|
tech234a |
Ahh... got it |
|
02:09
π
|
Flashfire |
Actually we should be starting on the goo.gl project soon |
|
02:09
π
|
tech234a |
Cool |
|
02:09
π
|
Flashfire |
The documents are released properly if the shortener goes down but are still available in the mean time as the torrents |
|
02:10
π
|
tech234a |
Ok |
|
02:10
π
|
Flashfire |
We plan to one day have these as Dark Warc files that will be ingested into wayback if a shortener goes down |
|
02:10
π
|
tech234a |
Good to know |
|
02:10
π
|
Flashfire |
(but I dont have the coding knowledge or time to do it) Right now I am supposed to be doing an assessment |
|
02:11
π
|
tech234a |
Of goo.gl? |
|
02:11
π
|
Flashfire |
Though if you find any new url shorteners that arent on the wiki feel free to drop them here and ping me or one of the other ops |
|
02:11
π
|
Flashfire |
No a school assignment lol |
|
02:11
π
|
tech234a |
Ah... cool |
|
02:12
π
|
tech234a |
Do you need help discovering URLs too? |
|
02:12
π
|
Flashfire |
I mean if you have new url shorteners then just drop them here. |
|
02:12
π
|
Flashfire |
Check the wiki and the unsorted page of the wiki |
|
02:12
π
|
tech234a |
Ok |
|
02:12
π
|
Flashfire |
Urlteam and Urlteam/Unsorted |
|
02:12
π
|
Flashfire |
I think they are called |
|
02:12
π
|
tech234a |
Thanks |
|
02:13
π
|
Flashfire |
all good |
|
02:13
π
|
Flashfire |
I am still trying to figure out where Cyrillic and Emojis fit into alphabetical order as well so if you have any insights lol |
|
02:14
π
|
tech234a |
I'm not sure about that myself :) |
|
02:14
π
|
Flashfire |
actually tech234a if you are bored with time on your hands you can find out which Cyrillic Alphabets http://ΡΠΎΡ.ΡΡ/ |
|
02:14
π
|
Flashfire |
http://ΡΡΡ.ΡΡ/ use |
|
02:14
π
|
Flashfire |
Those 2 url shorteners |
|
02:14
π
|
Flashfire |
I have been lazy about doing it myself so its up to you |
|
02:15
π
|
tech234a |
I'm a little busy right now, but I have a script that discovers URLs from CommonCrawl - I can grab those for you |
|
02:15
π
|
tech234a |
This won't be the first time that script has come in handy |
|
02:16
π
|
Flashfire |
if you want to DM me a list of urls that it has discovered I can look through it for short URLs if I have spare time |
|
02:16
π
|
|
warmwaffl has joined #urlteam |
|
02:16
π
|
Flashfire |
any little bit helps |
|
02:16
π
|
tech234a |
Ok, cool! |
|
02:56
π
|
tech234a |
Flashfire: Here are ~4 million URLs pulled from CommonCrawl relating to goo.gl https://drive.google.com/open?id=1tZBCWjtRWT9AWfZIVsTWMliDejTKmfUe |
|
02:57
π
|
Flashfire |
Ill take a look |
|
03:05
π
|
|
Hani has quit IRC (Read error: Connection reset by peer) |
|
03:07
π
|
|
Fusl has quit IRC (Ping timeout: 265 seconds) |
|
03:10
π
|
|
KingNerd has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
kiska has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
Flashfire has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
seatsea has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
driib has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
tech234a has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
odemg has quit IRC (efnet.portlane.se se.hub) |
|
03:10
π
|
|
Jens has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
zhongfu has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
bakJAA has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
t3 has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
jornbaer has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Jusque has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
mr_archiv has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
abstract has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
phuzion has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
N4Y has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
gandalf has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
hook54321 has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
horkermon has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Fusl_ has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
chr1sm has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
HCross has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
pnJay has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
diggan has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
JSharp has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Ctrl-S_ has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
deathy has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
kpcyrd has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Hecatz has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Muad-Dib has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
nyany has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
svchfoo3 has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
MrRadar2 has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
treora has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
BnAboyZ has quit IRC (efnet.portlane.se se.hub) |
|
03:11
π
|
|
Dallas has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
eythian has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
pikami has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
warmwaffl has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Smiley has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Frogging has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
ivan has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
JAA has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
svchfoo1 has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
lunik1 has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
marked has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
hiiva has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
VADemon_ has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Kagee has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
yano has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
MrRadar has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Somebody2 has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
arkiver has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
joepie91 has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
swebb has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
chfoo has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Cameron_D has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Soulflare has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Matthww_ has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
mtntmnky has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
TigerbotH has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
Mayonaise has quit IRC (efnet.portlane.se se.hub) |
|
03:12
π
|
|
kiska1 has quit IRC (efnet.portlane.se se.hub) |
|
03:13
π
|
|
Kaz has quit IRC (Ping timeout: 265 seconds) |
|
03:15
π
|
|
Kaz has joined #urlteam |
|
03:17
π
|
|
kiskabak has quit IRC (Ping timeout: 265 seconds) |
|
03:17
π
|
|
kiskabak has joined #urlteam |
|
03:17
π
|
|
Fusl__ has joined #urlteam |
|
03:17
π
|
|
Hani has joined #urlteam |
|
03:17
π
|
|
warmwaffl has joined #urlteam |
|
03:17
π
|
|
tech234a has joined #urlteam |
|
03:17
π
|
|
Smiley has joined #urlteam |
|
03:17
π
|
|
VADemon_ has joined #urlteam |
|
03:17
π
|
|
odemg has joined #urlteam |
|
03:17
π
|
|
Jens has joined #urlteam |
|
03:17
π
|
|
MrRadar2 has joined #urlteam |
|
03:17
π
|
|
nyany has joined #urlteam |
|
03:17
π
|
|
seatsea has joined #urlteam |
|
03:17
π
|
|
treora has joined #urlteam |
|
03:17
π
|
|
BnAboyZ has joined #urlteam |
|
03:17
π
|
|
Dallas has joined #urlteam |
|
03:17
π
|
|
mtntmnky has joined #urlteam |
|
03:17
π
|
|
TigerbotH has joined #urlteam |
|
03:17
π
|
|
Mayonaise has joined #urlteam |
|
03:17
π
|
|
eythian has joined #urlteam |
|
03:17
π
|
|
KingNerd has joined #urlteam |
|
03:17
π
|
|
kiska has joined #urlteam |
|
03:17
π
|
|
Flashfire has joined #urlteam |
|
03:17
π
|
|
Frogging has joined #urlteam |
|
03:17
π
|
|
Matthww_ has joined #urlteam |
|
03:17
π
|
|
zhongfu has joined #urlteam |
|
03:17
π
|
|
marked has joined #urlteam |
|
03:17
π
|
|
kiska1 has joined #urlteam |
|
03:17
π
|
|
Kagee has joined #urlteam |
|
03:17
π
|
|
ivan has joined #urlteam |
|
03:17
π
|
|
bakJAA has joined #urlteam |
|
03:17
π
|
|
svchfoo3 has joined #urlteam |
|
03:17
π
|
|
svchfoo1 has joined #urlteam |
|
03:17
π
|
|
se.hub sets mode: +oooo Flashfire bakJAA svchfoo3 svchfoo1 |
|
03:17
π
|
|
pikami has joined #urlteam |
|
03:17
π
|
|
yano has joined #urlteam |
|
03:17
π
|
|
t3 has joined #urlteam |
|
03:17
π
|
|
JAA has joined #urlteam |
|
03:17
π
|
|
lunik1 has joined #urlteam |
|
03:17
π
|
|
hiiva has joined #urlteam |
|
03:17
π
|
|
MrRadar has joined #urlteam |
|
03:17
π
|
|
Somebody2 has joined #urlteam |
|
03:17
π
|
|
arkiver has joined #urlteam |
|
03:17
π
|
|
joepie91 has joined #urlteam |
|
03:17
π
|
|
swebb has joined #urlteam |
|
03:17
π
|
|
jornbaer has joined #urlteam |
|
03:17
π
|
|
Jusque has joined #urlteam |
|
03:17
π
|
|
mr_archiv has joined #urlteam |
|
03:17
π
|
|
abstract has joined #urlteam |
|
03:17
π
|
|
se.hub sets mode: +ooo JAA Somebody2 arkiver |
|
03:17
π
|
|
driib has joined #urlteam |
|
03:17
π
|
|
phuzion has joined #urlteam |
|
03:17
π
|
|
N4Y has joined #urlteam |
|
03:17
π
|
|
Muad-Dib has joined #urlteam |
|
03:17
π
|
|
Hecatz has joined #urlteam |
|
03:17
π
|
|
kpcyrd has joined #urlteam |
|
03:17
π
|
|
deathy has joined #urlteam |
|
03:17
π
|
|
Ctrl-S_ has joined #urlteam |
|
03:17
π
|
|
HCross has joined #urlteam |
|
03:17
π
|
|
chr1sm has joined #urlteam |
|
03:17
π
|
|
diggan has joined #urlteam |
|
03:17
π
|
|
pnJay has joined #urlteam |
|
03:17
π
|
|
JSharp has joined #urlteam |
|
03:17
π
|
|
Fusl_ has joined #urlteam |
|
03:17
π
|
|
horkermon has joined #urlteam |
|
03:17
π
|
|
hook54321 has joined #urlteam |
|
03:17
π
|
|
gandalf has joined #urlteam |
|
03:17
π
|
|
Soulflare has joined #urlteam |
|
03:17
π
|
|
Cameron_D has joined #urlteam |
|
03:17
π
|
|
chfoo has joined #urlteam |
|
03:17
π
|
|
se.hub sets mode: +ooo HCross hook54321 chfoo |
|
03:20
π
|
tech234a |
Flashfire: ~3.7 million bit.ly URLs https://drive.google.com/open?id=1ozXk6mx8lBw5IVLnLxmdoIN1Hu3qDLKz |
|
03:21
π
|
Flashfire |
Bitly we currently have running through the warriors but thats still useful to look through |
|
03:22
π
|
tech234a |
I'll see what I can pull for TinyURL |
|
03:23
π
|
Flashfire |
See if you have anything for stuff that hasnt been proccessed through the warrior |
|
03:23
π
|
tech234a |
Such as? |
|
03:23
π
|
Flashfire |
https://www.archiveteam.org/index.php?title=URLTeam#Alive |
|
03:23
π
|
Flashfire |
anything from there that isnt also in https://www.archiveteam.org/index.php?title=URLTeam#Warrior_projects |
|
03:24
π
|
tech234a |
Ok |
|
03:24
π
|
Flashfire |
for example cl.ly is in the alive section but not the warrior section |
|
03:29
π
|
|
odemg has quit IRC (Ping timeout: 615 seconds) |
|
03:30
π
|
|
Flashfire sets mode: +o Kaz |
|
03:36
π
|
|
odemg has joined #urlteam |
|
03:36
π
|
tech234a |
Flashfire: ~900k tinyurl.com URLs https://drive.google.com/open?id=1LUCQUZamqDlq0uTQe9ybLQHEWZmLp5Ol |
|
03:36
π
|
tech234a |
cl.ly next |
|
03:37
π
|
Flashfire |
WOW |
|
03:43
π
|
tech234a |
Hmm... my script is acting slightly funny with cl.ly, probably because of the low number of URLs that were discovered. Looking into it... |
|
03:59
π
|
tech234a |
Flashfire: So it wasn't able to retrieve anything for cl.ly even though a few URLs showed up in the logs. If you can get me a comma or new-line separated list of domains to check, I can run it tomorrow. |
|
04:00
π
|
tech234a |
(There is a small bug in the script where it might drop up to 56 URLs per service.) |
|
04:08
π
|
|
VADemon__ has joined #urlteam |
|
04:12
π
|
|
VADemon_ has quit IRC (Read error: Operation timed out) |
|
04:14
π
|
|
Fusl__ is now known as Fusl |
|
04:24
π
|
|
warmwaffl has quit IRC (Remote host closed the connection) |
|
04:27
π
|
Flashfire |
ok |
|
06:01
π
|
|
DustinV has joined #urlteam |
|
06:34
π
|
|
DustinV has quit IRC (Read error: Operation timed out) |
|
07:15
π
|
Flashfire |
http://accntu.re a bitly alias |
|
08:07
π
|
|
tech234a has quit IRC (Quit: Connection closed for inactivity) |
|
08:15
π
|
|
Zerote has joined #urlteam |
|
12:23
π
|
|
tech234a has joined #urlteam |
|
12:44
π
|
|
flugga has joined #urlteam |
|
12:51
π
|
|
flugga has quit IRC (Quit: Page closed) |
|
13:03
π
|
|
morgan_ has joined #urlteam |
|
14:31
π
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |
|
14:33
π
|
|
tech234a has quit IRC (Quit: Connection closed for inactivity) |
|
14:56
π
|
|
tech234a has joined #urlteam |
|
16:12
π
|
|
VADemon__ is now known as VADemon |
|
16:13
π
|
VADemon |
Flashfire: cyrillic and alphabetical sorting WHERE? What language or what purpose? I am a native ΡΡΡΡΠΊΠΈΠΉ speaker, auto-qualified for the job :) |
|
16:14
π
|
|
kiska1 has quit IRC (Read error: Operation timed out) |
|
16:15
π
|
|
kiska1 has joined #urlteam |
|
16:21
π
|
|
kiska1 has quit IRC (Ping timeout (120 seconds)) |
|
16:21
π
|
|
kiska1 has joined #urlteam |
|
16:41
π
|
|
syn_ has joined #urlteam |
|
16:42
π
|
|
syn_ has quit IRC (Client Quit) |
|
17:20
π
|
|
Zerote has joined #urlteam |
|
17:23
π
|
|
tech234a has quit IRC (Quit: Connection closed for inactivity) |
|
17:43
π
|
|
warrior88 has joined #urlteam |
|
17:47
π
|
warrior88 |
hello |
|
17:47
π
|
warrior88 |
I'm getting "Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get." errors |
|
17:48
π
|
warrior88 |
I'm hoping someone here can help with that |
|
17:48
π
|
warrior88 |
I'm pretty sure it's a server side issue |
|
17:49
π
|
|
Veeb0rg has joined #urlteam |
|
17:50
π
|
Veeb0rg |
hey. new here got a issue/question.. |
|
17:51
π
|
Veeb0rg |
keep getting Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get. |
|
17:53
π
|
warrior88 |
Veeb0rg: same for me |
|
17:53
π
|
warrior88 |
I believe it's a server side problem |
|
17:54
π
|
Veeb0rg |
guess the other question should be is there any advantage in increasing the core and memory available to the vm? |
|
17:54
π
|
Veeb0rg |
core count |
|
18:56
π
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |
|
19:08
π
|
|
JackTerok has joined #urlteam |
|
19:09
π
|
JackTerok |
Hi guys. Just found this project today and im trying to set it up. Im getting Error communicating with tracker: 507 Server Error: The tracker needs an operator for manual maintenance. Try again later. for url: https://tracker.archiveteam.org:1338/api/get. |
|
19:10
π
|
JackTerok |
Is that a problem on my end? |
|
19:13
π
|
|
tech234a has joined #urlteam |
|
19:14
π
|
morgan_ |
Probably not. I'm having the same error |
|
19:15
π
|
marked |
4x independent reports of 507 errors now |
|
19:15
π
|
JackTerok |
Ok Thx |
|
19:16
π
|
morgan_ |
And the tracker says "0 scans per second" |
|
19:16
π
|
morgan_ |
https://tracker.archiveteam.org:1338/ |
|
19:26
π
|
JAA |
Looking into it. |
|
19:28
π
|
JAA |
Somebody2: dlvr-it is throwing a lot of "terroroftinytown.client.errors.UnexpectedNoResult: Unexpectedly did not get a body result" errors. |
|
19:29
π
|
JAA |
Disabled dlvr-it auto-queue and cleared the errors. |
|
19:29
π
|
JackTerok |
Its working \o/ |
|
19:34
π
|
|
Zerote has joined #urlteam |
|
20:03
π
|
|
JackTerok has quit IRC (Quit: Page closed) |
|
20:13
π
|
|
SmileyG has joined #urlteam |
|
20:14
π
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
20:22
π
|
Veeb0rg |
Is there any advantage to giving the VM more cpu cores or ram? |
|
20:22
π
|
JAA |
Veeb0rg: For URLTeam, no. This project uses near-zero resources. |
|
20:23
π
|
Veeb0rg |
oh, well i set it to 16cores and 16gb ram anyway. since there is nothing else running on the box anyway |
|
20:57
π
|
|
Veeb0rg has quit IRC (Quit: Page closed) |
|
21:42
π
|
|
tech234a has quit IRC (Quit: Connection closed for inactivity) |
|
21:58
π
|
VADemon |
you dont even need more than 2-4 cores and 2GB of ram in any way you would use it ^_^ |
|
22:13
π
|
|
warrior88 has quit IRC (Ping timeout: 260 seconds) |
|
23:15
π
|
|
Freiner has joined #urlteam |
|
23:22
π
|
|
tech234a has joined #urlteam |
|
23:23
π
|
|
Freiner has quit IRC (Quit: Page closed) |
|
23:49
π
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |