#archiveteam 2018-06-29,Fri

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***wp494 has quit IRC (Ping timeout: 260 seconds)
wp494 has joined #archiveteam
[00:01]
..... (idle for 20mn)
Matt07211 has quit IRC (Ping timeout: 268 seconds)
Matt07211 has joined #archiveteam
[00:21]
........ (idle for 39mn)
djsrv has joined #archiveteam [01:00]
Stilett0 has joined #archiveteam [01:05]
adinbied has joined #archiveteam [01:11]
djsrvhey uh is 500px.com being archived
in 2 days they're taking all their CC-licensed images off the internet https://support.500px.com/hc/en-us/articles/360005097533
the wiki doesn't seem to indicate any archive effort https://www.archiveteam.org/index.php/500px :/
[01:13]
There seem to be about 1.1 million CC images with a space in the title (it won't let me use a blank search query) [01:20]
***SoniEx2 has quit IRC (Read error: Connection reset by peer) [01:20]
SketchCowHow the fuck long has that been there [01:20]
djsrvI'm not sure, I just found out about this site [01:20]
adinbiedDamn, didn't know its disappearing :( - I just had a quick look around and they've made archiving a challenge
They shut down their API, and closed off all access a few weeks ago
The picture URL seems to be served by an internal CDN (drscdn.500px.org) and the photo number is the same as on the normal page. However, there is a sig URL param being passed, I'm guessing that is only valid for a single picture
[01:20]
SketchCow*********************** ARCHIVE TEAM ALERT *********************************
***************** DOWNLOAD AS MUCH OF 500PX AS POSSIBLE ****************
https://500px.com/creativecommons
[01:24]
djsrvIf possible the license and author for each photo needs to be kept or else the images are basically useless
Since aside for CC-0 they require attribution
[01:28]
adinbiedTake a look at the meta content in the page source for each photo - could we maybe parse that and save it as XML? It contains all of the metadata and full url [01:30]
SketchCow#500pieces [01:30]
***Soni has joined #archiveteam [01:34]
SketchCow!ao https://support.500px.com/hc/en-us/articles/360005097533-Marketplace-Transition-Contributor-FAQ [01:38]
........ (idle for 37mn)
wp494Verizon is killing Go90: https://www.reuters.com/article/us-verizon-restructuring-go90/verizon-to-shut-down-award-winning-go90-mobile-video-app-company-idUSKBN1JP01E [02:15]
..... (idle for 22mn)
***ta9le has quit IRC (Quit: Connection closed for inactivity) [02:37]
arkiverRegarding what SketchCow said: a warrior project for 500px is starting in 7 hours from now.
We need resources. That is machines running the warrior scripts and rsync targets for the WARCs.
Please spread the word about this project.
We might have to go through 264 million IDs in a day, which will take quite some resources.
odemg JAA jrwr HCross and others ^
[02:40]
godaneso everything is on fire got it [02:57]
***archodg__ has joined #archiveteam
djsrv has quit IRC (Quit: Page closed)
djsrv has joined #archiveteam
archodg_ has quit IRC (Ping timeout: 252 seconds)
odemg has quit IRC (Ping timeout: 260 seconds)
[03:04]
djsrv has quit IRC (Quit: Page closed)
djsrv has joined #archiveteam
odemg has joined #archiveteam
BlueMax has joined #archiveteam
[03:14]
.... (idle for 15mn)
Matt07211 has quit IRC (Ping timeout: 268 seconds)
nertzy has quit IRC (Read error: Connection reset by peer)
nertzy has joined #archiveteam
[03:38]
.... (idle for 17mn)
treora has quit IRC (Remote host closed the connection)
pizzaiolo has quit IRC (Quit: pizzaiolo)
treora has joined #archiveteam
BlueMax has quit IRC (Leaving)
[04:00]
..... (idle for 21mn)
Coderjo_ has joined #archiveteam
Coderjo has quit IRC (Read error: Connection reset by peer)
[04:25]
...... (idle for 29mn)
djsrv has quit IRC (Quit: Leaving) [04:55]
.... (idle for 18mn)
BlueMax has joined #archiveteam [05:13]
.......... (idle for 47mn)
DragonMon has joined #archiveteam [06:00]
Mateon1 has quit IRC (Read error: Operation timed out)
Mateon1 has joined #archiveteam
[06:08]
..... (idle for 21mn)
|Ripley| has quit IRC (Read error: Operation timed out)
|Ripley| has joined #archiveteam
[06:29]
archodg_ has joined #archiveteam
archodg_ has quit IRC (Connection closed)
archodg has joined #archiveteam
archodg__ has quit IRC (Ping timeout: 252 seconds)
[06:36]
............... (idle for 1h13mn)
Matt07211 has joined #archiveteam
Sk1d has quit IRC (Read error: Operation timed out)
Sk1d has joined #archiveteam
[07:52]
..... (idle for 23mn)
Flashfire has joined #archiveteam
Matt07211 has quit IRC (Read error: Connection reset by peer)
[08:20]
FlashfireWHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD
I think I did it right looking like an idiot?
[08:20]
***Matt07211 has joined #archiveteam [08:21]
FlashfireJAA?
ivan?
astrid?
PRAY TELL
[08:22]
atluxityFlashfire: please hold
its a manual trigger, not automated. I dont remember the secret word myself
[08:25]
Flashfire.......... [08:36]
arkiverbe patient [08:36]
Flashfirelol
Ok
[08:37]
arkiverdon't spam the #archiveteam channel [08:37]
.................. (idle for 1h28mn)
***ta9le has joined #archiveteam [10:05]
pizzaiolo has joined #archiveteam [10:19]
odemgarkiver, shout me when you've got the script on github, got a lot to throw at it [10:28]
arkiverawesome
putting script online now, little more testing and then we'll start
[10:28]
antomaticsupercool. so ready for this. [10:31]
FlashfireWhat are you guys trying? [10:32]
arkiver#500pieces [10:33]
Flashfireoooh new project [10:33]
***DragonMon has quit IRC (Remote host closed the connection)
DragonMon has joined #archiveteam
Flashfire has quit IRC (Quit: Bye)
ivan has quit IRC (Leaving)
[10:39]
ivan has joined #archiveteam [10:52]
....... (idle for 32mn)
archodg has quit IRC (Quit: Leaving)
archodg has joined #archiveteam
[11:24]
....... (idle for 31mn)
adinbied has quit IRC (Ping timeout: 255 seconds) [11:55]
SN4T14 has quit IRC (Quit: ZNC 1.6.3 - http://znc.in)
SN4T14 has joined #archiveteam
Laverne has quit IRC (Quit: ZNC - http://znc.sourceforge.net)
[12:03]
BlueMax has quit IRC (Leaving) [12:12]
adinbied has joined #archiveteam [12:19]
..... (idle for 20mn)
Smiley has quit IRC (Remote host closed the connection)
DopefishJ has joined #archiveteam
Smiley has joined #archiveteam
riking has quit IRC (Ping timeout: 257 seconds)
DrasticAc has quit IRC (Ping timeout: 257 seconds)
xarph has quit IRC (Ping timeout: 257 seconds)
jrwr has quit IRC (Ping timeout: 257 seconds)
deathy has quit IRC (Ping timeout: 257 seconds)
Ctrl-S___ has quit IRC (Ping timeout: 257 seconds)
trs80 has quit IRC (Ping timeout: 257 seconds)
inzom has quit IRC (Ping timeout: 257 seconds)
trs80 has joined #archiveteam
Vito` has quit IRC (Ping timeout: 260 seconds)
DFJustin has quit IRC (Ping timeout: 260 seconds)
davisonio has quit IRC (Ping timeout: 260 seconds)
voltagex has quit IRC (Ping timeout: 260 seconds)
arkiver has quit IRC (Ping timeout: 260 seconds)
macker has quit IRC (Ping timeout: 260 seconds)
plue has quit IRC (Ping timeout: 260 seconds)
abartov__ has quit IRC (Ping timeout: 260 seconds)
HCross has quit IRC (Ping timeout: 260 seconds)
bitspill has quit IRC (Ping timeout: 260 seconds)
kisspunch has quit IRC (Ping timeout: 260 seconds)
Rondom has quit IRC (Ping timeout: 260 seconds)
sircmpwn has quit IRC (Ping timeout: 260 seconds)
echarlie has quit IRC (Ping timeout: 260 seconds)
BartoCH has quit IRC (Ping timeout: 260 seconds)
Sue_ has quit IRC (Ping timeout: 260 seconds)
Jon has quit IRC (Ping timeout: 260 seconds)
omglolba- has quit IRC (Ping timeout: 260 seconds)
davidar has quit IRC (Connection closed)
zino_ has joined #archiveteam
odemg has quit IRC (Ping timeout: 260 seconds)
voker57 has quit IRC (Ping timeout: 260 seconds)
Meroje has quit IRC (Ping timeout: 260 seconds)
FalconK has quit IRC (Ping timeout: 260 seconds)
lexicon has quit IRC (Ping timeout: 260 seconds)
jsa has quit IRC (Ping timeout: 260 seconds)
Rondom has joined #archiveteam
voker57 has joined #archiveteam
jsa has joined #archiveteam
plue has joined #archiveteam
ThisAsYou has quit IRC (Ping timeout: 260 seconds)
JSharp has quit IRC (Ping timeout: 260 seconds)
omglolbah has joined #archiveteam
jmtd has joined #archiveteam
Meroje has joined #archiveteam
macker has joined #archiveteam
kisspunch has joined #archiveteam
Sue has joined #archiveteam
BartoCH has joined #archiveteam
arkiver has joined #archiveteam
Spydar007 has quit IRC (Read error: Operation timed out)
ebel_ has quit IRC (Read error: Operation timed out)
treora has quit IRC (Write error: Broken pipe)
treora has joined #archiveteam
ThisAsYou has joined #archiveteam
ebel_ has joined #archiveteam
Spydar007 has joined #archiveteam
sircmpwn has joined #archiveteam
FalconK has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
[12:39]
ThisAsYou has joined #archiveteam
JSharp has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
JSharp has quit IRC (Read error: Connection reset by peer)
[13:05]
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
[13:15]
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
[13:26]
ThisAsYou has joined #archiveteam [13:36]
ThisAsYou has quit IRC (Read error: Connection reset by peer) [13:41]
ThisAsYou has joined #archiveteam [13:47]
JSharp has joined #archiveteam [13:54]
m007a83 has quit IRC (Read error: Connection reset by peer)
m007a83 has joined #archiveteam
m007a83 has quit IRC (Read error: Connection reset by peer)
m007a83 has joined #archiveteam
hook54321 has quit IRC (Ping timeout: 252 seconds)
medowar has quit IRC (Ping timeout: 252 seconds)
pizzaiolo has quit IRC (Read error: Connection reset by peer)
pizzaiolo has joined #archiveteam
hook54321 has joined #archiveteam
DragonMon has quit IRC (Ping timeout: 252 seconds)
i0npulse has quit IRC (Ping timeout: 252 seconds)
i0npulse has joined #archiveteam
medowar has joined #archiveteam
DragonMon has joined #archiveteam
Ctrl has quit IRC (Ping timeout: 268 seconds)
Spydar007 has quit IRC (Ping timeout: 268 seconds)
Ceryn^ has joined #archiveteam
Spydar007 has joined #archiveteam
trs80 has quit IRC (Ping timeout: 268 seconds)
aMunster has quit IRC (Read error: Connection reset by peer)
trs80 has joined #archiveteam
C4K3 has quit IRC (Ping timeout: 600 seconds)
Spydar007 has quit IRC (Ping timeout: 268 seconds)
BnAboyZ has joined #archiveteam
Ceryn^ has quit IRC (Ping timeout: 268 seconds)
C4K3 has joined #archiveteam
Spydar007 has joined #archiveteam
REiN^ has quit IRC (Ping timeout: 600 seconds)
aMunster has joined #archiveteam
treora has quit IRC (Ping timeout: 268 seconds)
nwf has quit IRC (Ping timeout: 600 seconds)
REiN^ has joined #archiveteam
altlabel has joined #archiveteam
treora has joined #archiveteam
nwf has joined #archiveteam
Spydar007 has quit IRC (Ping timeout: 268 seconds)
K4k has quit IRC (Ping timeout: 365 seconds)
K4k has joined #archiveteam
C4K3 has quit IRC (Remote host closed the connection)
C4K3 has joined #archiveteam
beardicus has quit IRC (Read error: Operation timed out)
BnAboyZ has quit IRC (Ping timeout: 268 seconds)
TigerbotH has quit IRC (Ping timeout: 600 seconds)
beardicus has joined #archiveteam
BnAboyZ has joined #archiveteam
Spydar007 has joined #archiveteam
Tenebrae has quit IRC (Ping timeout: 365 seconds)
C4K3 has quit IRC (Remote host closed the connection)
arkiver has quit IRC (Ping timeout: 600 seconds)
Tenebrae has joined #archiveteam
Ctrl has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
arkiver has joined #archiveteam
jrwr has joined #archiveteam
Vito` has joined #archiveteam
JSharp has quit IRC (Read error: Connection reset by peer)
Vito` has quit IRC (Read error: Connection reset by peer)
TigerbotH has joined #archiveteam
benoli999 has quit IRC (Read error: Operation timed out)
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
benoli999 has joined #archiveteam
Ceryn^ has joined #archiveteam
C4K3 has joined #archiveteam
ThisAsYou has joined #archiveteam
[13:59]
..... (idle for 23mn)
JSharp has joined #archiveteam [15:17]
JSharp has quit IRC (Read error: Connection reset by peer) [15:25]
Matt07211 has quit IRC (Ping timeout: 268 seconds)
Matt07211 has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
Vito` has joined #archiveteam
Vito` has quit IRC (Read error: Connection reset by peer)
[15:39]
JSharp has joined #archiveteam
JSharp has quit IRC (Read error: Connection reset by peer)
[15:53]
altlabel has quit IRC (Read error: Operation timed out)
BnAboyZ has quit IRC (Read error: Operation timed out)
Spydar007 has quit IRC (Read error: Operation timed out)
Vito` has joined #archiveteam
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
JSharp has joined #archiveteam
kisspunch has quit IRC (Ping timeout: 268 seconds)
Deewiant has quit IRC (Ping timeout: 186 seconds)
Deewiant has joined #archiveteam
kisspunch has joined #archiveteam
Spydar007 has joined #archiveteam
BnAboyZ has joined #archiveteam
altlabel has joined #archiveteam
[15:58]
ThisAsYou has joined #archiveteam [16:18]
adinbied has quit IRC (Read error: Connection reset by peer)
phuzion has quit IRC (Remote host closed the connection)
m007a83 has quit IRC (Read error: Connection reset by peer)
Pixi has quit IRC (Read error: Connection reset by peer)
adinbied has joined #archiveteam
phuzion has joined #archiveteam
DragonMon has quit IRC (Ping timeout: 252 seconds)
m007a83 has joined #archiveteam
Sue has quit IRC (Remote host closed the connection)
[16:26]
ThisAsYou has quit IRC (Read error: Connection reset by peer)
db48x has joined #archiveteam
cf has quit IRC (Read error: Operation timed out)
cf has joined #archiveteam
ThisAsYou has joined #archiveteam
[16:42]
.... (idle for 15mn)
yuitimoth has quit IRC (Remote host closed the connection)
MrRadar2 has quit IRC (Ping timeout: 260 seconds)
[17:04]
..... (idle for 24mn)
Phoen1x has joined #archiveteam [17:29]
Phoen1xWHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD
That is stupid and hilarious, by the way
[17:29]
db48x:) [17:33]
***ThisAsYou has quit IRC (Read error: Connection reset by peer) [17:43]
..... (idle for 20mn)
DragonMon has joined #archiveteam
Sue has joined #archiveteam
[18:03]
ThisAsYou has joined #archiveteam [18:13]
phuzionPhoen1x: Looking at my logs, try #archiveteam and see if that works [18:15]
Phoen1x"Incorrect or missing CAPTCHA." [18:17]
***odemg has joined #archiveteam
Pixi has joined #archiveteam
[18:21]
Phoen1xNot `archiveteam` or `jasonscott` either [18:24]
astridWHAT IS YOUR QUEST [18:25]
Phoen1xThe wiki is outdated and incomplete and this infuriates me [18:26]
astridcheck your /msg [18:26]
Phoen1xballer. ty [18:26]
***hive-mind has quit IRC (Ping timeout: 260 seconds)
hive-mind has joined #archiveteam
[18:31]
ThisAsYou has quit IRC (Read error: Connection reset by peer) [18:43]
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
MrRadar2 has joined #archiveteam
ThisAsYou has joined #archiveteam
[18:49]
HCross has joined #archiveteam [19:03]
.... (idle for 19mn)
antomaticAnyone aroud with tracker access who can re-queue the outstanding items on 500px-grab? [19:22]
***m007a83 has quit IRC (Quit: Leaving)
m007a83 has joined #archiveteam
[19:25]
antomatic(thanks hc) [19:31]
***odemg has quit IRC (Ping timeout: 480 seconds) [19:35]
............. (idle for 1h3mn)
Pixi has quit IRC (Read error: Connection reset by peer)
m007a83 has quit IRC (Read error: Connection reset by peer)
Pixi has joined #archiveteam
m007a83 has joined #archiveteam
[20:38]
ThisAsYou has quit IRC (Read error: Connection reset by peer) [20:44]
Pixi` has joined #archiveteam
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
Pixi has quit IRC (Ping timeout: 255 seconds)
[20:49]
ats has quit IRC (Read error: Operation timed out)
ThisAsYou has joined #archiveteam
[21:04]
DragonMon has quit IRC (Remote host closed the connection) [21:16]
ats has joined #archiveteam [21:25]
................ (idle for 1h19mn)
ThisAsYou has quit IRC (Read error: Connection reset by peer)
arbin has quit IRC (Read error: Connection reset by peer)
arbin has joined #archiveteam
is- has quit IRC (Read error: Connection reset by peer)
Yurume has quit IRC (Ping timeout: 480 seconds)
[22:44]
atluxity has quit IRC (Ping timeout: 480 seconds) [22:55]
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
BlueMax has joined #archiveteam
Yurume has joined #archiveteam
is- has joined #archiveteam
[23:04]
ThisAsYou has joined #archiveteam
ThisAsYou has quit IRC (Read error: Connection reset by peer)
atluxity has joined #archiveteam
ThisAsYou has joined #archiveteam
Pixi` has quit IRC (Quit: Pixi`)
Pixi has joined #archiveteam
[23:17]
.... (idle for 19mn)
latinflav has joined #archiveteam
latinflav has quit IRC (Client Quit)
[23:43]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)