#archiveteam-bs 2016-03-07,Mon

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***Stilett0 is now known as Stiletto [00:22]
.... (idle for 15mn)
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #archiveteam-bs
[00:37]
....... (idle for 32mn)
JesseW has joined #archiveteam-bs [01:11]
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #archiveteam-bs
[01:23]
............... (idle for 1h14mn)
marvinw_ is now known as ivan` [02:38]
ivan`JesseW: thanks, grabbing your youtube submissions [02:38]
botpie91ivan`: 06 Mar 07:31Z <yipdw> tell ivan` that https://www.youtube.com/watch?v=DydIK14AvXI must be archived [02:38]
JesseWivan`: cool, glad to have it [02:39]
yipdwoh I was joking but [02:41]
ivan`https://www.youtube.com/watch?v=DEZ1mBA0AVA from the same channel [02:43]
***dashcloud has quit IRC (Read error: Operation timed out)
mismatch_ has quit IRC (Remote host closed the connection)
mismatch_ has joined #archiveteam-bs
dashcloud has joined #archiveteam-bs
[02:52]
JesseWIDK why Vxbinaca (on the wiki) decided to copy a random essay originally written by someone else on their Wikipedia user page into the archiveteam wiki -- but, eh, whatever. [02:59]
..... (idle for 23mn)
***superkuh has quit IRC (Quit: the neuronal action potential is an electrical manipulation of reversible abrupt phase changes in the lipid bilaye) [03:22]
.... (idle for 15mn)
bwn has quit IRC (Read error: Operation timed out)
Stiletto has quit IRC (Read error: Connection reset by peer)
Stolett0 has joined #archiveteam-bs
Stolett0 is now known as Stiletto
Stolett0 has joined #archiveteam-bs
[03:37]
Stiletto has quit IRC (Read error: Operation timed out)
vitzli has joined #archiveteam-bs
Stolett0 has quit IRC (Read error: Connection reset by peer)
Stolett0 has joined #archiveteam-bs
[03:58]
.... (idle for 16mn)
JesseWJesseW is enjoying https://archive.org/details/msdos_A_Matter_of_Time_1995 [04:17]
***Stolett0 is now known as Stiletto
Stiletto is now known as Stilett0
Stilett0 is now known as Stiletto
tomwsmf-a has quit IRC (Read error: Operation timed out)
[04:25]
........ (idle for 38mn)
RedType has joined #archiveteam-bs
RichardG has quit IRC (Read error: Operation timed out)
[05:07]
MrRadarLOL: https://twitter.com/jzsavoie/status/706622991006732288 [05:10]
***Sk1d has quit IRC (Ping timeout: 250 seconds)
bwn has joined #archiveteam-bs
metalcamp has joined #archiveteam-bs
[05:14]
Sk1d has joined #archiveteam-bs
bzc6p_ has joined #archiveteam-bs
swebb sets mode: +o bzc6p_
metalcamp has quit IRC (Ping timeout: 258 seconds)
vitzli has quit IRC (Leaving)
vitzli has joined #archiveteam-bs
bzc6p has quit IRC (Read error: Operation timed out)
VADemon has quit IRC (Quit: left4dead)
[05:21]
........... (idle for 50mn)
JesseW has quit IRC (Quit: Leaving.) [06:19]
........ (idle for 37mn)
fie has quit IRC (Read error: Connection reset by peer) [06:56]
.... (idle for 18mn)
ndizzle has joined #archiveteam-bs [07:14]
metalcamp has joined #archiveteam-bs [07:21]
xXx_ndidd has quit IRC (Read error: Operation timed out) [07:27]
RichardG has joined #archiveteam-bs [07:36]
bzc6p_ has left [07:50]
....... (idle for 34mn)
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #archiveteam-bs
schbirid has joined #archiveteam-bs
[08:24]
bwn has quit IRC (Read error: Operation timed out) [08:39]
.... (idle for 18mn)
metalcamp has quit IRC (Ping timeout: 258 seconds) [08:57]
........ (idle for 37mn)
bwn has joined #archiveteam-bs
vtyl has quit IRC (Ping timeout: 250 seconds)
lytv has joined #archiveteam-bs
[09:34]
......... (idle for 40mn)
jut has joined #archiveteam-bs [10:22]
.......... (idle for 47mn)
metalcamp has joined #archiveteam-bs [11:09]
........ (idle for 36mn)
signius has quit IRC (Read error: Operation timed out)
signius has joined #archiveteam-bs
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #archiveteam-bs
[11:45]
....... (idle for 33mn)
Sk2d has joined #archiveteam-bs
PurpleSym has quit IRC (*)
PurpleSym has joined #archiveteam-bs
Sk1d has quit IRC (hub.se irc.du.se)
[12:27]
.... (idle for 16mn)
Sk2d is now known as Sk1d
metalcamp has quit IRC (Read error: Connection reset by peer)
metalcamp has joined #archiveteam-bs
VADemon has joined #archiveteam-bs
[12:43]
.............. (idle for 1h9mn)
brayden_ has joined #archiveteam-bs
swebb sets mode: +o brayden_
brayden has quit IRC (Read error: Operation timed out)
[13:58]
pgoetz has quit IRC (Remote host closed the connection)
pgoetz has joined #archiveteam-bs
pgoetz has quit IRC (Remote host closed the connection)
[14:12]
...... (idle for 29mn)
metalcamp has quit IRC (Ping timeout: 258 seconds) [14:43]
.... (idle for 19mn)
pgoetz has joined #archiveteam-bs [15:02]
metalcamp has joined #archiveteam-bs [15:08]
...... (idle for 29mn)
brayden_ is now known as brayden [15:37]
......... (idle for 43mn)
godaneSketchCow: i'm uploading 2010-09 of kpfa [16:20]
***metalcamp has quit IRC (Ping timeout: 258 seconds) [16:24]
jutHow do i easily get around a geoblock?
our national broadcaster doesn't let me see videos even though i'm home.
http://www.lrt.lt/mediateka/irasas/6375
[16:38]
vitzlitry changing IP address? maybe they got new range and it was not updated in the GeoIP db [16:49]
***bwn has quit IRC (Read error: Operation timed out) [16:51]
MrRadarAlso make sure your DNS server is not set to one outside your country (some services block using DNS) [16:56]
***JesseW has joined #archiveteam-bs [16:59]
godanehttp://lrt-live.data.lt/mcache/_definst_/lrt/mp4:video2016/ZIN0_20160307.mp4/playlist.m3u8
http://lrt-live.data.lt:8080/media/radio/2016/03/1012615840.mp3
i found a way to grab stuff from that site
[17:11]
***JesseW has quit IRC (Quit: Leaving.) [17:22]
xXx_ndidd has joined #archiveteam-bs [17:33]
bwn has joined #archiveteam-bs [17:38]
jutIf we have some free time we could get them. They have alot of historical footage and they already removed the download button. [17:43]
***ndizzle has quit IRC (Read error: Operation timed out) [17:46]
...... (idle for 27mn)
vitzli has quit IRC (Leaving) [18:13]
SimpBrainarkiver, https://github.com/SimpleBrain/livejournal-dump [18:13]
arkiverSimpBrain: thanks! [18:15]
SimpBrainits a bit basic but it's doing the job [18:15]
arkiverI think I have the grab script almost ready for the warrior. Then we'll start on the items you found are working [18:15]
SimpBrainbasically im filtering if a profile exists
so you'll only be grabbing actual accounts
[18:16]
***ndizzle has joined #archiveteam-bs [18:16]
SimpBraindiscovery could possibly be done via a warrior job if you want [18:16]
arkiverYeah. Of course we can do packs of 100 IDs, but if it turns out there's 10 large sites from those 100 the item might become too big [18:16]
SimpBrainim guessing a lot of profiles wont have journals on there
so out of the 77 million profiles
[18:17]
arkiverOk, I'll create a small warrior job for the discovery [18:17]
SimpBraini put it about a million [18:17]
arkivermillion existing accounts? [18:18]
SimpBrainblogs [18:18]
arkiverOk, sunds like we have some work :)
sounds*
[18:18]
SimpBrainmost will have signed up to probably comment
hence why some accounts are empty
[18:18]
arkiverRight
I'll let you know when the discovery job is ready then
[18:19]
SimpBrainso grabbing 100 account blocks, you may get 1 or 2 blogs in that
if that
someone may get unlucky and hit a batch of blogs
but yeah, hitting their profile page will reveal of a blog exists
on the profile page will be "username's journal" near the top in big writing
[18:19]
xmcand a post count [18:21]
SimpBrainif that link fails, then they dont have a blog
http://www.livejournal.com/profile?userid=3160731&t=I
thats just a random hit
vs http://www.livejournal.com/profile?userid=3160738&t=I
or this one http://www.livejournal.com/profile?userid=3160747&t=I
so html status code 200 or 410 is the numbers required
if enough people hit the discovery with 1 concurrent, a few days. grabbing the content at a regulated crawl, a month? maybe less
nice slow churn project
or longer if we find a lot of content
but hammering the site too much will get you banned
[18:21]
***xXx_ndidd has quit IRC (Read error: Operation timed out) [18:29]
.... (idle for 16mn)
HCross has quit IRC (Read error: Connection reset by peer)
HCross has joined #archiveteam-bs
[18:45]
.... (idle for 16mn)
yipdw has quit IRC (Ping timeout: 1224 seconds)
signius has quit IRC (Ping timeout: 345 seconds)
FalconK has quit IRC (Ping timeout: 345 seconds)
bauruine has quit IRC (Ping timeout: 316 seconds)
balrog has quit IRC (Ping timeout: 345 seconds)
dan- has quit IRC (Ping timeout: 345 seconds)
HCross2 has quit IRC (Read error: Connection reset by peer)
zhongfu has quit IRC (Remote host closed the connection)
wp494_ has joined #archiveteam-bs
winr4r has quit IRC (Write error: Connection reset by peer)
_desu____ has joined #archiveteam-bs
bauruine has joined #archiveteam-bs
Boltsie_ has joined #archiveteam-bs
balrog has joined #archiveteam-bs
swebb sets mode: +o balrog
deathy_ has joined #archiveteam-bs
TheKiwi_ has joined #archiveteam-bs
FalconK has joined #archiveteam-bs
TheKiwi_ has quit IRC (Connection closed)
TheKiwi_ has joined #archiveteam-bs
zhongfu has joined #archiveteam-bs
wp494 has quit IRC (Ping timeout: 274 seconds)
_desu___ has quit IRC (Ping timeout: 274 seconds)
Boltsie has quit IRC (Ping timeout: 274 seconds)
JSharp___ has quit IRC (Ping timeout: 274 seconds)
TheKiwi has quit IRC (Ping timeout: 274 seconds)
Ctrl-S___ has quit IRC (Ping timeout: 274 seconds)
deathy has quit IRC (Ping timeout: 274 seconds)
_desu____ is now known as _desu___
Boltsie_ is now known as Boltsie
deathy_ is now known as deathy
TheKiwi_ is now known as TheKiwi
dan- has joined #archiveteam-bs
HCross2 has joined #archiveteam-bs
signius has joined #archiveteam-bs
TheKiwi has quit IRC (Remote host closed the connection)
TheKiwi has joined #archiveteam-bs
winr4r has joined #archiveteam-bs
[19:05]
jut has quit IRC (jut) [19:23]
...... (idle for 29mn)
ersiWhy are you guys doing LiveJournal?
Also, I've got a pretty decently large username discovery dump from a year ago that I put together
sqlite> SELECT COUNT(*) FROM users;
6647647
[19:52]
SimpBrainwhat count did you get up to? [20:04]
JW_workersi: because it is very old, widely regarded as in decline, and has a lot of important stuff buried in it [20:05]
ersiAFAIK SketchCow knows people on ze insizes
insidez
LJ has an API by the way, which is pretty useful
[20:05]
xmc^ [20:09]
ersiEspecially for finding users at least [20:12]
.... (idle for 17mn)
***ndiddy has joined #archiveteam-bs
ndizzle has quit IRC (Read error: Operation timed out)
[20:29]
godanei'm starting to upload more of Joystiq Massively Speaking
2013 to 2015 epsiodes need to be uploaded
[20:37]
***dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #archiveteam-bs
[20:39]
.... (idle for 19mn)
metalcamp has joined #archiveteam-bs [21:01]
....... (idle for 32mn)
schbirid has quit IRC (Quit: Leaving) [21:33]
..... (idle for 23mn)
fie has joined #archiveteam-bs [21:56]
dashcloud has quit IRC (Read error: Operation timed out)
metalcamp has quit IRC (Ping timeout: 258 seconds)
dashcloud has joined #archiveteam-bs
[22:07]
......... (idle for 40mn)
yipdw has joined #archiveteam-bs
wp494_ is now known as wp494
[22:51]
yipdwhuh, what the F
Mar 2 18:02:02 avatar kernel: [216706.800224] bitlbee invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
i've never seen bitlbee get oompa'd
[22:58]
FalconKhuh.
harsh.
say, yipdw, did you ever figure out who to talk to about collection permissions?
[23:01]
yipdwnot yet, but it's probably SketchCow [23:01]
***RedType has left [23:01]
yipdwon a different note, Grimes is awesome because she inserted "8===D" into the liner notes of Art Angels [23:05]
***VADemon has quit IRC (Quit: left4dead) [23:17]
......... (idle for 40mn)
FalconKyipdw: https://github.com/falconkirtaran/ArchiveBot/commit/217064195aeb8b43c17a197f5362bce231aea67f
ready to test
SketchCow: any chance of creds for an IA collection?
[23:57]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)