Time |
Nickname |
Message |
00:24
🔗
|
|
achip has joined #archiveteam-bs |
00:29
🔗
|
|
marvinw has quit IRC (Max SendQ exceeded) |
00:30
🔗
|
|
lytv has quit IRC (Max SendQ exceeded) |
00:33
🔗
|
|
lytv has joined #archiveteam-bs |
00:34
🔗
|
|
marvinw has joined #archiveteam-bs |
00:44
🔗
|
|
Mayonaise has joined #archiveteam-bs |
01:39
🔗
|
|
achip has quit IRC () |
01:46
🔗
|
|
lytv has quit IRC (Read error: Connection reset by peer) |
01:49
🔗
|
|
lytv has joined #archiveteam-bs |
01:55
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
02:03
🔗
|
godane |
so looks like my upload script for koreanet-1 daegu happy screwed up |
02:04
🔗
|
godane |
20070707 and 20080808 have a full month of episodes instead of just one |
02:10
🔗
|
|
mistym has joined #archiveteam-bs |
02:15
🔗
|
joepie91 |
winr4r: https://soundcloud.com/apparat/k-f-thema |
02:15
🔗
|
joepie91 |
:) |
02:16
🔗
|
joepie91 |
man |
02:16
🔗
|
joepie91 |
apparat has certainly changed his style of music |
02:16
🔗
|
joepie91 |
over the years |
02:30
🔗
|
winr4r |
"It looks like you have a Flash blocker browser setting or extension. Please enable Flash to hear this track" |
02:31
🔗
|
winr4r |
i'm just gonna go back to switching my user agent to ipad |
02:34
🔗
|
joepie91 |
hehe |
02:34
🔗
|
joepie91 |
"hi, I'm an iPad!" |
02:38
🔗
|
|
rejon has joined #archiveteam-bs |
02:39
🔗
|
|
abartov has quit IRC (Ping timeout: 258 seconds) |
02:49
🔗
|
|
lytv has quit IRC (Read error: Connection reset by peer) |
02:52
🔗
|
|
lytv has joined #archiveteam-bs |
02:59
🔗
|
|
primus104 has quit IRC (Leaving.) |
03:06
🔗
|
|
achip has joined #archiveteam-bs |
03:29
🔗
|
|
rejon has quit IRC (Read error: Operation timed out) |
03:56
🔗
|
|
Nertsy` is now known as Nertsy |
04:29
🔗
|
Ctrl-S |
is there a web library i should use in python for making scripts for you guys? |
04:30
🔗
|
Ctrl-S |
i've used mechanize in the past |
04:31
🔗
|
yipdw |
what's wrong with seesaw+{wget,wpull} |
04:31
🔗
|
Ctrl-S |
never heard of it |
04:31
🔗
|
yipdw |
it's what is used for most projects here |
04:31
🔗
|
Ctrl-S |
I plan to make a script to save fanfiction.net stuff |
04:31
🔗
|
Ctrl-S |
because there's a page on it on the wiki but i don't see anything saved |
04:32
🔗
|
Ctrl-S |
http://archiveteam.org/index.php?title=FanFiction.Net |
04:32
🔗
|
yipdw |
we did a snapshot a long time ago |
04:32
🔗
|
Ctrl-S |
should probably rescrape every now and then |
04:32
🔗
|
yipdw |
https://archive.org/details/archiveteam-fanfiction-warc-00 |
04:32
🔗
|
yipdw |
through -13 |
04:33
🔗
|
Ctrl-S |
that's pretty old |
04:33
🔗
|
yipdw |
in any case, if you want to take advantage of the Warrior etc it's easier to use seesaw |
04:34
🔗
|
yipdw |
it's pretty old, and fanfiction.net is still alive |
04:34
🔗
|
yipdw |
there's been other things to do |
04:34
🔗
|
yipdw |
etc. |
04:35
🔗
|
yipdw |
there exists a pre-seesaw grabber as well -> https://github.com/ArchiveTeam/ffnet-grab |
04:35
🔗
|
Ctrl-S |
might be worthwile going after other fanfic sites too? |
04:35
🔗
|
yipdw |
I wouldn't reuse it, though |
04:36
🔗
|
yipdw |
my personal opinion on this is that groups like Archive Of Our Own are doing a good job of saving fanfic |
04:36
🔗
|
yipdw |
as a result I don't see a reason to have duplicate efforts |
04:36
🔗
|
yipdw |
but that's just me and in no way applies to anyone else |
04:38
🔗
|
Ctrl-S |
they scrape other sites? |
04:40
🔗
|
yipdw |
I'm not sure, they may not |
04:40
🔗
|
yipdw |
if you want to set up something that is recurring you may want to look into adapting the urlteam tracker |
04:40
🔗
|
yipdw |
it's set up to do a similar thing |
04:44
🔗
|
Ctrl-S |
how so? |
04:44
🔗
|
yipdw |
shortened URLs appear on a regular basis and are predictable |
04:45
🔗
|
Ctrl-S |
the data returned would be much larger though |
04:45
🔗
|
yipdw |
it's just HTTP |
04:45
🔗
|
yipdw |
I mean, you can also reuse seesaw for this and keep pumping in new items |
04:50
🔗
|
SketchCow |
PDFy should be fine |
04:50
🔗
|
Ctrl-S |
? |
04:51
🔗
|
SketchCow |
Super sexy |
04:51
🔗
|
SketchCow |
But I want to know if I can keyword it!! |
04:56
🔗
|
|
kyan has joined #archiveteam-bs |
05:10
🔗
|
Ctrl-S |
this stuff is just confusing me |
05:11
🔗
|
|
achip has quit IRC (Remote host closed the connection) |
05:13
🔗
|
Ctrl-S |
should i set up a linux box to do dev work? |
05:21
🔗
|
|
aaaaaaaaa has quit IRC (Leaving) |
05:33
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
05:36
🔗
|
|
sep332 has quit IRC (bye) |
05:59
🔗
|
Start |
godane: the 2015 articles can be grabbed from joystiq, massively, wow insider and tuaw |
06:00
🔗
|
Start |
wow insider and tuaw have already been grabbed for 2015, but they are missing a few articles from the last day or two |
06:06
🔗
|
|
underscor has quit IRC (Ping timeout: 370 seconds) |
06:31
🔗
|
|
underscor has joined #archiveteam-bs |
06:31
🔗
|
|
swebb sets mode: +o underscor |
06:32
🔗
|
|
Start is now known as StartAway |
06:40
🔗
|
godane |
i'm uploading massively.joystiq.com 2015 pages |
06:41
🔗
|
godane |
with images for those pages |
07:32
🔗
|
|
dashcloud has quit IRC (Read error: Connection reset by peer) |
07:32
🔗
|
|
dashcloud has joined #archiveteam-bs |
08:08
🔗
|
|
midas has quit IRC (hub.dk irc.underworld.no) |
08:08
🔗
|
|
S[h]O[r]T has quit IRC (hub.dk irc.underworld.no) |
08:08
🔗
|
|
raylee has quit IRC (hub.dk irc.underworld.no) |
08:08
🔗
|
|
Atluxity has quit IRC (hub.dk irc.underworld.no) |
08:08
🔗
|
|
wm_ has quit IRC (hub.dk irc.underworld.no) |
08:08
🔗
|
|
Kirk has quit IRC (hub.dk irc.underworld.no) |
08:12
🔗
|
|
achip has joined #archiveteam-bs |
08:14
🔗
|
|
cloudmons has joined #archiveteam-bs |
08:20
🔗
|
|
achip has quit IRC (Read error: Operation timed out) |
08:23
🔗
|
godane |
i'm uploading dvd 80 and 84 of linux magazine |
08:26
🔗
|
|
useretail has quit IRC (hub.se irc.ac.za) |
08:28
🔗
|
godane |
SketchCow: i'm giving you my SDCC 2012 stuff to your ftp |
08:28
🔗
|
godane |
its about 90gb i think |
08:29
🔗
|
godane |
also tuawvideo is being grabbed and its over 100gb |
09:24
🔗
|
|
LittUp has joined #archiveteam-bs |
09:34
🔗
|
|
primus104 has joined #archiveteam-bs |
09:48
🔗
|
|
Kirk has joined #archiveteam-bs |
09:48
🔗
|
|
midas has joined #archiveteam-bs |
09:48
🔗
|
|
wm_ has joined #archiveteam-bs |
09:49
🔗
|
|
raylee has joined #archiveteam-bs |
10:14
🔗
|
|
cloudmons has quit IRC (Remote host closed the connection) |
10:22
🔗
|
|
cloudmons has joined #archiveteam-bs |
10:36
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
10:49
🔗
|
|
schbirid has joined #archiveteam-bs |
10:49
🔗
|
|
phuzion has quit IRC (Read error: Operation timed out) |
10:52
🔗
|
|
phuzion has joined #archiveteam-bs |
10:57
🔗
|
schbirid |
noice This server could not prove that it is hkps.pool.sks-keyservers.net; its security certificate is not trusted by your computer's operating system. |
10:59
🔗
|
ersi |
Yeah, they use CAcert |
11:00
🔗
|
schbirid |
\o/ |
11:06
🔗
|
|
xtr-201 has quit IRC (Ping timeout: 370 seconds) |
11:41
🔗
|
godane |
SketchCow: i hope you can change this to iso type file: https://archive.org/details/cdrom-linux-magazine-80 |
11:42
🔗
|
godane |
the upload script i was using fixed the file to $id.avi |
11:42
🔗
|
godane |
when it should be $id.iso |
11:42
🔗
|
godane |
i change that .avi to .iso |
12:41
🔗
|
|
useretail has joined #archiveteam-bs |
13:14
🔗
|
|
primus104 has quit IRC (Leaving.) |
14:17
🔗
|
|
Nertsy has quit IRC (Read error: Operation timed out) |
14:18
🔗
|
|
Nertsy has joined #archiveteam-bs |
14:34
🔗
|
|
sep332 has joined #archiveteam-bs |
15:01
🔗
|
|
sankin has joined #archiveteam-bs |
15:08
🔗
|
|
StartAway has quit IRC (Disconnected.) |
15:16
🔗
|
|
wacky_ is now known as wacky |
15:32
🔗
|
|
mistym has joined #archiveteam-bs |
15:33
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
15:36
🔗
|
DFJustin |
you can change that yourself in edit item, change information, down at the botom |
15:52
🔗
|
|
mistym has joined #archiveteam-bs |
15:55
🔗
|
|
Ravenloft has joined #archiveteam-bs |
15:58
🔗
|
SketchCow |
He did it. |
15:58
🔗
|
|
achip has joined #archiveteam-bs |
16:10
🔗
|
|
dashcloud has quit IRC (Ping timeout: 512 seconds) |
16:13
🔗
|
DFJustin |
still says cinepack |
16:14
🔗
|
|
dashcloud has joined #archiveteam-bs |
16:14
🔗
|
|
primus104 has joined #archiveteam-bs |
16:17
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
16:19
🔗
|
|
dashcloud has joined #archiveteam-bs |
16:25
🔗
|
|
primus104 has quit IRC (Leaving.) |
16:58
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
17:00
🔗
|
|
Start has joined #archiveteam-bs |
17:17
🔗
|
|
primus104 has joined #archiveteam-bs |
17:17
🔗
|
|
mistym has joined #archiveteam-bs |
17:29
🔗
|
|
rejon has joined #archiveteam-bs |
17:38
🔗
|
|
Nertsy has quit IRC (Read error: Operation timed out) |
17:42
🔗
|
|
Nertsy has joined #archiveteam-bs |
17:43
🔗
|
|
Ravenloft has quit IRC (Read error: Connection reset by peer) |
17:45
🔗
|
|
Start has quit IRC (Disconnected.) |
17:53
🔗
|
|
phuzion has quit IRC (Quit: Adios y'all) |
17:53
🔗
|
|
aaaaaaaaa has joined #archiveteam-bs |
18:26
🔗
|
|
xtr-201 has joined #archiveteam-bs |
18:41
🔗
|
|
useretail has quit IRC (hub.se irc.ac.za) |
18:42
🔗
|
|
useretai- has joined #archiveteam-bs |
19:24
🔗
|
|
Ravenloft has joined #archiveteam-bs |
19:53
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
20:06
🔗
|
|
deathy has joined #archiveteam-bs |
20:08
🔗
|
|
mistym has joined #archiveteam-bs |
20:15
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
20:20
🔗
|
|
dashcloud has joined #archiveteam-bs |
20:32
🔗
|
|
Start has joined #archiveteam-bs |
20:39
🔗
|
|
mistym has quit IRC (Remote host closed the connection) |
20:42
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
20:55
🔗
|
|
mistym has joined #archiveteam-bs |
21:02
🔗
|
|
Ravenloft has quit IRC (Ping timeout: 512 seconds) |
21:22
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
21:31
🔗
|
schbirid |
https://catalogd.archive.org/history/rfl007 :( |
21:33
🔗
|
midas |
what was it schbirid ? |
21:33
🔗
|
schbirid |
https://www.jamendo.com/en/list/a84912/tap-water-drinkers apparently |
21:33
🔗
|
schbirid |
oh hey, JAMENDO |
21:33
🔗
|
schbirid |
;) |
21:33
🔗
|
midas |
crap :p |
21:34
🔗
|
schbirid |
wtf https://catalogd.archive.org/history/rfl011 too |
21:34
🔗
|
schbirid |
worst netlabel ever |
21:34
🔗
|
SketchCow |
Removed at the artist's request. |
21:34
🔗
|
schbirid |
yeah |
21:36
🔗
|
* |
schbirid dives under the covers |
21:36
🔗
|
schbirid |
good night |
21:36
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
21:36
🔗
|
ersi |
darked? |
21:44
🔗
|
midas |
yep |
21:59
🔗
|
|
sankin has quit IRC (Leaving.) |
22:51
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
23:02
🔗
|
|
dashcloud has joined #archiveteam-bs |
23:07
🔗
|
|
phuzion has joined #archiveteam-bs |
23:07
🔗
|
|
phuzion has quit IRC (Remote host closed the connection) |