Time |
Nickname |
Message |
00:10
π
|
|
tomwsmf has joined #archiveteam-bs |
00:14
π
|
|
JesseW has joined #archiveteam-bs |
00:31
π
|
|
REiN^ has quit IRC (Read error: Operation timed out) |
00:33
π
|
|
ravetcofx has joined #archiveteam-bs |
01:22
π
|
|
schbirid has quit IRC (Ping timeout: 258 seconds) |
01:30
π
|
|
wp494 has quit IRC (Ping timeout: 250 seconds) |
01:36
π
|
|
schbirid has joined #archiveteam-bs |
01:38
π
|
|
Ravenloft has joined #archiveteam-bs |
01:51
π
|
|
twrist has joined #archiveteam-bs |
01:52
π
|
|
GLaDOS has quit IRC (Ping timeout: 260 seconds) |
01:53
π
|
|
twrist has quit IRC (Read error: Operation timed out) |
01:54
π
|
|
GLaDOS has joined #archiveteam-bs |
02:04
π
|
|
wp494 has joined #archiveteam-bs |
02:24
π
|
godane |
i'm uploading more of 'The Times News (Idaho Newspaper)' pdfs |
02:24
π
|
godane |
1998 to 2000 for now |
02:27
π
|
godane |
btw i'm at 778k items |
02:49
π
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
02:49
π
|
|
GLaDOS has joined #archiveteam-bs |
02:57
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
03:02
π
|
DoomTay |
!a http://savehorizons.tripod.com/ --no-offsite-links |
03:15
π
|
|
Ravenloft has quit IRC (Read error: Connection reset by peer) |
03:15
π
|
|
Ravenloft has joined #archiveteam-bs |
03:16
π
|
|
tomwsmf has quit IRC (Read error: Operation timed out) |
03:30
π
|
|
Discant has joined #archiveteam-bs |
03:30
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:31
π
|
|
chazchaz_ has quit IRC (Remote host closed the connection) |
03:35
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:36
π
|
|
chazchaz_ has quit IRC (Remote host closed the connection) |
03:39
π
|
|
xfce has quit IRC (Quit: .) |
03:40
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:41
π
|
|
JesseW has joined #archiveteam-bs |
03:42
π
|
|
Discant has quit IRC (Read error: Operation timed out) |
03:42
π
|
|
chazchaz_ has quit IRC (Read error: Connection reset by peer) |
03:43
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:43
π
|
|
chazchaz_ has quit IRC (Remote host closed the connection) |
03:52
π
|
godane |
i feel like some one should give Boardwatch Magazine Collection to bombjack |
03:52
π
|
godane |
there are only like 5 issues on there site |
03:53
π
|
|
Ravenloft has quit IRC (Read error: Connection reset by peer) |
03:53
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:54
π
|
|
chazchaz_ has quit IRC (Remote host closed the connection) |
03:55
π
|
|
chazchaz_ has joined #archiveteam-bs |
03:56
π
|
|
Panasoul_ has joined #archiveteam-bs |
03:57
π
|
|
chazchaz_ has quit IRC (Remote host closed the connection) |
03:58
π
|
|
chazchaz_ has joined #archiveteam-bs |
04:04
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
04:15
π
|
|
Discant has joined #archiveteam-bs |
04:16
π
|
|
nightpool has joined #archiveteam-bs |
04:21
π
|
|
marvinw is now known as ivan |
04:30
π
|
|
Discant has quit IRC (Read error: Connection reset by peer) |
04:30
π
|
|
JesseW has joined #archiveteam-bs |
04:48
π
|
|
Panasoul_ has quit IRC (Ping timeout: 246 seconds) |
04:48
π
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
04:49
π
|
|
DoomTay has quit IRC (Quit: Page closed) |
04:50
π
|
|
tomwsmf has joined #archiveteam-bs |
04:53
π
|
|
DoomTay has joined #archiveteam-bs |
04:54
π
|
|
GLaDOS has quit IRC (Read error: Connection reset by peer) |
04:54
π
|
|
GLaDOS has joined #archiveteam-bs |
04:54
π
|
|
Sk1d has joined #archiveteam-bs |
05:18
π
|
|
nightpool has quit IRC (Read error: Operation timed out) |
05:37
π
|
|
metalcamp has joined #archiveteam-bs |
05:59
π
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
06:02
π
|
|
metalcamp has joined #archiveteam-bs |
06:07
π
|
|
Aranje has joined #archiveteam-bs |
06:07
π
|
|
yipdw has quit IRC (Remote host closed the connection) |
06:12
π
|
|
DoomTay has quit IRC (Quit: Page closed) |
06:14
π
|
|
REiN^ has joined #archiveteam-bs |
06:17
π
|
|
ndiddy has quit IRC (Read error: Operation timed out) |
06:24
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
06:42
π
|
|
tomwsmf has quit IRC (Read error: Operation timed out) |
06:46
π
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
06:53
π
|
|
yipdw has joined #archiveteam-bs |
06:55
π
|
|
ravetcofx has quit IRC (Remote host closed the connection) |
06:58
π
|
|
FalconK has quit IRC (Ping timeout: 260 seconds) |
06:59
π
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
06:59
π
|
|
GLaDOS has joined #archiveteam-bs |
07:02
π
|
|
ravetcofx has joined #archiveteam-bs |
07:07
π
|
|
FalconK has joined #archiveteam-bs |
08:00
π
|
|
GLaDOS has quit IRC (Read error: Operation timed out) |
08:00
π
|
|
GLaDOS has joined #archiveteam-bs |
08:03
π
|
|
DiscantX has joined #archiveteam-bs |
08:11
π
|
|
GLaDOS has quit IRC (Read error: Connection reset by peer) |
08:11
π
|
|
twrist has joined #archiveteam-bs |
08:12
π
|
|
twrist is now known as GLaDOS |
08:14
π
|
godane |
so i'm grabbing BBC Radio 4 Today |
08:14
π
|
godane |
at least whats there |
08:16
π
|
espes__ |
github's unlimited repositories working great for some: https://github.com/kanripo :P |
08:23
π
|
|
GLaDOS has quit IRC (Read error: Connection reset by peer) |
08:25
π
|
|
GLaDOS has joined #archiveteam-bs |
08:31
π
|
yipdw |
that's so bizarre, why one file per repo |
08:33
π
|
yipdw |
oh one text per repository |
08:33
π
|
yipdw |
that makes a bit more sense |
08:41
π
|
godane |
so BBC Radio 4 The World Tonight has some good archives |
08:41
π
|
godane |
going back to 2009-04-14 |
09:20
π
|
|
GLaDOS has quit IRC (Oh crap, I died.) |
09:20
π
|
|
GLaDOS has joined #archiveteam-bs |
09:58
π
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
10:01
π
|
|
GLaDOS has joined #archiveteam-bs |
10:06
π
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
10:06
π
|
|
GLaDOS has joined #archiveteam-bs |
10:12
π
|
|
GLaDOS has quit IRC (Oh crap, I died.) |
10:12
π
|
|
GLaDOS has joined #archiveteam-bs |
11:06
π
|
schbirid |
lol http://www.pcgamer.com/company-claims-no-mans-sky-uses-its-patented-equation-without-permission/ |
11:11
π
|
schbirid |
https://akp.thecthulhu.com/statement.txt |
12:12
π
|
|
kristian_ has joined #archiveteam-bs |
12:36
π
|
Igloo |
are you writing a script set for portalgraphics arkiver ? |
12:36
π
|
arkiver |
yeah, almost done |
12:37
π
|
Igloo |
Ah cool |
13:27
π
|
luckcolor |
question if anybody knows pls answe: does wpull in grab-site automatically splits warcs? |
13:28
π
|
arkiver |
luckcolor: I'm not sure if it will do that without any set settings |
13:28
π
|
arkiver |
But yes, it can do that |
13:31
π
|
luckcolor |
for the record "--warc-max-size=BYTES: Try to limit each WARC file to around BYTES bytes before rolling over to a new WARC file (default: 5368709120, which is 5GiB). Note that the resulting WARC files may be drastically larger if there are very large responses." |
13:56
π
|
|
DoomTay has joined #archiveteam-bs |
13:59
π
|
|
kristian_ has quit IRC (Leaving) |
14:01
π
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
14:09
π
|
|
schbirid has quit IRC (Quit: Leaving) |
14:19
π
|
DoomTay |
So....arkiver, any progress on that warrior? |
14:20
π
|
Igloo |
For which project DoomTay ? |
14:20
π
|
DoomTay |
portalgraphics |
14:20
π
|
Igloo |
Should be finished soon I think |
14:20
π
|
DoomTay |
The "death date" is less than a week away |
14:20
π
|
Igloo |
He's working on it now |
14:20
π
|
DoomTay |
Cool |
14:21
π
|
Igloo |
I've juggled some scripts / stuff |
14:21
π
|
Igloo |
So i can get a bunch of decent hosts pulling as soon as they're released |
14:21
π
|
DoomTay |
And it turns out that ArchiveBot made a bit of a mess with the relevant Jjb I fed it, so I'm going back and resaving a handful of things' |
14:21
π
|
|
nightpool has joined #archiveteam-bs |
15:17
π
|
|
JesseW has joined #archiveteam-bs |
15:36
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
16:56
π
|
|
ndiddy has joined #archiveteam-bs |
17:13
π
|
|
tomwsmf has joined #archiveteam-bs |
17:25
π
|
|
schbirid has joined #archiveteam-bs |
17:28
π
|
|
DoomTay has quit IRC (Quit: Page closed) |
17:36
π
|
|
ravetcofx has quit IRC (Quit: Leaving) |
17:44
π
|
|
ravetcofx has joined #archiveteam-bs |
17:51
π
|
|
tomwsmf has quit IRC (Read error: Operation timed out) |
18:10
π
|
|
DoomTay has joined #archiveteam-bs |
18:16
π
|
|
kristian_ has joined #archiveteam-bs |
18:27
π
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
18:27
π
|
|
GLaDOS has joined #archiveteam-bs |
18:33
π
|
|
GLaDOS has quit IRC (Oh crap, I died.) |
18:33
π
|
|
GLaDOS has joined #archiveteam-bs |
18:42
π
|
|
GLaDOS has quit IRC (Ping timeout: 260 seconds) |
18:56
π
|
|
kristian_ has quit IRC (Leaving) |
19:40
π
|
arkiver |
DoomTay: can you please have a look at this log http://paste.nerds.io/raw/epirojifay |
19:40
π
|
arkiver |
If it looks good to you, we'll start the grab |
19:43
π
|
DoomTay |
Can I see how you're handling numbers below 1000? |
19:44
π
|
DoomTay |
Everything seems okay, but it looks like attaching the lang= http://www.portalgraphics.net/pg/illust/?image_id=90331 does no good. |
19:45
π
|
arkiver |
I'm going to keep the lang= in for now |
19:45
π
|
arkiver |
if it turns out we can't grab everything in time I'll remove those URLs. |
19:45
π
|
arkiver |
ID 139: http://paste.nerds.io/raw/cuqelebajo |
19:46
π
|
DoomTay |
Yup, looks good |
19:46
π
|
DoomTay |
And also a last-minute heads up, the upper limit is now 90346 and that may change tomorrow |
19:48
π
|
HCross |
running a private crawl on (http://www.intercambiosvirtuales.org) - a Spanish torrent/piracy site |
19:50
π
|
DoomTay |
Do you have a thing to catch occurances of "εη·γθΎΌγΏεγ£γ¦γγγΎγγζιγγγγ¦εεΊ¦γ’γ―γ»γΉγγ¦γγ γγ", which basically means "The servers are busy. Please wait"? |
19:57
π
|
arkiver |
DoomTay: no, I never got that message |
19:57
π
|
DoomTay |
Hmm |
19:57
π
|
arkiver |
do you have a status code for that? |
19:57
π
|
DoomTay |
It'll give you a 200 |
20:01
π
|
arkiver |
Will the whole page be ??????????????????????????????? |
20:01
π
|
arkiver |
or is that string somewhere on the page? |
20:01
π
|
arkiver |
also, view-source:http://www.portalgraphics.net/pg/illust/?image_id=1 |
20:01
π
|
arkiver |
It has the japanese characters and some more info after that |
20:01
π
|
arkiver |
http://www.portalgraphics.net/pg/illust/?image_id=1 |
20:02
π
|
arkiver |
does the servers are busy message also have some more explanation? |
20:07
π
|
|
DoomTay has quit IRC (Ping timeout: 268 seconds) |
20:07
π
|
|
kvieta has quit IRC (Read error: Operation timed out) |
20:07
π
|
|
kvieta has joined #archiveteam-bs |
20:07
π
|
|
zerkalo has quit IRC (Read error: Operation timed out) |
20:08
π
|
|
hawc145 has joined #archiveteam-bs |
20:08
π
|
|
SilSte has quit IRC (Read error: Operation timed out) |
20:08
π
|
|
HCross has quit IRC (Read error: Operation timed out) |
20:09
π
|
|
xmc has quit IRC (Read error: Operation timed out) |
20:09
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
20:09
π
|
|
Fletcher has quit IRC (Read error: Operation timed out) |
20:09
π
|
|
yeoldetoa has quit IRC (Read error: Operation timed out) |
20:11
π
|
|
dxrt- has quit IRC (Read error: Operation timed out) |
20:11
π
|
|
DoomTay has joined #archiveteam-bs |
20:12
π
|
DoomTay |
If I remember correctly, the only other thing besides that message was a link to www.portalgraphics.net |
20:12
π
|
|
Start has quit IRC (Read error: Operation timed out) |
20:12
π
|
|
brayden has quit IRC (Read error: Operation timed out) |
20:12
π
|
DoomTay |
As for that other thing you just linked me, that basically means the image was actually deleted |
20:13
π
|
DoomTay |
So yeah, in other news, my house kinda lost power, hence my sudden disappearance |
20:13
π
|
|
dashcloud has joined #archiveteam-bs |
20:14
π
|
|
yeoldetoa has joined #archiveteam-bs |
20:14
π
|
|
Fusl has quit IRC (Read error: Operation timed out) |
20:16
π
|
|
Fusl has joined #archiveteam-bs |
20:18
π
|
|
JW_work has quit IRC (Ping timeout: 633 seconds) |
20:19
π
|
arkiver |
DoomTay: you don't have a copy of the full response you got stored anywhere right? |
20:19
π
|
DoomTay |
I'm digging for such a page right now... |
20:19
π
|
DoomTay |
I know Wayback Machine happens to have such a thing |
20:19
π
|
|
zerkalo has joined #archiveteam-bs |
20:20
π
|
DoomTay |
Oh, here's one: http://web.archive.org/web/20160718113152/http://portalgraphics.net/pg/illust/download.php?image_id=57054 |
20:21
π
|
arkiver |
Thing is unicode is a little problematic in lua |
20:22
π
|
DoomTay |
Oh |
20:22
π
|
arkiver |
(should move to python) |
20:22
π
|
arkiver |
I'll check the received content for <br><br><br><a href="/pg/"> |
20:22
π
|
arkiver |
if it has that, grab will be aborted |
20:22
π
|
DoomTay |
Cool |
20:22
π
|
|
goekesmi_ has quit IRC (Ping timeout: 633 seconds) |
20:22
π
|
arkiver |
normal pages don't seem to have that string |
20:26
π
|
|
Ravenloft has joined #archiveteam-bs |
20:28
π
|
|
kristian_ has joined #archiveteam-bs |
20:29
π
|
|
goekesmi has joined #archiveteam-bs |
20:29
π
|
|
DoomTay has quit IRC (Ping timeout: 268 seconds) |
20:31
π
|
|
Start has joined #archiveteam-bs |
20:31
π
|
|
SilSte has joined #archiveteam-bs |
20:32
π
|
|
DoomTay has joined #archiveteam-bs |
20:35
π
|
DoomTay |
But yeah, my house lost power and I'm on a laptop. I might disappear again in an hour or so. Just an FYI |
20:39
π
|
|
Ravenloft has quit IRC (Read error: Connection reset by peer) |
20:42
π
|
|
VADemon has joined #archiveteam-bs |
20:43
π
|
|
xmc has joined #archiveteam-bs |
20:43
π
|
|
swebb sets mode: +o xmc |
20:50
π
|
|
RichardG has quit IRC (Ping timeout: 260 seconds) |
20:50
π
|
godane |
https://archive.org/details/bbc-radio-4-the-world-tonight-2009-04-14 |
20:55
π
|
|
Fletcher has joined #archiveteam-bs |
20:55
π
|
|
Fletcher_ sets mode: +o Fletcher |
21:11
π
|
godane |
sort of good news everyone: https://web.archive.org/web/20150609001718im_/http://kat.cr/dailydump.txt.gz |
21:12
π
|
godane |
kat was making dumps of there magnet urls last year |
21:27
π
|
|
DoomTay has quit IRC (Ping timeout: 268 seconds) |
21:28
π
|
|
DoomTay has joined #archiveteam-bs |
21:42
π
|
|
RichardG has joined #archiveteam-bs |
22:02
π
|
|
RichardG has quit IRC (Read error: Operation timed out) |
22:04
π
|
|
RichardG has joined #archiveteam-bs |
22:09
π
|
|
schbirid has quit IRC (Remote host closed the connection) |
22:12
π
|
xmc |
eighty bucks! fuck http://archiveteam.org/index.php?title=Restoring&curid=5695&diff=26063&oldid=25375 |
22:27
π
|
|
GLaDOS has joined #archiveteam-bs |
22:32
π
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
22:39
π
|
|
JW_work has joined #archiveteam-bs |
22:53
π
|
|
DiscantX has quit IRC (Read error: Operation timed out) |
22:53
π
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
22:53
π
|
|
w0rp has quit IRC (Ping timeout: 250 seconds) |
22:53
π
|
|
espes__ has quit IRC (Ping timeout: 250 seconds) |
22:53
π
|
|
Lord_Nigh has quit IRC (Ping timeout: 251 seconds) |
22:53
π
|
|
dashcloud has quit IRC (Ping timeout: 250 seconds) |
22:53
π
|
|
Fletcher_ has quit IRC (Ping timeout: 250 seconds) |
22:53
π
|
|
w0rp has joined #archiveteam-bs |
22:54
π
|
|
Sk1d has joined #archiveteam-bs |
22:54
π
|
|
Lord_Nigh has joined #archiveteam-bs |
22:54
π
|
|
dashcloud has joined #archiveteam-bs |
22:55
π
|
|
Fletcher_ has joined #archiveteam-bs |
22:56
π
|
hook54321 |
https://techcrunch.com/2016/07/18/opera-renegotiates-its-1-2b-sale-down-to-600m-for-browser-privacy-apps-chinese-jv/ |
22:57
π
|
hook54321 |
Can we trust the company that they are selling to? Or is this going to be Adblock Plus all over again? |
22:59
π
|
|
espes__ has joined #archiveteam-bs |
23:06
π
|
|
kristian_ has quit IRC (Leaving) |
23:08
π
|
|
BlueMaxim has joined #archiveteam-bs |
23:14
π
|
|
dxrt- has joined #archiveteam-bs |
23:14
π
|
|
dxrt sets mode: +o dxrt- |
23:20
π
|
Frogging |
I didn't know ABP got sold to anyone |
23:27
π
|
|
tomwsmf has joined #archiveteam-bs |
23:38
π
|
|
nightpool has quit IRC (Ping timeout: 501 seconds) |
23:43
π
|
DoomTay |
Do you think http://www.centralfloridafuture.com/ would be too much for ArchiveBot? Might need saving given http://www.centralfloridafuture.com/story/news/2016/07/21/central-florida-future-cease-publication/87394312/ |
23:58
π
|
hook54321 |
According to google it has about "11,900 results" |