Time |
Nickname |
Message |
00:53
🔗
|
n00b452 |
how do i go to quitpic channel ? |
00:54
🔗
|
ex-parrot |
n00b452: type /join #quitpic |
00:54
🔗
|
n00b452 |
ty |
01:08
🔗
|
SketchCow |
Yeah, that's the thing to do. |
01:09
🔗
|
SketchCow |
edsu: People are welcome to try. |
01:17
🔗
|
SmileyG |
fuck me i need to ignore joins in here |
01:39
🔗
|
SketchCow |
That's like two sentences |
02:07
🔗
|
SmileyG |
hmmmmm project valhalla.... we need moar space :/ |
02:27
🔗
|
LD100 |
SmileyG: valhalla -> #huntinggrounds |
04:33
🔗
|
SketchCow |
About to shove a pile of computer vintage into the archive. |
04:41
🔗
|
dashcloud |
awesome! |
04:42
🔗
|
SmileyG |
weeeeeee |
05:12
🔗
|
Compresse |
here we go |
05:12
🔗
|
Compresse |
WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD |
05:14
🔗
|
Jonimus |
yahoosucks |
05:21
🔗
|
Compresse |
thanks |
05:33
🔗
|
SmileyG |
hd |
05:33
🔗
|
SmileyG |
hdd |
05:33
🔗
|
SmileyG |
hahaa |
12:10
🔗
|
Fusl |
can someone help me with installing archivebot on a plain debian system? |
12:12
🔗
|
Fusl |
i'm getting the following error when i run bundle exec ruby dashboard/app.rb --redis 'redis://127.0.0.1:6379/0' --url 'http://127.0.0.1:8080' |
12:12
🔗
|
Fusl |
https://ezcrypt.it/4O9n#cpoB4g3jiWXFZTBx1aQJ71Oj |
12:14
🔗
|
Fusl |
or umm... do i even need that bot? O_O |
14:57
🔗
|
bzc6p_ |
Fusl: don't you mean ArchiveTeam Warrior? What is your intention? |
15:16
🔗
|
Fusl |
bzc6p_: i'm trying to run archiveteam warrior but this needs virtualbox or similar |
15:16
🔗
|
Fusl |
so i want to run the standalone version of it |
15:17
🔗
|
bzc6p_ |
Well, archivebot is quite a different thing. |
15:17
🔗
|
aaaaaaaaa |
the warrior and archivebot are two different (but overlapping) projects |
15:17
🔗
|
bzc6p_ |
What you need is the project srcipt. |
15:17
🔗
|
bzc6p_ |
https://github.com/ArchiveTeam/twitpic-grab |
15:17
🔗
|
Kazzy |
Fusl: if you want to run scripts without using the warrior, each project has it's own set of scripts |
15:18
🔗
|
bzc6p_ |
There you find the instructions too, Fusl. |
15:18
🔗
|
Kazzy |
archivebot is unrelated to 'warrior projects' |
15:18
🔗
|
Fusl |
oh |
15:18
🔗
|
bzc6p_ |
See "Debian/Ubuntu specific instructions" there (or something like that) |
15:19
🔗
|
bzc6p_ |
oh sorry, I'm not on the twitpic channel |
15:20
🔗
|
bzc6p_ |
So, yes, you need the project specific scripts (they are similar to each other). The Wiki or https://github.com/ArchiveTeam is a good starting point to find the one you need. |
15:23
🔗
|
Fusl |
the howto for debian/ubuntu at https://github.com/ArchiveTeam/twitpic-grab also fails |
15:23
🔗
|
Fusl |
POD document had syntax errors at /usr/bin/pod2man line 71. |
15:25
🔗
|
Fusl |
hi bzc6p__ did you timeout? |
15:26
🔗
|
aaaaaaaaa |
go to the bottom, there are troubleshooting instructions. |
15:30
🔗
|
bzc6p__ |
Fusl: I had. My router sometimes say "I'm fed up" and connection gets lost. |
15:30
🔗
|
bzc6p__ |
I'll check history |
15:31
🔗
|
aaaaaaaaa |
Fusl: search the readme for wget-lua was not successfully built |
15:31
🔗
|
Fusl |
already done |
15:31
🔗
|
Fusl |
is running |
15:31
🔗
|
Fusl |
thanks |
15:31
🔗
|
bzc6p__ |
Great. |
15:32
🔗
|
Fusl |
and that's all i have to do to help archiveteam with twitpic? |
15:36
🔗
|
bzc6p__ |
Well, right now unfortunately none of us can do more than HTML scraping. Noah Everett hid the pictures. |
15:37
🔗
|
bzc6p__ |
If you find them, you'll get the Nobel Prize in Archiving. |
15:40
🔗
|
bzc6p__ |
To be serious: you can run other projects as well (right now ancestry is active). Or increase the concurrency for TwitPic. |
15:49
🔗
|
nico |
Fusl: you were trying to start the infrastructure of ArchiveBot ? |
15:50
🔗
|
nico |
(ArchiveBot is another project, now very different from the Warrior) |
15:50
🔗
|
nico |
(it is more an irc-controlled distributed crawler) |
15:51
🔗
|
Fusl |
nico: yea, i thought i need archivebot :D |
15:52
🔗
|
nico |
Fusl: if you want to run ArchiveBot, look under the pipeline/ directory |
15:53
🔗
|
Fusl |
nico: nah, i thought archivebot is part of the warrior |
15:53
🔗
|
nico |
ho :) |
15:53
🔗
|
nico |
it started with the same tech (wget-lua, seesaw, rsync) |
15:54
🔗
|
nico |
but now, it is different (seesaw hooked by archivebot-specific code, wpull, a dedicated uploader that wrap rsync) |
20:21
🔗
|
wp494 |
well I finally gave the IRC page a much needed update |
20:46
🔗
|
dashcloud |
what's the official wpull download site? (preferably with installation instructions as well) |
20:47
🔗
|
Kazzy |
https://github.com/chfoo/wpull ? |
20:48
🔗
|
dashcloud |
I wasn't entirely sure, so if that is the current wpull home, that's what I wanted |
20:48
🔗
|
aaaaaaaaa |
http://wpull.readthedocs.org/en/master/ |
20:49
🔗
|
aaaaaaaaa |
It is nicely written too. |
20:57
🔗
|
dashcloud |
does the documentation cover how to archive a site like example.com/ab/000001 (with numbers increasing normally)? |
21:24
🔗
|
bebzol_ |
WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD |
21:24
🔗
|
Kazzy |
bebzol_: yahoosucks |
21:24
🔗
|
bebzol_ |
thx :) |
22:59
🔗
|
bebzol |
hi! I would like to create a new project (ownlog.com - blog platform with 45 000 blogs that is rotting away). I was able to create item list and I can write a seesaw script, but I don't know what to do next |
22:59
🔗
|
bebzol |
what is the best way to test a written seesaw script? Do you have any testing tracker? |
23:03
🔗
|
Muad-Dib |
arkiver, you have been busy writing these recently, right? |
23:11
🔗
|
Muad-Dib |
bebzol: I have to go now, it might take a while before anyone else responds, though |
23:12
🔗
|
bebzol |
k, thanks :) |
23:15
🔗
|
aaaaaaaaa |
While waiting for more people with more knowledge, I'd recommend reading: http://archiveteam.org/index.php?title=Dev |
23:20
🔗
|
bebzol |
aaaaaaaaa: yeah, I've read it :) |
23:22
🔗
|
bebzol |
could you please create a github repository ownlog-grab and give permissions to user "basement-labs"? Thanks in advance |