Time |
Nickname |
Message |
00:11
π
|
|
hive-mind has quit IRC (Ping timeout: 260 seconds) |
00:13
π
|
|
hive-mind has joined #archiveteam |
00:28
π
|
|
odemg has quit IRC (Remote host closed the connection) |
00:29
π
|
|
odemg has joined #archiveteam |
00:53
π
|
|
RichardG_ is now known as RichardG |
01:18
π
|
|
Stilett0 has quit IRC (Read error: Operation timed out) |
01:50
π
|
|
Stilett0 has joined #archiveteam |
01:59
π
|
|
Stilett0 has quit IRC (Ping timeout: 370 seconds) |
02:56
π
|
|
icedice has quit IRC (Quit: Leaving) |
02:57
π
|
|
pizzaiolo has left |
03:31
π
|
|
Guest7383 has joined #archiveteam |
04:22
π
|
|
dashcloud has quit IRC (Ping timeout: 260 seconds) |
04:23
π
|
|
Sk1d has joined #archiveteam |
04:27
π
|
|
dashcloud has joined #archiveteam |
04:42
π
|
|
arbin has quit IRC (Read error: Operation timed out) |
04:53
π
|
|
Stilett0 has joined #archiveteam |
04:54
π
|
|
Stilett0 is now known as Stiletto |
05:04
π
|
|
ndiddy has quit IRC () |
05:44
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
05:47
π
|
|
dashcloud has joined #archiveteam |
06:27
π
|
|
tuxy has joined #archiveteam |
06:29
π
|
tuxy |
Hello guys! |
06:30
π
|
tuxy |
How can I download the Yoyo sandbox completely |
06:34
π
|
tuxy |
How is the sandbox even archived? |
06:34
π
|
db48x |
everything the Archive Team saved for the the Gamemaker Sandbox is available here: https://archive.org/details/archiveteam_gamemaker |
06:35
π
|
db48x |
these are all WARC files, with CDX files which are indexes |
06:36
π
|
tuxy |
There seem to be multiple files. |
06:36
π
|
tuxy |
Ok |
06:36
π
|
tuxy |
I'm new to archive formats |
06:37
π
|
tuxy |
How do I download all of them and view them. IS there like a guide. Thanks |
06:38
π
|
db48x |
well, the collection has 62 items |
06:38
π
|
db48x |
each item has some files associated with it |
06:38
π
|
db48x |
actually, on closer inspection only 15 of those items are WARCs; the other 47 appear to be single executable files extracted from those WARCs |
06:39
π
|
db48x |
a WARC file is a record of every HTTP request, and the response that was recieved, that the archiving team made |
06:40
π
|
db48x |
there are several tools you can use to view them |
06:41
π
|
db48x |
probably the simplest would be a proxy that serves up content from them to your web browser |
06:42
π
|
db48x |
https://github.com/alard/warc-proxy, for example, or https://github.com/internetarchive/warcprox |
06:43
π
|
tuxy |
The second one says it's a writing MITM proxy |
06:46
π
|
tuxy |
So can I still help other projects by running Warrior? |
06:47
π
|
tuxy |
Does that still work? |
06:47
π
|
tuxy |
http://archiveteam.org/index.php?title=ArchiveTeam_Warrior |
06:48
π
|
db48x |
yep |
06:48
π
|
tuxy |
Does it work automatically? |
06:49
π
|
db48x |
yea, the warrior is automatic |
06:49
π
|
db48x |
you can see all the projects that might have work to do at http://tracker.archiveteam.org/ |
06:51
π
|
tuxy |
BTW how does viewing multiple warcs work with the Sandbox. What if I wanted to search a game. Is that what CDX files are for? |
06:53
π
|
db48x |
I believe that alard's warc-proxy simply shows you everything in every warc in the directory that you ran it from |
06:55
π
|
db48x |
the CDX is a straight-forward text file that tells you where each HTTP request/response is within a WARC: |
06:55
π
|
db48x |
com,yoyogames,sandbox)/extras/image/name/san1/0/116000/large/loader.jpg?1215841807 20141015224914 http://sandbox.yoyogames.com/extras/image/name/san1/0/116000/large/loader.jpg?1215841807 image/jpeg 200 JVQG5RRC3QJXS2RPAJ3D6EY3YUK5UB24 - - 3704 4388284889 archiveteam_gamemaker_20141118085013/gamemaker_20141118085013.megawarc.warc.gz |
06:55
π
|
db48x |
com,yoyogames,sandbox)/extras/image/name/san1/0/116000/thumb/loader.jpg?1215841807 20141015224919 http://sandbox.yoyogames.com/extras/image/name/san1/0/116000/thumb/loader.jpg?1215841807 image/jpeg 200 WK44LBO4USBHOAHXA4J4YXNGLLQNAXCT - - 1043 4388388280 archiveteam_gamemaker_20141118085013/gamemaker_20141118085013.megawarc.warc.gz |
06:55
π
|
db48x |
com,yoyogames,sandbox)/extras/image/name/san1/0/119000/large/opo.jpg?1216567269 20141015233541 http://sandbox.yoyogames.com/extras/image/name/san1/0/119000/large/opo.jpg?1216567269 image/jpeg 200 S5HDXK7SDLPHVVSZHZCKV7SL4B37TZ4A - - 3280 41313654721 archiveteam_gamemaker_20141118085013/gamemaker_20141118085013.megawarc.warc.gz |
06:56
π
|
db48x |
you could save yourself some time by downloading all of the CDX files first, then grepping them for the urls you want |
06:56
π
|
db48x |
then downloading the correct WARC |
06:56
π
|
|
schbirid has joined #archiveteam |
07:08
π
|
|
odemg has quit IRC (Remote host closed the connection) |
07:10
π
|
|
odemg has joined #archiveteam |
07:23
π
|
|
odemg has quit IRC (Quit: fucked right off!!) |
07:49
π
|
tuxy |
Guys I'm getting ERR_EMPTY_RESPONSE |
07:50
π
|
tuxy |
When I try to access warrior from my browser |
07:51
π
|
tuxy |
I'll try using Virtualbox instead of VMware |
07:55
π
|
|
topdownji has quit IRC (Remote host closed the connection) |
07:56
π
|
|
topdownji has joined #archiveteam |
07:56
π
|
tuxy |
Guys I live in India. Is it okay for you if I run warrior |
07:57
π
|
|
hive-mind has quit IRC (Ping timeout: 260 seconds) |
07:57
π
|
|
hive-mind has joined #archiveteam |
07:57
π
|
tuxy |
A few sites are banned like adfly and piratebay |
08:07
π
|
|
anhedonis has quit IRC (Read error: Operation timed out) |
08:07
π
|
|
anhedonis has joined #archiveteam |
08:29
π
|
|
Simpbrain has joined #archiveteam |
08:29
π
|
|
zino has joined #archiveteam |
08:31
π
|
|
tuxy has quit IRC (Ping timeout: 268 seconds) |
09:55
π
|
|
_Zialus_ has joined #archiveteam |
09:55
π
|
|
Zialus has quit IRC (Read error: Operation timed out) |
09:59
π
|
|
numba has joined #archiveteam |
10:00
π
|
numba |
Do you guys check from multiple warriors for blocks and scraping errors to make sure data is clean |
10:01
π
|
numba |
My warrior is not working |
10:01
π
|
numba |
This page isnβt working localhost didnβt send any data. ERR_EMPTY_RESPONSE |
10:01
π
|
numba |
http://localhost:8001/ |
10:02
π
|
numba |
I really want to run a warrior please help me with the error |
10:26
π
|
|
pizzaiolo has joined #archiveteam |
10:30
π
|
|
zenguy has quit IRC (Read error: Operation timed out) |
10:31
π
|
pizzaiolo |
Fossamail is shutting down in May: https://www.reddit.com/r/linux/comments/65awd3/fossamail_to_shut_down_in_may_2017/ |
10:34
π
|
|
zenguy has joined #archiveteam |
10:36
π
|
pizzaiolo |
I did an archivebot job for it, not sure if everything came through though |
10:52
π
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
11:28
π
|
|
khaoohs has quit IRC (Ping timeout: 1208 seconds) |
11:33
π
|
|
numba has quit IRC (Ping timeout: 268 seconds) |
11:35
π
|
|
RichardG_ has joined #archiveteam |
11:35
π
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
11:48
π
|
|
anhedonis has quit IRC (Remote host closed the connection) |
11:59
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
12:02
π
|
|
dashcloud has joined #archiveteam |
12:20
π
|
|
odemg has joined #archiveteam |
13:11
π
|
|
kristian_ has joined #archiveteam |
13:30
π
|
|
anhedonis has joined #archiveteam |
13:44
π
|
|
Guest7383 has quit IRC (Quit: Bye) |
14:21
π
|
|
ndiddy has joined #archiveteam |
14:36
π
|
|
icedice has joined #archiveteam |
15:11
π
|
|
kristian_ has quit IRC (Quit: Leaving) |
15:42
π
|
|
LastNinja has quit IRC (byeeee) |
15:58
π
|
|
RichardG_ is now known as RichardG |
16:02
π
|
|
Aranje has joined #archiveteam |
16:37
π
|
|
_Zialus_ has quit IRC (i'm out!) |
17:28
π
|
|
nsfmc has quit IRC (Quit: Connection closed for inactivity) |
17:42
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
17:46
π
|
|
Simpbrain has quit IRC (Read error: Connection reset by peer) |
18:04
π
|
|
kris33 has quit IRC (Remote host closed the connection) |
18:09
π
|
|
MMovie has joined #archiveteam |
18:20
π
|
|
zino has quit IRC (Remote host closed the connection) |
18:21
π
|
|
nsfmc has joined #archiveteam |
18:45
π
|
|
kevinr has quit IRC () |
18:47
π
|
|
kevinr has joined #archiveteam |
19:43
π
|
|
DFJustin has quit IRC (Remote host closed the connection) |
19:52
π
|
|
DFJustin has joined #archiveteam |
20:25
π
|
|
anhedonis has quit IRC (Read error: Operation timed out) |
21:08
π
|
|
LastNinja has joined #archiveteam |
21:16
π
|
|
icedice has quit IRC (Quit: Leaving) |
21:29
π
|
|
Madchen has joined #archiveteam |
21:55
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
21:59
π
|
|
dashcloud has joined #archiveteam |
22:36
π
|
|
schbirid has quit IRC (Quit: Leaving) |
22:46
π
|
|
kristian_ has joined #archiveteam |
22:55
π
|
|
Odd0002_ has joined #archiveteam |
22:55
π
|
|
Odd0002 has left |
22:56
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
23:24
π
|
|
BlueMaxim has joined #archiveteam |
23:35
π
|
|
bsmith093 has joined #archiveteam |
23:48
π
|
|
dashcloud has joined #archiveteam |
23:58
π
|
|
dashcloud has quit IRC (Read error: Operation timed out) |