Time |
Nickname |
Message |
00:09
π
|
|
Kitaru has quit IRC (Quit: This computer has gone to sleep) |
00:24
π
|
|
Lune has quit IRC (Quit: Page closed) |
00:41
π
|
|
JesseW has joined #archiveteam |
00:47
π
|
|
RichardG has quit IRC (Read error: Operation timed out) |
01:09
π
|
|
DoomTay has joined #archiveteam |
01:38
π
|
|
tomwsmf-a has quit IRC (Read error: Operation timed out) |
02:05
π
|
|
Aranje has joined #archiveteam |
02:35
π
|
|
ravetcofx has quit IRC (Ping timeout: 506 seconds) |
04:03
π
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
04:10
π
|
|
Sk1d has joined #archiveteam |
04:13
π
|
|
WinterFox has joined #archiveteam |
04:38
π
|
|
ravetcofx has joined #archiveteam |
05:00
π
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
05:08
π
|
|
Sk1d has joined #archiveteam |
05:08
π
|
|
Sk1d has quit IRC (Connection closed) |
05:10
π
|
|
Sk1d has joined #archiveteam |
05:17
π
|
|
DiscantX has joined #archiveteam |
05:31
π
|
|
VADemon has joined #archiveteam |
05:40
π
|
|
DiscantX has quit IRC (Ping timeout: 244 seconds) |
05:43
π
|
|
Emcy has quit IRC (Read error: Operation timed out) |
05:48
π
|
|
Ymgve has quit IRC () |
05:49
π
|
|
Ymgve has joined #archiveteam |
06:09
π
|
|
vtyl has joined #archiveteam |
06:18
π
|
|
lytv has quit IRC (Read error: Operation timed out) |
06:38
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
07:08
π
|
|
Arcai has joined #archiveteam |
07:10
π
|
|
DoomTay has quit IRC (Quit: Page closed) |
08:14
π
|
|
BlueMaxim has joined #archiveteam |
08:38
π
|
|
Emcy has joined #archiveteam |
08:42
π
|
Arcai |
Let's say that a website that's closing up shop wants to aid an effort to archive itself. Has Archive Team been involved in such a situation before? |
08:49
π
|
|
atomotic has joined #archiveteam |
08:50
π
|
bwn |
Arcai: i believe so, but you'll want to speak with someone other than me |
08:57
π
|
PurpleSym |
How big is the site, Arcai ? |
08:59
π
|
Arcai |
On the order of single-digit terabytes. |
09:00
π
|
PurpleSym |
So, probably a millions of pages? |
09:00
π
|
Arcai |
Yeah. |
09:01
π
|
PurpleSym |
#archivebot wonβt work then, I guess. |
09:02
π
|
Arcai |
It's purely hypothetical at this point but I'm making a last-ditch contingency plan for an organization that hosts a lot of content that I'd hate to have vanish in the event that it cannot continue its own operations in any way. |
09:02
π
|
HCross |
might it be worth a "just in case" download then? |
09:05
π
|
PurpleSym |
It kind of depends on the site. If you have enumerable objects (images, videos, β¦) we usually make a Warrior project (distributed crawling). |
09:05
π
|
Arcai |
It's in no danger at this point. My question was more directed at whether there's something I can include in the plan to make ArchiveTeam's job easier should it ever come to that. |
09:06
π
|
PurpleSym |
Early shutdown notification in this channel. |
09:07
π
|
PurpleSym |
Disable Cloudflare DDoS protection (the captcha thing). |
09:07
π
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
09:08
π
|
HCross |
Dont be a dickhole when our crawl causes higher than normal load |
09:08
π
|
PurpleSym |
If youβre very forthcoming: A URL/item list and or complete sitemap. |
09:09
π
|
Arcai |
I was thinking of things like some form of database dumps and access to domains. |
09:12
π
|
PurpleSym |
Youβre free to upload a database dump to archive.org if you want to. |
09:19
π
|
|
BartoCH has joined #archiveteam |
09:20
π
|
luckcolor |
bzc6p: if you want a rsync target for rsyncing the lists to my server let me know |
09:26
π
|
Arcai |
All right. Thanks. :) |
09:27
π
|
Arcai |
I'll make sure that advance notice is part of the plan. |
09:40
π
|
|
Emcy has quit IRC (Read error: Operation timed out) |
10:06
π
|
|
Arcai has quit IRC (Ping timeout: 268 seconds) |
10:22
π
|
|
dxrt- sets mode: +o dxrt |
10:29
π
|
|
VADemon has quit IRC (Quit: left4dead) |
10:31
π
|
|
RichardG has joined #archiveteam |
11:06
π
|
|
Emcy has joined #archiveteam |
11:06
π
|
|
fie has quit IRC (Ping timeout: 370 seconds) |
11:22
π
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
11:33
π
|
|
zhongfu has quit IRC (Ping timeout: 260 seconds) |
11:38
π
|
|
zhongfu has joined #archiveteam |
11:44
π
|
|
zhongfu has quit IRC (Remote host closed the connection) |
11:58
π
|
|
zhongfu has joined #archiveteam |
12:03
π
|
|
zhongfu has quit IRC (Remote host closed the connection) |
12:15
π
|
|
zhongfu has joined #archiveteam |
12:45
π
|
|
RichardG_ has joined #archiveteam |
12:45
π
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
12:54
π
|
|
zhongfu has quit IRC (Remote host closed the connection) |
12:56
π
|
|
zhongfu has joined #archiveteam |
12:56
π
|
|
mutoso has quit IRC (Read error: Operation timed out) |
12:57
π
|
|
mutoso has joined #archiveteam |
13:09
π
|
|
vitzli has joined #archiveteam |
13:21
π
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
13:25
π
|
|
WinterFox has quit IRC (Read error: Operation timed out) |
13:54
π
|
|
RichardG_ has quit IRC (Read error: Operation timed out) |
13:55
π
|
|
RichardG has joined #archiveteam |
14:16
π
|
|
nwf__ has joined #archiveteam |
14:19
π
|
|
nwf_ has quit IRC (Read error: Operation timed out) |
14:56
π
|
|
metalcamp has joined #archiveteam |
15:07
π
|
|
DoomTay has joined #archiveteam |
15:50
π
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
15:50
π
|
|
JesseW has joined #archiveteam |
16:09
π
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
16:14
π
|
|
SN4T14 has quit IRC (Ping timeout: 370 seconds) |
16:52
π
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
16:53
π
|
|
RichardG has joined #archiveteam |
16:58
π
|
|
mutoso has quit IRC (Read error: Operation timed out) |
17:04
π
|
|
DiscantX has joined #archiveteam |
17:06
π
|
|
mutoso has joined #archiveteam |
17:18
π
|
|
atomotic has joined #archiveteam |
17:25
π
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
17:55
π
|
|
Sue_ has quit IRC (Read error: Operation timed out) |
18:08
π
|
|
Sue_ has joined #archiveteam |
18:09
π
|
|
tomwsmf-a has joined #archiveteam |
18:36
π
|
|
JesseW has joined #archiveteam |
18:37
π
|
|
RedType has quit IRC (Ping timeout: 260 seconds) |
18:47
π
|
|
DiscantX has quit IRC (Ping timeout: 244 seconds) |
18:48
π
|
|
RedType has joined #archiveteam |
19:18
π
|
|
DiscantX has joined #archiveteam |
19:18
π
|
|
tomwsmf-a has quit IRC (Read error: Operation timed out) |
19:26
π
|
|
vitzli has quit IRC (Leaving) |
20:09
π
|
|
anjacks0n has joined #archiveteam |
20:27
π
|
|
Start has quit IRC (Quit: Disconnected.) |
20:30
π
|
|
Start has joined #archiveteam |
20:57
π
|
|
DiscantX has quit IRC (Ping timeout: 244 seconds) |
20:57
π
|
|
metal_cam has joined #archiveteam |
21:00
π
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
21:05
π
|
|
anjacks0n has quit IRC (anjacks0n) |
21:07
π
|
|
metal_cam has quit IRC (Ping timeout: 244 seconds) |
21:37
π
|
|
anjacks0n has joined #archiveteam |
21:47
π
|
|
godane has quit IRC (Leaving.) |
22:16
π
|
|
ndiddy has joined #archiveteam |
22:18
π
|
|
DoomTay has quit IRC (Quit: Page closed) |
22:22
π
|
|
Jeroen52 has joined #archiveteam |
23:22
π
|
|
godane has joined #archiveteam |
23:24
π
|
|
anjacks0n has quit IRC (anjacks0n) |
23:33
π
|
|
anjacks0n has joined #archiveteam |
23:47
π
|
|
anjacks0n has quit IRC (anjacks0n) |