[00:08] *** Honno has quit IRC (Read error: Operation timed out) [00:32] *** Stilett0 has joined #archiveteam [01:11] *** Stilett0 has quit IRC (Read error: Operation timed out) [01:28] *** Asparagir has joined #archiveteam [01:29] *** username1 has joined #archiveteam [01:29] *** Asparagir has left [01:29] *** Asparag-1 has joined #archiveteam [01:31] *** schbirid2 has quit IRC (Read error: Operation timed out) [01:42] *** Asparag-1 is now known as Asparagir [01:51] *** theaetetu has joined #archiveteam [01:53] *** Pudsey has joined #archiveteam [01:53] *** Pudsey has quit IRC (Remote host closed the connection) [02:01] *** Morbus has joined #archiveteam [02:37] *** fennec has quit IRC (Quit: %quiet%) [02:39] *** fennec has joined #archiveteam [02:46] *** Stilett0 has joined #archiveteam [02:50] *** Stiletto has joined #archiveteam [02:53] *** Stilett0 has quit IRC (Ping timeout: 250 seconds) [02:56] *** Stilett0 has joined #archiveteam [02:57] *** Stiletto has quit IRC (Read error: Operation timed out) [03:04] *** mhazinsk has left WeeChat 0.4.2 [03:08] *** Stilett0 has quit IRC (Read error: Operation timed out) [03:27] *** qw3rty119 has joined #archiveteam [03:33] *** qw3rty118 has quit IRC (Read error: Operation timed out) [04:21] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:27] *** Sk1d has joined #archiveteam [04:31] *** Mateon1 has quit IRC (Ping timeout: 255 seconds) [04:32] *** Mateon1 has joined #archiveteam [04:33] *** Mateon1 has quit IRC (Remote host closed the connection) [04:33] *** Mateon1 has joined #archiveteam [04:51] *** MMovie has quit IRC (Read error: Connection reset by peer) [04:54] *** Odd0002 has quit IRC (Read error: Operation timed out) [05:14] *** Odd0002 has joined #archiveteam [05:23] *** Odd0002 has quit IRC (Read error: Operation timed out) [05:29] *** Odd0002 has joined #archiveteam [05:42] *** ajshell1_ has joined #archiveteam [05:44] *** kitties has joined #archiveteam [05:44] *** ajshell1 has quit IRC (Read error: Operation timed out) [05:46] *** Asparagir has quit IRC (Asparagir) [06:14] *** MMovie has joined #archiveteam [06:28] *** BubuAnabe has quit IRC (Ping timeout: 268 seconds) [06:34] *** MMovie has quit IRC (Read error: Operation timed out) [06:34] *** MMovie has joined #archiveteam [06:37] *** terburg has joined #archiveteam [06:50] *** MMovie2 has joined #archiveteam [06:52] *** Odd0002 has quit IRC (Ping timeout: 633 seconds) [06:53] *** MMovie has quit IRC (Read error: Operation timed out) [07:02] *** Odd0002 has joined #archiveteam [07:03] *** MMovie has joined #archiveteam [07:05] *** MMovie2 has quit IRC (Read error: Operation timed out) [07:09] *** espes__ has quit IRC (Ping timeout: 245 seconds) [07:16] *** espes__ has joined #archiveteam [07:20] *** MMovie2 has joined #archiveteam [07:21] *** Odd0002 has quit IRC (Read error: Operation timed out) [07:22] *** MMovie has quit IRC (Read error: Operation timed out) [07:23] *** username1 is now known as schbirid [07:25] *** MMovie2 has quit IRC (Read error: Operation timed out) [07:26] *** MMovie has joined #archiveteam [07:32] *** Odd0002 has joined #archiveteam [07:37] *** bRick5772 has joined #archiveteam [07:39] *** MMovie2 has joined #archiveteam [07:40] *** MMovie has quit IRC (Read error: Operation timed out) [07:42] *** Odd0002 has quit IRC (Read error: Operation timed out) [07:49] *** midas1 has joined #archiveteam [07:49] *** swebb sets mode: +o midas1 [07:51] *** Odd0002 has joined #archiveteam [07:58] *** victor has joined #archiveteam [08:00] *** MMovie2 has quit IRC (Read error: Operation timed out) [08:03] *** victor has quit IRC (Ping timeout: 260 seconds) [08:11] *** Odd0002 has quit IRC (Read error: Operation timed out) [08:14] *** terburg has quit IRC (terburg) [08:18] *** MMovie has joined #archiveteam [08:26] *** kimmer22 has joined #archiveteam [08:32] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [08:37] *** bRick5772 has quit IRC (Quit: Leaving.) [08:56] *** MMovie has quit IRC (Read error: Operation timed out) [08:57] *** MMovie has joined #archiveteam [08:58] *** kimmer2 has joined #archiveteam [09:04] *** kimmer22 has quit IRC (Ping timeout: 633 seconds) [09:10] *** MMovie has quit IRC (Read error: Operation timed out) [09:11] *** kimmer22 has joined #archiveteam [09:12] *** arbin has joined #archiveteam [09:15] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [09:16] *** kimmer2 has joined #archiveteam [09:22] *** kimmer22 has quit IRC (Ping timeout: 633 seconds) [09:23] *** midas1 has quit IRC (Read error: Operation timed out) [09:29] *** Odd0002 has joined #archiveteam [09:30] *** kimmer22 has joined #archiveteam [09:38] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [09:42] *** Odd0002 has quit IRC (Read error: Operation timed out) [09:52] *** Odd0002 has joined #archiveteam [10:00] *** kitties has quit IRC (Quit: Connection closed for inactivity) [10:01] *** Odd0002 has quit IRC (Ping timeout: 268 seconds) [10:02] *** midas has quit IRC (Read error: Operation timed out) [10:03] *** midas has joined #archiveteam [10:03] *** swebb sets mode: +o midas [10:06] *** Odd0002 has joined #archiveteam [10:11] *** midas1 has joined #archiveteam [10:11] *** swebb sets mode: +o midas1 [10:15] *** MMovie has joined #archiveteam [11:05] *** pizzaiolo has joined #archiveteam [11:20] *** Mateon1 has quit IRC (Remote host closed the connection) [11:20] *** Mateon1 has joined #archiveteam [11:31] *** wp494 has quit IRC (Read error: Connection reset by peer) [11:35] *** wp494 has joined #archiveteam [12:15] *** zhongfu has joined #archiveteam [12:39] *** j08nY has joined #archiveteam [12:44] *** BlueMaxim has quit IRC (Quit: Leaving) [12:54] *** zhongfu has quit IRC (Ping timeout: 260 seconds) [12:56] *** zhongfu has joined #archiveteam [13:00] *** Soni has quit IRC (Read error: Operation timed out) [13:18] *** kimmer2 has joined #archiveteam [13:27] *** kimmer22 has quit IRC (Read error: Operation timed out) [13:30] *** kimmer22 has joined #archiveteam [13:34] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [13:54] *** Soni has joined #archiveteam [14:06] *** kimmer2 has joined #archiveteam [14:15] *** kimmer22 has quit IRC (Ping timeout: 633 seconds) [14:16] *** kimmer22 has joined #archiveteam [14:23] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [14:26] *** kimmer2 has joined #archiveteam [14:33] *** kimmer22 has quit IRC (Ping timeout: 633 seconds) [14:33] *** kimmer23 has joined #archiveteam [14:37] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [14:44] *** kimmer2 has joined #archiveteam [14:49] *** kimmer23 has quit IRC (Ping timeout: 633 seconds) [14:55] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [15:18] *** j08nY has quit IRC (Ping timeout: 633 seconds) [15:24] *** schbirid2 has joined #archiveteam [15:28] *** schbirid has quit IRC (Read error: Operation timed out) [15:35] *** oli has quit IRC (Read error: Operation timed out) [15:35] *** j08nY has joined #archiveteam [15:36] *** Zebranky has quit IRC (Ping timeout: 260 seconds) [15:36] *** Zebranky has joined #archiveteam [15:40] *** oli has joined #archiveteam [15:49] *** Stilett0 has joined #archiveteam [16:00] *** Ctrl has quit IRC (Ping timeout: 245 seconds) [16:10] *** Ctrl has joined #archiveteam [16:10] *** Ctrl has quit IRC (Excess Flood) [16:13] *** username1 has joined #archiveteam [16:15] *** schbirid2 has quit IRC (Read error: Operation timed out) [16:39] *** Stilett0 has quit IRC (Ping timeout: 260 seconds) [16:41] *** cache_ has quit IRC (Read error: Operation timed out) [16:45] *** cache_ has joined #archiveteam [16:49] *** username1 is now known as schbiri [16:49] *** schbiri is now known as schbirid [16:55] *** j08nY has quit IRC (Read error: Operation timed out) [17:01] *** godane has quit IRC (Read error: Operation timed out) [17:54] *** BubuAnabe has joined #archiveteam [18:06] *** godane has joined #archiveteam [18:11] *** fie has quit IRC (Ping timeout: 506 seconds) [18:16] *** schbirid2 has joined #archiveteam [18:16] *** Stilett0 has joined #archiveteam [18:19] *** schbirid has quit IRC (Read error: Operation timed out) [18:20] *** fie has joined #archiveteam [18:21] *** REiN^ has quit IRC (Max SendQ exceeded) [18:22] *** REiN^ has joined #archiveteam [18:43] *** terburg has joined #archiveteam [19:13] *** kitties has joined #archiveteam [19:15] *** Asparagir has joined #archiveteam [19:29] *** j08nY has joined #archiveteam [19:38] *** MorbusIff has joined #archiveteam [19:40] *** Morbus has quit IRC (Read error: Operation timed out) [19:56] *** Lotheric has joined #archiveteam [19:58] Hello ArchiveTeam! Someone pointed me to your channel for help on archiving a website that will shut down shortly (company went bankrupt): http://www.dep.ca/ [19:59] The site contains much information about music albums (hi-res album covers, UPC, cat #, etc.) which I'm trying to preserve since I'm an editor @MusicBrainz [19:59] any help appreciated [20:10] *** Stilett0 has quit IRC (Ping timeout: 246 seconds) [20:11] Lotheric: you have come to the right place. Please hold [20:11] can i just say i really love Picard [20:11] sure you can! Picard is awesome :) [20:11] it's the most amazing tool [20:12] guys; is dep.ca too big for #archivebot ? [20:12] *** Stilett0 has joined #archiveteam [20:16] *** terburg has quit IRC (terburg) [20:17] ohh, i see, it's a big catalog [20:18] yeah that's the problem. most sites only get a snapshots of the front page [20:18] I tried the wayback machine [20:19] it's (was) the biggest distributor for indie Quebec artists [20:19] the database seems to be quite big [20:23] i'm starting a wget to see if it'll traverse nicely [20:26] i include random wait times of 1-3 seconds between requests so as not to overly hammer on a server [20:26] sooo we'll see shortly [20:26] but it is grabbing stuff [20:26] cool [20:43] *** xit has quit IRC (Read error: Operation timed out) [20:45] hey i think this is working, it's pulling stuff from the 2nd page [20:45] so it should work for the rest [20:45] I don't think it's too big for archivebot per see. [20:46] < 20k pages unless there is a forum in there I've missed. [20:46] wget -mkEpnp -w 2 --random-wait http://www.dep.ca seems to be working well [20:47] i'm new here so not sure what the preferred flags are or format, etc [20:48] excellent [20:48] when the archiving is done, I guess it'll be available on the internet archive ? [20:49] What bluesoul is doing can be available on IA if he uploads it to a collection, but it probably will not be part of the Wayback Machine. [20:50] ok, as long as it is avaibale somehow :) [20:50] thanks a lot guys! [20:50] it's being pulled down to redundant storage and then backed up to the cloud, but i need to know a bit more about the process of sharing with IA, i have an account there but haven't contributed in any meaningful way [20:51] I'll see if I can put in in archivebot later tonight. That way it will be available in the normal collection. [20:51] Keep doing what you are doing though bluesoul. So far I've done nothing. [20:51] DEP went bankrupt in march, just found out this week... and the site is still up for now hehe [20:52] won't be for long I guess [20:52] Lotheric: But no disclosed end date so far? [20:54] a trust in bankruprcy (not sure of the english term) took control in march to sell their assets [20:55] http://montrealgazette.com/business/local-business/dep-record-distributor-closing-its-doors [20:55] well, hopefully it's not in the next day or so [20:56] I'm guessing their web hosting was paid in advanced for the year or something [20:57] yeah you never know, sometimes companies are prevented from cancelling service while bankruptcy proceedings are ongoing [20:57] *** xit has joined #archiveteam [20:58] whois says dep.ca domain expiry date is june 2018 [21:01] and last updated in june 2017 so after they went bankrupt? [21:07] on https://www.registreentreprises.gouv.qc.ca [21:07] it says [21:07] Nom Devletian & Associés Inc. [21:07] Date du début de la charge 2017-03-13 [21:07] Date de fin de la charge [21:07] Fonction Syndic de faillite [21:07] Adresse 210-5000 rue Jean-Talon O Montréal (Québec) H4P1W9 Canada [21:07] faillite is french for bankrupcy [21:08] it looks like it's pulling a new page down in full every 3-4 minutes and there are about 400 pages to process [21:08] so that's...20 hours? [21:10] if it's made it this long it'll probably be okay where i don't have to really give it the firehose treatment [21:12] probably :) [21:12] Should probably move this to #archiveteam-bs now. [21:13] *** kristian_ has joined #archiveteam [21:21] *** Stilett0 has quit IRC (Read error: Operation timed out) [21:21] *** Stilett0 has joined #archiveteam [21:33] *** CatQuest has joined #archiveteam [21:34] * CatQuest waves at Lotheric [21:56] *** nwf__ has joined #archiveteam [22:01] *** nwf_ has quit IRC (Read error: Operation timed out) [22:08] *** CatQuest has left blup [22:09] *** Asparagir has quit IRC (Asparagir) [22:51] *** kristian_ has quit IRC (Quit: Leaving) [23:32] *** Rondom has quit IRC (Remote host closed the connection) [23:33] *** Rondom has joined #archiveteam [23:48] *** Rondom has quit IRC (Remote host closed the connection) [23:51] *** Zialus has quit IRC (i'm out!) [23:55] *** Zialus has joined #archiveteam