[00:00] I'm planning on doing something like that, but if I do it's going to be separate from AT's efforts unless I get a consensus that you guys are okay with it [00:06] Whats the max file size for the IA web uploader? [00:08] hundred megabytes is kinda pushing it [00:08] it mostly depends on what makes your web browser unhappy, i think [00:08] ah ok, will use CyberDuck to push my lot through then [00:08] *** Emcy_ has joined #archiveteam [00:09] *** tomwsmf-a has quit IRC (Ping timeout: 259 seconds) [00:09] another reason to split your items: if the connection dies mid-upload ... [00:09] ¯\_(ツ)_/¯ [00:13] *** mistym has quit IRC (Remote host closed the connection) [00:13] *** Emcy has quit IRC (Ping timeout: 306 seconds) [00:25] HCross: you can upload gigabytes through it, just be aware that it can take a long time, and that tab (or window) is effectively frozen while your upload is in progress [00:25] dashcloud, its on one of my windows servers so doesnt matter [00:26] and anyway I wouldnt do it on my 12mb/s upload [00:26] make sure you give your uploads the best metadata (description, tags, etc) that you can- so much easier to find and categorize then (also helps to see if your item helps answer someone's question) [00:27] *** Asparagir has joined #archiveteam [00:27] yh, not sure how to apply the metadata any other way. Was thinking, already made the bucket in CyberDuck and then was going to edit it on the web after [00:56] *** Mayonaise has joined #archiveteam [01:01] *** mistym has joined #archiveteam [01:10] *** dxrt has quit IRC (Read error: Operation timed out) [01:10] *** dxrt has joined #archiveteam [01:13] *** primus104 has quit IRC (Leaving.) [01:18] *** Balrog_ has quit IRC (Read error: Connection reset by peer) [01:20] I routinely do ISOs on the web uploader [01:20] I have a fair bit more than an ISO to put up there [01:20] cyberduck is handy though [01:20] it still shits the bed if the connection drops though [01:21] yh, ive created the bucket, how do I edit the metadata, get erros when downloading the stuff. Do I edit it on the web after? [01:21] you can edit it on the web after [01:21] or before [01:21] cool, there is a fair bit to be uploaded. How do I edit before, as the uploader wants me to send a file, but I want to do that via cyberduck [01:25] you can create a bucket with cyberduck [01:25] ive done that [01:26] then it will exist at archive.org/details/whatever [01:26] *** xk_id has quit IRC (Remote host closed the connection) [01:26] where there should be an edit link [01:27] ah yes, https://archive.org/details/2015.07.ftp.mrc-lmb.cam.ac.uk is the thing [01:27] one of the mods here can move it to the ftp area when it's ready [01:28] ok, its going to take a time as its over 450GB [01:28] The Internet Archive's Wayback Machine saves the day again -- saved now-deleted evidence from a quack autism doctor's blog: http://www.forbes.com/sites/emilywillingham/2015/07/09/government-search-of-autism-doctor-bradstreets-office-related-to-experimental-autism-treatment/ [01:29] Cant change the media type tho [01:30] yeah that's a mod thing too [01:30] ah ok. Are all the upload servers in the USA then [01:31] yes [01:37] Should be zipped in 2 mins then will push it over. page is updated [01:41] *** bzc6p_ has joined #archiveteam [01:41] *** swebb sets mode: +o bzc6p_ [01:42] DFJustin, thx http://harrycross.me/902.png [01:42] =) [01:47] *** Asparagir has quit IRC (Asparagir) [01:47] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [01:50] *** toad1 has joined #archiveteam [01:52] *** Asparagir has joined #archiveteam [02:00] *** kyan has joined #archiveteam [02:51] *** dserodio has quit IRC (Read error: Connection reset by peer) [02:53] *** dserodio has joined #archiveteam [02:53] *** kyan has quit IRC (Quit: This computer has gone to sleep) [02:58] *** kyan has joined #archiveteam [03:28] *** kyan has quit IRC (Quit: This computer has gone to sleep) [03:32] *** kyan has joined #archiveteam [03:33] *** Asparagir has quit IRC (Asparagir) [03:35] *** BlueMaxim has joined #archiveteam [03:38] *** lbft has quit IRC (Read error: Operation timed out) [03:52] *** lbft has joined #archiveteam [04:13] *** mistym has quit IRC (Remote host closed the connection) [04:27] *** RedType has quit IRC (Remote host closed the connection) [04:29] *** kyan has quit IRC (Quit: This computer has gone to sleep) [04:30] *** kyan has joined #archiveteam [04:35] *** aaaaaaaaa has quit IRC (Leaving) [04:38] *** mistym has joined #archiveteam [04:56] *** wp494 has quit IRC (LOUD UNNECESSARY QUIT MESSAGES) [05:06] *** Ungstein1 has joined #archiveteam [05:07] *** Ungstein has quit IRC (Ping timeout: 265 seconds) [05:14] *** cadbury_ has quit IRC (Read error: Operation timed out) [05:21] *** Apathy has quit IRC (Read error: Operation timed out) [05:22] *** Apathy has joined #archiveteam [05:24] *** cadbury_ has joined #archiveteam [05:28] *** RedType has joined #archiveteam [05:29] *** khaoohs_ has joined #archiveteam [05:30] *** MMovie2 has joined #archiveteam [05:31] *** khaoohs has quit IRC (Read error: Operation timed out) [05:32] *** MMovie has quit IRC (Ping timeout: 306 seconds) [05:32] *** BlueMaxim has quit IRC (Ping timeout: 306 seconds) [05:32] *** BlueMaxim has joined #archiveteam [05:41] *** phillipsj has quit IRC (Remote host closed the connection) [06:34] *** laice has quit IRC (Ping timeout: 186 seconds) [06:43] *** mistym has quit IRC (Remote host closed the connection) [06:59] *** wp494 has joined #archiveteam [07:34] *** cadbury_ has quit IRC (Read error: Operation timed out) [07:37] *** caber has quit IRC (Ping timeout: 606 seconds) [07:42] *** atomotic has joined #archiveteam [07:43] *** mistym has joined #archiveteam [07:44] *** schbirid has joined #archiveteam [07:47] *** mistym has quit IRC (Read error: Operation timed out) [07:52] *** caber has joined #archiveteam [07:52] *** primus104 has joined #archiveteam [07:54] *** cadbury_ has joined #archiveteam [08:17] *** primus104 has quit IRC (Leaving.) [08:41] *** dashcloud has quit IRC (Read error: Connection reset by peer) [08:42] *** dashcloud has joined #archiveteam [09:05] *** xk_id has joined #archiveteam [09:37] *** dashcloud has quit IRC (Read error: Operation timed out) [09:38] *** primus104 has joined #archiveteam [09:46] *** dashcloud has joined #archiveteam [09:56] *** mistym has joined #archiveteam [09:59] *** xk_id has quit IRC (Remote host closed the connection) [10:04] *** mistym has quit IRC (Ping timeout: 483 seconds) [10:04] *** xk_id has joined #archiveteam [10:09] *** xk_id has quit IRC (Remote host closed the connection) [10:13] *** xk_id has joined #archiveteam [10:32] *** sprit has joined #archiveteam [10:36] Question: Does IA throttle upload after a time, because tonight I went from well over 200Mbps to 20Mbps [10:42] HCross: yes, but mainly the number of items (usually if you have hundreds green rows on https://archive.org/catalog.php?history=1&justme=1 ) [10:43] More often, it's networking issues between you and IA [10:44] Ive got quite a few pink rows. Doesnt help coming from europe either [10:52] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:08] *** Morbus has joined #archiveteam [11:09] *** MorbusIff has quit IRC (Ping timeout: 265 seconds) [11:32] *** xk_id has quit IRC (Remote host closed the connection) [11:42] *** Emcy has joined #archiveteam [11:46] *** Emcy_ has quit IRC (Ping timeout: 306 seconds) [11:57] *** mistym has joined #archiveteam [11:59] *** WinterFox has quit IRC (Remote host closed the connection) [12:00] *** WinterFox has joined #archiveteam [12:02] *** mistym has quit IRC (Ping timeout: 252 seconds) [12:13] *** Muad-Dib has joined #archiveteam [12:18] *** atomotic has joined #archiveteam [12:19] *** bzc6p_ is now known as bzc6p [12:44] *** Muad-Dib has quit IRC (Ping timeout: 252 seconds) [13:35] *** WinterFox has quit IRC (Remote host closed the connection) [13:37] *** K4k has joined #archiveteam [13:42] *** BlueMaxim has quit IRC (Quit: Leaving) [13:44] *** dashcloud has quit IRC (Read error: Operation timed out) [13:45] *** lrkj has quit IRC (Read error: Operation timed out) [13:46] *** lrkj has joined #archiveteam [13:49] *** godane has quit IRC (Read error: Operation timed out) [13:49] HCross: connectivity between EU and IA is *extremely* spotty [13:50] HCross: I am honestly amazed that you managed to get 200mbps, assuming it was a single connection :) [13:50] best I've ever seen on a single connection was around 50-60mbps [13:50] worst is somewhere around 5kbps, probably [13:50] yh, it is from an Online.net dedicated server. I recon my Virgin line could beat this, 2.7MB/s. [13:50] huh, online? interesting [13:51] they are not known for their... great international routing :P [13:51] well it all seems to hit Cogent Communications, all the way to IA [13:52] joepie91, their UK routing is the reason I am moving all my main stuff to OVH [13:55] *** Muad-Dib has joined #archiveteam [13:55] *** dashcloud has joined #archiveteam [13:58] *** bzc6p_ has joined #archiveteam [13:58] *** swebb sets mode: +o bzc6p_ [13:59] *** mistym has joined #archiveteam [14:01] *** bzc6p has quit IRC (Read error: Operation timed out) [14:07] *** mistym has quit IRC (Ping timeout: 492 seconds) [14:09] *** Emcy has quit IRC (Ping timeout: 240 seconds) [14:10] *** Emcy has joined #archiveteam [14:12] *** Morbus has quit IRC (http://www.disobey.com/) [14:16] *** Morbus has joined #archiveteam [14:18] *** jmc_ has joined #archiveteam [14:22] *** SN4T14__ has joined #archiveteam [14:24] *** Rickster` has joined #archiveteam [14:25] *** Rickster has quit IRC (Ping timeout: 505 seconds) [14:25] *** Rickster` is now known as Rickster [14:25] *** jmc has quit IRC (Ping timeout: 619 seconds) [14:26] *** sprit has quit IRC (Ping timeout: 489 seconds) [14:26] *** SN4T14_ has quit IRC (Ping timeout: 489 seconds) [14:26] *** sprit has joined #archiveteam [14:26] *** Kenshin has quit IRC (Ping timeout: 483 seconds) [14:26] *** Kenshin has joined #archiveteam [14:28] *** xmc has quit IRC (Ping timeout: 483 seconds) [14:31] *** mistym has joined #archiveteam [14:35] *** xk_id has joined #archiveteam [14:37] *** xmc has joined #archiveteam [14:37] *** swebb sets mode: +o xmc [14:47] *** mistym has quit IRC (Remote host closed the connection) [14:49] *** Stiletto has quit IRC (Read error: Operation timed out) [14:51] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:53] *** sprit has quit IRC (Quit: Leaving) [15:02] *** mistym has joined #archiveteam [15:07] *** xk_id has quit IRC (Remote host closed the connection) [16:01] *** mistym has quit IRC (Remote host closed the connection) [16:16] *** mistym has joined #archiveteam [16:26] *** WubTheCap has joined #archiveteam [16:26] I've grabbed Fogles.us to a WARC with GNU Wget and uploaded it to archive.org. I've also tagged it with a subject "archiveteam". Can you move it to the ArchiveTeam collection? https://archive.org/details/fogles_grab_20150713 [16:55] *** garyrh has quit IRC (Read error: Connection reset by peer) [17:02] *** khaoohs_ has quit IRC (Read error: Connection reset by peer) [17:03] *** khaoohs_ has joined #archiveteam [17:11] *** khaoohs_ has quit IRC (Read error: Connection reset by peer) [17:12] *** khaoohs_ has joined #archiveteam [17:19] *** Aranje has joined #archiveteam [17:51] *** atomotic has joined #archiveteam [17:52] *** habi has joined #archiveteam [17:58] *** primus104 has quit IRC (Leaving.) [18:08] *** maffafa has joined #archiveteam [18:08] !archive google.com [18:09] what's the name of the bot? [18:09] you want the #archivebot channel [18:09] 2 [18:17] *** maffafa has quit IRC (Client Quit) [18:33] *** Stiletto has joined #archiveteam [18:39] *** c_b has joined #archiveteam [18:42] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [18:43] *** primus104 has joined #archiveteam [18:58] *** bzc6p_ is now known as bzc6p [19:20] *** garyrh has joined #archiveteam [19:31] *** T31M has quit IRC (Quit: Leaving) [19:38] *** habi has left [19:52] *** aaaaaaaaa has joined #archiveteam [19:52] *** swebb sets mode: +o aaaaaaaaa [19:54] *** khaoohs__ has joined #archiveteam [19:55] *** khaoohs_ has quit IRC (Ping timeout: 240 seconds) [19:58] *** kyan has quit IRC (Quit: Leaving) [20:00] *** khaoohs has joined #archiveteam [20:00] *** khaoohs__ has quit IRC (Read error: Operation timed out) [20:02] *** khaoohs_ has joined #archiveteam [20:04] *** K4k has quit IRC (Ping timeout: 265 seconds) [20:06] *** khaoohs has quit IRC (Read error: Operation timed out) [20:34] *** lbft has quit IRC (Read error: Operation timed out) [20:34] *** schbirid has quit IRC (Leaving) [20:36] *** Kenshin has quit IRC (Ping timeout: 258 seconds) [20:38] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [20:40] *** Kenshin has joined #archiveteam [20:48] *** Kenshin has quit IRC (Quit: ZNC - http://znc.in) [20:48] *** Kenshin has joined #archiveteam [20:48] *** Kenshin has quit IRC (Client Quit) [20:48] *** Kenshin has joined #archiveteam [20:51] *** oldcad has joined #archiveteam [20:53] *** lbft has joined #archiveteam [20:59] *** ruukasu has quit IRC (Quit: ZNC - 1.6.0 - http://znc.in) [21:00] *** habi has joined #archiveteam [21:05] *** habi has left [21:11] *** ruukasu has joined #archiveteam [21:20] *** Start_ has joined #archiveteam [21:20] *** Start has quit IRC (Read error: Connection reset by peer) [21:27] *** mistym has quit IRC (Remote host closed the connection) [21:27] *** mistym has joined #archiveteam [21:28] *** Start_ is now known as Start [21:29] *** mistym has quit IRC (Read error: Operation timed out) [21:30] *** mistym has joined #archiveteam [21:34] *** xk_id has joined #archiveteam [21:54] *** Froggypwn has joined #archiveteam [21:58] *** aliz has quit IRC (Remote host closed the connection) [21:58] *** godane has joined #archiveteam [22:14] *** dashcloud has quit IRC (Read error: Connection reset by peer) [22:16] *** nertzy has quit IRC (Quit: Leaving) [22:18] *** dashcloud has joined #archiveteam [22:22] *** kyan has joined #archiveteam [22:23] *** nertzy has joined #archiveteam [22:26] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:26] *** Aranje has joined #archiveteam [22:30] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:31] *** Aranje has joined #archiveteam [22:42] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:43] *** Aranje has joined #archiveteam [23:23] *** godane has quit IRC (Ping timeout: 265 seconds) [23:26] *** Stiletto has quit IRC (Ping timeout: 370 seconds) [23:27] *** WinterFox has joined #archiveteam [23:31] *** Aranje has quit IRC (Read error: Connection reset by peer) [23:31] *** Aranje has joined #archiveteam [23:40] *** godane has joined #archiveteam [23:51] *** c_b2 has joined #archiveteam [23:52] *** c_b has quit IRC (Ping timeout: 252 seconds) [23:52] *** Stiletto has joined #archiveteam [23:54] *** c_b2 has quit IRC (Client Quit) [23:59] *** xf2e has joined #archiveteam