#archiveteam 2017-12-04,Mon

↑back Search

Time Nickname Message
00:02 🔗 jschwart has quit IRC (Quit: Konversation terminated!)
00:30 🔗 jmtd is now known as Jon
01:01 🔗 useretail hey guys, how to bypass such msg: Please reduce your request rate. - bucket_tasks_queued exceeds rationed amount
01:01 🔗 JAA useretail: Context? And what do you mean by "bypass"?
01:04 🔗 useretail i'm trying to upload ~200GB
01:04 🔗 useretail and believe it or not, i can't do it because of such errors
01:05 🔗 JAA To the Internet Archive?
01:06 🔗 useretail yes, using ia
01:07 🔗 useretail can you please explain a bit more about "rationed amount" and "bucket tasks"?
01:08 🔗 useretail and what does "request rate" mean?
01:08 🔗 useretail am i uploading too much?
01:08 🔗 JAA I see. I haven't come across that. Maybe someone else can help. Otherwise, I guess you'll have to send them an email or ask in #internetarchive (not sure how active that channel is). We're not the Internet Archive...
01:09 🔗 useretail ok, thx
01:10 🔗 Morbus has quit IRC (Quit: http://www.disobey.com/)
01:10 🔗 MorbusIff has quit IRC (Quit: http://www.disobey.com/)
01:10 🔗 Mateon1 has quit IRC (Ping timeout: 245 seconds)
01:12 🔗 Mateon1 has joined #archiveteam
01:16 🔗 Stilett0 has joined #archiveteam
01:17 🔗 joepie91 useretail: are you using `ia` with `xargs` by any chance?
01:19 🔗 joepie91 useretail: specifically, is it possible that you're running more than 59 total upload tasks at the same time, or more than 19 upload tasks for a single item at the same time?
01:19 🔗 joepie91 (in which case S3 will return 'overloaded' when the system has a large backllg)
01:19 🔗 joepie91 backlog*
01:50 🔗 medowar has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 i0npulse has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 Nemo_bis has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 voidsta has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 Rai-chan has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 dboard2 has quit IRC (Ping timeout: 248 seconds)
01:50 🔗 medowar has joined #archiveteam
01:51 🔗 Nemo_bis has joined #archiveteam
01:51 🔗 Nemo_bis has quit IRC (se.hub irc.underworld.no)
01:51 🔗 medowar has quit IRC (se.hub irc.underworld.no)
01:59 🔗 dboard2 has joined #archiveteam
03:01 🔗 Martle_ has quit IRC (Read error: Connection reset by peer)
03:29 🔗 Martle has joined #archiveteam
04:03 🔗 second_ has joined #archiveteam
04:04 🔗 second_ has quit IRC (Client Quit)
04:04 🔗 second_ has joined #archiveteam
04:05 🔗 second_ is now known as sec0nd
04:28 🔗 qw3rty117 has joined #archiveteam
04:33 🔗 qw3rty116 has quit IRC (Read error: Operation timed out)
04:41 🔗 Ctrl has quit IRC (Ping timeout: 245 seconds)
05:37 🔗 balrog has quit IRC (Read error: Operation timed out)
05:42 🔗 balrog has joined #archiveteam
06:08 🔗 Soni has quit IRC (Ping timeout: 255 seconds)
06:46 🔗 fie has quit IRC (Quit: Leaving)
06:47 🔗 Nemo_bis has joined #archiveteam
06:47 🔗 medowar has joined #archiveteam
06:48 🔗 Rai-chan has joined #archiveteam
06:51 🔗 voidsta has joined #archiveteam
06:51 🔗 i0npulse has joined #archiveteam
06:57 🔗 ZexaronS has quit IRC (Quit: Leaving)
06:57 🔗 slpp has joined #archiveteam
06:58 🔗 slpp has left
07:43 🔗 schbirid has joined #archiveteam
08:22 🔗 jschwart has joined #archiveteam
08:24 🔗 schbirid has quit IRC (Ping timeout: 255 seconds)
08:37 🔗 schbirid has joined #archiveteam
08:53 🔗 atomotic has joined #archiveteam
09:04 🔗 Soni has joined #archiveteam
09:35 🔗 CoolCanuk has quit IRC (Quit: Connection closed for inactivity)
10:56 🔗 tobbez has joined #archiveteam
11:36 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
11:42 🔗 atomotic has quit IRC (Quit: atomotic)
12:56 🔗 atomotic has joined #archiveteam
13:08 🔗 nertzy has joined #archiveteam
13:11 🔗 nertzy2 has quit IRC (Read error: Operation timed out)
13:37 🔗 Morbus has joined #archiveteam
14:08 🔗 atomotic has quit IRC (Quit: atomotic)
14:26 🔗 nyaomi has quit IRC (Read error: Operation timed out)
14:46 🔗 K4k has quit IRC (Quit: WeeChat 1.9.1)
14:48 🔗 K4k has joined #archiveteam
16:05 🔗 atomotic has joined #archiveteam
16:16 🔗 Lord_Nigh has quit IRC (Read error: Operation timed out)
16:38 🔗 Stilett0 is now known as Stiletto
17:01 🔗 Lord_Nigh has joined #archiveteam
17:10 🔗 nyaomi has joined #archiveteam
17:21 🔗 atomotic has quit IRC (Quit: atomotic)
18:04 🔗 Valentine has quit IRC (Read error: Connection reset by peer)
18:07 🔗 Valentine has joined #archiveteam
19:13 🔗 CoolCanuk has joined #archiveteam
19:53 🔗 jschwart has quit IRC (Remote host closed the connection)
20:08 🔗 jschwart has joined #archiveteam
20:28 🔗 schbirid has quit IRC (Remote host closed the connection)
20:57 🔗 MrDignity has quit IRC (Remote host closed the connection)
20:57 🔗 MrDignity has joined #archiveteam
20:58 🔗 jschwart has quit IRC (Remote host closed the connection)
21:02 🔗 jschwart has joined #archiveteam
21:09 🔗 jschwart has quit IRC (Read error: Connection reset by peer)
21:10 🔗 jschwart has joined #archiveteam
21:18 🔗 Aerochrom has quit IRC (Read error: Connection reset by peer)
21:24 🔗 retroity has joined #archiveteam
21:25 🔗 retroity If you guys aren't aware, ROBLOX is closing their forums. It's read only, everything will be deleted on December 11th. https://forum.roblox.com/Forum/ShowPost.aspx?PostID=228429979
21:25 🔗 JAA Oh, deleting it this time. Excellent.
21:25 🔗 JAA Well, at least we already have a channel and the code: #robloxd
21:29 🔗 retroity Yeah and at least there's already code from earlier this year to grab Roblox forum posts.
21:54 🔗 Martle has quit IRC (Read error: Operation timed out)
22:00 🔗 CoolCanuk excellent
22:10 🔗 Morbus has quit IRC (Ping timeout: 259 seconds)
22:10 🔗 Morbus has joined #archiveteam
22:19 🔗 ndiddy has joined #archiveteam
22:21 🔗 Martle has joined #archiveteam
22:23 🔗 icedice has joined #archiveteam
23:09 🔗 bithippo has joined #archiveteam
23:10 🔗 ranavalon has quit IRC (Read error: Connection reset by peer)
23:10 🔗 ranavalon has joined #archiveteam
23:11 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
23:11 🔗 Mateon1 has joined #archiveteam
23:12 🔗 ZexaronS has joined #archiveteam
23:15 🔗 ranavalon has quit IRC (Read error: Connection reset by peer)
23:16 🔗 ranavalon has joined #archiveteam
23:17 🔗 jschwart has quit IRC (Konversation terminated!)
23:19 🔗 ranavalon has quit IRC (Read error: Connection reset by peer)
23:19 🔗 ranavalon has joined #archiveteam
23:23 🔗 retroity archiveteam.org is really slow now and I got a resource limit error at one point, anyone else getting this?
23:23 🔗 astrid yes
23:23 🔗 astrid it's slow
23:23 🔗 astrid sorry
23:26 🔗 CoolCanuk JAA will work on hopefully before new years. Just waiting on permissions.
23:27 🔗 bithippo is now known as TooMuchTo
23:28 🔗 TooMuchTo is now known as bithippo
23:32 🔗 bithippo Does anyone know how much traffic archiveteam.org does in a month?
23:32 🔗 CoolCanuk attempted traffic? or traffic that went through?
23:32 🔗 icedice has quit IRC (Ping timeout: 260 seconds)
23:32 🔗 bithippo The latter.
23:33 🔗 CoolCanuk here is alexa, which is not confirmed, only guessed. https://www.alexa.com/siteinfo/archiveteam.org
23:34 🔗 CoolCanuk pretty low
23:35 🔗 bithippo Wondering if its something I could kick in ~$25-50/month for and we throw a CDN in front of it (since Cloudflare is persona non grata)
23:36 🔗 bithippo Or maybe just Varnish on whatever machine/instance its hosted on? I don't know the details, so I'm just wildly speculating!
23:36 🔗 CoolCanuk persona non grata?
23:36 🔗 CoolCanuk oh
23:36 🔗 CoolCanuk I dont think it's a site problem. I think it's mediawiki
23:37 🔗 bithippo "persona non grata" = shit list
23:37 🔗 CoolCanuk I have never had an error when browsing http://archiveteam.org/images/
23:37 🔗 CoolCanuk only when on the actual wiki
23:37 🔗 CoolCanuk the host is Enterprise class
23:37 🔗 bithippo Maybe heavy caching is in order with invalidations performed when content changes?
23:37 🔗 CoolCanuk JAA plans to work on that
23:38 🔗 bithippo Cool :thumbs up:
23:44 🔗 CoolCanuk hopefully we get lots of improvements. HTTPS, VisualEditor, mobile view, MediaViewer :)
23:45 🔗 bithippo Exciting!
23:45 🔗 ZexaronS has quit IRC (Read error: Operation timed out)
23:45 🔗 CoolCanuk I love VisualEditor :)
23:47 🔗 ZexaronS has joined #archiveteam
23:48 🔗 Morbus has quit IRC (Ping timeout: 255 seconds)
23:50 🔗 bithippo JAA: If you need help with the above, feel free to ping me!
23:54 🔗 CoolCanuk i'd love to help too

irclogger-viewer