#archiveteam 2015-09-24,Thu

↑back Search

Time Nickname Message
00:19 🔗 wp494 <10K items to go on thingiverse currently
00:19 🔗 wp494 I'd probably get the next batch ready to be loaded in
00:24 🔗 wp494 thingiverse is now out of items to do
00:25 🔗 joepie91 wp494: mmmm. what was the first batch?
00:25 🔗 joepie91 like, up to what number
00:26 🔗 arkiver new items added.
00:26 🔗 joepie91 oh
00:26 🔗 joepie91 arkiver is awake
00:26 🔗 joepie91 :P
00:26 🔗 * arkiver is afk for the night
00:26 🔗 joepie91 arkiver: hold
00:26 🔗 arkiver nope
00:26 🔗 joepie91 arkiver: if new items need adding, wat do?
00:26 🔗 joepie91 (if I'm still awake)
00:27 🔗 arkiver everything up to 1000000 (million) is now in the tracker
00:27 🔗 wp494 awesome, ty
00:32 🔗 Deewiant has quit IRC (Ping timeout: 198 seconds)
00:32 🔗 tephra_ has quit IRC (Ping timeout: 240 seconds)
00:32 🔗 tephra has joined #archiveteam
00:33 🔗 Deewiant has joined #archiveteam
00:34 🔗 vitzli has joined #archiveteam
00:35 🔗 JesseW has joined #archiveteam
00:51 🔗 robink has quit IRC (Ping timeout: 492 seconds)
00:52 🔗 robink has joined #archiveteam
00:52 🔗 primus104 has quit IRC (Leaving.)
01:28 🔗 RichardG has joined #archiveteam
01:31 🔗 vitzli has quit IRC (Quit: Leaving)
01:40 🔗 dashcloud has quit IRC (Read error: Operation timed out)
01:44 🔗 dashcloud has joined #archiveteam
02:04 🔗 JesseW has quit IRC (Read error: Operation timed out)
02:04 🔗 BlueMaxim has joined #archiveteam
02:05 🔗 dashcloud has quit IRC (Read error: Operation timed out)
02:17 🔗 dashcloud has joined #archiveteam
02:51 🔗 JesseW has joined #archiveteam
02:54 🔗 dashcloud has quit IRC (Read error: Operation timed out)
02:57 🔗 dashcloud has joined #archiveteam
03:39 🔗 vitzli has joined #archiveteam
04:03 🔗 aaaaaaaa_ has joined #archiveteam
04:03 🔗 aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
04:11 🔗 aaaaaaaa_ is now known as aaaaaaaaa
04:11 🔗 zenguy_pc has quit IRC (Ping timeout: 258 seconds)
04:17 🔗 aaaaaaaaa has quit IRC (Leaving)
04:40 🔗 dashcloud has quit IRC (Read error: Operation timed out)
04:43 🔗 dashcloud has joined #archiveteam
04:56 🔗 khaoohs has joined #archiveteam
05:00 🔗 logan has joined #archiveteam
05:01 🔗 khaoohs_ has quit IRC (Read error: Operation timed out)
05:03 🔗 logan2 has quit IRC (Ping timeout: 258 seconds)
05:04 🔗 Infreq_ has joined #archiveteam
05:04 🔗 ZeroDogg has joined #archiveteam
05:06 🔗 Zero_Dogg has quit IRC (hub.efnet.us irc.Prison.NET)
05:06 🔗 MrRadar has quit IRC (hub.efnet.us irc.Prison.NET)
05:06 🔗 Infreq has quit IRC (hub.efnet.us irc.Prison.NET)
05:06 🔗 db48x has quit IRC (hub.efnet.us irc.Prison.NET)
05:15 🔗 MrRadar_ has joined #archiveteam
05:25 🔗 sivoais has quit IRC (Ping timeout: 240 seconds)
05:28 🔗 Wyatts has quit IRC (Remote host closed the connection)
05:30 🔗 Wyatts has joined #archiveteam
05:40 🔗 robink has quit IRC (Ping timeout: 492 seconds)
05:41 🔗 robink has joined #archiveteam
05:49 🔗 primus104 has joined #archiveteam
05:52 🔗 phiren has quit IRC (Ping timeout: 506 seconds)
05:52 🔗 phiren has joined #archiveteam
06:01 🔗 db48x has joined #archiveteam
06:06 🔗 vitzli has quit IRC (Quit: Leaving)
06:08 🔗 zenguy_pc has joined #archiveteam
06:14 🔗 JesseW has quit IRC (Read error: Operation timed out)
06:14 🔗 schbirid has joined #archiveteam
06:24 🔗 sivoais has joined #archiveteam
06:54 🔗 dashcloud has quit IRC (Read error: Operation timed out)
07:00 🔗 dashcloud has joined #archiveteam
07:03 🔗 PurpleSym has joined #archiveteam
07:17 🔗 primus104 has quit IRC (Leaving.)
07:23 🔗 habi has joined #archiveteam
07:23 🔗 habi has left
07:35 🔗 dashcloud has quit IRC (Read error: Operation timed out)
07:38 🔗 dashcloud has joined #archiveteam
07:39 🔗 habi has joined #archiveteam
07:40 🔗 habi has quit IRC (Client Quit)
08:02 🔗 BlueMaxim has quit IRC (Quit: Leaving)
08:07 🔗 zenguy_pc has quit IRC (Read error: Operation timed out)
08:21 🔗 zenguy_pc has joined #archiveteam
08:26 🔗 arkiver 700000 items have been added to thingiverse, after these items we have all files.
08:26 🔗 arkiver SketchCow: so everything from thingiverse is currently going ot the gamefront rsync target on FOS
08:27 🔗 arkiver SketchCow: after these files we'll do the other stuff from thingiverse, so we'll have it complete
08:28 🔗 arkiver SketchCow: why do you think thingiverse might be going away?
08:29 🔗 arkiver Because of the problems yesterday or is more happening?
08:33 🔗 DopefishJ has joined #archiveteam
08:33 🔗 DFJustin has quit IRC (Ping timeout: 252 seconds)
08:41 🔗 SketchCow No idea
08:41 🔗 SketchCow Had someone mail me and tell me
08:41 🔗 SketchCow Tips rarely come in that emphatic
09:03 🔗 godane i'm still doing my own grab of it
09:03 🔗 godane mostly cause i'm not 100% sure how much of it you guys grab
09:03 🔗 godane for real
09:10 🔗 johndoe_ has joined #archiveteam
09:13 🔗 johndoe_ hi everyone. Is the skillfeed script still working https://github.com/ArchiveTeam/skillfeed-grab/blob/master/skillfeed.lua ?
09:13 🔗 johndoe_ I tried to understand it to download a single course from the skillfeed site but run into problems because google cache only stores the front page for each course and not the single lecture webpages?
09:13 🔗 johndoe_ So I can only download the first introductory video
09:14 🔗 johndoe_ Did you download everything before they blocked it or does the script works with google cache?
09:14 🔗 habi has joined #archiveteam
09:18 🔗 habi has left
09:34 🔗 Fletcher johndoe_, a lot of videos were grabbed before google cache was required, if the course id was sub 10k it was most likely archived fully. Past that the chances go down some but you'll need to check the data to be sure. https://archive.org/details/archiveteam_skillfeed
09:35 🔗 Fletcher (probably isn't easily checkable yet)
09:42 🔗 primus104 has joined #archiveteam
10:07 🔗 zenguy_pc has quit IRC (Read error: Operation timed out)
10:13 🔗 arkiver godane: for now we're only grabbing the files (those are the most important), but we'll grab everything else too
10:20 🔗 godane ok
10:20 🔗 arkiver godane: so we'll do everyting
10:20 🔗 arkiver when it comes to warrior projects we really don't miss things
10:20 🔗 johndoe_ Flechter, Thank you for your answer I will have a look
10:21 🔗 arkiver I think you can say ArchiveTeam is perfectionism when it comes to those grabs
10:21 🔗 arkiver SketchCow: ok, got it
10:21 🔗 dashcloud has quit IRC (Read error: Operation timed out)
10:22 🔗 zenguy_pc has joined #archiveteam
10:22 🔗 arkiver hmm, I mean perfectionistic
10:22 🔗 godane i know what you mean :-D
10:22 🔗 godane i'm the same way with things
10:26 🔗 dashcloud has joined #archiveteam
10:34 🔗 godane arkiver: btw i'm grabbing the missing/lost episodes of JIBS News General
10:34 🔗 godane turns out vlc can get them but not mplayer
10:38 🔗 dashcloud has quit IRC (Read error: Operation timed out)
10:41 🔗 dashcloud has joined #archiveteam
10:43 🔗 johndoe_ has quit IRC (Quit: Page closed)
11:18 🔗 arkiver godane: sounds good! So that collection will be complete
11:23 🔗 primus104 has quit IRC (Leaving.)
11:28 🔗 godane i'm grabbing the missing 6 episodes of 2011 of jibs news general
11:32 🔗 Morbus has quit IRC (Quit: http://www.disobey.com/)
11:34 🔗 Morbus has joined #archiveteam
12:17 🔗 zenguy_pc has quit IRC (Read error: Operation timed out)
12:22 🔗 zenguy_pc has joined #archiveteam
12:34 🔗 primus104 has joined #archiveteam
13:39 🔗 PurpleSym has quit IRC (WeeChat 1.1.1)
14:01 🔗 vitzli has joined #archiveteam
14:02 🔗 PurpleSym has joined #archiveteam
14:06 🔗 K4k has joined #archiveteam
14:08 🔗 zenguy_pc has quit IRC (Read error: Operation timed out)
14:13 🔗 afics has quit IRC (Ping timeout: 252 seconds)
14:16 🔗 DopefishJ is now known as DFJustin
14:22 🔗 zenguy_pc has joined #archiveteam
14:25 🔗 nertzy has joined #archiveteam
14:26 🔗 zenguy_pc has quit IRC (Read error: Operation timed out)
14:41 🔗 zenguy_pc has joined #archiveteam
14:43 🔗 nertzy has quit IRC (Quit: This computer has gone to sleep)
14:48 🔗 scyther has joined #archiveteam
15:00 🔗 primus104 has quit IRC (Leaving.)
15:05 🔗 JesseW has joined #archiveteam
15:28 🔗 yuvadm has quit IRC (Ping timeout: 240 seconds)
15:30 🔗 JesseW has quit IRC (Read error: Operation timed out)
15:33 🔗 yuvadm has joined #archiveteam
15:41 🔗 vitzli has quit IRC (Quit: Leaving)
16:25 🔗 nertzy has joined #archiveteam
16:30 🔗 primus104 has joined #archiveteam
16:36 🔗 nertzy has quit IRC (Quit: This computer has gone to sleep)
16:37 🔗 robink has quit IRC (Ping timeout: 492 seconds)
16:38 🔗 robink has joined #archiveteam
16:40 🔗 dashcloud has quit IRC (Read error: Operation timed out)
16:43 🔗 dashcloud has joined #archiveteam
16:48 🔗 xk_id has quit IRC (Remote host closed the connection)
16:50 🔗 scyther has quit IRC (Quit: Leaving)
17:18 🔗 RedType has quit IRC (Quit: leaving)
17:22 🔗 RedType has joined #archiveteam
17:23 🔗 RedType has quit IRC (Client Quit)
17:23 🔗 RedType has joined #archiveteam
17:34 🔗 aaaaaaaaa has joined #archiveteam
17:37 🔗 matthusby fyi: Thingiverse to out of items
17:45 🔗 khaoohs_ has joined #archiveteam
17:49 🔗 DFJustin is there any skillfeed in the wayback machine that's not in the google cache
17:49 🔗 khaoohs has quit IRC (Read error: Operation timed out)
17:50 🔗 khaoohs has joined #archiveteam
17:54 🔗 khaoohs_ has quit IRC (Ping timeout: 492 seconds)
18:16 🔗 phuzion has quit IRC (Remote host closed the connection)
18:47 🔗 Zandro has quit IRC (Read error: Connection reset by peer)
18:47 🔗 Zandro has joined #archiveteam
18:49 🔗 scyther has joined #archiveteam
19:09 🔗 ohhdemgir has joined #archiveteam
19:35 🔗 habi has joined #archiveteam
19:42 🔗 wyatt8740 has quit IRC (Remote host closed the connection)
19:48 🔗 habi has left
19:49 🔗 schbirid has quit IRC (Quit: Leaving)
19:51 🔗 phuzion has joined #archiveteam
19:51 🔗 wyatt8740 has joined #archiveteam
19:52 🔗 xk_id has joined #archiveteam
20:26 🔗 afics has joined #archiveteam
20:56 🔗 PurpleSym has quit IRC (Remote host closed the connection)
20:59 🔗 jmad980 has quit IRC (Ping timeout: 362 seconds)
21:19 🔗 scyther has quit IRC (Leaving)
21:30 🔗 K4k has quit IRC (Ping timeout: 240 seconds)
21:32 🔗 jmad980 has joined #archiveteam
21:37 🔗 wp494 has quit IRC (Read error: Connection reset by peer)
21:41 🔗 wp494 has joined #archiveteam
21:44 🔗 vOYtEC has quit IRC (Ping timeout: 240 seconds)
21:45 🔗 arkiver SketchCow: all the items from Thingiverse have been uploaded to the GameFront rsync target, because we needed a target and couldn't wait a for a special thingiverse target
21:45 🔗 arkiver Can you please move the files from of thingiverse out of the gamefront target or upload them?
21:46 🔗 arkiver And yeah, there's a lot of tiny files, but yesterday we thought thingiverse was actually removing access to stuff and doing it the way we did was the best way to make sure we would get as much as possible
21:47 🔗 arkiver ^ also because sometimes files weren't available and sometimes they were
21:47 🔗 yipdw wow that fucks up that rsync a lot
21:47 🔗 yipdw hopefully megawarc isn't running
21:47 🔗 yipdw well done
21:48 🔗 arkiver so negative
21:48 🔗 arkiver we actually started the grab 40 minutes after SketchCow's message, whic I think was pretty fast
21:49 🔗 yipdw that's not negative, I'm looking at the directory
21:49 🔗 yipdw it's pretty fucked
21:50 🔗 yipdw luckily it looks like the packer isn't on
21:52 🔗 arkiver yeah, I think SketchCow didn't start it yet
21:53 🔗 arkiver I hope it won't be a too big problem to process the files
21:54 🔗 yipdw if you're still accepting uploads point them at /chfoo/thingiverse
21:54 🔗 yipdw er [whatever]/thingiverse
21:54 🔗 arkiver OK, done
21:57 🔗 vOYtEC has joined #archiveteam
21:58 🔗 arkiver tomorrow we'll start grabbing images and metadata from thingiverse, those will be done in 100 id's per item
21:58 🔗 arkiver so ~10000 files
21:59 🔗 * arkiver is afk for the night
22:00 🔗 yipdw move in progress
22:28 🔗 wyatt8740 has quit IRC (Read error: Operation timed out)
22:29 🔗 wyatt8740 has joined #archiveteam
22:35 🔗 aaaaaaaaa has quit IRC (Leaving)
23:15 🔗 RedType has quit IRC (Ping timeout: 1221 seconds)
23:16 🔗 xk_id has quit IRC (Read error: Operation timed out)
23:17 🔗 xk_id has joined #archiveteam
23:18 🔗 yipdw arkiver: moved
23:29 🔗 RedType has joined #archiveteam
23:42 🔗 khaoohs_ has joined #archiveteam
23:45 🔗 khaoohs has quit IRC (Read error: Operation timed out)

irclogger-viewer