#archiveteam-bs 2019-09-01,Sun

↑back Search

Time Nickname Message
00:13 🔗 ShellyRol has quit IRC (Ping timeout: 496 seconds)
00:14 🔗 ShellyRol has joined #archiveteam-bs
00:14 🔗 ephemer0l has quit IRC (Ping timeout: 745 seconds)
00:18 🔗 ephemer0l has joined #archiveteam-bs
00:27 🔗 JAA Last update before I go to bed: 286k discussions done, 11.0 GiB WARCs, 74 channels still in progress.
00:42 🔗 Quirk8 has quit IRC (Read error: Operation timed out)
00:55 🔗 Quirk8 has joined #archiveteam-bs
00:57 🔗 RichardG has joined #archiveteam-bs
00:57 🔗 RichardG_ has quit IRC (Read error: Connection reset by peer)
01:00 🔗 Quirk8 has quit IRC (Read error: Operation timed out)
01:02 🔗 Quirk8 has joined #archiveteam-bs
01:19 🔗 BlueMax has quit IRC (Quit: Leaving)
02:13 🔗 dxrt_2 is now known as dxrt_
03:26 🔗 qw3rty118 has joined #archiveteam-bs
03:33 🔗 qw3rty117 has quit IRC (Ping timeout: 612 seconds)
03:56 🔗 odemgi has joined #archiveteam-bs
04:01 🔗 odemgi_ has quit IRC (Read error: Operation timed out)
04:51 🔗 BlueMax has joined #archiveteam-bs
05:03 🔗 larryv has quit IRC (larryv)
05:52 🔗 wyatt8740 has quit IRC (Read error: Operation timed out)
05:57 🔗 wyatt8740 has joined #archiveteam-bs
06:36 🔗 wyatt8740 has quit IRC (Read error: Operation timed out)
06:39 🔗 wyatt8740 has joined #archiveteam-bs
06:54 🔗 Ryz Mm, we are approaching either that Disqus Channels is closing on 12AM PST, or at the end of September 01
07:35 🔗 killsushi has quit IRC (Quit: Leaving)
08:06 🔗 godane so i'm looking at getting this computer : https://www.newegg.com/diypc-diy-f2-w-gaming-entertainment/p/1VK-01T2-00010
08:07 🔗 godane or at least review for it
08:07 🔗 godane based i got is reviews on the case
08:18 🔗 godane ok turns out to be a custom reseller: http://www.pricerightcomputers.com/
09:31 🔗 JAA So my Disqus Channels crawl finished at 05:35. It grabbed about 625k discussions. I had noticed already in tests that the number of discussions somehow didn't match up with the counts given on https://disqus.com/home/explore/channels/ so that might not mean anything, but I'm not sure.
09:31 🔗 JAA I don't see any signs of me getting banned, their servers breaking, or similar though.
09:33 🔗 JAA As a small random example for that count mismatch, https://disqus.com/home/channel/disqusoutlet/recent/ is listed as having 22 discussions on the index but only shows 12.
10:15 🔗 BlueMax has quit IRC (Ping timeout: 745 seconds)
10:23 🔗 BlueMax has joined #archiveteam-bs
10:29 🔗 achip has quit IRC (west.us.hub irc.Prison.NET)
10:29 🔗 Ryz has quit IRC (west.us.hub irc.Prison.NET)
10:29 🔗 Somebody2 has quit IRC (west.us.hub irc.Prison.NET)
10:29 🔗 Jens https://bpaste.net/show/sVcT <- Why does CheckIP fail?
10:30 🔗 Jens DNS resolution is functional.
10:34 🔗 Kaz doesn't look like it
10:35 🔗 Kaz that tries to resolve the following: twitter.com, facebook.com, youtube.com, microsoft.com, icanhas.cheezburger.com, archiveteam.org
10:35 🔗 Kaz I'd double check to make sure you can actually resolve all of those
10:35 🔗 Jens https://bpaste.net/show/3ViD
10:36 🔗 Kaz need all 6
10:37 🔗 Jens All work. Also, this machine is DNS server for the LAN. I'd have several people angry with me if resolver was broken.
10:38 🔗 Kaz I've just spun up a pipeline and everything worked perfectly, so there's got to be something your end
10:38 🔗 Kaz that or I've got a cached record for something that doesn't exist any more /shrug
10:39 🔗 Jens Got another pipeline running on a VPS that also works, so no doubt something is broken. Just trying to figure out what exactly.
10:46 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
10:48 🔗 Mateon1 has joined #archiveteam-bs
10:53 🔗 Ryz has joined #archiveteam-bs
10:53 🔗 Somebody2 has joined #archiveteam-bs
10:53 🔗 irc.Prison.NET sets mode: +o Somebody2
10:53 🔗 Fusl__ sets mode: +o Ryz
10:53 🔗 Fusl sets mode: +o Ryz
10:53 🔗 Fusl_ sets mode: +o Ryz
10:53 🔗 Jens Seeding the cache before invoking the pipeline made it go. Maybe the timeout in gethostbyname is too short.
10:54 🔗 Jens Whatever. It runs now.
10:54 🔗 achip has joined #archiveteam-bs
10:55 🔗 Jens As much as tinypic "goes" anywhere. God that's slow.
10:56 🔗 sirvy has quit IRC (Quit: WeeChat 2.3)
10:58 🔗 sirvy has joined #archiveteam-bs
10:59 🔗 odemgi https://old.reddit.com/r/opendirectories/comments/cy8jry/exodos_v40_release_theeye/
11:01 🔗 ivan_ cool
11:24 🔗 godane i'm uploading Ancient Prophecies IV - The Final Visions
11:24 🔗 godane a old avi file i have on one of my hard drives
11:30 🔗 kiskabak has quit IRC (Remote host closed the connection)
11:30 🔗 kiskabak has joined #archiveteam-bs
11:30 🔗 Fusl_ sets mode: +o kiskabak
11:30 🔗 Fusl sets mode: +o kiskabak
11:30 🔗 Fusl__ sets mode: +o kiskabak
11:33 🔗 kiska1 has quit IRC (Remote host closed the connection)
11:33 🔗 Ryz has quit IRC (Remote host closed the connection)
11:33 🔗 Ryz has joined #archiveteam-bs
11:33 🔗 Fusl sets mode: +o Ryz
11:33 🔗 Fusl__ sets mode: +o Ryz
11:33 🔗 Fusl_ sets mode: +o Ryz
11:33 🔗 kiska1 has joined #archiveteam-bs
11:33 🔗 Fusl__ sets mode: +o kiska1
11:33 🔗 Fusl sets mode: +o kiska1
11:33 🔗 Fusl_ sets mode: +o kiska1
11:41 🔗 Quirk8 has quit IRC (Ping timeout: 246 seconds)
11:42 🔗 godane https://archive.org/details/Ancient_Prophecies_IV_-_The_Final_Visions
11:49 🔗 zino_ has quit IRC (Read error: Operation timed out)
12:00 🔗 zino_ has joined #archiveteam-bs
12:11 🔗 Quirk8 has joined #archiveteam-bs
12:32 🔗 BlueMax has quit IRC (Quit: Leaving)
12:32 🔗 trc has quit IRC (Read error: Connection reset by peer)
12:39 🔗 trc has joined #archiveteam-bs
12:53 🔗 DogsRNice has joined #archiveteam-bs
13:57 🔗 lameboy has joined #archiveteam-bs
13:59 🔗 davie has joined #archiveteam-bs
14:01 🔗 JAA (Continuing on fbo.gov from #archiveteam)
14:01 🔗 JAA Seems like quite a pain to archive.
14:01 🔗 davie I don't want to waste your time, does anyone actually want to see what is there?
14:01 🔗 davie https://www.fbo.gov/spg/ODA/USSOCOM/FortBraggNC/H92239-19-Q-0023/listing.html
14:01 🔗 davie PSYOPS handbook for literally making people go crazy
14:02 🔗 JAA You seem to know the site pretty well. What can you tell me about the structure?
14:02 🔗 JAA Is it the stuff under "Opportunities", i.e. https://www.fbo.gov/index.php?s=opportunity&mode=list&tab=archives&tabmode=list , which is most crucial?
14:02 🔗 JAA (And the other tab, "Opportunities List")
14:03 🔗 JAA The search only has filters up to the past year, but you can send a larger value and it'll happily return more results it seems.
14:03 🔗 davie the only public discovery of the JWICS SOCOM registration link, and a few insights about war plans https://www.fbo.gov/spg/ODA/USSOCOM/SOAL-KB/H9222212RFIVW/listing.html
14:04 🔗 davie the site has an FTP directory with XML files containing data. The only reason I came here is because it's a massive pain to retrieve the attachments and solicitation revisions.
14:08 🔗 JAA Ew, the search parameters seem to go through cookies.
14:08 🔗 davie I was considering using a screen scraper, proxy, or something like offline explorer enterprise to caputre useful and hostable captures. Unfortunately, while I have a list of keywords to search for, there is the special access requirement. I don't have the active DUNS/FBO corporation anymore, but anyone who has a business can access those documents. Of note: proposals are often updated, redacted, or otherwise changed. These changes a
14:09 🔗 JAA davie: The webchat thingy cuts off messages. This one stopped with "These changes a".
14:09 🔗 davie The website is disgustingly difficult to archive in any meaningful way, but trust me there is information in here, and outbound links, that is literally only here.
14:09 🔗 davie Oh I'm sorry
14:11 🔗 davie These changes appear in a jscript window or index as posted on the left side of the page, but the problem is the links are dynamic, the permalinks always go to the final status page of a solicitation etc
14:11 🔗 davie Fortunately the document attachments are available as ZIP files for each series of documents per sol.\
14:14 🔗 JAA Can you give some examples of things that require a special account etc.?
14:14 🔗 davie Yes I am attempting to make a list of pages that require the auth access. My computer is very old, sorry.
14:15 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
14:15 🔗 Mateon1 has joined #archiveteam-bs
14:15 🔗 JAA Don't worry. I need to leave for a bit anyway.
14:19 🔗 davie in the meantime this is the new portal for acquisition https://beta.sam.gov/
15:09 🔗 Mateon1 has quit IRC (Quit: Mateon1)
15:09 🔗 Mateon1 has joined #archiveteam-bs
15:09 🔗 Mateon1 has quit IRC (Client Quit)
15:09 🔗 Mateon1 has joined #archiveteam-bs
15:14 🔗 davie takes two minutes to load per page, sorry here is the sam reg for MPIN that you need. there are three types of docs needing mpin: unclass restricted, sensistive, and restricted https://www.fsd.gov/fsd-gov/answer.do?sysparm_number=KB0013183
15:41 🔗 Smiley has quit IRC (Read error: Operation timed out)
15:57 🔗 Smiley has joined #archiveteam-bs
15:59 🔗 kiskabak has quit IRC (Remote host closed the connection)
15:59 🔗 kiskabak has joined #archiveteam-bs
15:59 🔗 Fusl sets mode: +o kiskabak
15:59 🔗 Fusl__ sets mode: +o kiskabak
15:59 🔗 Fusl_ sets mode: +o kiskabak
16:02 🔗 kiska1 has quit IRC (Remote host closed the connection)
16:02 🔗 Ryz has quit IRC (Remote host closed the connection)
16:02 🔗 Ryz has joined #archiveteam-bs
16:02 🔗 Fusl sets mode: +o Ryz
16:02 🔗 Fusl_ sets mode: +o Ryz
16:02 🔗 Fusl__ sets mode: +o Ryz
16:02 🔗 kiska1 has joined #archiveteam-bs
16:02 🔗 Fusl__ sets mode: +o kiska1
16:02 🔗 Fusl sets mode: +o kiska1
16:02 🔗 Fusl_ sets mode: +o kiska1
16:04 🔗 kiskabak has quit IRC (Remote host closed the connection)
16:04 🔗 kiskabak has joined #archiveteam-bs
16:04 🔗 Fusl__ sets mode: +o kiskabak
16:04 🔗 Fusl sets mode: +o kiskabak
16:04 🔗 Fusl_ sets mode: +o kiskabak
16:55 🔗 davie has quit IRC (Ping timeout: 260 seconds)
17:10 🔗 icedice has joined #archiveteam-bs
17:15 🔗 ShellyRol has quit IRC (Read error: Operation timed out)
17:15 🔗 ShellyRol has joined #archiveteam-bs
17:17 🔗 justas1 has quit IRC (Read error: Connection reset by peer)
17:17 🔗 justas1 has joined #archiveteam-bs
17:27 🔗 icedice2 has joined #archiveteam-bs
17:29 🔗 icedice2 has quit IRC (Client Quit)
17:31 🔗 icedice2 has joined #archiveteam-bs
17:33 🔗 icedice has quit IRC (Read error: Operation timed out)
17:51 🔗 unlobito has quit IRC (Quit: Quit.)
17:57 🔗 unlobito has joined #archiveteam-bs
18:00 🔗 Laverne has joined #archiveteam-bs
18:09 🔗 icedice2 has quit IRC (Read error: Connection reset by peer)
18:09 🔗 icedice2 has joined #archiveteam-bs
18:12 🔗 icedice2 has quit IRC (Read error: Connection reset by peer)
18:13 🔗 icedice2 has joined #archiveteam-bs
18:15 🔗 icedice has joined #archiveteam-bs
18:24 🔗 icedice2 has quit IRC (Ping timeout: 612 seconds)
18:37 🔗 icedice2 has joined #archiveteam-bs
18:40 🔗 icedice has quit IRC (Ping timeout: 246 seconds)
18:43 🔗 icedice2 has quit IRC (Quit: Leaving)
18:43 🔗 icedice has joined #archiveteam-bs
18:56 🔗 icedice has quit IRC (Read error: Connection reset by peer)
18:56 🔗 icedice has joined #archiveteam-bs
19:11 🔗 icedice has quit IRC (Read error: Connection reset by peer)
19:11 🔗 icedice has joined #archiveteam-bs
19:37 🔗 icedice2 has joined #archiveteam-bs
19:40 🔗 icedice has quit IRC (Ping timeout: 252 seconds)
19:49 🔗 icedice2 has quit IRC (Leaving)
20:05 🔗 ShellyRol has quit IRC (Ping timeout: 252 seconds)
20:08 🔗 ShellyRol has joined #archiveteam-bs
21:10 🔗 DogsRNice has quit IRC (Read error: Connection reset by peer)
21:35 🔗 godane SketchCow: some geekbrieftv episodes i missed are being upload now
21:50 🔗 godane i'm now uploading The Open Mind for 2013 to 2016
21:51 🔗 godane i have 40gb of it that you guys don't have so i figure i should upload it
22:00 🔗 benjins has quit IRC (Read error: Connection reset by peer)
22:03 🔗 benjins has joined #archiveteam-bs
22:06 🔗 SilSte has quit IRC (Read error: Operation timed out)
22:08 🔗 SilSte has joined #archiveteam-bs
22:16 🔗 Sanqui has quit IRC (Remote host closed the connection)
22:16 🔗 Sanqui has joined #archiveteam-bs
22:37 🔗 Leslie has joined #archiveteam-bs
23:59 🔗 Ryz has quit IRC (west.us.hub irc.Prison.NET)
23:59 🔗 achip has quit IRC (west.us.hub irc.Prison.NET)
23:59 🔗 Somebody2 has quit IRC (west.us.hub irc.Prison.NET)

irclogger-viewer