| Time |
Nickname |
Message |
|
00:13
🔗
|
|
ShellyRol has quit IRC (Ping timeout: 496 seconds) |
|
00:14
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
00:14
🔗
|
|
ephemer0l has quit IRC (Ping timeout: 745 seconds) |
|
00:18
🔗
|
|
ephemer0l has joined #archiveteam-bs |
|
00:27
🔗
|
JAA |
Last update before I go to bed: 286k discussions done, 11.0 GiB WARCs, 74 channels still in progress. |
|
00:42
🔗
|
|
Quirk8 has quit IRC (Read error: Operation timed out) |
|
00:55
🔗
|
|
Quirk8 has joined #archiveteam-bs |
|
00:57
🔗
|
|
RichardG has joined #archiveteam-bs |
|
00:57
🔗
|
|
RichardG_ has quit IRC (Read error: Connection reset by peer) |
|
01:00
🔗
|
|
Quirk8 has quit IRC (Read error: Operation timed out) |
|
01:02
🔗
|
|
Quirk8 has joined #archiveteam-bs |
|
01:19
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
02:13
🔗
|
|
dxrt_2 is now known as dxrt_ |
|
03:26
🔗
|
|
qw3rty118 has joined #archiveteam-bs |
|
03:33
🔗
|
|
qw3rty117 has quit IRC (Ping timeout: 612 seconds) |
|
03:56
🔗
|
|
odemgi has joined #archiveteam-bs |
|
04:01
🔗
|
|
odemgi_ has quit IRC (Read error: Operation timed out) |
|
04:51
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
05:03
🔗
|
|
larryv has quit IRC (larryv) |
|
05:52
🔗
|
|
wyatt8740 has quit IRC (Read error: Operation timed out) |
|
05:57
🔗
|
|
wyatt8740 has joined #archiveteam-bs |
|
06:36
🔗
|
|
wyatt8740 has quit IRC (Read error: Operation timed out) |
|
06:39
🔗
|
|
wyatt8740 has joined #archiveteam-bs |
|
06:54
🔗
|
Ryz |
Mm, we are approaching either that Disqus Channels is closing on 12AM PST, or at the end of September 01 |
|
07:35
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
08:06
🔗
|
godane |
so i'm looking at getting this computer : https://www.newegg.com/diypc-diy-f2-w-gaming-entertainment/p/1VK-01T2-00010 |
|
08:07
🔗
|
godane |
or at least review for it |
|
08:07
🔗
|
godane |
based i got is reviews on the case |
|
08:18
🔗
|
godane |
ok turns out to be a custom reseller: http://www.pricerightcomputers.com/ |
|
09:31
🔗
|
JAA |
So my Disqus Channels crawl finished at 05:35. It grabbed about 625k discussions. I had noticed already in tests that the number of discussions somehow didn't match up with the counts given on https://disqus.com/home/explore/channels/ so that might not mean anything, but I'm not sure. |
|
09:31
🔗
|
JAA |
I don't see any signs of me getting banned, their servers breaking, or similar though. |
|
09:33
🔗
|
JAA |
As a small random example for that count mismatch, https://disqus.com/home/channel/disqusoutlet/recent/ is listed as having 22 discussions on the index but only shows 12. |
|
10:15
🔗
|
|
BlueMax has quit IRC (Ping timeout: 745 seconds) |
|
10:23
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
10:29
🔗
|
|
achip has quit IRC (west.us.hub irc.Prison.NET) |
|
10:29
🔗
|
|
Ryz has quit IRC (west.us.hub irc.Prison.NET) |
|
10:29
🔗
|
|
Somebody2 has quit IRC (west.us.hub irc.Prison.NET) |
|
10:29
🔗
|
Jens |
https://bpaste.net/show/sVcT <- Why does CheckIP fail? |
|
10:30
🔗
|
Jens |
DNS resolution is functional. |
|
10:34
🔗
|
Kaz |
doesn't look like it |
|
10:35
🔗
|
Kaz |
that tries to resolve the following: twitter.com, facebook.com, youtube.com, microsoft.com, icanhas.cheezburger.com, archiveteam.org |
|
10:35
🔗
|
Kaz |
I'd double check to make sure you can actually resolve all of those |
|
10:35
🔗
|
Jens |
https://bpaste.net/show/3ViD |
|
10:36
🔗
|
Kaz |
need all 6 |
|
10:37
🔗
|
Jens |
All work. Also, this machine is DNS server for the LAN. I'd have several people angry with me if resolver was broken. |
|
10:38
🔗
|
Kaz |
I've just spun up a pipeline and everything worked perfectly, so there's got to be something your end |
|
10:38
🔗
|
Kaz |
that or I've got a cached record for something that doesn't exist any more /shrug |
|
10:39
🔗
|
Jens |
Got another pipeline running on a VPS that also works, so no doubt something is broken. Just trying to figure out what exactly. |
|
10:46
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
10:48
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
10:53
🔗
|
|
Ryz has joined #archiveteam-bs |
|
10:53
🔗
|
|
Somebody2 has joined #archiveteam-bs |
|
10:53
🔗
|
|
irc.Prison.NET sets mode: +o Somebody2 |
|
10:53
🔗
|
|
Fusl__ sets mode: +o Ryz |
|
10:53
🔗
|
|
Fusl sets mode: +o Ryz |
|
10:53
🔗
|
|
Fusl_ sets mode: +o Ryz |
|
10:53
🔗
|
Jens |
Seeding the cache before invoking the pipeline made it go. Maybe the timeout in gethostbyname is too short. |
|
10:54
🔗
|
Jens |
Whatever. It runs now. |
|
10:54
🔗
|
|
achip has joined #archiveteam-bs |
|
10:55
🔗
|
Jens |
As much as tinypic "goes" anywhere. God that's slow. |
|
10:56
🔗
|
|
sirvy has quit IRC (Quit: WeeChat 2.3) |
|
10:58
🔗
|
|
sirvy has joined #archiveteam-bs |
|
10:59
🔗
|
odemgi |
https://old.reddit.com/r/opendirectories/comments/cy8jry/exodos_v40_release_theeye/ |
|
11:01
🔗
|
ivan_ |
cool |
|
11:24
🔗
|
godane |
i'm uploading Ancient Prophecies IV - The Final Visions |
|
11:24
🔗
|
godane |
a old avi file i have on one of my hard drives |
|
11:30
🔗
|
|
kiskabak has quit IRC (Remote host closed the connection) |
|
11:30
🔗
|
|
kiskabak has joined #archiveteam-bs |
|
11:30
🔗
|
|
Fusl_ sets mode: +o kiskabak |
|
11:30
🔗
|
|
Fusl sets mode: +o kiskabak |
|
11:30
🔗
|
|
Fusl__ sets mode: +o kiskabak |
|
11:33
🔗
|
|
kiska1 has quit IRC (Remote host closed the connection) |
|
11:33
🔗
|
|
Ryz has quit IRC (Remote host closed the connection) |
|
11:33
🔗
|
|
Ryz has joined #archiveteam-bs |
|
11:33
🔗
|
|
Fusl sets mode: +o Ryz |
|
11:33
🔗
|
|
Fusl__ sets mode: +o Ryz |
|
11:33
🔗
|
|
Fusl_ sets mode: +o Ryz |
|
11:33
🔗
|
|
kiska1 has joined #archiveteam-bs |
|
11:33
🔗
|
|
Fusl__ sets mode: +o kiska1 |
|
11:33
🔗
|
|
Fusl sets mode: +o kiska1 |
|
11:33
🔗
|
|
Fusl_ sets mode: +o kiska1 |
|
11:41
🔗
|
|
Quirk8 has quit IRC (Ping timeout: 246 seconds) |
|
11:42
🔗
|
godane |
https://archive.org/details/Ancient_Prophecies_IV_-_The_Final_Visions |
|
11:49
🔗
|
|
zino_ has quit IRC (Read error: Operation timed out) |
|
12:00
🔗
|
|
zino_ has joined #archiveteam-bs |
|
12:11
🔗
|
|
Quirk8 has joined #archiveteam-bs |
|
12:32
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
12:32
🔗
|
|
trc has quit IRC (Read error: Connection reset by peer) |
|
12:39
🔗
|
|
trc has joined #archiveteam-bs |
|
12:53
🔗
|
|
DogsRNice has joined #archiveteam-bs |
|
13:57
🔗
|
|
lameboy has joined #archiveteam-bs |
|
13:59
🔗
|
|
davie has joined #archiveteam-bs |
|
14:01
🔗
|
JAA |
(Continuing on fbo.gov from #archiveteam) |
|
14:01
🔗
|
JAA |
Seems like quite a pain to archive. |
|
14:01
🔗
|
davie |
I don't want to waste your time, does anyone actually want to see what is there? |
|
14:01
🔗
|
davie |
https://www.fbo.gov/spg/ODA/USSOCOM/FortBraggNC/H92239-19-Q-0023/listing.html |
|
14:01
🔗
|
davie |
PSYOPS handbook for literally making people go crazy |
|
14:02
🔗
|
JAA |
You seem to know the site pretty well. What can you tell me about the structure? |
|
14:02
🔗
|
JAA |
Is it the stuff under "Opportunities", i.e. https://www.fbo.gov/index.php?s=opportunity&mode=list&tab=archives&tabmode=list , which is most crucial? |
|
14:02
🔗
|
JAA |
(And the other tab, "Opportunities List") |
|
14:03
🔗
|
JAA |
The search only has filters up to the past year, but you can send a larger value and it'll happily return more results it seems. |
|
14:03
🔗
|
davie |
the only public discovery of the JWICS SOCOM registration link, and a few insights about war plans https://www.fbo.gov/spg/ODA/USSOCOM/SOAL-KB/H9222212RFIVW/listing.html |
|
14:04
🔗
|
davie |
the site has an FTP directory with XML files containing data. The only reason I came here is because it's a massive pain to retrieve the attachments and solicitation revisions. |
|
14:08
🔗
|
JAA |
Ew, the search parameters seem to go through cookies. |
|
14:08
🔗
|
davie |
I was considering using a screen scraper, proxy, or something like offline explorer enterprise to caputre useful and hostable captures. Unfortunately, while I have a list of keywords to search for, there is the special access requirement. I don't have the active DUNS/FBO corporation anymore, but anyone who has a business can access those documents. Of note: proposals are often updated, redacted, or otherwise changed. These changes a |
|
14:09
🔗
|
JAA |
davie: The webchat thingy cuts off messages. This one stopped with "These changes a". |
|
14:09
🔗
|
davie |
The website is disgustingly difficult to archive in any meaningful way, but trust me there is information in here, and outbound links, that is literally only here. |
|
14:09
🔗
|
davie |
Oh I'm sorry |
|
14:11
🔗
|
davie |
These changes appear in a jscript window or index as posted on the left side of the page, but the problem is the links are dynamic, the permalinks always go to the final status page of a solicitation etc |
|
14:11
🔗
|
davie |
Fortunately the document attachments are available as ZIP files for each series of documents per sol.\ |
|
14:14
🔗
|
JAA |
Can you give some examples of things that require a special account etc.? |
|
14:14
🔗
|
davie |
Yes I am attempting to make a list of pages that require the auth access. My computer is very old, sorry. |
|
14:15
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
14:15
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
14:15
🔗
|
JAA |
Don't worry. I need to leave for a bit anyway. |
|
14:19
🔗
|
davie |
in the meantime this is the new portal for acquisition https://beta.sam.gov/ |
|
15:09
🔗
|
|
Mateon1 has quit IRC (Quit: Mateon1) |
|
15:09
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
15:09
🔗
|
|
Mateon1 has quit IRC (Client Quit) |
|
15:09
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
15:14
🔗
|
davie |
takes two minutes to load per page, sorry here is the sam reg for MPIN that you need. there are three types of docs needing mpin: unclass restricted, sensistive, and restricted https://www.fsd.gov/fsd-gov/answer.do?sysparm_number=KB0013183 |
|
15:41
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
15:57
🔗
|
|
Smiley has joined #archiveteam-bs |
|
15:59
🔗
|
|
kiskabak has quit IRC (Remote host closed the connection) |
|
15:59
🔗
|
|
kiskabak has joined #archiveteam-bs |
|
15:59
🔗
|
|
Fusl sets mode: +o kiskabak |
|
15:59
🔗
|
|
Fusl__ sets mode: +o kiskabak |
|
15:59
🔗
|
|
Fusl_ sets mode: +o kiskabak |
|
16:02
🔗
|
|
kiska1 has quit IRC (Remote host closed the connection) |
|
16:02
🔗
|
|
Ryz has quit IRC (Remote host closed the connection) |
|
16:02
🔗
|
|
Ryz has joined #archiveteam-bs |
|
16:02
🔗
|
|
Fusl sets mode: +o Ryz |
|
16:02
🔗
|
|
Fusl_ sets mode: +o Ryz |
|
16:02
🔗
|
|
Fusl__ sets mode: +o Ryz |
|
16:02
🔗
|
|
kiska1 has joined #archiveteam-bs |
|
16:02
🔗
|
|
Fusl__ sets mode: +o kiska1 |
|
16:02
🔗
|
|
Fusl sets mode: +o kiska1 |
|
16:02
🔗
|
|
Fusl_ sets mode: +o kiska1 |
|
16:04
🔗
|
|
kiskabak has quit IRC (Remote host closed the connection) |
|
16:04
🔗
|
|
kiskabak has joined #archiveteam-bs |
|
16:04
🔗
|
|
Fusl__ sets mode: +o kiskabak |
|
16:04
🔗
|
|
Fusl sets mode: +o kiskabak |
|
16:04
🔗
|
|
Fusl_ sets mode: +o kiskabak |
|
16:55
🔗
|
|
davie has quit IRC (Ping timeout: 260 seconds) |
|
17:10
🔗
|
|
icedice has joined #archiveteam-bs |
|
17:15
🔗
|
|
ShellyRol has quit IRC (Read error: Operation timed out) |
|
17:15
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
17:17
🔗
|
|
justas1 has quit IRC (Read error: Connection reset by peer) |
|
17:17
🔗
|
|
justas1 has joined #archiveteam-bs |
|
17:27
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
17:29
🔗
|
|
icedice2 has quit IRC (Client Quit) |
|
17:31
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
17:33
🔗
|
|
icedice has quit IRC (Read error: Operation timed out) |
|
17:51
🔗
|
|
unlobito has quit IRC (Quit: Quit.) |
|
17:57
🔗
|
|
unlobito has joined #archiveteam-bs |
|
18:00
🔗
|
|
Laverne has joined #archiveteam-bs |
|
18:09
🔗
|
|
icedice2 has quit IRC (Read error: Connection reset by peer) |
|
18:09
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
18:12
🔗
|
|
icedice2 has quit IRC (Read error: Connection reset by peer) |
|
18:13
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
18:15
🔗
|
|
icedice has joined #archiveteam-bs |
|
18:24
🔗
|
|
icedice2 has quit IRC (Ping timeout: 612 seconds) |
|
18:37
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
18:40
🔗
|
|
icedice has quit IRC (Ping timeout: 246 seconds) |
|
18:43
🔗
|
|
icedice2 has quit IRC (Quit: Leaving) |
|
18:43
🔗
|
|
icedice has joined #archiveteam-bs |
|
18:56
🔗
|
|
icedice has quit IRC (Read error: Connection reset by peer) |
|
18:56
🔗
|
|
icedice has joined #archiveteam-bs |
|
19:11
🔗
|
|
icedice has quit IRC (Read error: Connection reset by peer) |
|
19:11
🔗
|
|
icedice has joined #archiveteam-bs |
|
19:37
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
19:40
🔗
|
|
icedice has quit IRC (Ping timeout: 252 seconds) |
|
19:49
🔗
|
|
icedice2 has quit IRC (Leaving) |
|
20:05
🔗
|
|
ShellyRol has quit IRC (Ping timeout: 252 seconds) |
|
20:08
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
21:10
🔗
|
|
DogsRNice has quit IRC (Read error: Connection reset by peer) |
|
21:35
🔗
|
godane |
SketchCow: some geekbrieftv episodes i missed are being upload now |
|
21:50
🔗
|
godane |
i'm now uploading The Open Mind for 2013 to 2016 |
|
21:51
🔗
|
godane |
i have 40gb of it that you guys don't have so i figure i should upload it |
|
22:00
🔗
|
|
benjins has quit IRC (Read error: Connection reset by peer) |
|
22:03
🔗
|
|
benjins has joined #archiveteam-bs |
|
22:06
🔗
|
|
SilSte has quit IRC (Read error: Operation timed out) |
|
22:08
🔗
|
|
SilSte has joined #archiveteam-bs |
|
22:16
🔗
|
|
Sanqui has quit IRC (Remote host closed the connection) |
|
22:16
🔗
|
|
Sanqui has joined #archiveteam-bs |
|
22:37
🔗
|
|
Leslie has joined #archiveteam-bs |
|
23:59
🔗
|
|
Ryz has quit IRC (west.us.hub irc.Prison.NET) |
|
23:59
🔗
|
|
achip has quit IRC (west.us.hub irc.Prison.NET) |
|
23:59
🔗
|
|
Somebody2 has quit IRC (west.us.hub irc.Prison.NET) |