Time |
Nickname |
Message |
00:14
🔗
|
|
dan- has quit IRC (Ping timeout: 260 seconds) |
00:32
🔗
|
|
dan- has joined #archiveteam-bs |
00:35
🔗
|
godane |
no its TGIF block that aired on ABC in USA |
00:35
🔗
|
godane |
its not that |
00:59
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
01:05
🔗
|
|
schbirid has joined #archiveteam-bs |
01:06
🔗
|
|
schbirid2 has quit IRC (Ping timeout: 250 seconds) |
01:17
🔗
|
odemg |
godane, know where i can get that? seems the internet doesn't have it.. |
01:21
🔗
|
godane |
i have no idea cause i never heard of it before |
01:34
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
01:59
🔗
|
|
schbirid2 has joined #archiveteam-bs |
02:04
🔗
|
|
schbirid has quit IRC (Read error: Operation timed out) |
02:29
🔗
|
dashcloud |
odemg: as far as I remember, TGIF was a programming block with a couple of shows- I think the name was mostly a marketing tool |
02:30
🔗
|
dashcloud |
the shows just happened to be on Friday |
02:46
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
02:49
🔗
|
Lord_Nigh |
any info about betaarchive-mirroring? |
03:02
🔗
|
|
odemg has joined #archiveteam-bs |
03:04
🔗
|
jrwr |
so, Im doing something crazy |
03:04
🔗
|
jrwr |
its a VM King of the Hill |
03:04
🔗
|
jrwr |
keep your QR on screen while it runs any program uploaded to it |
03:05
🔗
|
jrwr |
longer its up there the more points you get |
03:21
🔗
|
|
ReimuHaku has quit IRC (Read error: Operation timed out) |
03:22
🔗
|
|
qw3rty2 has joined #archiveteam-bs |
03:27
🔗
|
|
qw3rty has quit IRC (Read error: Operation timed out) |
04:13
🔗
|
|
jspiros_ is now known as jspiros |
04:25
🔗
|
|
pizzaiolo has quit IRC (Remote host closed the connection) |
04:50
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
04:55
🔗
|
|
Sk1d has joined #archiveteam-bs |
05:13
🔗
|
|
ZexaronS has quit IRC (Quit: Leaving) |
05:26
🔗
|
|
Stiletti has joined #archiveteam-bs |
05:47
🔗
|
|
ReimuHaku has joined #archiveteam-bs |
06:17
🔗
|
|
kimmer22 has joined #archiveteam-bs |
06:25
🔗
|
|
kimmer2 has quit IRC (Read error: Operation timed out) |
06:33
🔗
|
|
kimmer2 has joined #archiveteam-bs |
06:39
🔗
|
|
kimmer22 has quit IRC (Ping timeout: 633 seconds) |
06:41
🔗
|
|
Honno has joined #archiveteam-bs |
07:27
🔗
|
|
kristian_ has joined #archiveteam-bs |
07:41
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
08:10
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
08:31
🔗
|
|
haxalicio has joined #archiveteam-bs |
08:40
🔗
|
|
quantum has joined #archiveteam-bs |
08:41
🔗
|
|
quantum has quit IRC (Client Quit) |
09:03
🔗
|
|
j08nY has joined #archiveteam-bs |
09:31
🔗
|
|
Honno has quit IRC (Read error: Operation timed out) |
09:57
🔗
|
|
haxalicio has quit IRC (Quit: Leaving) |
11:10
🔗
|
|
j08nY has quit IRC (Quit: Leaving) |
11:40
🔗
|
|
Stiletto has joined #archiveteam-bs |
11:41
🔗
|
|
Stiletti has quit IRC (Read error: Operation timed out) |
11:44
🔗
|
|
kristian_ has joined #archiveteam-bs |
11:59
🔗
|
|
ZexaronS has joined #archiveteam-bs |
12:13
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
12:17
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
12:22
🔗
|
|
pizzaiolo has quit IRC (Read error: Operation timed out) |
12:27
🔗
|
|
Nazca has quit IRC () |
12:57
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
13:54
🔗
|
|
kristian_ has joined #archiveteam-bs |
14:51
🔗
|
|
icedice has joined #archiveteam-bs |
15:00
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
15:04
🔗
|
|
dashcloud has joined #archiveteam-bs |
15:35
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
16:16
🔗
|
|
will has quit IRC (Goodbye) |
16:19
🔗
|
|
will has joined #archiveteam-bs |
17:37
🔗
|
|
kimmer3 has joined #archiveteam-bs |
17:38
🔗
|
|
mhazinsk has quit IRC (Read error: Operation timed out) |
17:38
🔗
|
|
svchfoo3 has quit IRC (Read error: Operation timed out) |
17:38
🔗
|
|
Mayonaise has quit IRC (Read error: Operation timed out) |
17:39
🔗
|
|
squires has quit IRC (Read error: Operation timed out) |
17:39
🔗
|
|
ruunyan has quit IRC (Read error: Operation timed out) |
17:39
🔗
|
|
Zebranky has quit IRC (Read error: Operation timed out) |
17:39
🔗
|
|
Zebranky has joined #archiveteam-bs |
17:39
🔗
|
|
robogoat_ has quit IRC (Read error: Operation timed out) |
17:39
🔗
|
|
robogoat has joined #archiveteam-bs |
17:40
🔗
|
|
arkiver has quit IRC (Read error: Operation timed out) |
17:40
🔗
|
|
ivan has quit IRC (Read error: Operation timed out) |
17:40
🔗
|
|
marvinw has joined #archiveteam-bs |
17:40
🔗
|
|
REiN^ has quit IRC (Read error: Operation timed out) |
17:40
🔗
|
|
ndiddy has quit IRC (Read error: Operation timed out) |
17:40
🔗
|
|
JAA has quit IRC (Read error: Operation timed out) |
17:41
🔗
|
|
htw has quit IRC (Read error: Operation timed out) |
17:41
🔗
|
|
ndiddy has joined #archiveteam-bs |
17:41
🔗
|
|
c4rc4s_ has joined #archiveteam-bs |
17:41
🔗
|
|
c4rc4s has quit IRC (Read error: Operation timed out) |
17:41
🔗
|
|
Mayonaise has joined #archiveteam-bs |
17:41
🔗
|
|
sep332 has quit IRC (Write error: Broken pipe) |
17:41
🔗
|
|
qw3rty has joined #archiveteam-bs |
17:41
🔗
|
|
JAA has joined #archiveteam-bs |
17:41
🔗
|
|
swebb sets mode: +o JAA |
17:41
🔗
|
|
svchfoo3 has joined #archiveteam-bs |
17:42
🔗
|
|
svchfoo1 sets mode: +o svchfoo3 |
17:42
🔗
|
|
squires has joined #archiveteam-bs |
17:42
🔗
|
|
htw has joined #archiveteam-bs |
17:43
🔗
|
|
mhazinsk has joined #archiveteam-bs |
17:43
🔗
|
|
kimmer1 has quit IRC (Read error: Operation timed out) |
17:43
🔗
|
|
kimmer3 is now known as kimmer1 |
17:44
🔗
|
|
REiN^ has joined #archiveteam-bs |
17:44
🔗
|
|
arkiver has joined #archiveteam-bs |
17:44
🔗
|
|
svchfoo1 sets mode: +o arkiver |
17:45
🔗
|
|
qw3rty2 has quit IRC (Read error: Operation timed out) |
18:16
🔗
|
|
signius has joined #archiveteam-bs |
18:26
🔗
|
|
kristian_ has joined #archiveteam-bs |
18:42
🔗
|
|
bitBaron has joined #archiveteam-bs |
18:48
🔗
|
|
username1 has joined #archiveteam-bs |
18:50
🔗
|
|
username1 has quit IRC (Read error: Operation timed out) |
18:50
🔗
|
|
username1 has joined #archiveteam-bs |
18:50
🔗
|
|
schbirid2 has quit IRC (Read error: Operation timed out) |
18:51
🔗
|
|
bitBaron has quit IRC (Read error: Operation timed out) |
18:59
🔗
|
|
schbirid2 has joined #archiveteam-bs |
18:59
🔗
|
|
schbirid2 has quit IRC (Read error: Connection reset by peer) |
19:02
🔗
|
|
username1 has quit IRC (Read error: Operation timed out) |
19:37
🔗
|
|
kristian_ has quit IRC (Remote host closed the connection) |
19:51
🔗
|
|
bitBaron has joined #archiveteam-bs |
20:00
🔗
|
|
JSharp___ is now known as JSharp |
20:02
🔗
|
|
bitBaron has quit IRC (Ping timeout: 506 seconds) |
20:07
🔗
|
|
schbirid has joined #archiveteam-bs |
20:32
🔗
|
|
ask2much has quit IRC (Leaving) |
20:57
🔗
|
|
bitBaron has joined #archiveteam-bs |
21:01
🔗
|
|
Honno has joined #archiveteam-bs |
21:03
🔗
|
|
bitBaron has quit IRC (Read error: Operation timed out) |
21:31
🔗
|
|
kimmer2 has quit IRC (Remote host closed the connection) |
22:03
🔗
|
|
bitBaron has joined #archiveteam-bs |
22:08
🔗
|
|
bitBaron has quit IRC (Read error: Operation timed out) |
22:15
🔗
|
|
Yoshimura has joined #archiveteam-bs |
22:31
🔗
|
JAA |
We need a project for the Roblox forums ASAP. (For those outside the loop, they're restructuring their forums on the 27th and will destroy tons of posts in the process.) I've finally figured out exactly how to retrieve everything without having to deal with scripted POST requests through hidden HTML forms. The result wouldn't be easily browsable, but at least the data wouldn't be lost. |
22:31
🔗
|
JAA |
arkiver: Will you be around tomorrow to set this up? |
22:32
🔗
|
arkiver |
sure |
22:32
🔗
|
arkiver |
Do you have example URLs? |
22:33
🔗
|
JAA |
arkiver: https://forum.roblox.com/Forum/ShowPost.aspx?PostID=221051085 loads the first page of the thread, appending &PageIndex=2 gets the second page, etc. |
22:34
🔗
|
JAA |
Using *any* post ID from the thread loads the first page, by the way. |
22:34
🔗
|
arkiver |
ah yeah, full of POSTs, pretty bad |
22:34
🔗
|
JAA |
This forum system is really fucking annoying. |
22:34
🔗
|
arkiver |
yeah |
22:34
🔗
|
arkiver |
nice find |
22:34
🔗
|
arkiver |
let's get this running tomorrow |
22:34
🔗
|
JAA |
I'm grabbing the forum indices right now. |
22:34
🔗
|
arkiver |
ok |
22:35
🔗
|
JAA |
Writing out the post IDs of the threads and the number of pages in each thread. |
22:35
🔗
|
arkiver |
ok, but we can also just get the number of pages with the warrior project |
22:36
🔗
|
JAA |
We could, but I'm already processing the indices anyway to get the "thread IDs", so I can extract that information at the same time. |
22:37
🔗
|
arkiver |
right |
22:38
🔗
|
arkiver |
I'm thinking of just doing a sequential crawl over all IDs |
22:38
🔗
|
JAA |
This will be a list of 'PostID MaxPageIndex'. If MaxPageIndex is zero, that means that we only need to retrieve ?PostID=x. If it's two or larger, we need ?PostID=x and ?PostID=x&PageIndex=y with y from 2 to MaxPageIndex. (MaxPageIndex can't be one.) |
22:38
🔗
|
arkiver |
any reason to not just go through all IDs? |
22:38
🔗
|
JAA |
I think that'd take *way* too long. |
22:38
🔗
|
JAA |
It would also produce a ton of duplicate data. |
22:38
🔗
|
arkiver |
ah |
22:39
🔗
|
JAA |
As I said, using any ID of a post in a certain thread will return that thread's first page. |
22:39
🔗
|
JAA |
Not even the page that post is on... |
22:39
🔗
|
JAA |
I want to murder the person who designed this thing so badly. |
22:40
🔗
|
JAA |
By the way, there are page IDs and page indices. The former are zero-based, the latter are one-based... |
22:44
🔗
|
arkiver |
ok |
22:52
🔗
|
JAA |
The good news is that I haven't seen any rate limiting so far. |
23:08
🔗
|
|
bitBaron has joined #archiveteam-bs |
23:16
🔗
|
|
bitBaron has quit IRC (Ping timeout: 506 seconds) |
23:23
🔗
|
|
ruunyan has joined #archiveteam-bs |
23:36
🔗
|
|
kanzure has quit IRC (Read error: Operation timed out) |
23:36
🔗
|
JAA |
Hmm, my index grab isn't going fast enough. :-/ |