clawbot f7b5acf210 Targets whose home page redirects are checked at /robots.txt (closes #194) ...

The browser follows a redirect, so the figures for the AWS Console, Akamai,
B2 and the S3 regions also timed the page it led to, for B2 and S3 on
another host. The Google Cloud Console redirects only requests that do not
say they come from another site; browsers say so and get a 403 directly.
Each of these targets is now checked at /robots.txt on its own host, which
answers without a redirect. README.md says what a figure includes. Chrome
opens a new connection for most S3 checks, so far regions now read higher.

Model: opus-5-5

2026-10-26 01:42:36 +00:00

..

main.test.js

Targets whose home page redirects are checked at /robots.txt (closes #194)

2026-10-26 01:42:36 +00:00