Career Navigator: 1,800+ Page React Launch & Bot Rendering Spec
Pre-launch technical SEO audit and 6-workstream engineering specification that eliminated site-wide noindex headers, 403 bot blocks, and SPA shell rendering across 1,800+ React career pages.
STAR Engineering Breakdown
01 · Situation & Problem
Tallo prepared to launch Career Navigator (1,800+ React career pages), but pre-launch bot crawls returned HTTP 403s, 1 KB empty SPA shells, site-wide noindex headers, and private/no-store cache headers.
02 · Technical Execution
Authored a 6-workstream engineering specification (~7–10 dev-days) covering SSR pre-rendering for search bots, slug-first canonical URLs, cache-control headers, and pagination to fix 77% orphan career pages.
03 · Verification & Telemetry
Built an automated Google Search Console URL Inspection API probe that replaced a broken internal "1% indexed" dashboard metric with ground-truth per-URL indexation telemetry.
04 · Verified Impact
Engineering merged all 6 workstreams within 2 weeks; Career Navigator reached 96% verified indexation within 8 weeks, and the same QA playbook powered a 35,000-URL job layer at 98% week-1 indexation.
def assert_bot_render_contract(url: str, resp: HttpResponse) -> None:
assert resp.status_code == 200, f"Bot blocked: {resp.status_code}"
assert "noindex" not in resp.headers.get("X-Robots-Tag", "")
assert "no-store" not in resp.headers.get("Cache-Control", "")
assert len(resp.body_bytes) >= 12_288 # Rejects 1KB SPA shell
assert f'<link rel="canonical" href="{url}"' in resp.textBenchmark Table
| METRIC | MANUAL BASELINE | PROGRAMMATIC ENGINE |
|---|---|---|
| Bot HTTP Response & Payload | 403 / ~1 KB SPA Shell | 200 OK / Full SSR HTML |
| Verified Page Indexation | 0% (Site-Wide noindex) | 96% Indexed in 8 Weeks |
| Orphan Career URLs (0 Inlinks) | 77% Unlinked Pages | 100% Hub & Pagination Linked |