salvacybersec c5332454b0 feat(14-02): add WaybackMachine + CommonCrawl recon sources ...

- WaybackMachineSource queries CDX API for historical snapshots
- CommonCrawlSource queries CC Index API for matching pages
- Both credentialless, rate-limited at 1 req/5s, RespectsRobots=true
- RegisterAll extended to 42 sources (40 Phase 10-13 + 2 Phase 14)
- Full httptest-based test coverage for both sources

2026-04-06 13:16:13 +03:00

..

sources

feat(14-02): add WaybackMachine + CommonCrawl recon sources

2026-04-06 13:16:13 +03:00

dedup_test.go

test(09-03): add failing test for cross-source Dedup

2026-04-06 00:42:45 +03:00

dedup.go

feat(09-03): implement stable cross-source finding Dedup

2026-04-06 00:43:07 +03:00

engine_test.go

feat(09-01): add Engine with parallel fanout and ExampleSource

2026-04-06 00:42:51 +03:00

engine.go

fix(phase-10): add --sources filter flag and DB persistence to recon full

2026-04-06 11:36:19 +03:00

example.go

feat(09-01): add Engine with parallel fanout and ExampleSource

2026-04-06 00:42:51 +03:00

integration_test.go

test(09-06): add recon pipeline integration test

2026-04-06 00:51:08 +03:00

limiter_test.go

feat(09-02): add LimiterRegistry with per-source rate limiters and jitter

2026-04-06 00:41:33 +03:00

limiter.go

feat(09-02): add LimiterRegistry with per-source rate limiters and jitter

2026-04-06 00:41:33 +03:00

robots_test.go

test(09-04): add failing tests for RobotsCache

2026-04-06 00:42:03 +03:00

robots.go

feat(09-04): implement RobotsCache with 1h per-host TTL

2026-04-06 00:42:33 +03:00

source.go

feat(09-01): add ReconSource interface and Config

2026-04-06 00:40:46 +03:00

stealth_test.go

test(09-03): add failing test for stealth UA pool

2026-04-06 00:41:55 +03:00

stealth.go

feat(09-03): implement stealth UA pool and StealthHeaders

2026-04-06 00:42:22 +03:00