salvacybersec/keyhunter
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(09-04): complete robots.txt cache plan

Browse Source 
Adds SUMMARY, marks RECON-INFRA-07 complete, updates phase 9 roadmap.
This commit is contained in:
salvacybersec
2026-04-06 00:43:49 +03:00
parent 851b2432b8
commit 4dbc38dcc5
4 changed files with 122 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
.planning/ROADMAP.md
View File

@@ -199,9 +199,9 @@ Plans:
4. `keyhunter recon full` fans out to all enabled sources in parallel and deduplicates findings before persisting to the database
**Plans**: 6 plans
- [ ] 09-01-PLAN.md — ReconSource interface + Engine skeleton + ExampleSource stub
- [ ] 09-02-PLAN.md — LimiterRegistry per-source rate.Limiter + jitter
- [x] 09-02-PLAN.md — LimiterRegistry per-source rate.Limiter + jitter
- [ ] 09-03-PLAN.md — Stealth UA pool + cross-source dedup
- [ ] 09-04-PLAN.md — robots.txt parser with 1h per-host cache
- [x] 09-04-PLAN.md — robots.txt parser with 1h per-host cache
- [ ] 09-05-PLAN.md — cmd/recon.go CLI tree (full, list)
- [ ] 09-06-PLAN.md — Integration test + phase summary
@@ -325,7 +325,7 @@ Phases execute in numeric order: 1 → 2 → 3 → ... → 18
| 6. Output, Reporting & Key Management | 0/? | Not started | - |
| 7. Import Adapters & CI/CD Integration | 0/? | Not started | - |
| 8. Dork Engine | 0/? | Not started | - |
| 9. OSINT Infrastructure | 0/? | Not started | - |
| 9. OSINT Infrastructure | 2/6 | In Progress| |
| 10. OSINT Code Hosting | 0/? | Not started | - |
| 11. OSINT Search & Paste | 0/? | Not started | - |
| 12. OSINT IoT & Cloud Storage | 0/? | Not started | - |