docs(phase-4): add validation strategy

2026-03-26 14:19:56 +01:00
parent 22b5ffe0f2
commit 5be2b48d1a
1 changed files with 79 additions and 0 deletions
@@ -0,0 +1,79 @@
+---
+phase: 4
+slug: power-user-features
+status: draft
+nyquist_compliant: false
+wave_0_complete: false
+created: 2026-03-26
+---
+
+# Phase 4 — Validation Strategy
+
+> Per-phase validation contract for feedback sampling during execution.
+
+---
+
+## Test Infrastructure
+
+| Property | Value |
+|----------|-------|
+| **Framework** | go test |
+| **Config file** | none — standard Go test toolchain |
+| **Quick run command** | `go test ./...` |
+| **Full suite command** | `go test -v -count=1 ./...` |
+| **Estimated runtime** | ~5 seconds |
+
+---
+
+## Sampling Rate
+
+- **After every task commit:** Run `go test ./...`
+- **After every plan wave:** Run `go test -v -count=1 ./...`
+- **Before `/gsd:verify-work`:** Full suite must be green
+- **Max feedback latency:** 5 seconds
+
+---
+
+## Per-Task Verification Map
+
+| Task ID | Plan | Wave | Requirement | Test Type | Automated Command | File Exists | Status |
+|---------|------|------|-------------|-----------|-------------------|-------------|--------|
+| 4-01-01 | 01 | 1 | CAPT-05 | unit | `go test ./capture/ -run TestBPFFilter` | ❌ W0 | ⬜ pending |
+| 4-01-02 | 01 | 1 | CAPT-05 | unit | `go test ./capture/ -run TestBPFValidation` | ❌ W0 | ⬜ pending |
+| 4-02-01 | 02 | 1 | CAPT-06 | unit | `go test ./capture/ -run TestPcapRead` | ❌ W0 | ⬜ pending |
+| 4-02-02 | 02 | 1 | CAPT-06 | unit | `go test ./aggregate/ -run TestTimestampWindow` | ❌ W0 | ⬜ pending |
+| 4-03-01 | 03 | 2 | CAPT-05,CAPT-06 | integration | `go test ./... -run TestCLIFlags` | ❌ W0 | ⬜ pending |
+
+*Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky*
+
+---
+
+## Wave 0 Requirements
+
+- [ ] `capture/capture_test.go` — stubs for BPF filter and pcap reading tests
+- [ ] `aggregate/window_test.go` — stubs for timestamp-based windowing tests
+- [ ] `cmd/netsynth/main_test.go` — stubs for CLI flag interaction tests
+
+*Existing go test infrastructure covers framework needs.*
+
+---
+
+## Manual-Only Verifications
+
+| Behavior | Requirement | Why Manual | Test Instructions |
+|----------|-------------|------------|-------------------|
+| Live BPF filter on real interface | CAPT-05 | Requires root + network traffic | Run `sudo netsynth -i eth0 --filter "port 53"`, generate DNS traffic, verify only DNS in output |
+| Pcap file produces audible MP3 | CAPT-06 | Audio quality is subjective | Run `netsynth --read test.pcap -o out.mp3`, play file, confirm distinct tones |
+
+---
+
+## Validation Sign-Off
+
+- [ ] All tasks have `<automated>` verify or Wave 0 dependencies
+- [ ] Sampling continuity: no 3 consecutive tasks without automated verify
+- [ ] Wave 0 covers all MISSING references
+- [ ] No watch-mode flags
+- [ ] Feedback latency < 5s
+- [ ] `nyquist_compliant: true` set in frontmatter
+
+**Approval:** pending