Files
Nexus-Guard-Suite/.omo/evidence/final-qa/qa-report.txt
T
datadunia cbacfea7f2
NexusGuard CI / server-core-test (push) Failing after 3m6s
NexusGuard CI / server-core-build (push) Has been skipped
NexusGuard CI / device-agent-test (push) Failing after 4s
NexusGuard CI / device-agent-cross-build (amd64, linux) (push) Has been skipped
NexusGuard CI / device-agent-cross-build (amd64, windows) (push) Has been skipped
NexusGuard CI / device-agent-cross-build (arm64, linux) (push) Has been skipped
NexusGuard CI / dashboard-test (push) Failing after 4s
NexusGuard CI / dashboard-dist (push) Has been skipped
chore: update submodule refs, clean up plans/evidence, update .gitignore
2026-06-07 23:53:15 +07:00

125 lines
4.7 KiB
Plaintext

Device Agent Reliability — Final QA Report
==========================================
Date: 2026-06-02
Executor: Sisyphus-Junior (F3 Real Manual QA)
SCENARIOS [10/15 PASS | 5 BLOCKED]
=================================
T1: State Machine Core — PASS
- TestStateMachine_InitialState: PASS
- TestStateMachine_ValidTransitions (7 sub-tests): ALL PASS
- TestStateMachine_InvalidTransitions (9 sub-tests): ALL PASS
- TestStateMachine_String (5 sub-tests): ALL PASS
- TestStateMachine_OnStateChange: PASS
- TestStateMachine_ContextCancellation: PASS
- TestStateMachine_ConcurrentTransitions (100 goroutines): PASS
- TestStateMachine_OnStateChangeNotPanicWhenNil: PASS
T2: Tunnel Restart Fix — PASS
- TestUAPIConversion: PASS
- TestUAPIConversionWithPSK: PASS
- StopStealthTunnel() exists and is idempotent
- Graceful restart with 2s cleanup wait implemented
- Code review: restart logic in StartStealthTunnel correct
T3: Handshake Monitor Fix — PASS
- TestHeartbeatInterval: PASS
- TestReconnectBackoff: PASS
- TestHandshakeTimeout: PASS
T4: CLI Help Menu — BLOCKED
- Cannot build binary (main.go:174 missing ctx arg)
- Source review: printHelp() comprehensive (flags, env, examples, JSON fields)
T5: Health Check System — PASS
- DefaultHealthCheckerConfig() returns correct values
- NewHealthChecker: creation, failure tracking, ResetFailures, Failures snapshot
- runCheckLoop: threshold triggers StateRecovering, recovery callback fires
- Start/Stop lifecycle: context cancellation, WaitGroup cleanup
- BEHAVIORAL NOTE: onRecover only fires for sub-threshold recovery
T6: Failover Manager — PASS
- Priority-based server selection: correct
- Endpoint format: correct
- RecordFailure: endpoint exhaustion -> next server
- ResetFailure: clears counts and backoff
- Empty server list: all ops safe
- Concurrent access (100 goroutines): no race/panic
T7: Provisioning Timeout — PASS
- TestProvisionSuccess: encrypted config round-trip works
- TestInvalidToken: HTTP 404 handled
- TestRetryOnNetworkError: 3 retries with 5s backoff verified (10s+)
T8: Enhanced Logging — BLOCKED
- Cannot build binary
- Source review: JSONMessage struct, jsonLog(), 4 components, RFC3339
T9: Server Heartbeat API — PASS
- server-core builds cleanly
- heartbeat.go: accepts StatusReport (status, state, tunnel_up, last_handshake)
- Validation: device_id UUID parse, last_handshake RFC3339 format
T10: Server Status API — PASS
- status.go: GetDeviceStatus + ListStatuses
- Response format consistent across both endpoints
T11: Installation Documentation — PASS
- Linux: automated install, manual install, Docker
- Windows: nssm, PowerShell New-Service
- Android: AAR library, WireGuard app
- Troubleshooting: 7-row issue table, log locations, debug commands
T12: Configuration Documentation — PASS
- docs/configuration.md: env vars table, CLI flags table
- JSON format documented, version info, internal defaults
T13: Windows Support — BLOCKED (BUG)
- windows.go:31: svc.SpecificCode undefined
- svc.Handler.Execute requires (bool, uint32), not (svc.SpecificCode, error)
T14: Android Support — BLOCKED
- gomobile not installed on test machine
- Code review: AgentController, GetAndroidID fallback chain correct
T15: Cross-Compile Pipeline — BLOCKED (BUG)
- main.go:174 compilation error blocks all builds
- Makefile targets verified: 5 linux + 1 windows + 1 android + release
COMPILATION BUGS (2)
====================
BUG 1 — main.go:174 (Critical)
client.Provision(serverURL, regToken, hwid)
Expected: client.Provision(ctx, serverURL, regToken, hwid)
Impact: Blocks binary build, CLI, logging, all cross-compilation
BUG 2 — internal/platform/windows.go:31 (Critical)
Execute returns (svc.SpecificCode, error)
svc.Handler requires (svcSpecificEC bool, exitCode uint32)
Impact: Blocks Windows compilation
CROSS-TASK INTEGRATION [3/4]
============================
State Machine + Health Checks: PASS
State Machine + Failover: PASS
Health Checks + Failover: PASS
main.go Integration: FAIL (Task 7 broke main.go)
EDGE CASES [8/8 PASS | 1 NOTE]
==============================
Concurrent state machine (100 goroutines): PASS
Concurrent failover manager (100 goroutines): PASS
Context cancellation propagation: PASS
Invalid transitions silently ignored: PASS
Full lifecycle: Idle->Connected->Recovering->Connected->Stopped->Idle: PASS
Empty server list operations: PASS
Nil callback safety: PASS
Unknown state String(): PASS
onRecover post-threshold: NOTE (by design — recovery counter resets)
VERDICT: FAIL
=============
Scenarios [10/15 pass | 5 BLOCKED] | Integration [3/4 | 1 FAIL] | Edge Cases [8/8 | 1 note]