feat(logger): AppLogger.minimumLevel + mirrorsToConsole (#958) - #959
Conversation
Debug builds mirror every AppLogger level to stderr, and several ASR debug lines carry recognised words. Host apps handling sensitive audio (e.g. clinical dictation) had no way to keep transcript text out of the Xcode console short of not running Debug builds on real recordings. - AppLogger.minimumLevel: levels below it are dropped from os_log and console alike (default .debug, unchanged behavior). - AppLogger.mirrorsToConsole: false routes everything to os_log only, i.e. the Release path, in Debug too (default true). - Both backed by an OSAllocatedUnfairLock rather than nonisolated(unsafe). - Routing factored into an internal route(for:) so it is unit-testable. - Level gains Comparable.
Supertonic3 Smoke Test ✅
Runtime: 0m23s Note: CI VMs lack a physical Neural Engine; the ANE-bucketed VectorEstimator falls back to CPU here. This validates download + variant resolution + synthesis, not ANE residency/perf. |
PocketTTS Smoke Test ✅
Runtime: 0m26s Note: PocketTTS uses CoreML MLState (macOS 15) KV cache + Mimi streaming state. CI VM lacks physical GPU — audio quality and performance may differ from Apple Silicon. |
Parakeet EOU Benchmark Results ✅Status: Benchmark passed Performance Metrics
Streaming Metrics
Test runtime: 2m10s • 09/24/2026, 02:31 PM EST RTFx = Real-Time Factor (higher is better) • Processing includes: Model inference, audio preprocessing, state management, and file I/O |
Speaker Diarization Benchmark ResultsSpeaker Diarization PerformanceEvaluating "who spoke when" detection accuracy
Diarization Pipeline Timing BreakdownTime spent in each stage of speaker diarization
Speaker Diarization Research ComparisonResearch baselines typically achieve 18-30% DER on standard datasets
Note: RTFx shown above is from GitHub Actions runner. On Apple Silicon with ANE:
🎯 Speaker Diarization Test • AMI Corpus ES2004a • 1049.0s meeting audio • 51.7s diarization time • Test runtime: 3m 16s • 09/24/2026, 02:33 PM EST |
VAD Benchmark ResultsPerformance Comparison
Dataset Details
✅: Average F1-Score above 70% |
Offline VBx Pipeline ResultsSpeaker Diarization Performance (VBx Batch Mode)Optimal clustering with Hungarian algorithm for maximum accuracy
Offline VBx Pipeline Timing BreakdownTime spent in each stage of batch diarization
Speaker Diarization Research ComparisonOffline VBx achieves competitive accuracy with batch processing
Pipeline Details:
🎯 Offline VBx Test • AMI Corpus ES2004a • 1049.0s meeting audio • 101.0s processing • Test runtime: 1m 46s • 09/24/2026, 02:40 PM EST |
ASR Benchmark Results ✅Status: All benchmarks passed Parakeet v3 (multilingual)
Parakeet v2 (English-optimized)
Streaming (v3)
Streaming (v2)
Streaming tests use 5 files with 0.5s chunks to simulate real-time audio streaming 25 files per dataset • Test runtime: 8m22s • 09/24/2026, 02:41 PM EST RTFx = Real-Time Factor (higher is better) • Calculated as: Total audio duration ÷ Total processing time Expected RTFx Performance on Physical M1 Hardware:• M1 Mac: ~28x (clean), ~25x (other) Testing methodology follows HuggingFace Open ASR Leaderboard |
Sortformer High-Latency Benchmark ResultsES2004a Performance (30.4s latency config)
Sortformer High-Latency • ES2004a • Runtime: 4m 2s • 2026-09-24T18:41:57.647Z |
Closes #958.
In Debug builds,
AppLoggermirrors every level to stderr, and some ASR debug lines include recognised words. Apps that transcribe sensitive audio had no way to keep that text off the console.AppLogger.minimumLeveldrops messages below the chosen level from both os_log and the console. Default is.debug, so nothing changes unless an app sets it.AppLogger.mirrorsToConsole = falsestops console output and logs to os_log only (the Release path), in Debug builds too. Default istrue.OSAllocatedUnfairLock. The routing now lives in an internalroute(for:), andAppLoggerTestscovers it.Note: when Xcode's debugger is attached, os_log output still appears in the Xcode console, so
minimumLevelis the setting that keeps transcript text out of it.🤖 Generated with Claude Code