DualPiP v1.9 Release Notes

DualPiP v1.9 makes Live Captions work on significantly more video sites and streaming platforms. The speech-to-text engine has been completely rebuilt to detect audio sources more reliably, handle encrypted streams, and save bandwidth by downloading only audio data instead of full video files.

DualPiP v1.9.5 improves live stream captions on YouTube, Twitch, Bilibili and similar sites. Live Captions can use audio the player has already buffered so subtitles stay closer to speech, and can return to ahead-of-playback recognition when buffering recovers.

• Live Captions on popular live sites: Better sync on YouTube, Twitch, Bilibili and other live streams by recognizing buffered audio; switches back from real-time capture when enough buffer is available again
• Waits for real speech at the start: Long intros with only music or silence no longer force an early switch to real-time captions
• More streams without audio DRM: Pre-generated subtitles on some videos that protect the picture but not the sound track
• Smarter auto Live Captions per site: Uses the video’s own captions when present; starts speech-to-text only when there are none. Re-checks when Picture-in-Picture plays the next video
• Calmer subtitles while translating: Less flicker during live recognition and translation; the previous line stays on screen a little longer when speech is fast
• Faster, more reliable caption loading: Reuses subtitles already on the page and pauses requests when the site rate-limits you

• More stable DualPiP Cloud when auto-detecting language, switching between pre-generated and real-time captions, or watching for a long time
• A clear notice when today’s free trial quota is used up, instead of staying on “Connecting…”
• No false failure on music-only or silent passages
• Real-time captions lagging behind speech during automatic language detection
• Real-time captions sometimes not starting with your own speech API key
• On YouTube: wrong captions from another video, and captions not updating when autoplay goes to the next or previous video
• Pre-generated captions mixing with the previous video or stopping after a video change; language-detection notices clear when you switch videos
• Pre-generated subtitles and caption detection on some sites when DualPiP and CaptionGo are installed together

• Pre-generated Live Captions on more sites and formats: Live Captions can prepare subtitles ahead of playback on more video sites and stream types. DualPiP automatically links captions to the video that is actually playing, so subtitles show up faster and use less bandwidth
• Smarter audio track choice for multilingual videos: When a video has multiple language tracks, Live Captions prefers the default track or the one that matches your page language for more accurate speech-to-text
• More stable automatic language detection: Long periods without speech no longer trigger a premature “can’t detect language” warning; the notice clears as soon as speech is recognized again
• No DualPiP button on thumbnail previews: Small hover or preview players no longer show the Picture-in-Picture extension button
• Subtitles reset when PiP plays the next video: When Picture-in-Picture advances to the next item in a playlist, Live Captions starts fresh; real-time captions resume automatically only if you already turned on auto Live Captions for that site
• Clearer prompts when audio cannot be captured: Status messages better explain when the browser cannot pick up sound from the player

• Fixed audio continuing to download after Live Captions was stopped
• Fixed pre-generated subtitles showing text only at the beginning of the video on some sites; DualPiP switches to real-time captions sooner when the audio cannot be recognized
• Fixed clicks on the DualPiP control scrubbing the progress bar on some players, and overlapping buttons on Dailymotion
• Fixed repeated reconnect attempts when no audio signal was received

• Live Captions status indicator in Picture-in-Picture: A new indicator in the top-right corner of the PiP window shows whether Live Captions is working and how far subtitle generation has progressed. Click it to switch the recognition language or stop Live Captions — with DualPiP Cloud it also shows today's remaining free trial time
• Pre-generated subtitles on more sites: Live Captions can now generate subtitles ahead of playback on more video sites, and they stay in sync with the speech even when you turn it on midway through a video
• Advanced Deepgram settings: Fine-tune recognition in the Deepgram provider settings — smart formatting, profanity filter, and key terms that help recognize names and technical words more accurately, plus separate sentence-break options for real-time and pre-generated captions

• Easy-to-read captions for long speech: Long stretches of speech are now split at sentence ends and natural pauses into short captions, instead of one long block without breaks. Sentences are also more complete, with fewer missing endings (you can turn off "Split Long Captions" in settings)
• More accurate automatic language detection: Music intros, silence and other parts without speech no longer throw off detection, and a language is only used once the result is reliable
• Step-by-step language confirmation: When generating subtitles ahead of playback, Live Captions now recognizes one segment at a time and confirms the spoken language before speeding up. The progress count only goes up once subtitles are actually ready, and processing pauses immediately if the language looks wrong — saving your quota
• Same experience with DualPiP Cloud and your own Deepgram key: Recognition language, capture mode, silence filter and other settings now apply to the built-in DualPiP Cloud too, and subtitles are prepared just as far ahead
• Clearer language detection messages: Each step — detecting, confirming, correcting or failing — shows a short message with the language name instead of a code, and you can pick a language right away
• Error details in the Live Captions menu: When Live Captions can't start or stops, the menu now shows the reason instead of a generic error
• More accurate real-time caption timing: Subtitles no longer go missing or out of sync after a brief network drop
• Cleaner bilingual subtitles: Earlier lines no longer reappear and push the latest line off screen
• Fully translated Live Captions controls: Buttons and status messages that were still in English are now translated

• Fixed messages in the top-left corner of the Picture-in-Picture window disappearing right after they appeared — after you sign in and turn on Live Captions, language detection and confirmation messages now show properly
• Fixed the beginning of long sentences being cut off in real-time captions
• Fixed the "language switched" message disappearing right after it appeared
• Fixed progress getting stuck on the same number when the speech recognition service can't be reached, followed by an unnecessary switch to real-time mode — you now get a "check your network" message within about 40 seconds, with one-click Retry
• Fixed no message appearing when a real-time connection fails
• Fixed audio still being uploaded in the background after Live Captions was stopped, which used up quota
• Fixed Live Captions not working after signing in until Picture-in-Picture was closed and reopened

• Smarter language detection: When Live Captions can't reliably detect the spoken language, it now pauses and prompts you to select a language manually instead of guessing — saving your recognition quota
• Better Chinese/Japanese/Korean recognition: Improved accuracy when distinguishing between Chinese, Japanese, and Korean audio
• Language re-detection on seek: Seeking to a different part of the video now restarts language detection from the new position — ideal for skipping music intros or navigating to speech sections
• More reliable audio processing: Improved compatibility with a wider range of video formats, reducing cases where audio download would get stuck at "Downloading audio…" or fail to produce subtitles
• Audio download progress: Now shows real-time download progress with speed (e.g. "Downloading audio… 35% (120 KB/s)") so you know exactly what's happening
• Better reliability on slow networks: Audio download now automatically retries with optimized settings on slow or unstable connections
• Processing progress between segments: Shows progress indicators (e.g. "Processing audio… 3/7") between subtitle segments, only when no subtitle is currently displayed
• AI translation quality upgrade: Refined translation prompts for better subtitle coherence, larger context window (up to 30 previous lines), and video metadata (title, synopsis) now informs the translation for more accurate results
• ASR-aware AI translation: AI translator now adapts its approach when translating speech recognition subtitles, producing more fluent results for imperfect source text

• AI translation privacy control: New toggle in Translation Settings to control whether video context (title, URL, description) is sent to AI translation — enabled by default, can be turned off for privacy

• Fixed video black screen when opening video file URLs directly in the browser (e.g. .mp4 links)
• Fixed MP4 audio extraction downloading nearly the entire file for certain video formats (e.g. lecture/educational videos), now intelligently extracts only audio data
• Fixed subtitles stopping midway through longer videos when the predownload window was fully processed
• Fixed "Preparing subtitles…" message stuck on screen after seeking to an already-processed section
• Fixed predownload progress indicator getting stuck and not reaching 100%
• Fixed language selection badge not appearing when manual language selection was needed
• Fixed translation inaccuracies caused by repeated phrases across different subtitle segments sharing cached translations
• Fixed membership status not refreshing after browser restart

• Fixed Live Captions predownload restarting repeatedly on sites using Wistia player (e.g. online course platforms)

• Better predownload stability — fewer unnecessary restarts, avoids re-processing already-recognized audio segments

• Live Captions on more sites: completely rebuilt speech-to-text engine that automatically detects audio sources from HLS, DASH, and MP4 video streams
• Automatic video stream discovery: detects video manifests and audio URLs by monitoring page network traffic, so Live Captions works even on sites without explicit audio source configuration
• Encrypted video support: Live Captions now works on sites using AES-128 encrypted audio, including more streaming platforms with protected content
• Bandwidth-efficient audio download: extracts and downloads only the audio track from MP4 files instead of the full video, reducing data usage significantly
• TikTok and hotlink-protected sites: automatically adds the correct request headers so audio predownload no longer fails on sites like TikTok that block external requests

• Live Captions no longer shows "downloading…" or "processing…" messages once subtitles have started appearing — only errors are shown
• Audio predownload settings can be updated remotely without requiring an extension update
• Automatically falls back to realtime mode when predownload encounters DRM-protected content or fails to obtain an audio source
• AI translation now retries automatically to reduce missed translations caused by model initialization race conditions

• Fixed an issue where dragging subtitles to the top of the PiP window caused the drag handle to overflow, making the subtitles impossible to reposition
• Fixed caption cache mismatch on pages with multiple videos (e.g. Twitter/X) where PiP subtitles could appear on the wrong video