The audio and video quality of interactive live video streaming or a video call deteriorates under poor network conditions. To improve the efficiency of interactive live video streaming or a video call, the
setRemoteSubscribeFallbackOption methods are used for the SDK to automatically switch the high-video stream to low-video stream and disable the video stream under these conditions.
Refer to the following steps to set the stream fallback under poor network conditions:
After joining the channel, the publisher calls the
enableDualStreamMode method to enable dual stream mode.
The publisher calls the
setLocalPublishFallbackOption method and set
AUDIO_ONLY (2) to enable the fallback option for the locally published media stream based on the network conditions. The SDK will disable the upstream video but enable audio only when the network conditions deteriorate and cannot support both video and audio streams.
Agora does not recommend using this method for Media Push, because the remote CDN live user will have a noticeable lag when the locally published video stream falls back to
When the local video stream falls back to
audio only or when the audio-only stream switches back to the video stream, the SDK triggers the
onLocalPublishFallbackToAudioOnly callback to report current stream state to the local publisher.
The subscriber in the channel calls the
setRemoteSubscribeFallbackOption method to set the subscribed stream fallback under poor network conditions.
STREAM_LOW (1) to only subscribe to the low-video stream from the publisher under poor network conditions.
AUDIO_ONLY (2) to subscribe to the low-video stream or even audio stream from the publisher under poor network conditions.
Once the remote media stream switches to the low stream due to poor network conditions, you can monitor the stream switch between a high and low stream in the
onRemoteVideoStats callback. When the remotely subscribed video stream falls back to audio-only or when the audio-only stream switches back to the video stream, the SDK triggers the
// C++ // Enable the dual-stream mode (Configuration for the local). int nRet = rtcEngine.enableDualStreamMode(static_cast<bool>(true)); // Configuration for the publisher. When the network condition is poor, send audio only. nRet = rtcEngine.setLocalPublishFallbackOption(static_cast<STREAM_FALLBACK_OPTIONS>(STREAM_FALLBACK_OPTION_AUDIO_ONLY)); // Configuration for the subscriber. Try to receive low stream under poor network conditions. When the current network conditions are not sufficient for video streams, receive audio stream only. nRet = rtcEngine.setRemoteSubscribeFallbackOption(static_cast<STREAM_FALLBACK_OPTIONS>(STREAM_FALLBACK_OPTION_AUDIO_ONLY));