tencent cloud

Tencent Real-Time Communication

소식 및 공지 사항
제품 업데이트
Tencent Cloud 오디오/비디오 단말 SDK 재생 업그레이드 및 권한 부여 인증 추가
TRTC 월간 구독 패키지 출시 관련 안내
제품 소개
제품 개요
기본 개념
제품 기능
제품 장점
응용 시나리오
성능 데이터
구매 가이드
Billing Overview
무료 시간 안내
Monthly subscription
Pay-as-you-go
TRTC Overdue and Suspension Policy
과금 FAQ
Refund Instructions
신규 사용자 가이드
Demo 체험
Call
개요(TUICallKit)
Activate the Service
Run Demo
빠른 통합(TUICallKit)
오프라인 푸시
Conversational Chat
온클라우드 녹화(TUICallKit)
AI Noise Reduction
UI 사용자 정의
Calls integration to Chat
Additional Features
No UI Integration
Server APIs
Client APIs
Solution
ErrorCode
릴리스 노트
FAQs
라이브 스트리밍
Billing of Video Live Component
Overview
Activating the Service (TUILiveKit)
Demo 실행
No UI Integration
UI Customization
Live Broadcast Monitoring
Video Live Streaming
Voice Chat Room
Advanced Features
Client APIs
Server APIs
Error Codes
Release Notes
FAQs
RTC Engine
Activate Service
SDK 다운로드
API 코드 예시
Usage Guidelines
API 클라이언트 API
고급 기능
RTC RESTFUL API
History
Introduction
API Category
Room Management APIs
Stream mixing and relay APIs
On-cloud recording APIs
Data Monitoring APIs
Pull stream Relay Related interface
Web Record APIs
AI Service APIs
Cloud Slicing APIs
Cloud Moderation APIs
Making API Requests
Call Quality Monitoring APIs
Usage Statistics APIs
Data Types
Appendix
Error Codes
콘솔 가이드
애플리케이션 관리
사용량 통계
모니터링 대시보드
개발 보조
Solution
Real-Time Chorus
FAQs
과금 개요
기능 관련
UserSig 관련
방화벽 제한 처리
설치 패키지 용량 축소 관련 질문
Andriod 및 iOS 관련
Web 관련
Flutter 관련
Electron 관련
TRTCCalling Web 관련
멀티미디어 품질 관련
기타 질문
Protocols and Policies
컴플라이언스 인증
보안 백서
정보 보안에 관한 참고 사항
Service Level Agreement
Apple Privacy Policy: PrivacyInfo.xcprivacy
TRTC 정책
개인 정보 보호 정책
데이터 처리 및 보안 계약
용어집
문서Tencent Real-Time Communication

Android

포커스 모드
폰트 크기
마지막 업데이트 시간: 2023-12-28 21:32:43

Implementation process

In the lyrics synchronization scheme, the actions of three different roles are as follows:
Lead Singer
Chorus
Audience
NTP time calibration
Turn on black frame compensation
Send SEI message
Local lyrics synchronization
Update lyrics widget
NTP time calibration
Local lyrics synchronization
Update lyrics widget
NTP time calibration
Receive SEI message
Update lyrics widget
The lead singer and chorus update the lyrics progress locally according to the synchronized song playback progress; the audience needs to receive the SEI message sent by the lead singer, which contains the latest lyrics progress, to update the local lyrics progress.




Timing diagram





The lyrics synchronization timing can be mainly divided into three parts: NTP time calibration, turning on black frame compensation, and local and remote lyrics synchronization. The code implementation of NTP time calibration has been given in the song synchronization, and the specific code implementation for the latter two parts will be provided below.

Key code implementation

1. Turn on black frame compensation

// In pure audio mode, the main instance (vocal instance) needs to turn on black frame compensation to carry the SEI message.
mTRTCCloud.callExperimentalAPI("{\\"api\\":\\"enableBlackStream\\",\\"params\\": {\\"enable\\":true}}");
Note:
The experimental interface enableBlackStream needs to be called after entering the room.
On Android, the value type of the enable parameter is boolean, and on iOS, it is integer.
The receiver needs to call startRemoteView(userId, null) when onUserVideoAvailable(userId, true) is received.

2. Send song progress through SEI message

mAudioEffectManager.setMusicObserver(mCurPlayMusicId, new TXAudioEffectManager.TXMusicPlayObserver() {
@Override
public void onPlayProgress(int id, long curPtsMS, long durationMS) {
JSONObject jsonObject = new JSONObject();
// Current NTP time
long ntpTime = TXLiveBase.getNetworkTimestamp();
jsonObject.put("bgmProgressTime", curTime);
jsonObject.put("ntpTime", ntpTime);
jsonObject.put("musicId", musicId);
jsonObject.put("duration", duration);
jsonObject.toString().getBytes();
mTRTCCloud.sendSEIMsg(jsonObject.toString().getBytes(), 1);
}
}

Note:
The frequency of the lead singer sending SEI messages is determined by the frequency of background music playback event callbacks, usually 200ms;
The reason for not directly using CMD messages to send song progress: The signaling transmitted by the SEI channel can be transmitted to the live CDN along with the video frames, providing better compatibility for the audience pulling the CDN stream.

3. Local and remote lyrics synchronization

// Local lyrics synchronization
mAudioEffectManager.setMusicObserver(mCurPlayMusicId, new TXAudioEffectManager.TXMusicPlayObserver() {
@Override
public void onPlayProgress(int id, long curPtsMS, long durationMS) {
...
// TODO Update lyrics widget logic:
// Determine whether to seek the lyrics widget based on the latest progress and local lyrics progress error
...
}
}

// Remote lyrics synchronization
@Override
public void onRecvSEIMsg(String userId, byte[] data) {
String result = new String(data);
JSONObject jsonObject = new JSONObject(result);
long bgmProgressTime = jsonObject.getLong("bgmProgressTime");
long ntpTime = jsonObject.getLong("ntpTime");
String musicId = jsonObject.getString("musicId");
long duration = jsonObject.getLong("duration");
...
// TODO Update lyrics widget logic:
// If you reuse the TUIKaraoke component's lyrics widget,
//please refer to the code logic of the TUIKaraoke LyricsView section to synchronize the lyrics widget progress.
...
}
Note:
If you reuse the TUIKaraoke component's lyrics widget, please refer to the code logic of the TUIKaraoke LyricsView section to synchronize the lyrics widget progress.


도움말 및 지원

문제 해결에 도움이 되었나요?

피드백