Audio and Video Decoding and Synchronous Playback for Embedded Systems

Source:
By:Journal of Computer Science Research

DOI: https://doi.org/10.30564/jcsr.v1i1.165

Abstract: The audio and video decoding and synchronization playback system of
MPEG-2 TS stream is designed and implemented based on ARM embedded system. In this system, hardware processor is embedded in the ARM processor. In order to make full use of this resource, hardware MFC is adopted. The multi-format codec decoder decodes the video data and decodes the audio data using the open source Mad (libmad) library. The V4L2 (Video for Linux2) driver interface and the ALSA (advanced Linux sound architecture) library are used to implement the video. Because the video frame playback period and the hardware processing delay are inconsistent, the system has a time difference between the audio and video data operations, which causes the audio and video playback to be out of sync. Therefore, we use the method of synchronizing the video playback implemented to the audio playback stream; realize the audio and video are playing sync. Test results show that, the designed audio decodes and synchronization playback system can decode and synchronize audio and video data.

References:

[1] Park K, Lim Y, Suh D Y. Delivery of ATSC 3.0 services with MPEG media transport standard considering redistribution in MPEG-2 TS format[J]. IEEE Transactions on Broadcasting, 2016, 62(1): 338-351. [2] Lin Y Y, Hsu H H. General Architecture for MPEG-2/H.263/H.264/AVC toH.264/AVC intra frame transcoding[J]. Journal of Signal Processing Systems, 2015,79(3): 299-311. [3] Yuste L B, Boronat F, Montagud M. Understanding timelines within MPEG standards[J]. IEEE Communications Surveys & Tutorials, 2016, 18(1): 368-400. [4] Huang X W, Xu Y X, Wang K. Synchronization between audio and video in digital[J]. TV System, 2005(7): 45-46. (in Chinese) [5] Wu W, Chang Y. A novel algorithm of media synchronization for MPEG-2[J].IEEE Transactions on Consumer Electronics, 2006, 52(2): 646-650. [6] Abdallah F B, Trabelsi C, Atitallah R B. Early power-aware design space exploration for embedded systems: MPEG-2 case study[C]Proceedings of 2014 International Symposium on System-on-Chip (SoC). Tampere, Finland, IEEE, 2014:1-8. [7] Fei W, Cong K. Implementation of linux video capture driver based on V4L2 architecture[J]. Electronic Science and Technology, 2012, 25(2): 86-87. [8] Belloch J A, Gonzalez A, Mayo R. Evaluating the potential of low power systems for headphone-based spatial audio applications[J]. Procedia Computer Science, 2015,51: 191-200. [9] Binh N, Chung S T, Cho S. Design and implementation of an embeddedArticle 18 multimedia live streaming decoder system[C]2014 International Conference on Advanced Technologies for Communications (ATC 2014). Hanoi, Vietnam, IEEE， 2014: 377-382. [10] Lei X, Jiang X, Wang C. Design and implementation of a real-time video stream analysis system based on FFmpeg[C] Proceedings of 4th IEEE World Congress on Software Engineering (WCSE). Beijing, China, 2013: 212-216. [11]International Organization for Standardization (ISO). Information technology -generic coding of moving pictures and associated audio information: systems[S].Geneva, Switzerland: ISO, 2000. [12] Zhang J, Li Y, Wei Y. Using timestamp to realize audio-video synchronization in real-time streaming media transmission[C]Proceedings of International Conference on Audio, Languageand Image Processing. Shanghai, China, 2008: 1073-1076. [13] Mosharafa S M, Ebrahim G A, Zekry A A. A novel algorithm for synchronizing audio andvideo streams in MPEG-2 system layer[C] 2014 9th International Conference on ComputerEngineering & Systems (ICCES). Cairo, Egypt, IEEE, 2014:142-147. [14] Yang M, Bourbakis N, Chen Z. An efficient audio-video synchronization methodology[C]Proceedings of IEEE International Conference on Multimedia and Expo. Beijing, China, 2007:767-770.