| Author: | Lai, Ki-kit |
| Title: | Advanced bitstream switching techniques for H.264 video streaming and multi-view video |
| Degree: | Ph.D. |
| Year: | 2011 |
| Subject: | Streaming technology (Telecommunications) Digital video. Switching circuits. Hong Kong Polytechnic University -- Dissertations |
| Department: | Department of Electronic and Information Engineering |
| Pages: | xvi, 122 leaves : ill. ; 30 cm. |
| Language: | English |
| Abstract: | The goal of video streaming is to transmit pre-encoded videos from a server to a client over the Internet. Owing to the large bandwidth fluctuation, efficient adaptation to channel bandwidth is critical when transmitting video over various networks. The most straightforward way of solving the fluctuation problem is to represent each pre-encoded video sequence by using multiple and independent bitstreams of different bitrates and quality. An efficient switching mechanism among different bitstreams is then used to select an appropriate bitstream. Therefore, in this thesis, some novel techniques are suggested for bitstream switching with the minimum storage requirement and the reasonable complexity of the server. To put it in the nutshell, performing switching at P-frames and I-frames induces error propagation and sacrifices the coding efficiency significantly, respectively. In H.264, the new frame type -Synchronization-Predictive frames (SP-frames) - is developed for multiple bitrate streaming with the support of seamless switching. Notwithstanding the guarantee of drift-free switching, the trade-offs are the bulkiness of SP-frames and degradation of quality. Our analysis reveals that the conventional pixel-domain motion estimation is not appropriate for encoding secondary SP-frames such that a significant amount of additional space or bandwidth for storage or transmission is induced. For this reason, we propose a new motion estimation and compensation technique, which is operated in the quantized transform (QDCT) domain instead of pixel-domain, for coding secondary SP-frames. In this technique, the encoding structure of secondary SP-frames is re-designed. Our proposed work keeps the secondary SP-frames as small as possible without affecting the size of primary SP-frames by incorporating QDCT-domain motion estimation and compensation in the secondary SP-frame coding. Simulation results demonstrate that the size of secondary SP-frames can be reduced remarkably. In the meantime, multi-view video service has been attracting more and more attention recently. Different from the traditional single-view video, multi-view video brings in a brand new viewing experience with a high degree of user interactivity. It allows users to select their favourite viewpoint. It switches the bitstream at a particular view when necessary instead of transmitting all the views. The SP-frames, with capability of drift-free switching, can be directly employed in the low-delay viewpoint switching of multi-view videos. It means that QDCT-domain motion estimation can then be proposed to apply on the multi-view video scenarios. Experiments show that the weak interframe correlation in multi-view videos, comparing to multiple bitrate videos, can get benefit from our proposed scheme due to the fact that QDCT-domain motion estimation aims at minimizing residues rather than finding true motion vectors. Although the new QDCT-domain scheme exhibits promising results for reducing the storage requirement of secondary SP-frames in multiple bitrate video and multi-view video systems, there are still some cases that pixel-domain motion estimation outperforms QDCT-domain motion estimation. To avoid this, a straightforward way is to perform both pixel-domain and QDCT-domain motion estimation separately. The sizes of secondary SP-frames generated by both estimation techniques are then compared and the set of final motion vectors with a smaller bit-count is chosen. This approach demands huge computational complexity. In our work, we propose two hybrid motion estimation algorithms (frame-based and macroblock-based) to select an appropriate domain of motion estimation in secondary SP-frame coding. The selection is based on inter-frame correlation, which is measured using the bit-counts of its corresponding primary SP-frame. Results show that the proposed algorithm significantly decreases the size of secondary SP-frames and consumes much less time. By employing QDCT-domain motion estimation, the work in this thesis shows outstanding improvements in terms of size and computational complexity for both multiple bitrate video and multi-view video applications. There is no doubt that the results of our work will certainly be useful for the future development of bitstream switching systems. |
| Rights: | All rights reserved |
| Access: | open access |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| b24624998.pdf | For All Users | 7.8 MB | Adobe PDF | View/Open |
Copyright Undertaking
As a bona fide Library user, I declare that:
- I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
- I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
- I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.
Please use this identifier to cite or link to this item:
https://theses.lib.polyu.edu.hk/handle/200/6269