We present a framework for cross-layer optimized real time multiuser encoding of video using a single layer H.264/AVC and transmission over MIMO wireless channels. In the proposed cross-layer adaptation, the channel of every user is characterized by the probability density function of its channel mutual information and the performance of the H.264/AVC encoder is modeled by a rate distortion model that takes into account the channel errors. These models are used during the resource allocation of the available slots in a TDMA MIMO communication system with capacity achieving channel codes. This framework allows for adaptation to the statistics of the wireless channel and to the available resources in the system and utilization of the multiuser diversity of the transmitted video sequences. We show the effectiveness of the proposed framework for video transmission over Rayleigh MIMO block fading channels, when channel distribution information is available at the transmitter. 1. Introduction The telecommunication industry is expected to benefit greatly from the transmission of video. Great portion of this video traffic will be real time, so, real time multiuser video transmission is expected to become a common service. The optimal real time video transmission over wireless channels is still an open problem. This is due to the complexity and requirements of the video coding process and the severity of the wireless channel. Namely, real time video requires variable bit rates and low delay, the wireless system has limited resources (bandwidth and power) and the wireless channel itself is time varying . Previous research results [1–3] have shown that cross-layer adaptation can result in substantial performance improvement compared to treating the different layers as isolated entities. Here, we utilize the implementation of the cross-layer principle for real time H.264 single layer video encoding and transmission in systems that use capacity achieving codes presented in  and extend the concept to a multiuser MIMO TDMA system. It has been shown that the utilization of the multiuser principle can improve system performance in a video streaming scenario [5, 6], but the joint cross-layer optimization for real time H.264/AVC single layer video encoding and transmission in a multiuser wireless system based on outage probability has not been addressed yet. The novelty of our work is in proposing a cross-layer framework for optimized real time transmission and encoding of video from multiple users in a TDMA wireless system using capacity achieving channel coding
S. Pejoski and V. Kafedziski, “Cross-layer framework for real time H.264/AVC video transmission over wireless channels using outage probability,” in Proceedings of the 9th International Symposium on Telecommunications (BIHTEL '12), pp. 1–6, Sarajevo, Bosnia and Herzegovina, October 2012.
E. Maani, P. V. Pahalawatta, R. Berry, T. N. Pappas, and A. K. Katsaggelos, “Resource allocation for downlink multiuser video transmission over wireless lossy networks,” IEEE Transactions on Image Processing, vol. 17, no. 9, pp. 1663–1671, 2008.
D.-K. Kwon, M.-Y. Shen, and C.-C. Jay Kuo, “Rate control for H.264 video with enhanced rate and distortion models,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 5, pp. 517–529, 2007.
Y. Zhang, W. Gao, Y. Lu, Q. Huang, and D. Zhao, “Joint source-channel rate-distortion optimization for H.264 video coding over error-prone networks,” IEEE Transactions on Multimedia, vol. 9, no. 3, pp. 445–454, 2007.
V. Kafedziski and S. Pejoski, “Optimization of video transmission on MIMO channels using outage probability,” in Proceedings of the 52nd International Symposium (ELMAR '10), pp. 273–276, Zadar, Croatia, September 2010.
S. Parakh and A. K. Jagannatham, “Game theory based dynamic bitrate adaptation for H.264 scalable video transmission in 4G wireless systems,” in Proceedings of the International Conference on Signal Processing and Communications (SPCOM '2012), pp. 1–5, Bangalore, India, July 2012.
Z. Han, G.-M. Su, A. Kwasinski, M. Wu, and K. J. R. Liu, “Multiuser distortion management of layered video over resource limited downlink multicode-CDMA,” IEEE Transactions on Wireless Communications, vol. 5, no. 11, pp. 3056–3067, 2006.
H. Zhang, Y. Zheng, M. A. Khojastepour, and S. Rangarajan, “Cross-layer optimization for streaming scalable video over fading wireless networks,” IEEE Journal on Selected Areas in Communications, vol. 28, no. 3, pp. 344–353, 2010.
V. Joseph and G. de Veciana, “Joint optimizing multi-user rate adaptation for video transport over wireless systems: mean-fairness-variability tradeoffs,” International Journal of Computer Applications, vol. 53, no. 8, pp. 44–49, 2012.
P. Pahalawatta, R. Berry, T. Pappas, and A. Katsaggelos, “Content-aware resource allocation and packet scheduling for video transmission over wireless networks,” IEEE Journal on Selected Areas in Communications, vol. 25, no. 4, pp. 749–759, 2007.
L.-U. Choi, W. Kellerer, and E. Steinbach, “On cross-layer design for streaming video delivery in multiuser wireless environments,” EURASIP Journal on Wireless Communications and Networking, vol. 2006, no. 2, Article ID 060349, p. 55, 2006.
F. Fu and M. van der Schaar, “A systematic framework for dynamically optimizing multi-user wireless video transmission,” IEEE Journal on Selected Areas in Communications, vol. 28, no. 3, pp. 308–320, 2010.
S. Karachontzitis, T. Dagiuklas, and L. Dounis, “Fair cross-layer scheme for heterogeneous H.264/AVC video streams over LTE-based broadband systems,” in Proceedings of the 8th International Wireless Communications & Mobile Computing Conference (IWCMC '12), pp. 1006–1010, Limassol, Cyprus, August 2012.
J. Huang, Z. Li, M. Chiang, and A. K. Katsaggelos, “Joint source adaptation and resource allocation for multi-user wireless video streaming,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 5, pp. 582–594, 2008.
D.-E. Meddour, A. Abdallah, T. Ahmed, and R. Boutaba, “A cross layer architecture for multicast and unicast video transmission in mobile broadband networks,” Journal of Network and Computer Applications, vol. 35, no. 5, pp. 1377–1391, 2012.
L. Superiori, M. Wrulich, P. Svoboda et al., “Content-aware scheduling for video streaming over HSDPA networks,” in Proceedings of the 2nd International Workshop on Cross Layer Design (IWCLD '09), pp. 1–5, Palma de Mallorca, Spain, June 2009.
C. Bouras, N. Kanakis, V. Kokkinos, and A. Papazois, “Application layer forward error correction for multicast streaming over LTE networks,” International Journal of Communication Systems, vol. 26, no. 11, pp. 1459–1474, 2012.
J. Xing, W. Fan, and Z. Lu, “A cross-layer scheduling scheme for video streaming based on fuzzy decision-making,” in Proceedings of the IEEE 13th International Conference on Communication Technology (ICCT '11), pp. 84–87, Jinan, China, September 2011.
L. Zhou, X. Wang, W. Tu, G.-M. Muntean, and B. Geller, “Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks,” IEEE Journal on Selected Areas in Communications, vol. 28, no. 3, pp. 409–419, 2010.
W. Saesue, C. T. Chou, and J. Zhang, “Cross-layer QoS-optimized EDCA adaptation for wireless video streaming,” in Proceedings of the 17th IEEE International Conference on Image Processing (ICIP '10), pp. 2925–2928, Hong Kong, September 2010.
D. Yuan, Z. Guan, and H. Zhang, “Optimal and fair resource allocation for multiuser wireless multimedia transmissions,” EURASIP Journal on Wireless Communications and Networking, vol. 2009, Article ID 801613, pp. 1–12, 2009.
W. Ma, W. Zheng, H. Zhang, X. Wen, and Z. Lu, “Distortion-guaranteed energy saving power allocation for downlink OFDMA multiuser video transmission,” Journal of Information & Computational Science, vol. 9, no. 11, pp. 3011–3019, 2012.
A. Chan, H. Lundgren, and T. Salonidis, “Video-aware rate adaptation for MIMO WLANs,” in Proceedings of the 19th IEEE International Conference on Network Protocols (ICNP '11), pp. 321–330, British Columbia, Canada, October 2011.
M. Hafeez, S. Jangsher, and S. A. Khayam, “A cross-layer architecture for motion-adaptive video transmission over MIMO channels,” in Proceedings of the IEEE International Conference on Communications (ICC '11), pp. 1–5, Kyoto, Japan, June 2011.
A. Khalek, C. Caramanis, and R. Heath, “Video-aware MIMO precoding with packet prioritization and unequal modulation,” in Proceedings of the 20th European Signal Processing Conference (EUSIPCO '12), pp. 1905–1909, Bucharest, Romania, August 2012.
Y. P. Fallah, H. Mansour, S. Khan, P. Nasiopoulos, and H. M. Alnuweiri, “A link adaptation scheme for efficient transmission of H.264 scalable video over multirate WLANs,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 7, pp. 875–887, 2008.
M. Bansal, M. Jubran, and L. P. Kondi, “Scalable H.264 wireless video transmission over MIMO-OFDM channels,” in Advanced Concepts for Intelligent Vision Systems, vol. 6475 of Lecture Notes in Computer Science, pp. 34–45, Springer, Berlin, Germany, 2010.
J. Park, U. Jang, T. Oh, S. Lee, and A. C. Bovik, “Optimal power allocation for minimizing visual distortion over MIMO communication systems,” in Proceedings of the IEEE International Conference on Image Processing (ICIP '09), pp. 1833–1836, Cairo, Egypt, November 2009.
S. Mahajan and A. K. Jagannatham, “Hierarchical DWT based optimal diversity power allocation for video transmission in MIMO wireless systems with quantized feedback,” in Proceedings of the Australasian Telecommunication Networks and Applications Conference (ATNAC '11), pp. 1–7, Victoria, Australia, November 2011.
S. Zhao, Y. Zhang, and L. Gui, “Optimal resource allocation for video delivery over MIMO OFDM wireless systems,” in Proceedings of the 53rd IEEE Global Communications Conference (GLOBECOM '10), pp. 1–5, Miami, Fla, USA, December 2010.
O. H. Salim and W. Xiang, “A novel unequal error protection scheme for 3-D video transmission over cooperative MIMO-OFDM systems,” EURASIP Journal of Wireless Communication and Networking, vol. 2012, article 269, 2012.
L. Liu and X. Zhuang, “Fast motion estimation and mode decision for H.264 video coding in packet loss environment,” in Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '08), pp. 781–784, Hanover, Germany, April 2008.