Visual sensor networks (VSNs) comprised of battery-operated electronic devices endowed with low-resolution cameras have expanded the applicability of a series of monitoring applications. Those types of sensors are interconnected by ad hoc error-prone wireless links, imposing stringent restrictions on available bandwidth, end-to-end delay and packet error rates. In such context, multimedia coding is required for data compression and error-resilience, also ensuring energy preservation over the path(s) toward the sink and improving the end-to-end perceptual quality of the received media. Cross-layer optimization may enhance the expected efficiency of VSNs applications, disrupting the conventional information flow of the protocol layers. When the inner characteristics of the multimedia coding techniques are exploited by cross-layer protocols and architectures, higher efficiency may be obtained in visual sensor networks. This paper surveys recent research on multimedia-based cross-layer optimization, presenting the proposed strategies and mechanisms for transmission rate adjustment, congestion control, multipath selection, energy preservation and error recovery. We note that many multimedia-based cross-layer optimization solutions have been proposed in recent years, each one bringing a wealth of contributions to visual sensor networks.
References
[1]
Akyildiz, I; Su, W; Sankarasubramaniam, Y; Cayirci, E. A survey on sensor networks. Comput. Netw 2002, 38, 393–422, doi:10.1016/S1389-1286(01)00302-4.
[2]
Baronti, P; Pillai, P; Chook, V; Chessa, S; Gotta, A; Hu, Y. Wireless sensor networks: A survey on the state of the art and the 802.15.4 and ZigBee standards. Comput. Commun 2006, 30, 1655–1695.
Obraczka, K; Manduchi, R; Garcia-Luna-Aveces, JJ. Managing the Information Flow in Visual Sensor Networks. Proceedings of the 5th International Symposium on Wireless Personal Multimedia Communications, Honolulu, HI, USA, 27–30 October 2002; pp. 1177–1181.
[5]
Akyildiz, I; Melodia, T; Chowdhury, K. A survey on wireless multimedia sensor networks. Comput. Netw 2007, 51, 921–960, doi:10.1016/j.comnet.2006.10.002.
[6]
Almalkawi, I; Zapata, M; Al-Karaki, J; Morillo-Pozo, J. Wireless multimedia sensor networks: Current trends and future directions. Sensors 2010, 10, 6662–6717, doi:10.3390/s100706662. 22163571
[7]
Soro, S; Heinzelman, W. A survey of visual sensor networks. Adv Multimed 2009, 2009, doi:10.1155/2009/640386..
[8]
Costa, DG; Guedes, LA. The coverage problem in video-based wireless sensor networks: A survey. Sensors 2010, 10, 8215–8247, doi:10.3390/s100908215. 22163651
[9]
Wan, J; Xu, X; Feng, R; Wu, Y. Cross-layer active predictive congestion control protocol for wireless sensor networks. Sensors 2009, 9, 8278–8310, doi:10.3390/s91008278. 22408506
Chew, LW; Ang, L-M; Seng, KP. A Survey of Image Compression Algorithms in Wireless Sensor Networks. Proceedings of the International Symposium on Information Technology, Kuala Lumpur, Malaysia, 26–28 August 2008; pp. 1–9.
[12]
Zhang, L; Hauswirth, M; Shu, L; Zhou, Z; Reynolds, V; Han, G. Multi-priority multi-path selection for video streaming in wireless multimedia sensor networks. Lect. Notes Comput. Sci 2008, 5061, 439–452.
[13]
Chow, HY; Lui, K-S; Lam, EY. efficient on-demand image transmission in visual sensor networks. EURASIP J. Appl. Signal Process 2007, 2007, 1–11.
[14]
Puri, R; Majundar, A; Ishwar, P; Ramchandran, K. Distributed video coding in wireless sensor networks. IEEE Signal Process. Mag 2006, 23, 94–106, doi:10.1109/MSP.2006.1657820.
[15]
Slepian, D; Wolf, JK. Noiseless coding of correlated information sources. IEEE Trans. Inform. Theory 1973, 19, 471–480, doi:10.1109/TIT.1973.1055037.
[16]
Wyner, D; Ziv, J. The rate-distortion function for source coding with side information at the decoder. IEEE Trans. Inform Theory 1976, 22, 1–10, doi:10.1109/TIT.1976.1055508.
[17]
Aaron, A; Rane, S; Setton, E; Girod, B. Transform-domain Wyner-Ziv Codec for Video. Proceedings of Visual Communications and Image Processing, Sao Jose, CA, USA, 20 January 2004; pp. 520–528.
[18]
Puri, R; Ramchandran, K. PRISM: A New Robust Video Coding Architecture Based on Distributed Compression Principles. Proceedings of the 40th Allerton Conference on Communication, Control and Computing, Champaign, IL, USA, October 2002; pp. 586–595.
[19]
Yu, W; Sahinoglu, Z; Vetro, A. Energy Efficient JPEG 2000 Image Transmission over Wireless Sensor Networks. Proceedings of the IEEE Globecom, Dallas, TX, USA, 29 November–3 December 2004; pp. 2738–2743.
[20]
Boukerche, A; Du, Y; Feng, J; Pazzi, R. A Reliable Synchronous Transport Protocol for Wireless Image Sensor Networks. Proceedings of the IEEE Symposium on Computers and Communications, Marrakech, Morocco, 6–9 July 2008; pp. 1083–1089.
[21]
Boukerche, A; Feng, J; Werner, RP; Du, Y; Huang, Y. Reconstructing the Plenoptic Function from Wireless Multimedia Sensor Networks. Proceedings of the IEEE Conference on Local Computer Networks, Montreal, Canada, 14–17 October 2008; pp. 74–81.
[22]
Cheng, AM; Shang, F. Priority-driven coding and transmission of progressive jpeg images for real-time applications. J. VLSI Signal Process 2007, 47, 169–182, doi:10.1007/s11265-006-0044-3.
[23]
Leelapornchai, P; Stockhammer, T. Progressive Image Transmission Applying Multipath Routing in Mobile Ad hoc Networks. Proceedings of the International Conference on Image Processing, Rochester, MN, USA, 22–25 September 2002; pp. 553–556.
[24]
Lecuire, V; Duran-Faundez, C; Krommenacker, N. Energy-efficient transmission of wavelet-based images in wireless sensor networks. J Image Video Process 2007, 1–11, doi:10.1155/2007/47345..
[25]
Lecuire, V; Duran-Faundez, C; Krommenacker, N. Energy-efficient image transmission in sensor networks. Int. J. Sens. Netw 2008, 4, 37–47, doi:10.1504/IJSNET.2008.019250.
[26]
Lee, J-H; Jun, I-B. Adaptive-compression based congestion control technique for wireless sensor networks. Sensors 2010, 10, 2919–2945, doi:10.3390/s100402919. 22319280
[27]
Christopoulos, C; Skodras, A; Ebrahimi, T. The JPEG2000 still image coding system: An overview. IEEE Trans. Consum. Electron 2000, 46, 1103–1127, doi:10.1109/30.920468.
[28]
Engel, D; Stütz, T; Uhl, A. A survey on JPEG2000 encryption. Multimedia Syst 2009, 15, 243–270, doi:10.1007/s00530-008-0150-0.
[29]
Wang, H; Peng, D; Wang, W; Sharif, H. Optimal Rate-based Image Transmissions Via Multiple Paths in Wireless Sensor Network. Proceedings of the IEEE Conference Multimedia and Expo, Beijing, China, 2–5 July 2007; pp. 2146–2149.
Bandyopadhyay, S; Coyle, EJ. An Energy-efficient Hierarchical Clustering Algorithm for Wireless Sensor Networks. Proceedings of the IEEE INFOCOM, San Francisco, CA, USA, 30 March–3 April 2003; pp. 1713–1723.
[32]
Abbasi, AA; Younis, M. A Survey on clustering algorithms for wireless sensor networks. Comput. Comm 2007, 30, 2826–2841, doi:10.1016/j.comcom.2007.05.024.
[33]
Wu, H; Abouzeid, A. Energy-efficient distributed image compression in resource-constrained multihop wireless networks. Comput. Comm 2005, 28, 1658–1668, doi:10.1016/j.comcom.2005.02.018.
[34]
Nasri, M; Helali, A; Sghaier, H; Maaref, H. Adaptive Image Transfer for Wireless Sensor Networks (WSNs). Proceedings of the International Conference on Design and Technology of Integrated Systems in Nanoscale, Hammamet, Algeria, 23–25 March 2010; pp. 1–7.
[35]
Wu, H; Abouzeid, AA. Error resilient image transport in wireless sensor networks. Comput. Netw 2006, 50, 2873–2887, doi:10.1016/j.comnet.2005.09.039.
[36]
Biard, L; Noguet, D. Reed solomon codes for low power communication. J. Commun 2008, 3, 13–21.
[37]
Ferrigno, L; Marano, S; Pacielo, V; Pietrosanto, A. Balancing Computational and Transmission Power Consumption in Wireless Image Sensor Networks. Proceedings of the 2005 IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems (VECIMS 2005), Sicily, Italy, 18–20 July 2005; pp. 61–66.
[38]
Politis, I; Tsagkaropoulos, M; Dagiuklas, T; Kotsopoulos, S. Power efficient video multipath transmission over wireless multimedia sensor networks. Mobile Network. Appl 2008, 13, 274–284.
[39]
Liang, YJ; Apostolopoulos, JG; Girod, B. Analyses of Packet Loss for Compressed Video: Does Burst-length Matter? Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, Hong Kong, 6–10 April 2003; pp. 684–687.
[40]
Korhonen, J; Wang, Y. Effect of Packet Size on Loss Rate and Delay in Wireless Links. Proceedings of the 2005 IEEE Wireless Communications and Networks Conference (WCNC 2005), New Orleans, LA, USA, 13–17 March 2005; 3, pp. 1608–1613.
[41]
Turletti, T; Huitema, C. Videoconferencing on the internet. IEEE ACM Trans. Network 1996, 4, 340–351, doi:10.1109/90.502233.
[42]
Heinzelman, WR; Chandrakasan, A; Balakrishman, H. Energy-efficient Communication Protocol for Wireless Microsensor Networks. Proceedings of the 33rd Annual Hawaii International Conference on System Sciences (HICSS-33), Maui, HI, USA, 4–7 January 2000; pp. 1–10.
[43]
Aghdasi, HS; Abbaspour, M; Moghadam, ME; Samei, Y. An energy-efficient and high-quality video transmission architecture in wireless video-based sensor networks. Sensors 2008, 8, 4529–4559, doi:10.3390/s8084529.
[44]
Chen, M; Leung, VC; Mao, S; Li, M. Cross-layer and Path Priority Scheduling Based Real-time Video Communications over Wireless Sensor Networks. Proceedings of the IEEE Vehicular Technology Conference, Singapore, 11–14 May 2008; pp. 2873–2877.
[45]
Chen, M; Leung, V; Mao, S; Yuan, Y. Directional geographical routing for real-time video communications in wireless sensor networks. Comput. Commun 2007, 30, 3368–3383, doi:10.1016/j.comcom.2007.01.016.
[46]
Mao, S; Lin, S; Panwar, SS; Wang, Y; Celebi, E. Video transport over ad hoc networks: Multistream coding with multipath transport. IEEE J. Sel. Area. Commun 2003, 21, 1721–1737, doi:10.1109/JSAC.2003.815965.
[47]
Gürses, E; Akan, ？. Multimedia communication in wireless sensor networks. Ann. Telecommun 2005, 60, 799–827.
[48]
Misra, S; Reisslein, M; Xue, G. A survey of multimedia streaming in wireless sensor networks. IEEE Commun. Surve. Tutorials 2009, 10, 18–39.
[49]
Zhang, J; Ding, J. Cross-layer Optimization for Video Streaming over Wireless Multimedia Sensor Networks. International Conference on Computer Application and System Modeling, Taiyuan, 22–24 October 2010; pp. 295–298.
[50]
Costa, DG; Guedes, LA. Coverage-aware Node-disjoint Multipath Selection in Wireless Multimedia Sensor Networks. Proceedings of the 4th IFIP International Conference on New Technologies, Mobility and Security (NTMS), Paris, France, 7–10 February 2011; pp. 1–5.
[51]
Chilamkurti, N; Zeadally, S; Soni, R; Giambene, G. Wireless multimedia delivery over 802.11e with cross-layer optimization techniques. Multimed. Tools Appl 2010, 47, 189–2051, doi:10.1007/s11042-009-0413-6.
[52]
Lin, C-H; Shieh, C-K; Ke, CH; Chilamkurti, N. An adaptive cross-layer mapping algorithm for MPEG-4 video transmission over IEEE 802.11e WLAN. Telecommun. Syst 2009, 42, 223–234, doi:10.1007/s11235-009-9182-9.
[53]
Licrandro, F; Lombardo, A; Schembra, G. Multipath routing and rate-controlled video encoding in wireless multimedia sensor networks. Multimed. Syst 2008, 14, 155–165, doi:10.1007/s00530-008-0121-5.
[54]
Goyal, VK. Multiple description coding: Compression meets the network. IEEE Signal Process. Mag 2001, 18, 74–93, doi:10.1109/79.952806.
[55]
Wang, Y; Reibman, AR; Lin, S. Multiple description coding for video delivery. Proc. IEEE 2005, 93, 57–70, doi:10.1109/JPROC.2004.839618.
[56]
Shu, L; Zhou, ZB; Hauswirth, M; Phuoc, DL; Yu, P; Zhang, L. Transmitting Streaming Data in Wireless Multimedia Sensor Networks with Holes. Proceedings of the 6th International Conference on Mobile and Ubiquitous Multimedia (MUM’07), Oulu, Finland, 12–14 December 2007; pp. 24–33.
[57]
Shu, L; Zhang, Y; Yu, Z; Yang, LT; Hauswirth, M; Xiong, N. Context-aware cross-layer optimized video streaming in wireless multimedia sensor networks. J. Supercomput 2010, 54, 94–121, doi:10.1007/s11227-009-0321-6.
[58]
Qaisar, S; Radha, H. Multipath Multi-stream Distributed Reliable Video Delivery in Wireless Sensor Networks. Proceedings of the 43rd Annual Conference on Information Sciences and Systems (CISS 2009), Baltimore, MD, USA, 18–20 March 2009; pp. 207–212.
[59]
Li, S; Neelisetti, R; Liu, C; Lim, A. Delay-constrained High Throughput Protocol for Multi-path Transmission over Wireless Multimedia Sensor Networks. Proceedings of the International Symposium on a World of Wireless, Mobile and Multimedia Networks, Newport Beach, CA, USA, 23–26 June 2008; pp. 1–8.
[60]
Intanagonwiwat, C; Giovidan, R; Estrin, D. Direct Diffusion: A Scalable and Robust Communication Paradigm for Sensor Networks. Proceedings of the International Conference on Mobile Computing and Networking, Boston, MA, USA, 6–11 August 2000; pp. 1–12.
[61]
Girod, B; Aaron, AM; Rane, S; Rebollo-Monedero, D. Distributed video Coding. Proc. IEEE 2005, 93, 71–83, doi:10.1109/JPROC.2004.839619.
[62]
Halloush, R; Misra, K; Radha, H. Practical Distributed Video Coding over Visual Sensors. Proceedings of the Picture Coding Symposium (PCS 2009), Chicago, IL, USA, 6–8 May 2009; pp. 1–4.
[63]
Ye, S; Ouaret, M; Dufaux, F; Ansorge, M; Ebrahimi, T. Error Resiliency of Distributed Video Coding in Wireless Video Communication. Proceedings of the SPIE Optics and Photonics, San Diego, CA, USA, 11–14 August 2008; pp. 1–11.
[64]
Xue, Z; Loo, KK; Cosmas, J; Yip, PY. Distributed video coding in wireless multimedia sensor networks for multimedia broadcasting. WSEAS Trans. Commun 2008, 7, 418–427.
[65]
Liang, L; Salama, P; Delp, EJ. Unequal error protection techniques based on Wyner-ziv coding. J Image Video Process 2009, 1–13.
[66]
Kim, CK; Suh, DY. A Cross-layer-based Rate Control Method for Distributed Video Coding. Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Victoria, Canada, 23–26 August 2009; pp. 867–870.
[67]
Shu, L; Zhang, Y; Zhou, Z; Hauswirth, M; Yu, Z; Hynes, G. Transmitting and gathering streaming data in wireless multimedia sensor networks within expected Network Lifetime. Mobile Network. Appl 2008, 13, 306–322.
[68]
Campelli, L; Akyildiz, IF; Fratta, L; Cesana, M. A Cross-layer Solution for Ultrawideband Based Wireless Video Sensor Networks. Proceedings of the IEEE Global Telecommunications Conference, New Orleans, LA, USA, 30 November–4 December 2008; pp. 1–6.
[69]
Culurciello, E; Park, JH; Savvides, A. Address-event Video Streaming over Wireless Sensor Networks. Proceedings of the IEEE Symposium on Circuits and Systems, New Orleans, LA, USA, 27–30 May 2007; pp. 849–852.
[70]
Pudlewski, S; Melodia, T. On the Performance of Compressive Video Streaming for Wireless Multimedia Sensor Networks. Proceedings of the IEEE Ad-hoc, Sensor and Mesh Networking Symposium, Cape Town, South Africa, 23–27 May 2010; pp. 1–5.
[71]
Dam, T; Langendoen, K. An Adaptive Energy Efficient MAC Protocol for Wireless Sensor Networks. Proceedings of the International Conference on Embedded Networked Sensor Systems, Los Angeles, USA, 5–7 November 2003; pp. 171–180.
[72]
Aghdasi, HS; Abbaspour, M. ET-MAC: An Energy-efficient and High Throughput MAC Protocol for Wireless Sensor Networks. Proceedings of the Communication Networks and Services Research Conference, Halifax, Canada, 5–8 May 2008; pp. 526–532.
[73]
Andreopoulos, Y; Mastronarde, N; Schaar, M. Cross-layer optimized video streaming over wireless multi-hop mesh networks. IEEE J. Sel. Area. Commun 2006, 24, 2104–2115, doi:10.1109/JSAC.2006.881614.
[74]
Schaar, M; Turaga, DS. Cross-layer packetization and retransmission strategies for delay-sensitive wireless multimedia transmission. IEEE Trans. Multimed 2007, 9, 185–197, doi:10.1109/TMM.2006.886384.
[75]
Wang, W; Peng, D; Wang, H; Sharif, H. Adaptive image transmission with p-v diversity in multihop wireless mesh networks. Int. J. Electr. Comput. Syst. Eng 2007, 1, 1–8.
[76]
Kulkarni, P; Ganesan, D; Shenoy, P; Lu, Q. SensEye: A Multi-Tier Camera Sensor Network. Proceedings of the 13th ACM International Conference on Multimedia, Singapore, 6–11 November 2005; pp. 229–238.
[77]
Kulkarni, P; Ganesan, D; Shenoy, P. The Case of Multi-Tier Camera Sensor Networks. Proceedings of the International Workshop on Network and Operating Systems Support for Digital Audio and Video, Stevenson, AL, USA, 13–14 June 2005; pp. 141–146.
[78]
Mittal, A; Davis, L. Visibility Analysis and Sensor Planning in Dynamic Environments. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic, 11–14 May 2004; pp. 175–189.
[79]
Tarabanis, K; Allen, P; Tsai, R. A Survey of sensor planning in computer vision. IEEE Trans. Rob. Autom 1995, 11, 86–104, doi:10.1109/70.345940.
