A Transmission Method to Guarantee QoS Parameters in Wireless Sensor Networks

Document Type : Computer Networking-Amin Hosseini

Authors

• Maryam Kordlar ¹
• Gholamhossein Ekbatanifard ²
• Ahad Jahangiry ³
• Ramin Ahmadi ⁴

¹ Tabriz Branch, Islamic Azad University, Tabriz, Iran.

² Lahijan Branch, Islamic Azad University, Lahijan, Guilan, Iran.

³ Qom Branch, Islamic Azad University, Qom, Iran.

⁴ Islamic Azad University Rasht

10.22067/cke.v1i2.62961

Abstract

This study proposes a novel routing algorithm using Q-learning. Q-learning is a machine learning (artificial intelligence) algorithm using the reinforcement learning policy which can be used to solve problems for which there are different ways to reach their goal. The proposed algorithm, the Modified Q-learning routing algorithm (MQRA), has eliminated the episodes of Q-learning required to gradually learn in different stages and this has made it a rapid routing algorithm. MQRA can be used in various types of networks. This study uses MQRA in mobile ad-hoc networks, its generalization to fisheye state routing (FSR) (a routing algorithm) and its performance results are compared with the standard FSR. Experimental results confirm the applicability and potential of the proposed algorithm.

Keywords

• Routing Algorithm
• Mobile ad-hoc Networks
• FSR Protocol
• Reinforcement learning
• Routing in MANETs

---

References

Akyildiz I, Su W, Sankarasubramaniam Y, Cayirci E. Wireless sensor networks: a survey. Computer Networks, 38:393–422, 2002.

[2] Yao-Nan Lien “Hop-by-Hop TCP for Sensor Networks”, International Journal of Computer Networks & Communications (IJCNC), April, Vol.1, No.1, 2009.

[3] Paulo Rogerio Pereira, Antonio Grilo, Francisco Rocha, Mario Serafim Nunes, Augusto Casaca, Claude Chaudet, Peter Almström and Mikael Johansson,” End-To-End Reliability in Wireless Sensor Networks: Survey And Research Challenges” EuroFGI Workshop on IP QoS and Traffic Control, P. Pereira (Ed.) Lisbon, Portugal, December 6-7, 2007

[4] J.-H. Hong, C.-H. Wu, C.-W. Wu “RSA Cryptosystem Based on the Chinese Remainder Theorem”, Proc. of Asia and South Pacific Design Automation Conference (ASP-DAC), Yokohama, Japan, January 2001.

[5] Ganesan, D.; Krishnamachari, B.; Woo, A.; Culler, D.; Estrin, D.; Wicker, S. Complex Behavior at Scale: An Experimental Study of Low-Power Wireless Sensor Networks; Technical report; CS TR 02-0013; UCLA: Los Angeles, CA, USA, 2002.

[6] Zhao, J.; Govindan, R. Understanding Packet Delivery Performance in Dense Wireless Sensor Networks. In Proceedings of ACM International Conference on Embedded Networked Sensor Systems, Los Angeles, CA, USA, November, 2003; pp. 1–13.

[7] Jaewan Seo, Moonseong Kim, In Hur, Wook Choi and Hyunseung Choo “DRDT: Distributed and Reliable Data Transmission with Cooperative Nodes for Lossy Wireless Sensor Networks”, 10, 2793-2811, Sensors 2010.

[8] Ganesan, D.; Krishnamachari, B.; Woo, A.; Culler, D.; Estrin, D.; Wicker, S. Complex Behavior at Scale: An Experimental Study of Low-Power Wireless Sensor Networks; Technical report; CS TR 02-0013; UCLA: Los Angeles, CA, USA, 2002.

[9] Huang, X., Fang, Y.: Multi constrained QoS Multipath Routing in Wireless Sensor Networks. ACM Wireless Networks (WINET), 2007.

[10] Couto, D.S.J.D.; Aguayo, D.; Bicket, J.C.; Morris, R. A High-throughput Path Metric for Multi-hop Wireless Routing. Wirel. Netw. 11, 419–434, 2007.

[11] Emad Felemban, Student Member, Chang-Gun Lee, Member, and Eylem Ekici” MMSPEED: Multipath Multi-SPEED Protocol for QoS Guarantee of Reliability and Timeliness in Wireless Sensor Networks”, IEEE TRANSACTIONS ON MOBILE COMPUTING, JUNE 2006 VOL. 5, NO. 6

[12] Cao, Q.; Abdelzaher, T.F.; He, T.; Kravets, R. Cluster-Based Forwarding for Reliable End-to-End Delivery in Wireless Sensor Networks. In Proceedings of IEEE International Conference on Computer Communications, Anchorage, AK, USA, May, pp. 1928–1936, 2007.

[13] C. Kang, X. Shangkon, Sh. Jinglun and W. Gang “An Energy-efficient Multiple Paths Routing Algorithm for Wireless Sensor Networks", IEEE, ICCS, 2008.

[14] S. Madden, M. J. Franklin, J. M. Hellerstein, and W. Hong, “Tag: a tiny aggregation service for ad-hoc sensor networks,” SIGOPS Oper. Syst. Rev, vol. 36, no. SI, pp. 131 146, 2002.

[15] Yuhua Liu and Hao Huang Kaihua Xu “Multi-path-based Distributed TCP Caching for Wireless Sensor Networks”, IEEE DOI, 2007.

[16] Dae-Young Kim and Jinsung Cho” Active Caching: A Transmission Method to Guarantee Desired Communication Reliability in Wireless Sensor Networks”, IEEE COMMUNICATIONS LETTERS, JUNE, VOL. 13, NO. 6, 2009.

[17] G. Campobello, A. Leonardi, S. Palazzo “On the Use of Chinese Remainder Theorem for Energy Saving in Wireless Sensor Networks.” Proc. of IEEE International Conference on Communications (ICC 2008), Beijing, China, May 2008.

[18] Ali Ghaffari, Maryam Kordlar, Vida Aghakhanloyetakanloo, “Energy-efficient multipath data forwarding in wireless sensor network”, Australian Journal of Basic and Applied Sciences, 5(8): 523-529, ISSN 1991-8178, 2011.

[19] M. R. Ebenezar Jebarani1and T. Jayanthy,” An Analysis of Various Parameters in Wireless Sensor Networks Using Adaptive FEC Technique”, International Journal of Ad hoc, Sensor & Ubiquitous Computing (IJASUC), September, Vol.1, No.3, 2010.

[20] Levente Buttyan, Ant´onio M. Grilo “A Secure Distributed Transport Protocol for Wireless Sensor Networks”, Australian Journal of Basic and Applied Sciences, 5(8): 523-529, 2011.

[21] Ye Ming Luz and Vincent W. S. Wong, “An energy-efficient multipath routing protocol for wireless sensor networks”, International Journal of Communication Sytems, 20:747–766, 2007.

[22] R Vidhyapriya, Dr P T Vanathi, “Energy Efficient Adaptive Multipath Routing for Wireless Sensor Networks”, IAENG International Journal of Computer Science, 34:1, IJCS_34_1_8, 2006.