Loading…

Application of reinforcement learning to wireless sensor networks: models and algorithms

Wireless sensor network (WSN) consists of a large number of sensors and sink nodes which are used to monitor events or environmental parameters, such as movement, temperature, humidity, etc. Reinforcement learning (RL) has been applied in a wide range of schemes in WSNs, such as cooperative communic...

Full description

Saved in:
Bibliographic Details
Published in:Computing 2015-11, Vol.97 (11), p.1045-1075
Main Authors: Yau, Kok-Lim Alvin, Goh, Hock Guan, Chieng, David, Kwong, Kae Hsiang
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483
cites cdi_FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483
container_end_page 1075
container_issue 11
container_start_page 1045
container_title Computing
container_volume 97
creator Yau, Kok-Lim Alvin
Goh, Hock Guan
Chieng, David
Kwong, Kae Hsiang
description Wireless sensor network (WSN) consists of a large number of sensors and sink nodes which are used to monitor events or environmental parameters, such as movement, temperature, humidity, etc. Reinforcement learning (RL) has been applied in a wide range of schemes in WSNs, such as cooperative communication, routing and rate control, so that the sensors and sink nodes are able to observe and carry out optimal actions on their respective operating environment for network and application performance enhancements. This article provides an extensive review on the application of RL to WSNs. This covers many components and features of RL, such as state, action and reward. This article presents how most schemes in WSNs have been approached using the traditional and enhanced RL models and algorithms. It also presents performance enhancements brought about by the RL algorithms, and open issues associated with the application of RL in WSNs. This article aims to establish a foundation in order to spark new research interests in this area. Our discussion has been presented in a tutorial manner so that it is comprehensive and applicable to readers outside the specialty of both RL and WSNs.
doi_str_mv 10.1007/s00607-014-0438-1
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1762093000</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3808852131</sourcerecordid><originalsourceid>FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483</originalsourceid><addsrcrecordid>eNp1kE1r3DAQhkVJIZs0PyA3QS69uBlJY1vubQn9CAR6aWFvQrFHW29saaPxEvrvo7A9hEBOc3nel3ceIS4VfFEA7TUDNNBWoLACNLZSH8RKoWmqGur2RKwAFFRo682pOGPeAYA2tluJzXq_n8beL2OKMgWZaYwh5Z5mioucyOc4xq1cknwaM03ELJkipywjLU8pP_BXOaeBJpY-DtJP25TH5e_Mn8TH4Cemi__3XPz5_u33zc_q7teP25v1XdUb7JaKaoS6xqa3SunGaoODJquJOjN03X1jMQw2WNRYY2i99iE02CCacG9Mh9aci8_H3n1Ojwfixc0j9zRNPlI6sFNto6Ez5eGCXr1Bd-mQY1lXKKVbjYUrlDpSfU7MmYLb53H2-Z9T4F5cu6NrV1y7F9dOlYw-ZriwcUv5VfO7oWehSYDu</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1712724930</pqid></control><display><type>article</type><title>Application of reinforcement learning to wireless sensor networks: models and algorithms</title><source>ABI/INFORM Collection</source><source>Springer Link</source><source>BSC - Ebsco (Business Source Ultimate)</source><creator>Yau, Kok-Lim Alvin ; Goh, Hock Guan ; Chieng, David ; Kwong, Kae Hsiang</creator><creatorcontrib>Yau, Kok-Lim Alvin ; Goh, Hock Guan ; Chieng, David ; Kwong, Kae Hsiang</creatorcontrib><description>Wireless sensor network (WSN) consists of a large number of sensors and sink nodes which are used to monitor events or environmental parameters, such as movement, temperature, humidity, etc. Reinforcement learning (RL) has been applied in a wide range of schemes in WSNs, such as cooperative communication, routing and rate control, so that the sensors and sink nodes are able to observe and carry out optimal actions on their respective operating environment for network and application performance enhancements. This article provides an extensive review on the application of RL to WSNs. This covers many components and features of RL, such as state, action and reward. This article presents how most schemes in WSNs have been approached using the traditional and enhanced RL models and algorithms. It also presents performance enhancements brought about by the RL algorithms, and open issues associated with the application of RL in WSNs. This article aims to establish a foundation in order to spark new research interests in this area. Our discussion has been presented in a tutorial manner so that it is comprehensive and applicable to readers outside the specialty of both RL and WSNs.</description><identifier>ISSN: 0010-485X</identifier><identifier>EISSN: 1436-5057</identifier><identifier>DOI: 10.1007/s00607-014-0438-1</identifier><language>eng</language><publisher>Vienna: Springer Vienna</publisher><subject>Algorithms ; Artificial Intelligence ; Communication ; Communications networks ; Computer Appl. in Administrative Data Processing ; Computer Communication Networks ; Computer Science ; Decision making ; Distance learning ; Energy consumption ; Humidity ; Information Systems Applications (incl.Internet) ; Learning ; Performance enhancement ; Reinforcement ; Remote sensors ; Sensors ; Software Engineering ; Studies ; Wireless networks</subject><ispartof>Computing, 2015-11, Vol.97 (11), p.1045-1075</ispartof><rights>Springer-Verlag Wien 2014</rights><rights>Springer-Verlag Wien 2015</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483</citedby><cites>FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/1712724930/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/1712724930?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>315,786,790,11715,27957,27958,36095,36096,44398,75252</link.rule.ids></links><search><creatorcontrib>Yau, Kok-Lim Alvin</creatorcontrib><creatorcontrib>Goh, Hock Guan</creatorcontrib><creatorcontrib>Chieng, David</creatorcontrib><creatorcontrib>Kwong, Kae Hsiang</creatorcontrib><title>Application of reinforcement learning to wireless sensor networks: models and algorithms</title><title>Computing</title><addtitle>Computing</addtitle><description>Wireless sensor network (WSN) consists of a large number of sensors and sink nodes which are used to monitor events or environmental parameters, such as movement, temperature, humidity, etc. Reinforcement learning (RL) has been applied in a wide range of schemes in WSNs, such as cooperative communication, routing and rate control, so that the sensors and sink nodes are able to observe and carry out optimal actions on their respective operating environment for network and application performance enhancements. This article provides an extensive review on the application of RL to WSNs. This covers many components and features of RL, such as state, action and reward. This article presents how most schemes in WSNs have been approached using the traditional and enhanced RL models and algorithms. It also presents performance enhancements brought about by the RL algorithms, and open issues associated with the application of RL in WSNs. This article aims to establish a foundation in order to spark new research interests in this area. Our discussion has been presented in a tutorial manner so that it is comprehensive and applicable to readers outside the specialty of both RL and WSNs.</description><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>Communication</subject><subject>Communications networks</subject><subject>Computer Appl. in Administrative Data Processing</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Decision making</subject><subject>Distance learning</subject><subject>Energy consumption</subject><subject>Humidity</subject><subject>Information Systems Applications (incl.Internet)</subject><subject>Learning</subject><subject>Performance enhancement</subject><subject>Reinforcement</subject><subject>Remote sensors</subject><subject>Sensors</subject><subject>Software Engineering</subject><subject>Studies</subject><subject>Wireless networks</subject><issn>0010-485X</issn><issn>1436-5057</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>M0C</sourceid><recordid>eNp1kE1r3DAQhkVJIZs0PyA3QS69uBlJY1vubQn9CAR6aWFvQrFHW29saaPxEvrvo7A9hEBOc3nel3ceIS4VfFEA7TUDNNBWoLACNLZSH8RKoWmqGur2RKwAFFRo682pOGPeAYA2tluJzXq_n8beL2OKMgWZaYwh5Z5mioucyOc4xq1cknwaM03ELJkipywjLU8pP_BXOaeBJpY-DtJP25TH5e_Mn8TH4Cemi__3XPz5_u33zc_q7teP25v1XdUb7JaKaoS6xqa3SunGaoODJquJOjN03X1jMQw2WNRYY2i99iE02CCacG9Mh9aci8_H3n1Ojwfixc0j9zRNPlI6sFNto6Ez5eGCXr1Bd-mQY1lXKKVbjYUrlDpSfU7MmYLb53H2-Z9T4F5cu6NrV1y7F9dOlYw-ZriwcUv5VfO7oWehSYDu</recordid><startdate>20151101</startdate><enddate>20151101</enddate><creator>Yau, Kok-Lim Alvin</creator><creator>Goh, Hock Guan</creator><creator>Chieng, David</creator><creator>Kwong, Kae Hsiang</creator><general>Springer Vienna</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>0U~</scope><scope>1-H</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L.0</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20151101</creationdate><title>Application of reinforcement learning to wireless sensor networks: models and algorithms</title><author>Yau, Kok-Lim Alvin ; Goh, Hock Guan ; Chieng, David ; Kwong, Kae Hsiang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>Communication</topic><topic>Communications networks</topic><topic>Computer Appl. in Administrative Data Processing</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Decision making</topic><topic>Distance learning</topic><topic>Energy consumption</topic><topic>Humidity</topic><topic>Information Systems Applications (incl.Internet)</topic><topic>Learning</topic><topic>Performance enhancement</topic><topic>Reinforcement</topic><topic>Remote sensors</topic><topic>Sensors</topic><topic>Software Engineering</topic><topic>Studies</topic><topic>Wireless networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yau, Kok-Lim Alvin</creatorcontrib><creatorcontrib>Goh, Hock Guan</creatorcontrib><creatorcontrib>Chieng, David</creatorcontrib><creatorcontrib>Kwong, Kae Hsiang</creatorcontrib><collection>CrossRef</collection><collection>Global News &amp; ABI/Inform Professional</collection><collection>Trade PRO</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Database‎ (1962 - current)</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ABI/INFORM Professional Standard</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Collection</collection><collection>Computing Database</collection><collection>ProQuest research library</collection><collection>Research Library (Corporate)</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>One Business (ProQuest)</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Computing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yau, Kok-Lim Alvin</au><au>Goh, Hock Guan</au><au>Chieng, David</au><au>Kwong, Kae Hsiang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Application of reinforcement learning to wireless sensor networks: models and algorithms</atitle><jtitle>Computing</jtitle><stitle>Computing</stitle><date>2015-11-01</date><risdate>2015</risdate><volume>97</volume><issue>11</issue><spage>1045</spage><epage>1075</epage><pages>1045-1075</pages><issn>0010-485X</issn><eissn>1436-5057</eissn><notes>ObjectType-Article-1</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-2</notes><notes>content type line 23</notes><abstract>Wireless sensor network (WSN) consists of a large number of sensors and sink nodes which are used to monitor events or environmental parameters, such as movement, temperature, humidity, etc. Reinforcement learning (RL) has been applied in a wide range of schemes in WSNs, such as cooperative communication, routing and rate control, so that the sensors and sink nodes are able to observe and carry out optimal actions on their respective operating environment for network and application performance enhancements. This article provides an extensive review on the application of RL to WSNs. This covers many components and features of RL, such as state, action and reward. This article presents how most schemes in WSNs have been approached using the traditional and enhanced RL models and algorithms. It also presents performance enhancements brought about by the RL algorithms, and open issues associated with the application of RL in WSNs. This article aims to establish a foundation in order to spark new research interests in this area. Our discussion has been presented in a tutorial manner so that it is comprehensive and applicable to readers outside the specialty of both RL and WSNs.</abstract><cop>Vienna</cop><pub>Springer Vienna</pub><doi>10.1007/s00607-014-0438-1</doi><tpages>31</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0010-485X
ispartof Computing, 2015-11, Vol.97 (11), p.1045-1075
issn 0010-485X
1436-5057
language eng
recordid cdi_proquest_miscellaneous_1762093000
source ABI/INFORM Collection; Springer Link; BSC - Ebsco (Business Source Ultimate)
subjects Algorithms
Artificial Intelligence
Communication
Communications networks
Computer Appl. in Administrative Data Processing
Computer Communication Networks
Computer Science
Decision making
Distance learning
Energy consumption
Humidity
Information Systems Applications (incl.Internet)
Learning
Performance enhancement
Reinforcement
Remote sensors
Sensors
Software Engineering
Studies
Wireless networks
title Application of reinforcement learning to wireless sensor networks: models and algorithms
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T02%3A23%3A59IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Application%20of%20reinforcement%20learning%20to%20wireless%20sensor%20networks:%20models%20and%20algorithms&rft.jtitle=Computing&rft.au=Yau,%20Kok-Lim%20Alvin&rft.date=2015-11-01&rft.volume=97&rft.issue=11&rft.spage=1045&rft.epage=1075&rft.pages=1045-1075&rft.issn=0010-485X&rft.eissn=1436-5057&rft_id=info:doi/10.1007/s00607-014-0438-1&rft_dat=%3Cproquest_cross%3E3808852131%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c349t-e5405546c811268234d2e82ee93d99b684fd8f842454f7a2aff646443fb339483%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1712724930&rft_id=info:pmid/&rfr_iscdi=true