Professional Documents
Culture Documents
Abstract
Radio frequency (RF) energy transfer and harvesting techniques have recently become alternative methods to
overcome the barriers that prevent the real-world wireless device deployment. For the next-generation wireless
networks, they can be key techniques. In this study, we develop a novel energy-harvesting scheme for the
cognitive radio (CR) network system. Using the sequential game model, data transmission and energy harvesting in
each device are dynamically scheduled. Our approach can capture the wireless channel state while considering
multiple device interactions. In a distributed manner, individual devices adaptively adjust their decisions based on
the current system information while maximizing their payoffs. When the channel selection collision occurs, our
sequential bargaining process coordinates this problem to optimize a social fairness. Finally, we have conducted
extensive simulations. The results demonstrate that the proposed scheme achieves an excellent performance for
the energy efficiency and spectrum utilization. The main contribution of our work lies in the fact that we shed
some new light on the trade-off between individual wireless devices and CR network system.
Keywords: Energy harvesting, Radio frequency, Cognitive radio network, Game theory, Sequential bargaining
solution
© The Author(s). 2017 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0
International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and
reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to
the Creative Commons license, and indicate if changes were made.
Kim EURASIP Journal on Wireless Communications and Networking (2017) 2017:16 Page 2 of 9
data on an idle channel, but also harvest RF energy from view, our approach can be implemented with reasonable
PUs’ transmission on a busy channel [7–9]. complexity.
Powering a cognitive radio network with RF energy The major contributions of our proposed scheme are
(CRN-RF) system can provide a spectrum-energy efficient (i) the adjustable dynamics considering the current
solution for wireless communications. In the CRN-RF CRN-RF system environments, (ii) the ability to strike
system, the dual use of RF signals for delivering energy as an appropriate trade-off in harvesting energy and trans-
well as for transporting information has been advocated. ferring data, (iii) practical approach to effectively reach a
Therefore, wireless devices must not only identify desirable solution, (iv) dynamic interactive process in a
spectrum holes for opportunistic data transmission but distributed fashion, and (v) the ability to maximize the
also search for occupied spectrum band to harvest RF en- total system performance by incorporating the social
ergy. Such RF signals could be from nearby non-battery fairness. In the proposed scheme, we can effectively
powered base stations or access points. The RF signal can address the energy-harvesting problem by using the
be converted into DC electricity, and it can be stored in a practical sequential game model while better capturing
battery for the information processing and data transmis- the reality of wireless communications; it has never been
sion. This approach can offer a low-cost option for sus- studied in the previous literatures.
tainable operations of wireless systems without hardware
modification on the transmitter side. However, due to the 1.1 Related work
specific nature of CRN-RF, traditional CRN protocols may Over the years, extensive research on efficient data
not be directly applied. In addition, the amount of trans- transmission and RF energy harvesting has been car-
mitted information and transferred energy cannot be gen- ried out. Niyato et al. [11] presented an overview of
erally maximized at the same time. Therefore, the main the different energy-harvesting technologies and the
challenge in CRN-RF system is to strike a well-balanced energy-saving mechanisms for wireless sensor net-
trade-off between data transmission and RF energy works. By using the energy-harvesting technology, the
harvesting [6, 7]. issues on energy efficiency for sensor networks were
Usually, all network agents in the CRN-RF system are intensively discussed. Finally, they showed an optimal
assumed to work together in a coordinated manner. energy management policy for a solar-powered sensor
However, in practice, network devices are always selfish node that used a sleep and wakeup strategy for energy
individuals that will not contribute their work without conservation [11].
getting paid. This situation can be seen a game theory In [12], authors investigated energy-effient uplink power
paradigm. Game theory is a decision-making process control and subchannel allocation algorithms for two-tier
between independent decision-making players as they at- femtocell networks. Based on the supermodular game
tempt to reach a joint decision that is acceptable to all model, they addressed the power control and subchannel
participants. In the game theory, a solution concept is a allocation problem while maximizing energy effiency of
rule that defines what it means for a decision vector to femtocell users. To reduce costs and complexity, the
be acceptable to all players in the light of the conflict- resource allocation problem was decomposed into two
cooperation environment. Nowadays, many applications subproblems, that is, a distributed subchannel allocation
of the game theory are related to a wider range of wire- scheme and a distributed power control scheme [12].
less communications and network managements [10]. Zhang et al. [13] investigated the joint uplink subchannel
Motivated by the above discussion, we propose a new and power allocation problem in cognitive small cells. By
energy-harvesting scheme for CRN-RF systems. To using the cooperative Nash bargaining theory, their ap-
develop a practical control mechanism, we adopt a game proach mitigated the cross-tier interference, minimized the
theory model to design the interactive relationship outage probability, and ensured the fairness in terms of
among the system agents. Under the real-world CRN-RF minimum rate requirement. Based on the Lagrangian dual
environments, the system agents are mutually dependent decomposition by introducing time-sharing variables and
on each other to maximize their payoffs. In the proposed the Lambert-W function, the near optimal cooperative
scheme, system agents dynamically adjust their control bargaining resource allocation strategy was derived. Finally,
decisions while responding individually to the current the existence, uniqueness, and fairness of their solution
system situations in order to maximize their payoffs. were proved [13].
This interactive procedure imitating the sequential game In [14], authors proposed a distributed power control
process is practical and suitable for real-world CRN-RF scheme for the uplink transmission of spectrum-sharing
implementation. In addition, we consider the social femtocell networks. According to a fictitious game model,
fairness issue among network devices. Therefore, the each network user announced a price that reflected its
channel spectrum is shared adaptively according to the sensitivity to the current interference level and adjusted
sequential bargaining mechanism. In realistic point of its power to maximize its utility. The convergence to a
Kim EURASIP Journal on Wireless Communications and Networking (2017) 2017:16 Page 3 of 9
unique optimal equilibrium was proved. Furthermore, performance of our proposed scheme with the existing
simple macrocell link protection and power optimization schemes in [8, 16] through extensive simulation. The
schemes were developed for the effective resource alloca- analysis is given in Section III.
tion in spectrum-sharing two-tier networks [14]. The rest of this paper is organized as follows. In Section
Authors in [15] investigated the uplink resource alloca- II, we familiarize the reader with the basics of energy-
tion problem of femtocells in co-channel deployment with harvesting game model and explain in detail the developed
macrocells. They modeled the uplink power and subchan- CRN-RF scheme based on the sequential game procedure.
nel allocation in femtocells as a non-cooperative game. We present experimental results in Section III and compare
Based on this game model, they devised a semi-distributed the performance to other existing schemes [8, 16]. Finally,
algorithm for each femtocell to first assign subchannels to we give our conclusion and future work in Section IV.
femto users and then allocated power to subchannels. Fi-
nally, they showed that their interference-aware femtocell 2 Cognitive radio network energy-harvesting
uplink resource allocation algorithm was able to provide algorithm
improved capacities for not only femtocells but also the In this section, we present an energy-harvesting game
macrocell in the two-tier network [15]. All the earlier work model for the CRN-RF system. Our game model employs
in [11–15] addressed the state-of-the-art research issue. a repeated interactive procedure while considering current
However, the work in [11] provided an overview about the system conditions. And then, we explain in detail about
energy-harvesting technology, and others [12–15] strongly the proposed algorithm in the nine-step procedures.
focused on the power control problem while considering
optimal solutions. Due to the model complexity, optimal 2.1 Energy-harvesting game model
solution approaches are impractical to be implemented for To model an energy-harvesting game for the CRN-RF sys-
realistic system operations. tem, it is assumed that a cognitive radio network with
The optimized node classification and channel pairing multiple PUs and SUs; PUs are licensed and non-battery-
(ONCCP) scheme [16] merged the cognitive radio and powered network agents, and SUs are unlicensed network
RF energy-harvesting technologies together to achieve devices operating by batteries. For each PU, a non-
network-wide spectral and energy efficiency. A novel overlapping spectrum channel is allocated individually,
two-level node-classification algorithm was introduced and a channel can be free or occupied by the PU for data
to select the best wireless nodes for reporting process. transmission. SUs have the RF energy-harvesting capabil-
At first level, the nodes were classified as harvesting or ity and perform the channel access by selecting one of
transmitting nodes based on their residual energy. In the them. If the selected channel is busy, the SU can harvest
second level, only those nodes could perform reporting, RF energy; the harvested energy is stored in the SU’s bat-
which acquired better quality channels that could trans- tery. Otherwise, the SU can transmit his data packets [8].
mit reporting-packet within the designated data slots. By Simply, we consider a CRN-RF system composed one
employing two-level classification, the ONCCP scheme cognitive base station (CBS), m PUs, and n SUs (m < n).
ensured successful reporting probability and achieved Based on the TDMA mechanism, the licensed spectrum
energybalancing [16]. channel consists of sequential frames. In other word,
The opportunistic channel access and energy-harvesting each spectrum channel is divided as multiple frames
(OCAEH) scheme [8] considered a network where the [17]. Frames over time are used for data transmission or
secondary user could perform channel access to transmit RF energy transferring. Under dynamic network environ-
a packet or to harvest RF energy when the selected chan- ments, the PU can use the whole frame for his own data
nel was idle or occupied by the primary user, respectively. transmission or vacates his frames. When a frame is ac-
And then, the optimization formulation was presented tively used for the PU’s data transmission, the RF energy
based on Markov decision process to obtain the channel can be transferred to the SUs through the RF energy
access policy. This formulation did not need the secondary harvesting process. If the frame is vacated, this vacated
user to know the current channel status. However, the frame can be used by a SU. The illustrative structure of
optimization problem required various model parameters channel frames is shown in the Fig. 1.
to obtain the policy. To obviate such a requirement, the In this study, we define a new game model, called
OCAEH scheme applied an online learning algorithm that energy-harvesting game (G), based on the sequential game
could observe the environment and adapted the channel approach. This new game model is originally designed to
access action accordingly without any a prior knowledge harvest the energy for the CRN-RF system. To effectively
about the model parameters [8]. The ONCCP and model strategic CRN-RF situations, we assume that
OCAEH schemes in [8, 16] have attracted a lot of atten- unlicensed network devices, i.e., SUs, are game players.
tion and introduced unique challenges to efficiently han- During the interactive sequential game process, players
dle the CRN-RF system. In this study, we compare the choose their strategy based on the reciprocal relationship.
Kim EURASIP Journal on Wireless Communications and Networking (2017) 2017:16 Page 4 of 9
From the view of individual SUs, the main challenge is to the total number of packets. Let tc be the current time,
effectively transmit his data or to harvest RF energy. and tc + 1 be the beginning time of next time period. If
Therefore, the proposed energy-harvesting game G is de- the device i transmits N ip packets during [tc, tc + 1] time
signed as a symmetric game with the same strategy set for period, the device i’s expected residual energy at the
game players. time tc + 1 (Φi(tc + 1)) can be computed as follows:
Definition 1. The energy-harvesting game ( G ) consti-
tutes three game tuple G ¼ N ; S i;0≤i≤n ; U i;0≤i≤n , where Φi ðt cþ1 Þ ¼ ℜi ðt c Þ−E t Fn ; N ip ð2Þ
(i) N is a set of game players; i ∈ N = {1, …, n} is an where ℜi(tc) is the device i’s residual energy level at time tc.
unlicensed
network device in the CRN-RF system In contrast to the energy consumption, the energy harvest-
(ii)S i ¼ s1i ; …ski …sm
i is a non-empty finite strategy set ing is the process by which energy is derived from external
of the player i∈N ; ski means that the kth PU channel sources and stored in wireless devices. If a PU actively
is selected by the player i for the CRN-RF service transmits his own data during the time period [tc, tc + 1],
(iii)Ui is the utility function to represent the payoff of the RF energy-harvesting rate (ℰH(tc, tc + 1, d)) in SUs is
player i ∈ N. Ui is decided accordingto the set of all given as follows [16, 18];
ðÞ ðÞ ðÞ
players’ strategies: s1 …si … sn → U i : !!
Z t¼t cþ1
Gt Gr
ℰ ðt c ; t cþ1 ; d Þ ¼
H
Γ pt dt
In our game model G , each PUs arbitrarily use their t¼t c ð4π Þ2 d α
channels to transmit their data over time. Therefore,
ð3Þ
SUs can temporally access the PUs’ channels in an op-
portunistic manner. As the data sender or RF energy where Γ is a factor of energy-harvesting efficiency, and
harvester, the major goal of SUs is to jointly optimize pt is the signal transmission power of the PU with RF re-
the data transmission and energy harvesting. If SUs want source. Gt and Gr are the gains of the energy transmitter
to transmit their data, they try to find the vacant PU and receiver, respectively. d is the distance between the
channels. If multiple SUs access a specific vacant chan- RF source and the energy-receiving device, and α is the
nel at the same time, the channel frames are adaptively path-loss exponent.
distributed for each SU to maximize the total CRN-RF Fundamental problem in game theory is determining
system performance. If the PU comes back to use his how players reach their decisions. Usually, players self-
designated channel, SUs should release the momentary- ishly select a strategy that maximizes their own payoff
using channel and try to find other idle channels [6, 8]. through the utility function. To design the utility func-
If SUs want to harvest the energy, they try to find the ac- tion (Ui) of player i, we should define the received bene-
tive data transferring channels of PUs. fit and the incurred cost during the CRN-RF services.
In this study, we assume a practical energy consumption
Let βi;k plit be the data transmission amount that the
and harvesting model for wireless networks. For a packet
player i can achieve over the kth frame in a channel with
transmitted from a transmitter device to a receiver device,
the energy (Et) consumed at the packet transmitter is the power level plit . Using Shannon formula, the player
defined as [18]; i’s time-varying data transmission amount can be
computed as follows:
E t Fn ; N p ¼ ððee Fn Þ þ ðplt ℒ ÞÞ N p ð1Þ
βi;k plit ¼ W k log2 1 þ γ i;k plit ð4Þ
where ee is the energy consumed by the device electron-
ics per bit, and Fn is the bit number of a packet. plt is a where, Wk is the bandwidth of kth frame and γi,k (plit ) is
transmission power level, and ℒ is the bit period. N p is the signal-to-interference-and-noise ratio (SINR) over
Kim EURASIP Journal on Wireless Communications and Networking (2017) 2017:16 Page 5 of 9
the kth frame [16]. The cost is defined as the instantan- channels. In the proposed scheme, V represents the N
eous expense function of consumed energy. Finally, the ð⋅Þ outcomes of the last x time rounds [tc − x, tc − 1] while
player i’s utility function (Ui(⋅)) during [tc, tc + 1] is de- emphasizing the most recent information. By using an
fined as follows; appropriate time-oriented fusion rule, the values in V
are estimated in the timed weighted manner. At time tc,
the V value for the channel l ðVtc ½lÞ is given by;
U i plit ; t c ; t cþ1
8 X n i q o t c−1
X
>
>
< β i;k pl i
t −ξ E t Fn ; N p i;k ; Vtc ½l ¼ ðð1−μÞtc −f Nf ½lÞ ð8Þ
¼ k∈S t c ;t
i cþ1 f ¼t c−x
>
> if data transmission strategy is selected
: H
ℰ ðt c ; t cþ1 ; d Þ; if energy harvesting strategy is selected where μ is a control factor, which can control the weight
ð5Þ for each timed strategies, and Nf ½l is the N½l at the time
f. Based on the V½⋅ information, game players individually
where Sti c ;tcþ1 is the set of frames, which are allocated for decide which PU’s channel is selected to maximize their
the player i during [tc, tc + 1]. plit and E it ð⋅Þ are the power payoffs. To adaptively make these decisions, each player
level and the Et value of the player i, respectively. ξ and has a data queue (ℚ) and battery (E ). ℚ is used to store
q are cost parameters. N pi;k are the total number of the generated data for transmission, and E is a battery to
packets in the kth frame of the player i. store RF energy harvested from radio signal [8]. T and P
0 ≤T ≤ℳ ℚ and 0 ≤P≤ℳ E represent the packet
2.2 Cognitive radio sensing mechanism amount in the ℚ, and energy level of the E, respectively;
Usually, allocated spectrum channels are largely unused in ℳℚ is the maximum size of ℚ and ℳ E is the maximum
any time and location; these are referred to as spectrum capacity of E.
holes. The increased spectrum utilization in CR networks is Based on the V½⋅; T and P values, each player selects
achieved through opportunistically sharing the spectrum his strategy whether to transmit data or to harvest energy.
holes between licensed and unlicensed wireless devices To formulate the player i’s channel selection problem at
[10]. To detect spectrum holes, unlicensed wireless devices the time tc, let ηij ðt c Þ is the player i’s propensity for the j’s
are sensing constantly the allocated spectrum channel.
channel selection. Based on the sophisticated combination
Based on the received signal from the detection, we can
of the remaining energy and data arriving rate, ηij ðt c Þ is
define two hypotheses for the case of the licensed device is
present (H1) or absent (H0). If there are K detection dynamically estimated for each individual player.
samplings, the kth received signal for the channel l X M −1
k T
r l ; i:e:; 1 ≤k≤ K can be written as ηj ð t c Þ ¼
i
ð M−V ½ j Þ ð M−V ½ l Þ
ℳℚ l¼1
8 k E
< h sðk; lÞ þ wðk; lÞ; if H 1 ℳ −P X m −1
r kl ¼ ð6Þ þ V ½ j V ½ l ; ð9Þ
: ℳE l¼1
wðk; lÞ; if H 0
s:t:; M ¼ maxV½l
where hk is the channel gain from the licensed wireless 1≤l≤M
device to the unlicensed wireless device; it is assumed to where m is the total number of PU channels. According
be slow flat fading. (k, l) is the channel l’s signal of the to (9), the channel j’s selection probability (P ij ) from the
licensed wireless device, and (w(k, 1)) is the channel l’s player i at time tc can be captured as follows:
additive white Gaussian noise (AWGN) with mean zero !
and variance σ 2w [19]. In this study, s(k, l) and w(k, 1) are X
m
value, each player tradeoffs to yield the maximum social Step 3: During our iterative dynamic game process,
benefit. Let Q ¼ f1…i…r…g⊆N be the set of players each unlicensed network devices are assumed game
selecting the same channel, the SBS at time tc (SBS(tc)) is players. They sense the spectrum channels and send
∂ðt c Þ ¼ ∂t1c …∂ti c …∂trc where ∂ti c represents the amount the r information to the CBS.
of frames assigned to the player i during [tc, tc + 1]. The Step 4: According to Eqs. (6) and (7), the CBS
SBS(tc) is obtained through the following maximization calculates each channel’s test statistics ðNð⋅ÞÞ using the
problem; time-oriented fusion rule and maintains a look-up
X vector (V) for each channels.
SBSðt c Þ ¼ max ϒ i log2 1 þ U i plit ; t c ; t cþ1 Step 5: In an entirely distributed manner, each game
∂ðt c Þ ¼ f∂ …∂ …∂r g i∈Q
tc tc tc
X
1 i
X player keeps its own control parameters T and P,
s:t:; Υi ¼ 1 and Υi ¼ Ti = Ti which are constantly updated. Based on the V½⋅; T
i∈Q i∈Q
and P values, the propensity of each game player (η(⋅))
ð11Þ for each channel is estimated using Eq. (9).
where Υj is the bargaining power of the player j; the bar- Step 6: According to the η(⋅) values, the channel
gaining power is the relative priority of the player in the selection probability ðP ð⋅ÞÞ is dynamically adjusted at
assignment of frames for the bargaining solution. In the each time period. Based on the P ð⋅Þ, players select the
proposed scheme, the bargaining powers are decided most adaptable spectrum channel to maximize their
according to the players’ T values. If a player has a rela- own payoff.
tively higher data amount in his ℚ, he has a higher Step 7: During the step-by-step iteration, players
bargaining power. Therefore, over the time period, the individually adjust their strategies by using the
players’ T values can be balanced while ensuring social dynamics of repeated game process.
fairness among players. Step 8: When the data collusion occurs in a specific
channel, available spectrum frames are dynamically
distributed based on the SBS process. Using formula
2.3 The main game procedure in our proposed algorithm (11), the bargaining power of each player is adaptively
Opportunistic RF energy harvesting is a promising tech- adjusted by considering the social fairness.
nique to sustain the operation of unlicensed network Step 9: Under the real-world RF-powered CRN
devices in CRN with RF energy systems. In this study, we environments, the game players are mutually
focus on the problem of channel selection problem for dependent on each other to maximize their profits,
dynamic spectrum access in a multi-channel CRN-RF sys- and they constantly are self-monitoring the current
tem. By considering the trade-off between data transmis- system conditions; proceeds to Step 3 for the next
sion and RF energy harvesting, each unlicensed device game iteration.
selects a particular channel to transmit data or harvest RF
energy. When the data collusion occurs in a specific chan- 3 Performance evaluation
nel, available spectrum frames are adaptively distributed In this section, we compare the performance of our scheme
through the sequential bargaining process. with other existing schemes [8, 16] and can confirm the
Usually, optimal solutions have exponential time com- performance superiority of the proposed approach by using
plexity. Therefore, they are impractical in real-time a simulation model. To facilitate the development and
process [21, 22]. In the proposed scheme, we do not focus implementation of our simulator, Table 1 lists the system
on trying to get an optimal solution based on the trad- control parameters.
itional approach. Usually, the traditional optimal algo- Our simulation results are achieved using MATLAB,
rithms have exponential time complexity. However, based which is widely used in academic and research institutions
on the interactive repeated process, our solution concept as well as industrial enterprises. To ensure the model is
only needs polynomial time complexity to capture an sufficiently generic to be valid in a real-world CRN-RF
effective solution. The proposed algorithm is described by system scenario, the assumptions implemented in our
the following major steps and a flow diagram in Fig. 2. simulation model were as follows.
Step 1: At the initial time tc = 1, the channel selection The simulated system is assumed as a TDMA
probability P ðt c Þ in each player is equally distributed. This system with one macro cell.
starting guess guarantees that each licensed spectrum The simulated system consists of one CBS, m
channel is selected randomly at the beginning of the game. number of primary users and n number of
Step 2: Control parameters n, m, ee, ℒ, Γ, Gt, Gr, secondary users for the CRN-RF system.
W, ξ, q and μ are given from the simulation scenario The PUs and SUs are randomly distributed over the
(refer to the Table 1). 500 × 500 m2 cell area.
Kim EURASIP Journal on Wireless Communications and Networking (2017) 2017:16 Page 7 of 9
Competing interests
The author declares that he has no competing interests.
References
1. S. Park, J. Heo, B. Kim, W. Chung, H. Wang, D. Hong, Optimal mode selection
for cognitive radio sensor networks with RF energy harvesting, (IEEE
PIMRC’2012, 2012, Sydney), pp. 2155–2159
2. T.B. Lim, N.M. Lee, B.L. Poh, Feasibility study on ambient RF energy harvesting
for wireless sensor network, (IEEE IMWS-BIO’2013, Singapore, 2013), pp. 1–3
3. I Jang, D Pyeon, S Kim, H Yoon, A survey on communication protocols for
wireless sensor networks. JCSE 7(4), 231–241 (2013)
4. SMK-u-R Raazi, S Lee, A survey on key management strategies for different
applications of wireless sensor networks. JCSE 4(1), 23–51 (2010)
5. E. Khansalee, Y. Zhao, E. Leelarasmee, K. Nuanyai, A dual-band rectifier for RF
energy harvesting systems, (IEEE ECTI-CON’2014, Nakhon Ratchasima, 2014), Submit your manuscript to a
pp. 1–4
6. X Lu, P Wang, D Niyato, DI Kim, H Zhu, Wireless networks with RF journal and benefit from:
energy harvesting: a contemporary survey. IEEE Commun. Surv. Tutorials
17(2), 757–789 (2015) 7 Convenient online submission
7. X Lu, P Wang, D Niyato, E Hossain, Dynamic spectrum access in cognitive radio 7 Rigorous peer review
networks with RF energy harvesting. IEEE Wirel. Commun. 21(3), 102–110 (2014) 7 Immediate publication on acceptance
8. DT Hoang, D Niyato, P Wang, DI Kim, Opportunistic channel access and RF 7 Open access: articles freely available online
energy harvesting in cognitive radio networks. IEEE J. Selected Areas
7 High visibility within the field
Commun. 32(11), 2039–2052 (2014)
9. A. Bhowmick, S.D. Roy, S. Kundu, Performance of secondary user with 7 Retaining the copyright to your article
combined RF and non-RF based energy-harvesting in cognitive radio network,
(IEEE ANTS’2015, Kolkata, 2015), pp. 1–3
Submit your next manuscript at 7 springeropen.com
10. S. Kim, Game theory applications in network design, (IGI Global, Hershey, 2014)