Machine

Learning for
Communica-
tions

Irfan Ahmed,
Joint Machine Learning based Resource
Hedi
Khammari Allocation and Hybrid Beamforming Design for
Outline Massive MIMO Systems
Introduction

System Model

Joint Irfan Ahmed, Hedi Khammari

ML-based
RRM and
Hybrid
Beamforming
Higher Colleges of Technology, UAE
Design Taif University, Saudi Arabia
iahmed3@hct.ac.ae
Simulation
Results and
Comparisons
December 13, 2018

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Machine
Learning for
Communica-
tions

Irfan Ahmed,
1 Outline
Hedi
Khammari

Outline
2 Introduction
Introduction

System Model 3 System Model

Joint
ML-based
RRM and
Hybrid 4 Joint ML-based RRM and Hybrid Beamforming Design
Beamforming
Design

Simulation
Results and
5 Simulation Results and Comparisons
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Advent of 5G

Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi
Khammari

Outline
Ultra high throughput and low latency (X1000)
Introduction
mmWave band in 5G
System Model

Joint massive MIMO systems

ML-based
RRM and
Hybrid
Beamforming
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Challenges with new PHY technologies

Machine
Learning for
Communica-
tions

Irfan Ahmed, 1 MmWave communication

Hedi
Khammari Quasi-LOS
High absorption and low penetration
Outline

Introduction
2 Massive MIMO
System Model It compensates the MmWave problems
Joint Suffers from high power consumptions in RF chain
ML-based
RRM and
Hybrid beamforming
Hybrid
Beamforming
3 Complexity of Radio Resource Management
Design
Number of optimization variables
Simulation
Results and
Execution time
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 System Model

Machine
Learning for
Communica-
tions

Irfan Ahmed,
We consider a multi-carrier MU-MIMO downlink system.
Hedi
Khammari Single base-station (BS) with Nt antennas.
Outline K number of single antenna users as shown in figure.
Introduction

System Model User1

Mixer
Joint
ML-based Machine 
IFFT P/S DAC × 
RRM and Learning 
NS Digital  Nt
Scheduling  Analog  K
Hybrid to select K  K
Precoder NRF
Data  FDB Precoder FAB
Beamforming MU‐MIMO 
streams
Design users

Simulation
IFFT P/S DAC × 
User K
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Channel Model

Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi Due to the high free-space pathloss characteristic at
Khammari
mmWave frequencies, mmWave propagation leads to
Outline limited spatial scattering.
Introduction
Extended Saleh-Valenzuela model accurately captures the
System Model
mathematical structure present in mmWave channels.
Joint
ML-based s
RRM and L
Nt Nr X
αl at (φt,l )aH
Hybrid
Beamforming H= r (φr ,l ), (1)
Design ρL
l=0
Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Objective

Machine
Learning for
Communica-
tions

Irfan Ahmed, Objective: maximize the sum throughput constraint to given

Hedi
Khammari number of RF chains (rank of the precoding matrix) and the
Outline
total transmit power in a multi-carrier multi-user massive
Introduction
MIMO downlink.
System Model maximize the sum throughput
Joint
ML-based
RRM and
Hybrid
Beamforming
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Objective

Machine
Learning for
Communica-
tions

Irfan Ahmed, Objective: maximize the sum throughput constraint to given

Hedi
Khammari number of RF chains (rank of the precoding matrix) and the
Outline
total transmit power in a multi-carrier multi-user massive
Introduction
MIMO downlink.
System Model maximize the sum throughput
Joint
ML-based
constraint to given number of RF chains (rank of the
RRM and
Hybrid
precoding matrix)
Beamforming
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Objective

Machine
Learning for
Communica-
tions

Irfan Ahmed, Objective: maximize the sum throughput constraint to given

Hedi
Khammari number of RF chains (rank of the precoding matrix) and the
Outline
total transmit power in a multi-carrier multi-user massive
Introduction
MIMO downlink.
System Model maximize the sum throughput
Joint
ML-based
constraint to given number of RF chains (rank of the
RRM and
Hybrid
precoding matrix)
Beamforming
Design total transmit power in a multi-carrier multi-user massive
Simulation MIMO downlink
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Problem Formulation

Machine
Learning for
Communica- The optimization problem
tions
Nf Ki
Irfan Ahmed, X X  
Hedi max U(FB ) = max U FBk,i (2)
Khammari
i=1 k=1

Outline subject to
Introduction

System Model H H
C1 : tr (FDB
i FAB FAB FDB
i ) ≤ Pi , ∀i
Joint
AB DB
ML-based C2 : rank(F F ) ≤ NRF
RRM and
Hybrid 2K
X
Beamforming
Design C3 : χi,l = 1, ∀i.
l=1
Simulation
Results and  
Comparisons
the utility function U FB
k,i is the throughput of user k in
the subchannel i

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Neural Networks based Resource Allocation

Machine
Learning for
The ML module resides at the base-station and takes the
Communica-
tions
uplink CSI as input. The output is the selected users’ set for
Irfan Ahmed,
subchannel allocation to maximize the sum-throughput as
Hedi
Khammari
shown in Fig.

Outline

Introduction

System Model

Joint (2K‐1) by (2K‐1) 
ML-based binary 
diagonal 
RRM and f(CSI) matrix with 1's 
Hybrid in the diagonal
Beamforming
Design

Simulation
Results and Features
Comparisons
Labels
(Users’ set selection using 
Kx1  10x1  (2K‐1)x1  One‐Vs‐All classifier)
input  hidden  output 
layer layer layer

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Processing Data for Neural Networks

Machine
Learning for
Communica-
tions

Irfan Ahmed, Pre-processing

Hedi
Khammari training data set, the validation data set, and the test data
set in 70%, 15%, and 15% ratio
Outline
Input data set: CSI based spectral efficiency
Introduction Output data set: MT based subchannel allocation
System Model

Joint
ML-based
RRM and
Hybrid
Beamforming
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Processing Data for Neural Networks

Machine
Learning for
Communica-
tions

Irfan Ahmed, Pre-processing

Hedi
Khammari training data set, the validation data set, and the test data
set in 70%, 15%, and 15% ratio
Outline
Input data set: CSI based spectral efficiency
Introduction Output data set: MT based subchannel allocation
System Model
Post-processing
Joint
ML-based The output data set contains a K dimensional binary
RRM and
Hybrid vector with 10 s in the positions of the selected users.
Beamforming
Design
neural network generates a 2K − 1 dimensional binary
vector with only χ∗i,l = 1 at the corresponding user pattern
Simulation
Results and location l ∗ .
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 ML-based Ranked-Constrained Hybrid
Beamforming Design
Machine 1: Inputs:K , Nf , Ki , NRF
Learning for 2: Initialization
Communica- 3: K = {1, ..., K }, Ki = {}, ∀i
tions {Step 1:ML-based Resource allocation to maximize sum-throughput}
Irfan Ahmed,
4: while i ≤ Nf do
Hedi 5: Compute Hi and FB i
Khammari 6: Compute information rate f (SINRi ) = log2 (1 + SINR(i))
7: Compute [χ∗ i,l ] = MachineLearningModule(K , f (SINRi ))
Outline 8: B∗
Compute fk,i
Introduction 9: FB∗
i
B∗
= [f1,i B∗
, ..., fK ,i ]

System Model
10: i ++
11: end while
{Step 2: Rank constraint realization}
Joint
ML-based 12: Stack the beamforming matrices FB∗ = [FB∗ B∗
1 , ..., FNf ]
RRM and 13: if rank(FB∗ ) ≤ NRF then
Hybrid
Beamforming
14: (FAB∗ , FDB∗ ) = QRdecomposition(FB∗ )
Design 15: FAB∗ = FAB∗ (:, 1 : NRF ), → FAB∗ ∈ CNt ×NRF
16: FDB∗ = FDB∗ (1 : NRF , :), → FDB∗ ∈ CNRF ×(Nf ×K )
Simulation 17: End of Algorithm
Results and
Comparisons
18: else
19: SVD(FB∗ ) = UΣVH
20: Σ̃ = diag (σ1 , ..., σN , 0, ...0)
RF
21: FB∗ = U Σ̃V
22: go to line 14
23: end if
Irfan Ahmed, Hedi Khammari Machine Learning for Communications
 Simulation Parameters

Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi
Khammari Neural network pattern recognition tool (nprtool) of
Outline Matlab
Introduction Two-layers feedforward network
System Model
Sigmoid transfer function
Joint
ML-based
RRM and
K = 4, Nf = 64
Hybrid
Beamforming Simulations are averaged over 1000 channel realizations
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Confusion matrix of test data

Machine 898 0 8 0 3 0 0 0 4 0 0 0 0 0 0 98.4%

1
Learning for 8.7% 0.0% 0.1% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 1.6%
Communica- 2
1 900 2 0 0 0 1 1 0 4 0 0 0 0 0 99.0%
tions 0.0% 8.7% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 1.0%
37 29 982 0 3 0 6 0 0 0 7 0 0 0 0 92.3%
3
Irfan Ahmed, 0.4% 0.3% 9.5% 0.0% 0.0% 0.0% 0.1% 0.0% 0.0% 0.0% 0.1% 0.0% 0.0% 0.0% 0.0% 7.7%

Hedi 0 0 0 915 3 3 0 0 0 0 0 8 0 1 0 98.4%

4
0.0% 0.0% 0.0% 8.8% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.1% 0.0% 0.0% 0.0% 1.6%
Khammari
32 0 3 33 981 0 3 0 0 0 0 0 3 0 0 93.0%
5
0.3% 0.0% 0.0% 0.3% 9.5% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 7.0%
Outline 0 44 2 29 0 994 8 0 0 0 0 2 0 2 0 92.0%
6
0.0% 0.4% 0.0% 0.3% 0.0% 9.6% 0.1% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 8.0%
Introduction 0 0 1 0 4 3 46 0 0 0 0 0 0 0 1 83.6%
7
0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.4% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 16.4%
Output Class

System Model 0 0 0 0 0 0 0 912 8 4 0 2 0 0 0 98.5%

8
0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 8.8% 0.1% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 1.5%

Joint 32 0 2 0 0 0 0 30 985 0 8 0 12 0 0 92.1%

9
0.3% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.3% 9.5% 0.0% 0.1% 0.0% 0.1% 0.0% 0.0% 7.9%
ML-based
0 27 0 0 0 0 0 21 2 987 6 3 0 10 0 93.5%
RRM and 10
0.0% 0.3% 0.0% 0.0% 0.0% 0.0% 0.0% 0.2% 0.0% 9.5% 0.1% 0.0% 0.0% 0.1% 0.0% 6.5%
Hybrid 0 0 0 0 0 0 0 0 0 3 21 0 0 0 0 87.5%
Beamforming 11
0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.2% 0.0% 0.0% 0.0% 0.0% 12.5%
Design 0 0 0 23 1 0 0 36 0 2 0 1125 5 5 0 94.0%
12
0.0% 0.0% 0.0% 0.2% 0.0% 0.0% 0.0% 0.3% 0.0% 0.0% 0.0% 10.9% 0.0% 0.0% 0.0% 6.0%
Simulation 0 0 0 0 5 0 0 0 1 0 0 6 45 0 1 77.6%
13
Results and 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.1% 0.4% 0.0% 0.0% 22.4%
Comparisons 14
0 0 0 0 0 0 0 0 0 0 0 2 0 29 0 93.5%
0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.3% 0.0% 6.5%
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 NaN%
15
0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% NaN%
89.8% 90.0% 98.2% 91.5% 98.1% 99.4% 71.9% 91.2% 98.5% 98.7% 50.0% 98.0% 69.2% 61.7% 0.0% 94.7%
10.2% 10.0% 1.8% 8.5% 1.9% 0.6% 28.1% 8.8% 1.5% 1.3% 50.0% 2.0% 30.8% 38.3% 100% 5.3%

Figure: ConfusionMachine
Irfan Ahmed, Hedi Khammari matrix for test
Learning data set
for Communications
 Cross Entropy

Machine
Learning for
Communica-
Best Validation Performance is 0.013709 at epoch 222
tions 100
Train
Irfan Ahmed, Validation
Hedi Test
Cross-Entropy (crossentropy)
Khammari Best

Outline

Introduction

System Model
10-1
Joint
ML-based
RRM and
Hybrid
Beamforming
Design

Simulation
Results and
Comparisons
10-2
0 50 100 150 200
228 Epochs

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Training statistics

Machine
Learning for
Communica- Gradient = 0.00091037, at epoch 228
10 -1
tions

Irfan Ahmed,
gradient
Hedi
Khammari 10
-2

Outline

Introduction 10
-3

System Model

Joint Validation Checks = 6, at epoch 228

6
ML-based
RRM and
Hybrid
4
Beamforming
val fail

Design

Simulation 2
Results and
Comparisons
0
0 50 100 150 200
228 Epochs

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Performance of Joint ML-based RRM and Hybrid
Beamforming Design
Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi
Khammari
4.5
104
CVX-based RRM
4 ML-based RRM
Outline
AST per subchannel in bits/s/Hz

3.5
103

Elapsed time (sec)

Introduction 3

2.5
System Model
102
2
Joint
1.5
ML-based
101
RRM and 1

Hybrid 0.5
Beamforming
0 100
Design 0 5 10 15 20 25 ML-based RRM CVX-based RRM
SNR in dB

Simulation
Results and (a) Average sum throughput for (b) Execution time comparison
Comparisons various SNR values

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Conclusions

Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi
Khammari
We replace the computationally intensive resource
management module with the neural network.
Outline
It has been shown that for K = 4 the neural network gets
Introduction

System Model
trained only after 228 iterations and provides the identical
Joint
performance.
ML-based
RRM and In this work we have compared the ML-based RRM with
Hybrid
Beamforming CVX-based optimal RRM, and have got 28.72 times less
Design
execution time.
Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications

 Q&A

Machine
Learning for
Communica-
tions

Irfan Ahmed,
Hedi
Khammari

Outline

Introduction

System Model
Thank you
Joint
ML-based
RRM and
Hybrid
Beamforming
Design

Simulation
Results and
Comparisons

Irfan Ahmed, Hedi Khammari Machine Learning for Communications