Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based...
Transcript of Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based...
![Page 1: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/1.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 1
Subspace based Multi-DimensionalSubspace based Multi-DimensionalModel Order SelectionModel Order Selection
in Colored Noise Scenariosin Colored Noise Scenarios
João Paulo C. Lustosa da Costa, Florian Roemer, Dominik Schulz, and Rafael Timóteo de Sousa Jr.
University of Brasília (UnB)Department of Electrical Engineering (ENE)Laboratory of Array Signal Processing
PO Box 4386Zip Code 70.919-970, Brasília - DF
Homepage: http://www.pgea.unb.br/~lasp
![Page 2: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/2.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
2
![Page 3: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/3.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
3
![Page 4: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/4.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 4
MotivationMotivation
The model order selection (MOS) problem is encountered in a variety of signal processing applications including radar, sonar, communications, channel modeling, malicious activity
detection in computer networks [1], medical imaging, and the estimation of the parameters of the dominant multipath components from
MIMO channel measurements. Not only for signal processing applications, but also in several science fields, e.g.,
chemistry, food industry, stock markets, pharmacy and psychometrics, the MOS problem is investigated.
It has been shown in [2] that for data contaminated by white noise, the R-D Exponential Fitting Test (R-D EFT) outperforms all the other model order selection schemes proposed in the literature. Since for data contaminated by colored noise, the R-D EFT is not applicable, the Closed-Form PARAFAC based Model Order Selection (CFP-MOS) scheme has been proposed [2] .
[1]: B. M. David et al., "Blind Automatic Malicious Activity Detection in Honeypot Data," The International Conference on Forensic Computer Science (ICoFCS) 2011.
[2]: J. P. C. L. da Costa, F. Roemer, M. Haardt, and R. T. de Souza Jr., ``Multi-Dimensional Model Order Selection,'' EURASIP Journal on Advances in Signal Processing 2011:26, July 2011, Springer publisher.
![Page 5: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/5.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 5
MotivationMotivation
The computational complexity of CFP-MOS is prohibitive for several applications. Therefore, another multidimensional model order selection scheme for colored noise scenarios is required.
In this paper, we propose a multi-dimensional extension of Estimation Error (ESTER) [3]. Since in [4] ESTER is outperformed by Subspace based Automatic Model Order Selection (SAMOS) scheme, we also compare it to our proposed R-D ESTER.
[3]: R. Badeau, B. David, and G. Richard, “Selecting the modeling order for the ESPRIT high resolution method an alternative approach”, In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2004), Montreal, Canada May 2004.
[4]: J.-M. Papy, L. de Lathauwer, and S. Van Huffel, “A shift invariance-based order-selection technique for exponential data modeling”, in IEEE Signal Processing Letters, Vol. 14, pp. 473-476, Jul. 2007.
![Page 6: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/6.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
6
![Page 7: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/7.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 7
Data Model and GoalData Model and Goal Noiseless case
Our objective is to estimate Our objective is to estimate dd from the noisy observations . from the noisy observations .
Matrix data model
+ +=
![Page 8: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/8.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 8
Colored noise model
Data Model and GoalData Model and Goal
![Page 9: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/9.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
Receive array: 1-D or 2-D
Frequency
Time
Transmit array: 1-D or 2-D
Direction of Arrival (DOA)
Delay
Doppler shift
Direction of Departure (DOD)
Example of MultiExample of Multi-Dimensional DataDimensional Data Channel model
5
![Page 10: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/10.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
Data Model and GoalData Model and Goal
Noiseless data representationNoiseless data representation
ProblemProblem
where is the colored noise tensor.
= ++
Our objective is to estimate Our objective is to estimate dd from the noisy observations . from the noisy observations .
17
![Page 11: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/11.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
11
![Page 12: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/12.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
ESTER (1)ESTER (1)
Estimation of Signal Parameters via Rotation Invariance Techniques
ESPRIT
12
dd
Shift Invariance Equation
![Page 13: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/13.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
ESTER (2)ESTER (2)
Estimation of Signal Parameters via Rotation Invariance Techniques
ESPRIT
13
The steering matrix A and the first d eigenvectors U of the covariance matrix generate the same subspace
Note that Us is related to the low-rank approximation.
Spatial frequencies
![Page 14: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/14.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
ESTER (3)ESTER (3)
ESTER Algorithm [3][3]
14
![Page 15: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/15.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
15
![Page 16: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/16.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 16
Operations on TensorsOperations on Tensors(Multidimensional Arrays)(Multidimensional Arrays)
• Unfoldings
• Concatenation
![Page 17: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/17.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 17
Operations on Tensors and MatricesOperations on Tensors and Matrices
• n-mode product
i.e., all the n-mode vectors multiplied from the left-hand-side by
11 2233
![Page 18: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/18.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 18
Review: The SVD of MatricesReview: The SVD of Matrices
“Full SVD”
“Economy size SVD”
Low-rank approximation
![Page 19: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/19.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos 19
Extension to the HOSVD of TensorsExtension to the HOSVD of Tensors
“Full HOSVD”
Low-rank approximation (truncated HOSVD)
“Economy size HOSVD”
![Page 20: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/20.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
R-D ESTER (1)R-D ESTER (1)
R-D ESTER Algorithm
20
![Page 21: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/21.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
21
![Page 22: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/22.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
SimulationsSimulations
22
![Page 23: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/23.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
SimulationsSimulations
23
![Page 24: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/24.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
OutlineOutline
Motivation Data Model and Goal ESTER R-D ESTER Simulations Conclusions
24
![Page 25: Universidade de Brasília Laboratório de Processamento de Sinais em Arranjos 1 Subspace based Multi-Dimensional Model Order Selection in Colored Noise Scenarios.](https://reader036.fdocumentos.com/reader036/viewer/2022062418/552fc134497959413d8d8114/html5/thumbnails/25.jpg)
Universidade de BrasíliaLaboratório de Processamento de Sinais em Arranjos
ConclusionsConclusions
In this work, we have proposed a multi-dimensional extension of the ESTER (R-D ESTER) scheme.
By taking into account the multi-dimensional structure of the data, the R-D ESTER outperforms significantly showing its matrix based version.
Similarly to the R-D EFT, the R-D ESTER is also based on the HOSVD.
25