An AO-ADMM Approach to Constraining PARAFAC2 on All Modes
Research output: Contribution to journal › Journal article › Research › peer-review
Standard
An AO-ADMM Approach to Constraining PARAFAC2 on All Modes. / Roald, Marie; Schenker, Carla; Calhoun, Vince D.; Adali, Tülay; Bro, Rasmus; Cohen, Jeremy E.; Acar, Evrim.
In: SIAM Journal on Mathematics of Data Science, Vol. 4, No. 3, 2022, p. 1191-1222.Research output: Contribution to journal › Journal article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - An AO-ADMM Approach to Constraining PARAFAC2 on All Modes
AU - Roald, Marie
AU - Schenker, Carla
AU - Calhoun, Vince D.
AU - Adali, Tülay
AU - Bro, Rasmus
AU - Cohen, Jeremy E.
AU - Acar, Evrim
PY - 2022
Y1 - 2022
N2 - Analyzing multiway measurements with variations across one mode of the dataset is a challenge in various fields including data mining, neuroscience, and chemometrics. For example, measurements may evolve over time or have unaligned time profiles. The PARAFAC2 model has been successfully used to analyze such data by allowing the underlying factor matrices in one mode (i.e., the evolving mode) to change across slices. The traditional approach to fit a PARAFAC2 model is to use an alternating least squares–based algorithm, which handles the constant cross-product constraint of the PARAFAC2 model by implicitly estimating the evolving factor matrices. This approach makes imposing regularization on these factor matrices challenging. There is currently no algorithm to flexibly impose such regularization with general penalty functions and hard constraints. In order to address this challenge and to avoid the implicit estimation, in this paper, we propose an algorithm for fitting PARAFAC2 based on alternating optimization with the alternating direction method of multipliers (AO-ADMM). With numerical experiments on simulated data, we show that the proposed PARAFAC2 AO-ADMM approach allows for flexible constraints, recovers the underlying patterns accurately, and is computationally efficient compared to the state-of-the-art. We also apply our model to two real-world datasets from neuroscience and chemometrics, and show that constraining the evolving mode improves the interpretability of the extracted patterns.
AB - Analyzing multiway measurements with variations across one mode of the dataset is a challenge in various fields including data mining, neuroscience, and chemometrics. For example, measurements may evolve over time or have unaligned time profiles. The PARAFAC2 model has been successfully used to analyze such data by allowing the underlying factor matrices in one mode (i.e., the evolving mode) to change across slices. The traditional approach to fit a PARAFAC2 model is to use an alternating least squares–based algorithm, which handles the constant cross-product constraint of the PARAFAC2 model by implicitly estimating the evolving factor matrices. This approach makes imposing regularization on these factor matrices challenging. There is currently no algorithm to flexibly impose such regularization with general penalty functions and hard constraints. In order to address this challenge and to avoid the implicit estimation, in this paper, we propose an algorithm for fitting PARAFAC2 based on alternating optimization with the alternating direction method of multipliers (AO-ADMM). With numerical experiments on simulated data, we show that the proposed PARAFAC2 AO-ADMM approach allows for flexible constraints, recovers the underlying patterns accurately, and is computationally efficient compared to the state-of-the-art. We also apply our model to two real-world datasets from neuroscience and chemometrics, and show that constraining the evolving mode improves the interpretability of the extracted patterns.
U2 - 10.1137/21M1450033
DO - 10.1137/21M1450033
M3 - Journal article
VL - 4
SP - 1191
EP - 1222
JO - SIAM Journal on Mathematics of Data Science
JF - SIAM Journal on Mathematics of Data Science
SN - 2577-0187
IS - 3
ER -
ID: 338064674