JAIST Repository >
School of Knowledge Science >
Articles >
Journal Articles >

Please use this identifier to cite or link to this item: http://hdl.handle.net/10119/15264

Title: Fast Parallel Randomized Algorithm for Nonnegative Matrix Factorization with KL Divergence for Large Sparse Datasets
Authors: Nguyen, Duy-Khuong
Ho, Tu-Bao
Keywords: Nonnegative matrix factorization
kullback-leibler divergence
sparse models
sparse representation
Issue Date: 2016-04
Publisher: International Journal of Machine Learning and Computing
Magazine name: International Journal of Machine Learning and Computing
Volume: 6
Number: 2
Start page: 111
End page: 116
DOI: 10.18178/ijmlc.2016.6.2.583
Abstract: Nonnegative Matrix Factorization (NMF) with Kullback-Leibler Divergence (NMF-KL) is one of the most significant NMF problems and equivalent to Probabilistic Latent Semantic Indexing (PLSI), which has been successfully applied in many applications. For sparse count data, a Poisson distribution and KL divergence provide sparse models and sparse representation, which describe the random variation better than a normal distribution and Frobenius norm. Specially, sparse models provide more concise understanding of the appearance of attributes over latent components, while sparse representation provides concise interpretability of the contribution of latent components over instances. However, minimizing NMF with KL divergence is much more difficult than minimizing NMF with Frobenius norm; and sparse models, sparse representation and fast algorithms for large sparse datasets are still challenges for NMF with KL divergence. In this paper, we propose a fast parallel randomized coordinate descent algorithm having fast convergence for large sparse datasets to archive sparse models and sparse representation. The proposed algorithm’s experimental results overperform the current studies’ ones in this problem.
Rights: Duy-Khuong Nguyen and Tu-Bao Ho, International Journal of Machine Learning and Computing, 6(2), 2016, 111-116. http://dx.doi.org/10.18178/ijmlc.2016.6.2.583 This work is licensed under a Creative Commons attribution-noncommerical license CC BY-NC-ND 4.0 https://creativecommons.org/licenses/by-nc-nd/4.0
URI: http://hdl.handle.net/10119/15264
Material Type: publisher
Appears in Collections:a10-1. 雑誌掲載論文 (Journal Articles)

Files in This Item:

File Description SizeFormat
23953.pdf10392KbAdobe PDFView/Open

All items in DSpace are protected by copyright, with all rights reserved.


Contact : Library Information Section, Japan Advanced Institute of Science and Technology