Naslov
Interpretable Low-Rank Document Representations with Label-Dependent Sparsity Patterns

Autori
Ivek, Ivan

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
Proceedings of DMNLP, Workshop at ECML/PKDD / Cellier P., Charnois T., Hotho A., Matwin S., Moens M.F., Toussaint Y. - Nancy, 2014, 97-112

Skup
Workshop at ECML/PKDD

Mjesto i datum
Nancy, Francuska, 15.09.2014. - 19.09.2014

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
Document Categorization; Latent Semantic Analysis; Supervised

Sažetak
In context of document classi cation, where in a corpus of documents their label tags are readily known, an opportunity lies in utilizing label information to learn document representation spaces with better discriminative properties. To this end, in this paper application of a Variational Bayesian Supervised Nonnegative Matrix Factorization (supervised vbNMF) with label-driven sparsity structure of coecients is proposed for learning of discriminative nonsubtractive latent semantic components occuring in TF-IDF document representations. Constraints are such that the components pursued are made to be frequently occuring in a small set of labels only, making it possible to yield document representations with distinctive label-speci c sparse activation patterns. A simple measure of quality of this kind of sparsity structure, dubbed inter-label sparsity, is introduced and experimentally brought into tight connection with classi cation performance. Representing a great practical convenience, inter-label sparsity is shown to be easily controlled in supervised vbNMF by a single parameter.

Izvorni jezik
Engleski

Znanstvena područja
Elektrotehnika, Računarstvo

POVEZANOST RADA