Abstract:Over the last few years, a lot of algorithms for discriminant analysis (DA) have been developed. Although having different motivations, they all inject structure information in data into their own within- and between-class scatters. However, to our best knowledge, there has not been yet a systematical examination about (1) which structure granularities lurk in data; (2) which structure granularities are utilized in scatters of a DA algorithm; (3) whether new DA algorithms can be developed based on existing structure granularities. In this paper, the established so-called structurally motivated (SM) framework for DA and its unified mathematical formulation of the ratio trace exactly answers them. It categorizes these DA algorithms from the viewpoint of constructing scatters based on different-granularity structures in data, identifies their applicable scenarios for different structure types, and provides insights into developing new DA algorithms. Inspired by the insight, we find that cluster granularity lying in the middle of granularity spectrum in SM framework can still be further utilized and exploited. As a result, the three DA algorithms based on the cluster granularity are derived from the SM framework and from the injection of the cluster structure information into the respective within-class, between-class and joint both scatter matrices for the classical MDA, and these corresponding algorithms are, respectively, called as SWDA, SBDA and SWBDA. The injection of cluster structure information makes the proposed three algorithms able to fit relatively complicated data not only more effectively, but also with the regularization technique obtain more projections than the classical MDA, which is very helpful for more effective DA. Moreover, MDA becomes their special case when the cluster numbers of all classes are set to 1. Our experiments on the benchmarks (face and UCI databases) here show that the proposed algorithms yield encouraging results.

Generalizing Case Frames Using a Thesaurus and the MDL Principle

A Probabilistic Approach to Lexical Semantic Knowledge Acquisition and S tructural Disambiguation

Learning Frames from Text with an Unsupervised Latent Variable Model

Corpus-based Approach to Automatic Constructions of Japanese Verbal Case Frames

Dependency Distance: A New Perspective on Syntactic Patterns in Natural Languages.

Speeding Up Natural Language Parsing by Reusing Partial Results

Recognition of Collocation Frames from Sentences

Discriminatively Modeling Commonality of Term Types for Extracting Relation from Small Corpora

Analyses of Multi-collection Corpora via Compound Topic Modeling

Rule-based Chinese frame elements identification

Generalizing French Schwa Deletion: the Role of Indexed Constraints*

Grammar induction by MDL-based distributional classification

Phrase-frames in Low- and Intermediate-level EFL Learners’ Essays: Variability, Structures, and Functions

Noun2Verb: Probabilistic frame semantics for word class conversion

On the Structural Generalization in Text-to-SQL

Identifying missing dictionary entries with frequency-conserving context models

Word Sense Disambiguation: A Structured Learning Perspective.

Automated Generalization of Phrasal Paraphrases from the Web.

A Structurally Motivated Framework for Discriminant Analysis

Conducting sparse feature selection on arbitrarily long phrases in text corpora with a focus on interpretability

A Two Stage Adaptation Framework for Frame Detection via Prompt Learning.