Immediate Constituent Analysis (IC analysis)

K. Willems

DOI: https://doi.org/10.1515/wsk.35.0.immediateconstituentanalysis

Abstract:Immediate Constituent Analysis is a structural method for analysing the hierarchical relations among the constituents of complex linguistic constructions, proceeding consecutively from the higher to the next lower level until no further breakdown into smaller units is possible.

Linguistics,Psychology

What problem does this paper attempt to address?

Cortical Tracking of Constituent Structure in Language Acquisition

Heidi Getz,Nai Ding,Elissa L. Newport,David Poeppel

DOI: https://doi.org/10.1016/j.cognition.2018.08.019

IF: 4.011

2018-01-01

Cognition

Abstract:Linguistic units are organized at multiple levels: words combine to form phrases, which combine to form sentences. Ding, Melloni, Zhang, Tian, and Poeppel (2016) discovered that the brain tracks units at each level of hierarchical structure simultaneously. Such tracking requires knowledge of how words and phrases are structurally related. Here we asked how neural tracking emerges as knowledge of phrase structure is acquired. We recorded electrophysiological (MEG) data while adults listened to a miniature language with distributional cues to phrase structure or to a control language which lacked the crucial distributional cues. Neural tracking of phrases developed rapidly, only in the condition in which participants formed mental representations of phrase structure as measured behaviorally. These results illuminate the mechanisms through which abstract mental representations are acquired and processed by the brain.
Elife Assessment: Finding Structure During Incremental Speech Comprehension

Nai Ding

DOI: https://doi.org/10.7554/elife.89311.2.sa2

2024-01-01

Abstract:A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker’s intended meaning. This rapid process is subject to multi-dimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.
Elements of Husserl's Early Analysis of the Internal Time-consciousness

Liang-kang NI

DOI: https://doi.org/10.3969/j.issn.1000-9639.2008.01.013

2008-01-01

Abstract:Although the consciousness is ever changing,flowing without rest,yet it still has a stable vertical intentional and horizontal intentional structure.Just because of the fluidity and timeliness of the consciousness,one can be aware of the temporalized feeling-content as well as the temporalizing of feeling-content,and further apprehend these time contents as time object,again further percept the temporality of these objects.Finally one can regard the time itself as an object,that is to say one can constitute the objective time.This is an elemental train of thoughts and a basic conclusion of Husserl's time-consciousness analysis.Based on his analysis we can explain why internal time-consciousness is a premise for the generation of the objective time.
Beyond the Constituent - A Dependency Grammar Analysis of Chains

T Osborne

DOI: https://doi.org/10.1515/flin.2006.39.3-4.251

2006-01-01

Folia Linguistica

Abstract:The paper introduces a unit of syntax beyond the constituent called the chain. A number of mechanisms are shown to be sensitive to chains, e.g. the formation of predicates and idioms, the ellipses of gapping, pseudogapping and VP-ellipsis, and the elided material of stripping and answer fragments. The presentation is couched in a surface syntax, dependency-bascd framework, as opposed to a constituency-based one. While the chain call be defined ill a manner consistent with constituency, doing so requires that one adopt some controversial assumptions about the nature of constituency structure. The potential of the chain concept is great; it is the tool necessary to address the manner in which semantic compositionality occurs in the syntax.
Diagnostics for Constituents: Dependency, Constituency, and the Status of Function Words.

Timothy Osborne

2015-01-01

Abstract:This contribution delivers two messages: 1) that the tests for constituents that are widely employed in linguistics and syntax textbooks are more congruent with dependency-based syntax than with constituency-based syntax and 2) that these same tests support the conventional analysis of function words, that is, the analysis that takes most function words (auxiliary verbs, adpositions, subordinators) to be heads over the content words with which they cooccur. The latter issue is important at present, since a recent annotation scheme is choosing to subordinate all function words to the content words with which they coocur.
Continuous or Discontinuous Constituents? A Comparison between Syntactic Analyses for Constituent Order and Their Processing Systems

Stefan Müller

DOI: https://doi.org/10.1023/b:rolc.0000016785.49729.d7

2004-06-01

Research on Language and Computation

Abstract:In this paper I discuss several possible analyses for constituent order in German. Approaches that assume continuous constituents are compared with an approach that assumes discontinuous constituents. I will show that certain proposals that have been made to analyze constituent order are either not adequate or cannot be implemented with currently available systems. For the proposals that can be implemented I will discuss the amount of work a parser has to do. I then compare two implementations of larger fragments of German: the Verbmobil grammar and the Babel grammar. It is shown that the amount of work to be done to parse the Verbmobil grammar is significantly higher than the work that has to be done parsing with the Babel grammar.
Coherence : A Dependency Grammar Analysis

Timothy Osborne

2005-01-01

Abstract:Bech’s seminal distinction between coherent and incoherent constructions in German does not allow for those structures that display the traits of both coherence and incoherence simultaneously, e.g. the third construction. Hence his original two-way distinction has given way to a three-way distinction. This paper proposes that a threeway division is indeed more accurate. The approach presented here distinguishes between coherent, incoherent, and pseudoincoherent constituents. Nine diagnostics are utilized to support this three-way division, i.e. extraposition, intraposition, bare infinitive fronting, infinitival fronting, scrambling, pied-piping, position of negation, scope of negation, and gapping. The analysis is couched in a dependency grammar framework and formalized in terms of the two features ±s (scrambling) and ±p (predicate). Three principles of word order are formulated in terms of these features: the Scrambling Principle, the Predicate Serialization Principle, and the Predicate Weight Principle. An introduction to dependency grammar is provided.
Constructions Are Catenae: Construction Grammar Meets Dependency Grammar

Timothy Osborne,Thomas Gross

DOI: https://doi.org/10.1515/cog-2012-0006

2012-01-01

Cognitive Linguistics

Abstract:The paper demonstrates that dependency-based syntax is in a strong position to produce principled and economical accounts of the syntax of constructs. The difficulty that constituency-based syntax has in this regard is that very many constructs fail to qualify as constituents. The point is evident with the box diagrams and attribute value matrices (AVMs.) that some construction grammars (CxGs) use to formalize constructions; these schemata often represent fragments rather than constituents. In dependency-based syntax in contrast, constructions are catenae, whereby a catena is a chain of words linked together by dependencies. The catena is a novel but well-defined unit of syntax associated with dependency grammar (DG). The constructs of CxGs are more amenable to analyses in terms of the catenae of dependency-based syntax than to analyses in terms of the constituents of constituency-based syntax.
Catenae: Introducing a Novel Unit of Syntactic Analysis

Timothy Osborne,Michael Putnam,Thomas Gross

DOI: https://doi.org/10.1111/j.1467-9612.2012.00172.x

2012-01-01

Syntax

Abstract:This paper introduces a novel unit of syntactic analysis, the catena (Latin for chain; plural catenae). The catena is defined in a dependency-based grammar as a word or a combination of words that is continuous with respect to dominance. According to this definition, any dependency tree or any subtree (complete or partial) of a dependency tree qualifies as a catena. The paper demonstrates that idioms are stored as catenae and that the elided material of ellipsis mechanisms (e.g., answer fragments, gapping, stripping, VP ellipsis, pseudogapping, sluicing, and comparative deletion) is a catena. Constituents are always catenae, but many catenae are not constituents. Based on the flexibility and utility of the catena concept, the claim is put forth and defended that the catena is the fundamental unit of syntax, not the constituent.
Antecedent Containment: A Dependency Grammar Solution In Terms Of Catenae

timothy osborne,thomas gros

DOI: https://doi.org/10.1111/j.1467-9582.2012.01191.x

2012-01-01

Studia Linguistica

Abstract:. The paper presents a new solution to an old problem, the problem of antecedent containment and the infinite regress that it gives rise to. The solution is couched in a dependency grammar (DG) framework and is possible by acknowledging DG catenae. The catena is a novel unit of syntactic analysis. Pronouns that appear to be contained within their antecedents actually take non-constituent catenae as their antecedents. These catenae quite naturally exclude the pronouns, so that antecedent containment never occurs. This account acknowledges surface configurations only. No appeals are made to derivational mechanisms or abstract representations.
Implicit causality of action verbs at the interface between conceptual structure and discourse coherence relations

Milena Kuehnast,Eva Meier

DOI: https://doi.org/10.2478/qal-2019-0002

2019-09-01

Questions and Answers in Linguistics

Abstract:Abstract Implicit causality of interpersonal transitive verbs (IC) pertains to preferences to attribute the cause of a given action to the subject or the object referent in active clauses. Causal attribution is operationalized as the probability of referential continuation in a subsequent explanatory clause. This paper presents an explorative investigation into the causal biases of action verbs, which in contrast to affective verbs have received less attention in IC research. We approach implicit causality as a discourse level phenomenon based on the textual level of discourse representation and enriched by conceptual knowledge. In study 1, we targeted IC effects of German action verbs ( N = 52) in sentences containing causal, additive and adversative connectives. Results showed that IC based categories of subject-object-, and non-biasing predicates were clearly discernable in causal contexts only. In study 2, we examined effects of situational knowledge (physical affectedness & social acceptability) and affective appraisals (valence & arousal) represented in the conceptual structure of the verbs on the construal of causality biases and their interplay with immediate contextual information such as gender of referents. Results show that higher degrees of physical affectedness were associated with causal attribution to the object referent. This effect was modulated by the affective properties of the verbs. Our findings revealed the influence of physiological arousal, an affective dimension not considered in previous investigations of IC. Actions with a strong physical impact that were characterized by high arousal, e.g., kick, or tickle were more likely to be explained with reference to the subject. Participants also considered the available contextual information, as indicated by the significant interactions of gender information with arousal. Within the subsample of non-biasing verbs, higher estimates for social behavior increased probabilities of causal attributions to the subject.
Implicit In-context Learning

Zhuowei Li,Zihao Xu,Ligong Han,Yunhe Gao,Song Wen,Di Liu,Hao Wang,Dimitris N. Metaxas

2024-05-23

Abstract:In-context Learning (ICL) empowers large language models (LLMs) to adapt to unseen tasks during inference by prefixing a few demonstration examples prior to test queries. Despite its versatility, ICL incurs substantial computational and memory overheads compared to zero-shot learning and is susceptible to the selection and order of demonstration examples. In this work, we introduce Implicit In-context Learning (I2CL), an innovative paradigm that addresses the challenges associated with traditional ICL by absorbing demonstration examples within the activation space. I2CL first generates a condensed vector representation, namely a context vector, from the demonstration examples. It then integrates the context vector during inference by injecting a linear combination of the context vector and query activations into the model's residual streams. Empirical evaluation on nine real-world tasks across three model architectures demonstrates that I2CL achieves few-shot performance with zero-shot cost and exhibits robustness against the variation of demonstration examples. Furthermore, I2CL facilitates a novel representation of "task-ids", enhancing task similarity detection and enabling effective transfer learning. We provide a comprehensive analysis of I2CL, offering deeper insights into its mechanisms and broader implications for ICL. The source code is available at:

Machine Learning,Artificial Intelligence,Computation and Language
An ICM Approach to(Chinese)Zero Subject

Xiong Xue-liang

DOI: https://doi.org/10.3969/j.issn.1003-6105.2001.01.003

2001-01-01

Abstract:According to Fillmore (1982) and Lakoff (1987), folk theories such as pragmatic experience and cultural knowledge about the world can be theoretically captured as frames (Fillmore) and ICMs (Lakoff) and may not look strictly scientific. However, as ICM successfully incorporates both denotational and representational sides of meaning, it may well help to depict some language phenomena which cannot be fully described within formal approaches. In this paper, therefore, we argue that semiotic relationship may not be totally objective. Ontological entities (O) may not be directly mapped epistemologically onto the symbolic system in the form of E but may rather give rise to corresponding ECs as organic combinations of epistemological counterpart of O and cognitive factors such as imagination, image schema, etc. We believe that this way of theorization enjoys priority over formal approaches in analyzing zero subject (○) phenomenon in Chinese. Furthermore, ○ can be subcategorized into ○e type (zero exophora) and ○a type (zero anaphora). These are different from empty syntactic categories such as e, t, pro and PRO. In linguistic literature, zero anaphora is usually studied in a [Xr ← A] framework. Yet, zero anaphora in general and first person zero anaphora in particular in Chinese boasts of a number of other analytic possibilities such as [Xr ← ○a],[○e← ○a], etc. and the length of the chain could be excessively great. This gives rise to an A model (anaphoric), a B model (inferential) and a C model (grammatical) in the description of the ○ phenomenon. An investigation shows that C model seems to be the most prototypical. That is, if an ICM is constructed to analyze the ○ phenomenon, we may find that [○] is more prototypical than [我], [自己], etc. And the ICM can equally depict C model as more prototypical than both A model and B model, put against data of the same nature. This is so simply because in the process of grammatical fossilization of the phenomenon, CC (cognitive factors) holds sway (rather than physical contextual factors (PC) or linguistic contextual factors (LC)), and some ideological content (e.g. Im) may enter the semantic domain of ○ with the lapse of time and thus produce a ○/Im parasitic cognitive unit.
Contrastive independent component analysis

Kexin Wang,Aida Maraj,Anna Seigal

2024-07-02

Abstract:Visualizing data and finding patterns in data are ubiquitous problems in the sciences. Increasingly, applications seek signal and structure in a contrastive setting: a foreground dataset relative to a background dataset. For this purpose, we propose contrastive independent component analysis (cICA). This generalizes independent component analysis to independent latent variables across a foreground and background. We propose a hierarchical tensor decomposition algorithm for cICA. We study the identifiability of cICA and demonstrate its performance visualizing data and finding patterns in data, using synthetic and real-world datasets, comparing the approach to existing contrastive methods.

Statistics Theory,Algebraic Geometry,Machine Learning
Some Insight into Many Constituent Dynamics

Jerzy Hanckowiak

DOI: https://doi.org/10.48550/arXiv.0807.1489

2008-07-10

Abstract:A description of many constituent (particle) systems with fuzzy initial conditions is proposed with the help of the field language. In this language correlation functions are defined and equations for them are derived in the free Fock space. Additional conditions for their solutions are postulated. The closure problem for polynomial, rational, local and nonlocal interactions is considered with exploitation of left or right invertibility of used operators. Some general remarks concerning symmetry and multi-scale descriptions are given.

Mathematical Physics
IC3 Modulo Theories via Implicit Predicate Abstraction

Alessandro Cimatti,Alberto Griggio,Sergio Mover,Stefano Tonetta

DOI: https://doi.org/10.48550/arXiv.1310.6847

2013-10-25

Abstract:We present a novel approach for generalizing the IC3 algorithm for invariant checking from finite-state to infinite-state transition systems, expressed over some background theories. The procedure is based on a tight integration of IC3 with Implicit (predicate) Abstraction, a technique that expresses abstract tran- sitions without computing explicitly the abstract system and is incremental with respect to the addition of predicates. In this scenario, IC3 operates only at the Boolean level of the abstract state space, discovering inductive clauses over the abstraction predicates. Theory reasoning is confined within the underlying SMT solver, and applied transparently when performing satisfiability checks. When the current abstraction allows for a spurious counterexample, it is refined by discov- ering and adding a sufficient set of new predicates. Importantly, this can be done in a completely incremental manner, without discarding the clauses found in the previous search. The proposed approach has two key advantages. First, unlike current SMT gener- alizations of IC3, it allows to handle a wide range of background theories without relying on ad-hoc extensions, such as quantifier elimination or theory-specific clause generalization procedures, which might not always be available, and can moreover be inefficient. Second, compared to a direct exploration of the concrete transition system, the use of abstraction gives a significant performance improve- ment, as our experiments demonstrate.

Logic in Computer Science,Software Engineering
Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism

Anhao Zhao,Fanghua Ye,Jinlan Fu,Xiaoyu Shen

2024-10-09

Abstract:Large language models (LLMs) exhibit remarkable in-context learning (ICL) capabilities. However, the underlying working mechanism of ICL remains poorly understood. Recent research presents two conflicting views on ICL: One emphasizes the impact of similar examples in the demonstrations, stressing the need for label correctness and more shots. The other attributes it to LLMs' inherent ability of task recognition, deeming label correctness and shot numbers of demonstrations as not crucial. In this work, we provide a Two-Dimensional Coordinate System that unifies both views into a systematic framework. The framework explains the behavior of ICL through two orthogonal variables: whether similar examples are presented in the demonstrations (perception) and whether LLMs can recognize the task (cognition). We propose the peak inverse rank metric to detect the task recognition ability of LLMs and study LLMs' reactions to different definitions of similarity. Based on these, we conduct extensive experiments to elucidate how ICL functions across each quadrant on multiple representative classification tasks. Finally, we extend our analyses to generation tasks, showing that our coordinate system can also be used to interpret ICL for generation tasks effectively.

Computation and Language
Intrinsic Units: Identifying a system's causal grain.

William Marshall,Graham Findlay,Larissa Albantakis,Giulio Tononi

DOI: https://doi.org/10.1101/2024.04.12.589163

2024-09-25

Abstract:Integrated information theory (IIT) aims to account for the quality and quantity of consciousness in physical terms. According to IIT, a substrate of consciousness must be a system of units that is a maximum of intrinsic, irreducible cause-effect power, quantified by integrated information (ϕ). Moreover, the grain of each unit must be the one—from micro (finer) to macro (coarser)—that maximizes the system's intrinsic irreducibility (i.e., maximizes ϕ). The units that maximize ϕ are called the intrinsic units of the system. This work extends the mathematical framework of IIT 4.0 to assess cause-effect power at different grains and thereby determine a system's intrinsic units. Using simple, simulated systems, we show that the cause-effect power of a system of macro units can be higher than the cause-effect power of the corresponding micro units. Two examples highlight specific kinds of macro units, and how each kind can increase cause-effect power. The implications of the framework are discussed in the broader context of IIT, including how it provides a foundation for tests and inferences about consciousness.

Systems Biology
Immediacy of Integration in Discourse Comprehension: Evidence from Chinese Readers’ Eye Movements

Suiping Wang,Hsuan-Chih Chen,Jinmian Yang,Lei Mo

DOI: https://doi.org/10.1080/01690960701437061

2008-01-01

Language and Cognitive Processes

Abstract:An eye-movement study was conducted to examine whether Chinese readers immediately activate and integrate related background information during discourse comprehension. Participants were asked to read short passages, each containing a critical word that fitted well within the local context but was inconsistent or neutral with background information from the early part of the passage. This manipulation of textual consistency produced reliable effects on both first-pass reading fixations in the target region and second-pass reading times in the pre-target and target regions. These results indicate that integration processes start very rapidly in reading text in a writing system with properties that encourage delayed processing, suggesting that immediate processing is likely a universal principle in discourse comprehension.
Constructing Three-Way Concept Lattice Based on the Composite of Classical Lattices

Sichun Yang,Yunan Lu,Xiuyi Jia,Weiwei Li

DOI: https://doi.org/10.1016/j.ijar.2020.03.007

IF: 4.452

2020-01-01

International Journal of Approximate Reasoning

Abstract:Three-way concept analysis provides a novel model for three-way decisions, and also extends the classical formal concept analysis, which has attracted many attentions in recent years. In order to construct three-way concept lattices, original formal context and its complement context need to be considered simultaneously. In this paper, a new method of constructing attribute-induced three-way (AE) and object-induced three-way (OE) concept lattices is proposed. Firstly, we introduce an AE-oriented composite operator and an OE-oriented composite operator that combine a pair of formal concepts coming from the concept lattices of original formal context and its complement context. Secondly, we define the candidate AE concepts and redundant AE concepts based on the AE-oriented composite operator, and define the candidate OE concepts and redundant OE concepts based on the OE-oriented composite operator, respectively. Finally, we propose an AE lattice construction algorithm and an OE lattice construction algorithm. Theoretical analysis and experimental results demonstrate that the proposed method is simple and effective, and it is a useful supplement to current three-way concept lattice construction methods.

Immediate Constituent Analysis (IC analysis)

Cortical Tracking of Constituent Structure in Language Acquisition

Elife Assessment: Finding Structure During Incremental Speech Comprehension

Elements of Husserl's Early Analysis of the Internal Time-consciousness

Beyond the Constituent - A Dependency Grammar Analysis of Chains

Diagnostics for Constituents: Dependency, Constituency, and the Status of Function Words.

Continuous or Discontinuous Constituents? A Comparison between Syntactic Analyses for Constituent Order and Their Processing Systems

Coherence : A Dependency Grammar Analysis

Constructions Are Catenae: Construction Grammar Meets Dependency Grammar

Catenae: Introducing a Novel Unit of Syntactic Analysis

Antecedent Containment: A Dependency Grammar Solution In Terms Of Catenae

Implicit causality of action verbs at the interface between conceptual structure and discourse coherence relations

Implicit In-context Learning

An ICM Approach to(Chinese)Zero Subject

Contrastive independent component analysis

Some Insight into Many Constituent Dynamics

IC3 Modulo Theories via Implicit Predicate Abstraction

Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism

Intrinsic Units: Identifying a system's causal grain.

Immediacy of Integration in Discourse Comprehension: Evidence from Chinese Readers’ Eye Movements

Constructing Three-Way Concept Lattice Based on the Composite of Classical Lattices