Some Ideas on Natural Language Processing

Liu Haita

DOI: https://doi.org/10.3969/j.issn.1007-2489.2001.01.007

2001-01-01

Abstract:Natural language processing (NLP) is the necessity of human development in information age, it is the natural chain of the human history. Therefor we should explore and research it from many fields, and not only independently from computational technology.

What problem does this paper attempt to address?

Research and development of natural language processing

LI Sheng

DOI: https://doi.org/10.3969/j.issn.1007-791X.2013.05.001

2013-01-01

Abstract:Natural Language Processing(NLP) is one of the key issues in the information technology. NLP for Chinese covers a broad topics of processing the character, the word, the sentence, the paragraph and the discourse. In this paper state-of-the-art NLP researches is summarized, with a special focus on the unique challenges in Chinese NLP. The achievements and existing problems in NLP is reviewed, and its possible future work is outlined as well from a personal perspective.
Development and Evaluation of Task-Specific NLP Framework in China.

Caixia Ge,Yinsheng Zhang,Zhenzhen Huang,Zheng Jia,Meizhi Ju,Huilong Duan,Haomin Li

DOI: https://doi.org/10.3233/978-1-61499-564-7-1031

2015-01-01

Abstract:Natural language processing (NLP) has been designed to convert narrative text into structured data. Although some general NLP architectures have been developed, a task-specific NLP framework to facilitate the effective use of data is still a challenge in lexical resource limited regions, such as China. The purpose of this study is to design and develop a task-specific NLP framework to extract targeted information from particular documents by adopting dedicated algorithms on current limited lexical resources. In this framework, a shared and evolving ontology mechanism was designed. The result has shown that such a free text driven platform will accelerate the NLP technology acceptance in China.
Exploring the Landscape of Natural Language Processing Research

Tim Schopf,Karim Arabi,Florian Matthes

DOI: https://doi.org/10.26615/978-954-452-092-2_111

2023-09-25

Abstract:As an efficient approach to understand, generate, and process natural language texts, research in natural language processing (NLP) has exhibited a rapid spread and wide adoption in recent years. Given the increasing research work in this area, several NLP-related approaches have been surveyed in the research community. However, a comprehensive study that categorizes established topics, identifies trends, and outlines areas for future research remains absent. Contributing to closing this gap, we have systematically classified and analyzed research papers in the ACL Anthology. As a result, we present a structured overview of the research landscape, provide a taxonomy of fields of study in NLP, analyze recent developments in NLP, summarize our findings, and highlight directions for future work.

Computation and Language
A Comprehensive Analytical Study of Traditional and Recent Development in Natural Language Processing

DOI: https://doi.org/10.30534/ijatcse/2021/121052021

2021-10-07

International Journal of Advanced Trends in Computer Science and Engineering

Abstract:This paper acts as a comprehensive analytical study of natural language processing (NLP) and provides a briefing of the most prominent astounding reforms of the field over a good chunk of time. It covers even the future research insights and most relevant features, which act as a result of the discussed concepts or research, until this paper's reading point. This paper starts with covering the most basic concepts of text cleaning, such as tokenization, the importance of stop words, etc., to concepts such as sequence modeling, speech recognition, the effect of quantum computing concepts in Natural Language Processing, and so on. The current development of deep neural networks, which is the current trend in artificial intelligence, always gives NLP a cutting-edge technology, also covered in this paper. This paper will also emphasize that it covers the broad area of explanations to the concepts to guide learners or researchers to have an excellent overall understanding of the field.
Comprehensive analysis of natural language processing

Rohit Kumar Yadav,Aanchal Madaan,Janu

DOI: https://doi.org/10.30574/gjeta.2024.19.1.0058

2024-04-30

Global Journal of Engineering and Technology Advances

Abstract:Natural Language Processing (NLP) is a fascinating field of study that teaches computers to understand and use human language. This means that computers can read, write, and even translate text just like humans. NLP has many practical uses, such as categorizing text, identifying the tone of language, recognizing names in text, translating languages, and answering questions. NLP has come a long way since it was first developed. In the past, it relied on strict rules to understand language, but now it uses advanced techniques like machine learning and deep learning to understand text. However, there are still some challenges in NLP, such as understanding the meaning of words in context and considering cultural differences. Despite these challenges, NLP is being used in many different areas, from healthcare and finance to education and customer service. NLP is transforming the way humans interact with computers and is making it easier to extract important information from large amounts of text.
Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

Keyu Chen,Cheng Fei,Ziqian Bi,Junyu Liu,Benji Peng,Sen Zhang,Xuanhe Pan,Jiawei Xu,Jinlang Wang,Caitlyn Heqi Yin,Yichao Zhang,Pohsun Feng,Yizhu Wen,Tianyang Wang,Ming Li,Jintao Ren,Qian Niu,Silin Chen,Weiche Hsieh,Lawrence K.Q. Yan,Chia Xin Liang,Han Xu,Hong-Ming Tseng,Xinyuan Song,Ming Liu

2024-10-30

Abstract:With a focus on natural language processing (NLP) and the role of large language models (LLMs), we explore the intersection of machine learning, deep learning, and artificial intelligence. As artificial intelligence continues to revolutionize fields from healthcare to finance, NLP techniques such as tokenization, text classification, and entity recognition are essential for processing and understanding human language. This paper discusses advanced data preprocessing techniques and the use of frameworks like Hugging Face for implementing transformer-based models. Additionally, it highlights challenges such as handling multilingual data, reducing bias, and ensuring model robustness. By addressing key aspects of data processing and model fine-tuning, this work aims to provide insights into deploying effective and ethically sound AI solutions.

Computation and Language,Human-Computer Interaction
Natural language processing: state of the art, current trends and challenges

Diksha Khurana,Aditya Koli,Kiran Khatter,Sukhdev Singh

DOI: https://doi.org/10.1007/s11042-022-13428-4

IF: 2.577

2022-07-15

Multimedia Tools and Applications

Abstract:Natural language processing (NLP) has recently gained much attention for representing and analyzing human language computationally. It has spread its applications in various fields such as machine translation, email spam detection, information extraction, summarization, medical, and question answering etc. In this paper, we first distinguish four phases by discussing different levels of NLP and components of N atural L anguage G eneration followed by presenting the history and evolution of NLP. We then discuss in detail the state of the art presenting the various applications of NLP, current trends, and challenges. Finally, we present a discussion on some available datasets, models, and evaluation metrics in NLP.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
A Brief Introduction to Natural Language Understanding and Generation

ZHAN Weidong

DOI: https://doi.org/10.3969/j.issn.1007-2489.2010.04.008

2010-01-01

Abstract:As a subfield of Artificial Intelligence,the aim of Natural Language Processing is to communicate between computers and human by natural language.In order to realizing it,computers should be able to understand natural language and generate natural language automatically as well.This paper gives a very brief introduction on the basic framework of NLU and NLG respectively,including the tasks,challenges and architectures of the two fields.Intuitively,the NLG can be viewed as the inverse process of NLU.The former,however,has received much less attention and research work than the latter.While there are many reasons which have been mentioned to explain why this might be so,this paper figures out a new image to illustrate the relation between them which is somewhat different from the past viewpoints.
A Survey on Natural Language Processing for Programming

Qingfu Zhu,Xianzhen Luo,Fang Liu,Cuiyun Gao,Wanxiang Che

2022-01-01

Abstract: Natural language processing for programming, which aims to use NLP techniques to assist programming, has experienced an explosion in recent years. However, there is no literature that systematically reviews related work from the full spectrum. In this paper, we comprehensively investigate existing work, ranging from early deductive models to the latest competition-level models. Another advantage of this paper is the completeness of the technique category, which provides easy access to locating and comparing future works.
Natural Language Processing: The PLNLP Approach

DOI: https://doi.org/10.1007/978-1-4615-3170-8

1993-01-01

Abstract:Natural language is easy for people and hard for machines. For two generations, the tantalizing goal has been to get computers to handle human languages in ways that will be compelling and useful to people. Obstacles are many and legendary. Natural Language Processing: The PLNLP Approach describes one group's decade of research in pursuit of that goal. A very broad coverage NLP system, including a programming language (PLNLP) development tools, and analysis and synthesis components, was developed and incorporated into a variety of well-known practical applications, ranging from text critiquing (CRITIQUE) to machine translation (e.g. SHALT). This books represents the first published collection of papers describing the system and how it has been used. Twenty-six authors from nine countries contributed to this volume. Natural language analysis, in the PLNLP approach, is done is six stages that move smoothly from syntax through semantics into discourse. The initial syntactic sketch is provided by an Augmented Phrase Structure Grammar (APSG) that uses exclusively binary rules and aims to produce some reasonable analysis for any input string. Its `approximate' analysis passes to the reassignment component, which takes the default syntactic attachments and adjusts them, using semantic information obtained by parsing definitions and example sentences from machine-readable dictionaries. This technique is an example of one facet of the PLNLP approach: the use of natural language itself as a knowledge representation language -- an innovation that permits a wide variety of online text materials to be exploited as sources of semantic information. The next stage computes the intrasential argument structure and resolves all references, both NP- and VP-anaphora, that can be treated at this point in the processing. Subsequently, additional components, currently not so well developed as the earlier ones, handle the further disambiguation of word senses, the normalization of paraphrases, and the construction of a paragraph (discourse) model by joining sentential semantic graphs. Natural Language Processing: The PLNLP Approach acquaints the reader with the theory and application of a working, real-world, domain-free NLP system, and attempts to bridge the gap between computational and theoretical models of linguistic structure. It provides a valuable resource for students, teachers, and researchers in the areas of computational linguistics, natural processing, artificial intelligence, and information science.
AI-Natural Language Processing (NLP)

Miss. Aliya Anam Shoukat Ali

DOI: https://doi.org/10.22214/ijraset.2021.37293

2021-08-10

International Journal for Research in Applied Science and Engineering Technology

Abstract:Natural Language Processing (NLP) could be a branch of Artificial Intelligence (AI) that allows machines to know the human language. Its goal is to form systems that can make sense of text and automatically perform tasks like translation, spell check, or topic classification. Natural language processing (NLP) has recently gained much attention for representing and analysing human language computationally. It's spread its applications in various fields like computational linguistics, email spam detection, information extraction, summarization, medical, and question answering etc. The goal of the Natural Language Processing is to style and build software system which will analyze, understand, and generate languages that humans use naturally, so as that you just could also be ready to address your computer as if you were addressing another person. Because it’s one amongst the oldest area of research in machine learning it’s employed in major fields like artificial intelligence speech recognition and text processing. Natural language processing has brought major breakthrough within the sector of COMPUTATION AND AI.
Putting Natural in Natural Language Processing

Grzegorz Chrupała

DOI: https://doi.org/10.48550/arXiv.2305.04572

2023-05-23

Abstract:Human language is firstly spoken and only secondarily written. Text, however, is a very convenient and efficient representation of language, and modern civilization has made it ubiquitous. Thus the field of NLP has overwhelmingly focused on processing written rather than spoken language. Work on spoken language, on the other hand, has been siloed off within the largely separate speech processing community which has been inordinately preoccupied with transcribing speech into text. Recent advances in deep learning have led to a fortuitous convergence in methods between speech processing and mainstream NLP. Arguably, the time is ripe for a unification of these two fields, and for starting to take spoken language seriously as the primary mode of human communication. Truly natural language processing could lead to better integration with the rest of language science and could lead to systems which are more data-efficient and more human-like, and which can communicate beyond the textual modality.

Computation and Language,Artificial Intelligence,Audio and Speech Processing
Putting Humans in the Natural Language Processing Loop: A Survey

Zijie J. Wang,Dongjin Choi,Shenyu Xu,Diyi Yang

DOI: https://doi.org/10.48550/arXiv.2103.04044

2021-03-06

Abstract:How can we design Natural Language Processing (NLP) systems that learn from human feedback? There is a growing research body of Human-in-the-loop (HITL) NLP frameworks that continuously integrate human feedback to improve the model itself. HITL NLP research is nascent but multifarious -- solving various NLP problems, collecting diverse feedback from different people, and applying different methods to learn from collected feedback. We present a survey of HITL NLP work from both Machine Learning (ML) and Human-Computer Interaction (HCI) communities that highlights its short yet inspiring history, and thoroughly summarize recent frameworks focusing on their tasks, goals, human interactions, and feedback learning methods. Finally, we discuss future directions for integrating human feedback in the NLP development loop.

Computation and Language,Artificial Intelligence,Human-Computer Interaction,Machine Learning
Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research

Denis Newman-Griffis,Jill Fain Lehman,Carolyn Rosé,Harry Hochheiser

DOI: https://doi.org/10.48550/arXiv.2104.07874

2021-04-16

Computation and Language

Abstract:Natural language processing (NLP) research combines the study of universal principles, through basic science, with applied science targeting specific use cases and settings. However, the process of exchange between basic NLP and applications is often assumed to emerge naturally, resulting in many innovations going unapplied and many important questions left unstudied. We describe a new paradigm of Translational NLP, which aims to structure and facilitate the processes by which basic and applied NLP research inform one another. Translational NLP thus presents a third research paradigm, focused on understanding the challenges posed by application needs and how these challenges can drive innovation in basic science and technology design. We show that many significant advances in NLP research have emerged from the intersection of basic principles with application needs, and present a conceptual framework outlining the stakeholders and key questions in translational research. Our framework provides a roadmap for developing Translational NLP as a dedicated research area, and identifies general translational principles to facilitate exchange between basic and applied research.
Natural Language Processing: A Historical Review

Karen Sparck Jones

DOI: https://doi.org/10.1007/978-0-585-35958-8_1

1994-01-01

Abstract:This paper reviews natural language processing (NLP) from the late 1940’s to the present, seeking to identify its successive trends as these reflect concerns with different problems or the pursuit of different approaches to solving these problems and building systems as wholes. The review distinguishes four phases in the history of NLP, characterised respectively by an emphasis on machine translation, by the influence of artificial intelligence, by the adoption of a logico-grammatical style, and by an attack on massive language data. The account considers the significant and salient work in each phase, and concludes with an assessment of where we stand after more than forty years of effort in the field.
New Approaches for Natural Language Understanding based on the Idea that Natural Language encodes both Information and its Processing Procedures

Limin Zhang

DOI: https://doi.org/10.48550/arXiv.2010.12789

2020-10-24

Computation and Language

Abstract:We must recognize that natural language is a way of information encoding, and it encodes not only the information but also the procedures for how information is processed. To understand natural language, the same as we conceive and design computer languages, the first step is to separate information (or data) and the processing procedures of information (or data). In natural language, some processing procedures of data are encoded directly as the structure chunk and the pointer chunk (this paper has reclassified lexical chunks as the data chunk, structure chunk, and the pointer chunk); some processing procedures of data imply in sentences structures; some requests of processing procedures are expressed by information senders and processed by information receivers. For the data parts, the classification encoding system of attribute information and the information organization architecture (including constitutional structures of information sets and the hierarchy between the information sets) were discussed. In section 2, the theoretical part elaborated in section 2 has been verified in examples and proofed that the studies in this paper have achieved the goal of enabling machines to understand the information conveyed in the dialogue. In section 4, the author summarizes the basic conditions of "Understanding", rethinks what "Understanding" is and how to proceed. The study in this paper provides a practical, theoretical basis and research methods for NLU. It also can be applied in large-scale and multi-type information processing in the artificial intelligence (AI) area.
Artificial Intelligence Methods in Natural Language Processing: A Comprehensive Review

Yanhan Chen,Hanxuan Wang,Kaiwen Yu,Ruoshui Zhou

DOI: https://doi.org/10.54097/vfwgas09

2024-03-13

Abstract:The rapid evolution of Artificial Intelligence (AI) since its inception in the mid-20th century has significantly influenced the field of Natural Language Processing (NLP), transforming it from a rule-based system to a dynamic and adaptive model capable of understanding the complexities of human language. This paper aims to offer a comprehensive review of the various applications and methodologies of AI in NLP, serving as a detailed guide for future research and practical applications. In the early sections, the paper elucidates the indispensable role of AI in NLP, highlighting its transition from symbolic reasoning to a focus on machine learning and deep learning, and its extensive applications in sectors such as healthcare, transportation, and finance. It emphasizes the symbiotic relationship between AI and NLP, facilitated by platforms like AllenNLP, which aid in the development of advanced language understanding models. Further, the paper explores specific AI techniques employed in NLP, including machine learning, Naive Bayes, and Support Vector Machines, and identifies pressing challenges and avenues for future research. It delves into the applications of AI in NLP, showcasing its transformative potential in tasks such as machine translation, facilitated by deep learning methods, and the development of chatbots and virtual assistants that have revolutionized human-technology interaction. The paper also highlights other fields impacted by AI techniques, including text summarization, sentiment analysis, and named entity recognition, emphasizing the efficiency and accuracy brought about by the integration of AI in these areas. In conclusion, the paper summarizes the remarkable advancements and persistent challenges in NLP, such as language ambiguity and contextual understanding, and underscores the need for diverse and representative labeled data for training. Looking forward, it identifies promising research avenues including Explainable AI, Few-shot and Zero-shot Learning, and the integration of NLP with other data modalities, aiming for a holistic understanding of multimodal data. The paper calls for enhanced robustness and security in NLP systems, especially in sensitive applications like content moderation and fake news detection, to foster trust and reliability in AI technologies. It advocates for continual learning in NLP models to adapt over time without losing previously acquired knowledge, paving the way for a future where AI and NLP work synergistically to understand and generate human language more effectively and efficiently.
Natural Language Processing RELIES on Linguistics

Juri Opitz,Shira Wein,Nathan Schneider

2024-05-10

Abstract:Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence. What does this mean for the future of linguistic expertise in NLP? We highlight several aspects in which NLP (still) relies on linguistics, or where linguistic thinking can illuminate new directions. We argue our case around the acronym $RELIES$ that encapsulates six major facets where linguistics contributes to NLP: $R$esources, $E$valuation, $L$ow-resource settings, $I$nterpretability, $E$xplanation, and the $S$tudy of language. This list is not exhaustive, nor is linguistics the main point of reference for every effort under these themes; but at a macro level, these facets highlight the enduring importance of studying machine systems vis-a-vis systems of human language.

Computation and Language,Artificial Intelligence
Interactive Natural Language Processing

Zekun Wang,Ge Zhang,Kexin Yang,Ning Shi,Wangchunshu Zhou,Shaochun Hao,Guangzheng Xiong,Yizhi Li,Mong Yuan Sim,Xiuying Chen,Qingqing Zhu,Zhenzhu Yang,Adam Nik,Qi Liu,Chenghua Lin,Shi Wang,Ruibo Liu,Wenhu Chen,Ke Xu,Dayiheng Liu,Yike Guo,Jie Fu

2023-05-23

Abstract:Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within the field of NLP, aimed at addressing limitations in existing frameworks while aligning with the ultimate goals of artificial intelligence. This paradigm considers language models as agents capable of observing, acting, and receiving feedback iteratively from external entities. Specifically, language models in this context can: (1) interact with humans for better understanding and addressing user needs, personalizing responses, aligning with human values, and improving the overall user experience; (2) interact with knowledge bases for enriching language representations with factual knowledge, enhancing the contextual relevance of responses, and dynamically leveraging external information to generate more accurate and informed responses; (3) interact with models and tools for effectively decomposing and addressing complex tasks, leveraging specialized expertise for specific subtasks, and fostering the simulation of social behaviors; and (4) interact with environments for learning grounded representations of language, and effectively tackling embodied tasks such as reasoning, planning, and decision-making in response to environmental observations. This paper offers a comprehensive survey of iNLP, starting by proposing a unified definition and framework of the concept. We then provide a systematic classification of iNLP, dissecting its various components, including interactive objects, interaction interfaces, and interaction methods. We proceed to delve into the evaluation methodologies used in the field, explore its diverse applications, scrutinize its ethical and safety issues, and discuss prospective research directions. This survey serves as an entry point for researchers who are interested in this rapidly evolving area and offers a broad view of the current landscape and future trajectory of iNLP.

Computation and Language,Artificial Intelligence
Advancements in Natural Language Processing for Text Understanding

M. John Basha,S. Vijayakumar,J. Jayashankari,Ahmed Hussein Alawadi,Pulatova Durdona

DOI: https://doi.org/10.1051/e3sconf/202339904031

2023-01-01

E3S Web of Conferences

Abstract:Natural language processing (NLP) developments have made it possible for robots to read and analyze human language with astounding precision, revolutionizing the field of text understanding. An overview of current advancements in NLP approaches and their effects on text comprehension are provided in this abstract. It examines significant developments in fields including named entity identification, sentiment analysis, semantic analysis, and question answering, highlighting the difficulties encountered and creative solutions put forth. To sum up, recent developments in natural language processing have raised the bar for text comprehension. Deep learning models and extensive pre-training have changed methods including semantic analysis, sentiment analysis, named entity identification, and question answering. These developments have produced text comprehension systems that are increasingly precise and complex. However, issues with prejudice, coreference resolution, and contextual comprehension still need to be resolved. The future of NLP for text understanding has considerable potential with continuing study and innovation, opening the door for increasingly sophisticated applications in numerous sectors.

Some Ideas on Natural Language Processing

Research and development of natural language processing

Development and Evaluation of Task-Specific NLP Framework in China.

Exploring the Landscape of Natural Language Processing Research

A Comprehensive Analytical Study of Traditional and Recent Development in Natural Language Processing

Comprehensive analysis of natural language processing

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

Natural language processing: state of the art, current trends and challenges

A Brief Introduction to Natural Language Understanding and Generation

A Survey on Natural Language Processing for Programming

Natural Language Processing: The PLNLP Approach

AI-Natural Language Processing (NLP)

Putting Natural in Natural Language Processing

Putting Humans in the Natural Language Processing Loop: A Survey

Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research

Natural Language Processing: A Historical Review

New Approaches for Natural Language Understanding based on the Idea that Natural Language encodes both Information and its Processing Procedures

Artificial Intelligence Methods in Natural Language Processing: A Comprehensive Review

Natural Language Processing RELIES on Linguistics

Interactive Natural Language Processing

Advancements in Natural Language Processing for Text Understanding