Natural language processing

Summary

Natural language processing (NLP) is an interdisciplinary subfield of linguistics and computer science. It is primarily concerned with processing natural language datasets, such as text corpora or speech corpora, using either rule-based or probabilistic (i.e. statistical and, most recently, neural network-based) machine learning approaches. The goal is a computer capable of "understanding" the contents of documents, including the contextual nuances of the language within them. The technology can then accurately extract information and insights contained in the documents as well as categorize and organize the documents themselves. Challenges in natural language processing frequently involve speech recognition, natural-language understanding, and natural-language generation. History Natural language processing has its roots in the 1950s. Already in 1950, Alan Turing published an article titled "Computing Machinery and Intelligence" which proposed what is now called the Tu

Official source

https://en.wikipedia.org/wiki/Natural_language_processing

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related publications (100)

Related publications

Related people (95)

Related people

Related units (27)

Related units

Related concepts (135)

Related concepts

Related courses (60)

Related courses

Related lectures (133)

Related lectures

Architectural Sampling: A Formal Basis for Machine-Learnable Architecture

Immanuel Chee Beng Koh

The spatial and formal conception of architecture, and thus its modes of design perception and representation, directly contributes to its machine-learnability; and consequently, its capacity in leveraging today's machine learning apparatus for design innovation. If text can be sampled and synthesized in Natural Language Processing, image in Image Processing and sound in Audio Signal Processing, how can architectural forms and spaces be likewise sampled for generating new designs? The thesis endeavours to construct such a theoretical and technical framework with the concept of architectural sampling -- defined as the exemplar-learning (pedagogical), the machinic encoding (technological) and probabilistic generation (aesthetical) of architectural forms. Foundational to this technical leap is the overcoming of architecture's own longstanding set of conceptual and perceptual assumptions, namely figure/ground, parts/whole and shapes/grammars; and replaced with one that is ontologically 'flattened', 'resolutional' and 'probabilistic'. The thesis samples precursory works from the history of architecture, alongside machine learning approaches, to build its theoretical claims; while algorithmically demonstrating and technically validating them through a series of design research projects organized according to their structural characteristics (grid, sequence and hierarchy). The contribution of the work lies in its fundamental reformulation of seeing, thinking and making architectural forms through the lens of machinic sampling.

EPFL2019

Distributed word representations, or word vectors, have recently been applied to many tasks in natural language processing, leading to state-of-the-art performance. A key ingredient to the successful application of these representations is to train them on very large corpora, and use these pre-trained models in downstream tasks. In this paper, we describe how we trained such high quality word representations for 157 languages. We used two sources of data to train these models: the free online encyclopedia Wikipedia and data from the common crawl project. We also introduce three new word analogy datasets to evaluate these word vectors, for French, Hindi and Polish. Finally, we evaluate our pre-trained word vectors on 10 languages for which evaluation datasets exists, showing very strong performance compared to previous models.

2018

Natural Language Processing (NLP) driven categorisation and detection of discourse in historical US patents

Jérôme Baudry, Nicolas Christophe Chachereau, Prakhar Gupta, Bhargav Srinivasa Desikan

Patents have traditionally been used in the history of technology as an indication of the thinking process of the inventors, of the challenges or “reverse salients” they faced, or of the social groups influencing the construction of technology. More recently, historians of science and technology also read them to interpret the way people described technology and how the specific inscriptions of inventions mattered for the justification and operation of the patent system. The digitization of historical patents opens up unique opportunities to assess the feasibility of unsupervised machine learning and natural language methods for such explorations. In this project, we analyze over a million US historical patents from 1830-1930 using a variety of text-based methods, with two major aims: 1) categorizing patents into coherent technical categories, 2) identifying discourses of safety, reflexivity, and environmental concern in technological innovation. We use both frequency-based and context-based methods, and find that a bag of words-based methods such as TDF-IDF and topic modeling do not perform well on semantic categorization due to the linguistic peculiarities of patent specifications. This suggests that a successful approach to categorizing patents would require contextual semantic representations such as Transformers-based methods (e.g. BERT), or static embedding based methods (e.g Word2Vec, Doc2Vec) which have relatively low computational costs but less expressive in some scenarios. We run early experiments using these methods and find that word embedding models are effective in learning semantics from the descriptions of the patents. In this poster, we will describe our early results, as well as exploratory data analysis on this massive historical patents dataset.

2022