Perceptron: Part 2

This lecture covers the Perceptron algorithm, one of the earliest iterative solutions for binary classification problems. It discusses linear separability, convergence properties, and limitations of the algorithm. The lecture also introduces the Pocket Perceptron algorithm, which improves the behavior of Perceptron for non-linearly separable data by keeping track of the best weight iterate. Examples using heart disease data demonstrate the application of Perceptron and Pocket Perceptron, showcasing empirical error rates for both reduced and full-dimensional feature vectors.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (38)

Related concepts (33)

EE-566: Adaptation and learning

In this course, students learn to design and master algorithms and core concepts related to inference and learning from data and the foundations of adaptation and learning theories with applications.

Perceptron

In machine learning, the perceptron (or McCulloch-Pitts neuron) is an algorithm for supervised learning of binary classifiers. A binary classifier is a function which can decide whether or not an input, represented by a vector of numbers, belongs to some specific class. It is a type of linear classifier, i.e. a classification algorithm that makes its predictions based on a linear predictor function combining a set of weights with the feature vector.

Tool

A tool is an object that can extend an individual's ability to modify features of the surrounding environment or help them accomplish a particular task. Although many animals use simple tools, only human beings, whose use of stone tools dates back hundreds of millennia, have been observed using tools to make other tools. Early human tools, made of such materials as stone, bone, and wood, were used for the preparation of food, hunting, the manufacture of weapons, and the working of materials to produce clothing and useful artifacts and crafts such as pottery, along with the construction of housing, businesses, infrastructure, and transportation.

Garden tool

A garden tool is any one of many tools made for gardening and landscaping, which overlap with the range of tools made for agriculture and horticulture. Garden tools can be divided into hand tools and power tools. Hand tool Today's garden tools originated with the earliest agricultural implements used by humans. Examples include the hatchet, axe, sickle, scythe, pitchfork, spade, shovel, trowel, hoe, fork, and rake. In some places, the machete is common. The earliest tools were made variously of wood, flint, metal, tin, and bone.

Hand tool

A hand tool is any tool that is powered by hand rather than a motor. Categories of hand tools include wrenches, pliers, cutters, , striking tools, struck or hammered tools, screwdrivers, vises, clamps, snips, hacksaws, drills, and knives. Outdoor tools such as garden forks, pruning shears, and rakes are additional forms of hand tools. Portable power tools are not hand tools. Hand tools have been used by humans since the Stone Age when stone tools were used for hammering and cutting.

Power tool

A power tool is a tool that is actuated by an additional power source and mechanism other than the solely manual labor used with hand tools. The most common types of power tools use electric motors. Internal combustion engines and compressed air are also commonly used. Tools directly driven by animal power are not generally considered power tools. Power tools are used in industry, in construction, in the garden, for housework tasks such as cooking, cleaning, and around the house for purposes of driving (fasteners), drilling, cutting, shaping, sanding, grinding, routing, polishing, painting, heating and more.

Kernel Methods: Nonlinear Separation Surfaces EE-566: Adaptation and learning

Explores kernel methods for nonlinear separation surfaces using polynomial and Gaussian kernels in Perceptron and SVM algorithms.

Document Analysis: Topic Modeling DH-406: Machine learning for DH

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Introduction to Data Science ENG-209: Data science for engineers with Python

Introduces the basics of data science, covering decision trees, machine learning advancements, and deep reinforcement learning.

Machine Learning Fundamentals DH-406: Machine learning for DH

Introduces fundamental machine learning concepts, covering regression, classification, dimensionality reduction, and deep generative models.

Support Vector Machines: SVM Basics EE-566: Adaptation and learning

Covers the basics of Support Vector Machines, focusing on hard-margin and soft-margin formulations.