Nature

Backpropagation-free spiking neural networks with the forward–forward algorithm

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs ...
Nature

Event-based backpropagation can compute exact gradients for spiking neural networks

How can we train spiking neural networks to achieve brain-like performance in machine learning tasks? The resounding success and pervasive use of the backpropagation algorithm in deep learning ...
PC Magazine

AI backpropagation

The method used to train a large language model (LLM). An AI model's neural network learns by recognizing patterns in the data and constantly adjusting its neurons to predict what comes next. With ...
Quanta Magazine

Neuron Bursts Can Mimic Famous AI Learning Strategy

A new model of learning centers on bursts of neural activity that act as teaching signals — approximating backpropagation, the algorithm behind learning in AI. Every time a human or machine learns how ...
Semiconductor Engineering

In Situ Backpropagation Strategy That Progressively Updates Neural Network Layers Directly in HW (TU Eindhoven)

A new technical paper titled “Hardware implementation of backpropagation using progressive gradient descent for in situ training of multilayer neural networks” was published by researchers at ...