WaveNet generated raw audio, and then music, sample by sample

DeepMind's paper and blog post describe a model predicting each audio sample from prior ones, applied first to speech and then to music.

Historical event

September 8, 2016

First source published

September 8, 2016

Site publication

September 18, 2026

What happened

On 8 September 2016, DeepMind announced WaveNet, a neural network that generates audio one sample at a time. The company's own blog post describes it as 'a deep generative model of raw audio waveforms' and reports that, for text-to-speech, it 'reduces the gap with human performance by over 50%' compared with existing systems. A detailed technical write-up followed as an arXiv paper submitted four days later, on 12 September 2016.

What the documents say

The paper's abstract states the model is 'fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones,' meaning every sample of the output waveform is generated in sequence, each informed by everything generated before it. This differs from earlier speech synthesis methods, which stitched together pre-recorded fragments; WaveNet instead builds the waveform itself. The abstract reports that human listeners rated the resulting speech 'significantly more natural sounding than the best parametric and concatenative systems' in both English and Mandarin, and that one trained model could represent many speakers. Separately, the blog post states the DeepMind team trained the same architecture on a dataset of classical piano recordings because, in the post's own words, 'we thought it would also be fun to try to generate music,' and that the model then generated new piano passages without being given a score, describing the results as 'fascinating samples.' The paper's abstract independently confirms that training on music yields 'novel and often highly realistic musical fragments.'

Why it matters for makers

The mechanism, generation at the level of the raw waveform rather than at the level of notes, symbols or pre-recorded units, is why WaveNet is treated as a starting point for the generative audio tools that followed it. A system working directly on the waveform is not constrained to notes a scoring system can represent; timbral detail, room tone, breath and attack sit inside that sample stream. That is why such models are computationally heavy: modelling every sample is expensive because it is unconstrained by musical structure.

What to check before you use it

A maker evaluating any later tool that claims a WaveNet-style or waveform-level architecture can ask what it was trained on, since the 2016 documents are explicit that the piano results came from a specific genre of training material, while its speech results came from production text-to-speech data, not music. Results in one domain do not automatically transfer to another. This is an editorial caution about generalising from a demonstration to a general capability claim.

• Was this tool's demonstrated quality measured on the same type of material I intend to generate?
• Is the model generating at the waveform level, or at a higher, more constrained representation, and does that change what artefacts to expect?
• If a listening comparison is cited as evidence of quality, was it a controlled listening test or an informal claim?

WaveNet's own documents describe a specific, narrow technical claim, sample-by-sample generation improves naturalness, tested rigorously for speech and demonstrated informally for music. The distinction between tested and demonstrated is worth preserving whenever a later tool cites WaveNet as its ancestor.

Sources & reading trail

DeepMind's own blog post announces WaveNet, dates the announcement, and describes both the speech naturalness gains and the music generation experiment trained on piano recordings.

Source published: 8 September 2016 · Retrieved: 16 September 2026

The paper's abstract describes the autoregressive sample-by-sample architecture, the text-to-speech naturalness results, and that training on music produces novel musical fragments.

Source published: 12 September 2016 · Retrieved: 16 September 2026

Papers, terms and official documents establish the record; the maker reading and the checks are Signal to Song editorial analysis. This retrospective draft does not imply the site published on the event date.

Continue reading

• NSynth shipped as an open dataset and model, not just a demo
• MusicLM was published with its memorisation study attached
• Jukebox generated singing from raw audio and stayed a demo
• Browse the complete the archive

Published September 18, 2026, not on the date of the event described.