Skip to main content

Engineering Docs

Study how neural audio systems represent sound, learn conditional relationships, generate audio, and are evaluated in production and research settings.

  1. Digital Audio Basics β€” establish the signal-level vocabulary used throughout the documentation.
  2. Music Representations β€” compare waveforms, spectrograms, symbolic formats, embeddings, and codec tokens.
  3. Signal Processing Basics β€” connect time-domain signals to frequency-domain analysis.
  4. Transformers for Audio and Diffusion Models β€” examine core generation architectures.
  5. Dataset Curation β€” understand the data, rights, and labeling decisions that shape a model.
  6. Evaluation Metrics β€” combine computational measurements with structured listening tests.

Choose by engineering task​

I need to…Start here
Design an audio representationAudio Embeddings and Neural Audio Codecs
Select a model architectureArchitecture
Prepare or augment training dataTraining
Integrate a hosted modelAPIs
Build a multi-model systemAI Music Agents
Fine-tune or control a modelAdvanced Topics
Check terminologyGlossary

These pages assume comfort with software concepts and introduce mathematics where it clarifies system behavior. Readers primarily interested in making music can use the User Guides.