Engineering Docs
Study how neural audio systems represent sound, learn conditional relationships, generate audio, and are evaluated in production and research settings.
Recommended pathβ
- Digital Audio Basics β establish the signal-level vocabulary used throughout the documentation.
- Music Representations β compare waveforms, spectrograms, symbolic formats, embeddings, and codec tokens.
- Signal Processing Basics β connect time-domain signals to frequency-domain analysis.
- Transformers for Audio and Diffusion Models β examine core generation architectures.
- Dataset Curation β understand the data, rights, and labeling decisions that shape a model.
- Evaluation Metrics β combine computational measurements with structured listening tests.
Choose by engineering taskβ
| I need to⦠| Start here |
|---|---|
| Design an audio representation | Audio Embeddings and Neural Audio Codecs |
| Select a model architecture | Architecture |
| Prepare or augment training data | Training |
| Integrate a hosted model | APIs |
| Build a multi-model system | AI Music Agents |
| Fine-tune or control a model | Advanced Topics |
| Check terminology | Glossary |
These pages assume comfort with software concepts and introduce mathematics where it clarifies system behavior. Readers primarily interested in making music can use the User Guides.