@audiolabtools/ai-sdk

@audiolabtools/ai-sdk

Audio analysis as Vercel AI SDK tools: let your LLM check loudness, voice quality, and signal properties of any audio URL, with one import.

npm install @audiolabtools/ai-sdk ai @ai-sdk/anthropic
# (or @ai-sdk/openai, etc.: bring your own model)

import { generateText } from 'ai';
import { audiolab } from '@audiolabtools/ai-sdk';
import { anthropic } from '@ai-sdk/anthropic';

const result = await generateText({
  model: anthropic('claude-opus-4-8'),
  tools: audiolab({ apiKey: process.env.AUDIOLAB_API_KEY }).tools,
  prompt: 'What is the loudness and true-peak of https://example.com/song.wav?',
});

console.log(result.text);

The LLM picks the right tool from your prompt, calls AudioLab's hosted API, and folds the structured response into its answer.

Tools

Every tool takes a public http(s) URL to an audio file; the AudioLab API fetches and decodes it server-side (nothing is uploaded by the caller).

Tool	Endpoint	Returns
analyzeLoudness	POST /mixlab/analyze	Integrated LUFS (EBU R128 / BS.1770-4), true-peak, LRA, crest factor, stereo correlation, tonal-balance bands
checkTarget	POST /mixlab/check-target	Pass/fail vs a delivery target (spotify / apple-music / youtube / tidal / amazon-music / podcast / ebu-broadcast / atsc-broadcast, or custom), with deltas + an ffmpeg loudnorm fix
analyzeTimeseries	POST /mixlab/timeseries	Short-term LUFS over time + downsampled waveform peaks
getSpectrum	POST /mixlab/spectrum	FFT magnitudes + 7-band energies
analyzeVoice	POST /voicelab/qa	Speech/silence ratio, speaking rate, SNR, noise floor, room echo, sibilance & clipping risk
getSpeechSegments	POST /voicelab/segments	Voiced regions with start/end + per-segment RMS
indexSignal	POST /signallab/index	Content-type guess, tags, clipping/silence regions, brightness & dynamics buckets
compareLoudness	two mixlab/analyze calls	A/B: runs loudness on urlA + urlB, returns both

Full TypeScript types ship in index.d.ts, with autocomplete on every response field.

Configuration

audiolab({
  apiKey?: string;   // AudioLab API key. Falls back to AUDIOLAB_API_KEY env var.
  baseUrl?: string;  // Override base URL. Default: https://audiolab.tools/v1
  fetch?: typeof fetch;  // Custom fetch (for testing / proxying).
})

Use one tool instead of all eight:

const { analyzeLoudness } = audiolab({ apiKey }).tools;
await generateText({ model, tools: { analyzeLoudness }, prompt: '...' });

Status

The hosted API is live with self-serve keys (free tier + paid tiers, Stripe billing live). Sign in at https://audiolab.tools/account to get a key. Prefer to try before wiring it up? The on-device playground at https://audiolab.tools/api#playground runs the same analysis in your browser (no signup, no upload).

License

MIT © Nathan Renting