Audio

​

Get Recent Audio

​

Endpoint

GET https://api.mentra.glass/api/audio/:userId

GET https://devapi.mentra.glass/api/audio/:userId

GET http://localhost:8002/api/audio/:userId

​

Parameters

​

Query Parameters

​

Response

• Binary audio data stream
• Content-Type: application/octet-stream
• Format: PCM audio buffer (concatenated audio chunks)

{
  "success": false,
  "message": "Invalid API key." // or "Authentication required. Provide apiKey, packageName, and userId."
}

{
  "success": false,
  "message": "Unauthorized package name"
}

{
  "error": "Session not found" // or "No audio available", "No decodable audio available"
}

{
  "error": "Error fetching audio"
}

​

Implementation

• File: packages/cloud/src/routes/audio.routes.ts:47-91
• Middleware: shazamAuthMiddleware - Validates package and API key
• Service: Uses AudioManager.getRecentAudioBuffer()

​

Authorization

• Only com.augmentos.shazam package is allowed
• Requires valid API key for the package
• Must specify target user ID in both URL and query parameters

​

Audio Processing

• Returns buffered audio from userSession.audioManager.getRecentAudioBuffer()
• Audio chunks are concatenated into single buffer
• LC3 codec support is commented out but planned for future

​

Text-to-Speech

​

Endpoint

GET https://api.mentra.glass/api/tts

GET https://devapi.mentra.glass/api/tts

GET http://localhost:8002/api/tts

​

Query Parameters

​

Response

• Audio stream
• Content-Type: audio/mpeg
• Streaming MP3 audio data
• Connection: keep-alive

{
  "success": false,
  "message": "Text parameter is required and must be a string" // or other validation errors
}

{
  "success": false,
  "message": "TTS service not configured" // or "Internal server error"
}

​

Voice Settings Example

{
  "stability": 0.5,
  "similarity_boost": 0.5,
  "style": 0.5,
  "use_speaker_boost": true
}

​

Implementation

• File: packages/cloud/src/routes/audio.routes.ts:94-223
• Service: Proxies to ElevenLabs API
• Streaming: Streams response directly to client using fetch API

​

Configuration

• ELEVENLABS_API_KEY: Your ElevenLabs API key
• ELEVENLABS_DEFAULT_VOICE_ID: Default voice to use (optional if voice_id provided)

​

Example Request

GET /api/tts?text=Hello%20world&voice_id=21m00Tcm4TlvDq8ikWAM

​

ElevenLabs Integration

• API endpoint: https://api.elevenlabs.io/v1/text-to-speech/{voice_id}/stream
• Requires xi-api-key header for authentication
• Supports streaming response for low latency

​

Error Codes

​

Notes

• Audio endpoint is restricted to Shazam app for music recognition
• TTS endpoint is publicly accessible but requires ElevenLabs configuration
• Audio is buffered and retrieved from AudioManager
• TTS responses are streamed for low latency
• Both endpoints have incorrect route definitions that include /api prefix when they shouldn’t