Voice interaction in service counters and field environments

Failures in voice AI project deployment rarely stem from cloud API integration. Instead, most originate from mismatches between front-end acoustic capture and edge compute hardware: deploying consumer single-mics in noisy halls resulting in collapsed recognition rates; severe acoustic feedback from high-volume onboard speakers preventing barge-in; or blindly pursuing fully offline large models that quadruple hardware budgets.

A deployable voice system requires close synergy between front-end acoustic capture (mic array & hardware AEC) and edge compute units (VAD / ASR / edge LLM / TTS). System integrators and solution builders must verify four sequential dimensions: acoustic distance & environment, barge-in requirements, edge vs. cloud workload partitioning, and concurrency vs. latency demands.

This guide provides an end-to-end hardware selection framework from microphones to edge computing gateways.

Quick Answer: Bundled Hardware Selection Matrix (Microphone + Compute Unit)

The table below summarizes recommended combinations across typical application scenarios and interaction models:

Deployment Scenario & ProfileRecommended Hardware BundleCapture Tier (Microphone)Processing Tier (Edge Box)Key Basis & Measured PerformanceReference System Price
Service window / counter near-field transcriptionReSpeaker Lite + reComputer RK3576ReSpeaker Lite (2-Mic USB), 1–3m near-fieldreComputer RK3576 (Onboard 6 TOPS NPU)Dual-mic beamforming; RK3576 NPU powers SenseVoice at 12-channel concurrency, p95 latency 1067 msApprox. $180–230
Meeting room / round-table 360° far-field minutesReSpeaker Mic Array v2.0 + reComputer RK3576ReSpeaker v2.0 (4-Mic circular array), 3–5mreComputer RK3576 (or reRouter CM4)Hardware XMOS AEC + DOA direction-of-arrival speaker tracking; raw audio stays strictly within the roomApprox. $220–270
Interactive kiosk / service robot with full-duplex barge-inReSpeaker XVF3800 + reComputer RK3576ReSpeaker XVF3800 4-Mic (Flagship DSP)reComputer RK3576 (Local voice, cloud LLM)Flagship double-talk AEC; instant sub-second voice barge-in even during loud onboard speaker playbackApprox. $230–280
Offline confidential voice LLM appliance (finance/healthcare)ReSpeaker XVF3800 + reComputer J4012ReSpeaker XVF3800 or LitereComputer J4012 (Orin NX 16G, 100 TOPS)Full offline closed-loop: Audio + Qwen3.5-4B local LLM on-device, decoding at 35 tok/s, zero cloud exposureApprox. $970–1870
Single-point standalone desk transcriptionReSpeaker Lite + reRouter CM4ReSpeaker Lite (2-Mic USB)reRouter CM4 (Quad-core A72)VAD and lightweight ASR execute on CPU; fits 1–2 person single-point desksApprox. $220–280
Mobile inspection / healthcare rounds / field patrolReSpeaker Clip + Phone/CloudReSpeaker Clip (Wearable lapel badge)Offline recording, phone app Bluetooth sync14–18 hours continuous recording, streams audio to cloud via app without fixed edge hardwareApprox. $39–59

Note: Reference prices indicate single-unit/bundle budgetary ranges (collected October 2026) and vary with specifications and volume; final pricing is subject to the official Bazaar store or sales quote.

Three conditions modify the selection matrix above:

  • Must support immediate voice barge-in while speaking —— The microphone must feature hardware DSP AEC, specifically ReSpeaker XVF3800 or ReSpeaker Flex. Standard software mics mute themselves during playback, rendering true conversational barge-in impossible.
  • Language support beyond Chinese and English —— reComputer RK3576 models are optimized for Chinese and English. For multilingual requirements (Japanese, Korean, Arabic, and up to 30 languages), select reComputer RK3588, J3011, or J4012.
  • Speaker distance exceeds 3 meters or ambient noise surpasses 70 dB —— Acoustic signal-to-noise ratio must be resolved first by positioning mics closer or adding units. Compute power cannot fix physically clipped or distorted acoustic inputs.

To generate a tailored hardware bill of materials based on your acoustic deployment scenario, use the interactive configurator below; for complex setups involving high ambient noise, multilingual offline LLMs, or custom enclosure constraints, you can also query our AI Solution Assistant (powered by solution-cli) directly:

🤖 Ask the AI Solution Assistant (Powered by Official Hardware & Accessory Database):

  • Instant Terminal Query: Run npx @seeed-studio/solution-cli hub get acoustic-audio-ai --sections products,architecture to inspect recommended hardware and topologies in one step.
  • Natural Language Q&A: Ask directly in Claude Code, Codex, Antigravity, or Cursor (e.g., "We have a kiosk environment with 70dB ambient noise requiring 3-meter barge-in voice interruption and offline command recognition; what microphone and compute box bundle should we choose?"). The AI assistant calculates compute loads and verifies box contents. Learn more in the solution-cli documentation and installation guide.

Configure your setup

Tell us whether you need transcription or conversation and what must run locally; we work out the microphone, speaker and compute box.

  • reSpeaker Lite dual-mic + reRouter CM4

    硬件/物料名称数量型号/SKU说明
    reSpeaker Lite dual-mic (desk, near-field)1107990273-
    reRouter CM4 (local VAD · ASR)1110110110-
  • reSpeaker XVF3800 4-mic array + reComputer RK3576

    硬件/物料名称数量型号/SKU说明
    reSpeaker XVF3800 4-mic array (on-board AEC, room coverage)1101991441-
    reComputer RK3576 (local VAD · ASR, multi-channel)1100052518-
  • reSpeaker Clip + reComputer RK3576

    硬件/物料名称数量型号/SKU说明
    reSpeaker Clip (wearable, uploads via phone app)1100020126-
    reComputer RK3576 (local VAD · ASR, multi-channel)1100052518-
  • reSpeaker Lite dual-mic

    硬件/物料名称数量型号/SKU说明
    reSpeaker Lite dual-mic (desk, near-field)1107990273-
  • reSpeaker XVF3800 4-mic array

    硬件/物料名称数量型号/SKU说明
    reSpeaker XVF3800 4-mic array (on-board AEC, room coverage)1101991441-
  • reSpeaker Clip

    硬件/物料名称数量型号/SKU说明
    reSpeaker Clip (wearable, uploads via phone app)1100020126-
  • reSpeaker Lite dual-mic + reComputer J4012 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Lite dual-mic (desk, near-field)1107990273-
    reComputer J4012 (local VAD · ASR · TTS · LLM)1110110145-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker XVF3800 4-mic array + reComputer J4012 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker XVF3800 4-mic array (on-board AEC, room coverage)1101991441-
    reComputer J4012 (local VAD · ASR · TTS · LLM)1110110145-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker Flex XVF3800 + reComputer J4012 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Flex XVF3800 (split board, on-board AEC, built-in)1100005504-
    reComputer J4012 (local VAD · ASR · TTS · LLM)1110110145-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker Lite dual-mic + reComputer RK3576 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Lite dual-mic (desk, near-field)1107990273-
    reComputer RK3576 (local VAD · ASR · TTS; LLM in the cloud)1100052518-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker XVF3800 4-mic array + reComputer RK3576 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker XVF3800 4-mic array (on-board AEC, room coverage)1101991441-
    reComputer RK3576 (local VAD · ASR · TTS; LLM in the cloud)1100052518-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker Flex XVF3800 + reComputer RK3576 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Flex XVF3800 (split board, on-board AEC, built-in)1100005504-
    reComputer RK3576 (local VAD · ASR · TTS; LLM in the cloud)1100052518-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker Lite dual-mic + reRouter CM4 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Lite dual-mic (desk, near-field)1107990273-
    reRouter CM4 (local VAD and audio relay; ASR, LLM, TTS in the cloud)1110110110-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker XVF3800 4-mic array + reRouter CM4 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker XVF3800 4-mic array (on-board AEC, room coverage)1101991441-
    reRouter CM4 (local VAD and audio relay; ASR, LLM, TTS in the cloud)1110110110-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-
  • reSpeaker Flex XVF3800 + reRouter CM4 + Speaker 4Ω 5W

    硬件/物料名称数量型号/SKU说明
    reSpeaker Flex XVF3800 (split board, on-board AEC, built-in)1100005504-
    reRouter CM4 (local VAD and audio relay; ASR, LLM, TTS in the cloud)1110110110-
    Speaker 4Ω 5W (JST port on the mic board, plays replies)1114993346-

Why Process Voice at the Edge

Compared to streaming raw audio over the public internet to cloud services, edge processing delivers three core engineering advantages:

1. Latency reduced under 300ms for natural barge-in.
Piping audio chunks to cloud ASR, then to cloud LLMs, and finally streaming cloud TTS audio back creates round-trip latencies of 1.2 to 2.5 seconds, breaking conversational rhythm. Edge processing tightly couples local VAD with onboard ASR, triggering intent in 200–300ms for human-like conversational responsiveness.

2. Sensitive voice data never leaves the facility.
In clinical consultations, banking counters, government halls, and executive boardrooms, speech carries patient names, diagnostics, and financial records. Edge architectures process audio in local RAM, forwarding only structured text to downstream enterprise systems.

3. Resilient autonomous operation during network dropouts.
In manufacturing shops, underground utility corridors, and remote fields, cellular connectivity frequently drops. Full on-device voice nodes run local VAD, ASR, and offline command matching (or 4B local LLMs) autonomously, maintaining control commands even when disconnected.


System Architecture & Four Field Scenarios

For complete system architecture and industrial references, visit the Audio & Acoustic AI Solution.

Voice System Architecture

Mic Array (Acoustic Capture & Hardware AEC) → Edge Box (VAD / ASR / LLM / TTS) → Speaker → Business System

Scenario 1: Service Window & Counter Intercom (Transcription & Archiving)

  • Environment: Counter glass separating staff and public (0.8–1.5m), background hall chatter and paper rustling.
  • Strategy: Deploy ReSpeaker Lite (2-Mic USB array) for directional beamforming, coupled with reComputer RK3576 running SenseVoice to produce structured real-time logs.

Scenario 2: Conference Rooms & Round-Table Meetings (360° Omnidirectional Minutes)

  • Environment: Participants seated 2–4m around a conference table speaking in turns.
  • Strategy: Position ReSpeaker Mic Array v2.0 (4-Mic circular array) at table center. Its XMOS DSP provides 360° capture and DOA (Direction-of-Arrival) angle output to distinguish speakers.

Scenario 3: Exhibition Kiosks & Service Robots (Full-Duplex Barge-in)

  • Environment: High-output onboard speakers delivering voice prompts, with visitors interrupting spontaneously.
  • Strategy: Deploy ReSpeaker XVF3800 with flagship XMOS DSP. Speaker output loops back into the DSP as reference, canceling playback echo and cutting speech the millisecond an interruption occurs.

Scenario 4: Industrial Control Cabinets & Hands-Free Workstations (Offline Control)

  • Environment: Motor and fan ambient noise exceeding 70 dB; workers' hands occupied with tools.
  • Strategy: Pair noise-tuned mics with reComputer RK3576 running local keyword spotting (KWS). Direct DI/DO and RS485 interfaces trigger emergency stop and machine line switching without network reliance.

Four-Step Engineering Selection Guide

Step 1: Select Front-End Microphone Array by Distance and Form Factor

Microphone ModelArray Architecture & ChipNominal Pickup RangePickup Pattern & FeaturesHardware AECSpeaker Amp OutputForm FactorReference Price
ReSpeaker Lite2-Mic Linear Array / Onboard DSP1–3 metersDirectional BeamformingBasic AECOnboard 3W amp headerDesktop, counter, kioskApprox. $19.9
ReSpeaker Mic Array v2.04-Mic Circular Array / XMOS XVF30003–5 meters360° Omnidirectional + DOAHardware chip-level AEC3.5mm line out (needs external amp)Meeting table center, ceiling mountApprox. $59.0
ReSpeaker XVF38004-Mic Omnidirectional / XMOS XVF3800 Flagship DSP3–5 meters360° / Deep Noise Suppression / DereverberationFlagship Double-Talk AEC (Barge-in)Onboard high-power speaker headerRobots, interactive kiosks, loud speakersApprox. $69.0
ReSpeaker FlexSplit 4-Mic Array / XMOS DSP3–5 metersDetached array & processing boardHardware chip-level AECExternal 10W speaker loadCustom enclosures, embedded robotsApprox. $79.0
ReSpeaker ClipWearable Lapel / High SNR Mic0.5–1 meterNear-field voice captureNone (One-way recording)NoneInspector lapel, doctor rounds, mobile staffApprox. $39–59

Step 2: Define Interaction Flow & Barge-in Requirements

Interaction ModelTypical TasksDevice Plays AudioBarge-in NeededMicrophone RequirementCompute Stack
Pure TranscriptionCounter logs, meeting minutes, inspection logsNoNoStandard mic (Lite / v2.0 / Clip)VAD + ASR
Turn-Based DialogStandard inquiry desks, slow announcementsYes (Low volume)RarelyBasic AEC (ReSpeaker Lite)VAD + ASR + Cloud LLM + TTS
Full-Duplex DialogInteractive robots, loud exhibition screensYes (High volume)Immediate barge-inMandatory Flagship Hardware AEC (XVF3800 / Flex)VAD + ASR + Low-latency LLM + TTS

Step 3: Match Edge Compute Gateway by Concurrency and Local LLM Scope

Compute Gateway ModelArchitecture & NPUSenseVoice ConcurrencyMeasured p50 / p95 LatencyLLM Deployment TierTarget ScaleReference Price
reRouter CM4Quad-core A72 1.5GHz1–2 channels1200ms / 2100msTranscription or cloud LLMSingle-desk stationApprox. $200–260
reComputer RK3576Quad A72 + Quad A53, 6 TOPS NPU12 channels concurrent680ms / 1067msOn-device voice + Cloud LLMMulti-window counters (Primary recommendation)Approx. $160–210
reComputer RK3588Octa-core CPU, 6 TOPS NPU16 channels concurrent510ms / 890msMultilingual voice + Cloud LLMInternational airports (30 languages)Approx. $240–310
reComputer J4012NVIDIA Orin NX 16GB, 100 TOPS20+ channels concurrent320ms / 580msFull local closed-loop: On-device 4B–8B LLMOffline confidential appliance, decodes 35 tok/sApprox. $900–1800

Step 4: Verify Acoustic Mechanical Isolation & Cabling

  1. Speaker-to-Mic Mechanical Vibration Decoupling: If mics and speakers share one enclosure, physical vibration conducts directly to mic diaphragms. Mount speakers using silicone damping washers and keep at least 15 cm physical separation with internal chamber baffling.
  2. Cabling Topology: Use direct USB connections when mic and host share an enclosure. For ceiling/wall mounts (>3m away), use shielded twisted pairs or networked mics with XIAO ESP32-S3 over Ethernet/Wi-Fi.
  3. Ambient Noise Baseline: If steady noise exceeds 70 dB, apply pre-filtering and reposition mics within 30 cm of speakers.


Solution Architecture & Reference Design

  • Complete Solution & Topology: Visit the Acoustic & Audio AI Solution for microphone array topologies, edge-cloud split compute pipelines, and the dynamic BOM configurator.
  • Runnable Reference Implementation: Deploy the Conversational Voice AI Reference Design to evaluate local SenseVoice with LLM inference, verified latency, and deployment scripts.

Data Sources & Test Methodology

  • Concurrency Benchmark: Evaluated using open-source SenseVoice-Small model; audio clips 3–4 seconds; p50/p95 timed from end-of-speech to complete text output.
  • On-Device LLM Decoding: reComputer J4012 running Qwen3.5-4B INT4 with 2K token context, averaging 35 tokens/second.
  • Acoustic Specs & AEC Performance: Based on XMOS XVF3800 and XVF3000 datasheets and Seeed anechoic chamber test data.
  • Solutions & Reference Designs: Acoustic & Audio AI Solution and Conversational Voice AI Reference Design.