gensft Speech · on-premise speech platform

On-premise speech-to-text. Keep every word private.

Turn live conversations and recorded audio into timestamped transcripts without sending them to a cloud API. Run on your own CPU or GPU infrastructure, with optional translation and a typed API for your existing systems.

Talk directly with an engineer about your audio, hardware and security boundary.

On-premise deploymentOffline capableCPU and GPU supportStreaming and batchEnterprise integration
One private processing pipelineLive + recorded audio
customer-controlled boundaryegress: none
audio in
16 kHz · pcm · live
local inference
vad
asr · gpu0
mt · optional
transcript out
00:04
00:11
00:19
00:26
partial → final · ordered · timestamped▮ translation path

From audio input to transcript output, processing stays inside your environment. Illustrative flow; capacity is evaluated for your hardware and workload.

01 · The problem

When audio cannot leave, bring transcription to it.

Conventional cloud transcription is convenient until the recordings are confidential. Then every upload becomes a question for legal, security and finance. gensft Speech brings speech recognition to the place your recordings already live. Make conversations searchable and usable without handing the audio to an external transcription service.

01Sensitive audio leaves the organisation the moment it is uploaded
02Data sovereignty becomes a contract question rather than a network fact
03Per-minute pricing makes costs scale with usage you cannot fully predict
04Every transcript depends on an internet connection being up
05Limited control over where, how and on what hardware processing runs
06Restricted environments cannot reach external services at all
02 · Benefits

Deploy within your infrastructure. Keep sensitive audio under your control.

01

Keep sensitive data private

Audio and transcripts remain inside your controlled environment. Nothing is uploaded, and nothing is retained unless you configure it to be.

02

Operate without cloud dependency

Deploy in private networks, data centres, restricted environments or fully air-gapped infrastructure. Internet access is not a requirement.

03

Scale predictably

Bounded workloads, admission control and hardware-specific capacity profiles give predictable behaviour under demand — no surprise bills, no silent degradation.

04

Integrate with existing systems

Strongly typed APIs for batch processing, bidirectional live streaming, health monitoring and capability discovery slot into the software you already run.

03 · Core capabilities
Live streaming transcription
Batch file transcription
Timestamped transcript segments
Partial and final streaming results
Multilingual speech recognition
Optional text translation
Voice activity detection
CPU-optimised deployment
NVIDIA GPU acceleration
Configurable model and accuracy profiles
Backpressure and overload protection
Cancellation and request deadlines
Health checks, metrics and structured diagnostics
Offline deployment packages
04 · How it works

Five stages. One boundary.

01

Ingest

Receive recorded files or live audio streams over the API.

02

Normalise

Decode, resample, validate and prepare the audio for inference.

03

Transcribe

Process speech using locally deployed inference workers on CPU or GPU.

04

Translate

Optionally translate completed transcript segments in place.

05

Deliver

Return ordered, timestamped partial or final results through the stream.

05 · Engineered for production

More than a model. A dependable production system.

A speech model is a component. A speech service has to accept a thousand malformed files, run for months, refuse work it cannot finish and shut down cleanly when told. gensft Speech is written in modern C++ with that second job in mind.

Systems architectureModern C++ with explicit resource ownership and deterministic cleanup — memory and handles are released when work ends, not when a garbage collector gets round to it.
Bounded by designQueues have limits, memory use is controlled, and strict media and workload limits reject what the node cannot safely process.
Hardware-aware schedulingBackend-specific CPU and GPU scheduling places work where it will finish fastest without starving neighbouring requests.
Graceful under pressureCancellation, deadlines and orderly shutdown mean a busy or restarting node fails requests cleanly rather than silently.
Ordered resultsStreaming output is reassembled in order, so partial and final segments arrive as a coherent transcript.
Verified buildsReproducible builds, model integrity verification and offline diagnostics, backed by load, soak, sanitizer and malformed-input testing.
06 · Deployment options

Air-gapped transcription on your own hardware.

Deploy in private networks or fully air-gapped environments, with CPU and NVIDIA GPU options for your workload and offline installation packages.

profile a

CPU deployment

For environments prioritising compatibility, simplicity and controlled infrastructure costs. Runs on the servers you already have.

x86-64 with vector extensions
quantised model profiles
no driver dependencies
profile b

NVIDIA GPU deployment

For higher throughput, lower latency and larger concurrent workloads. Capacity profiles are published per supported GPU.

CUDA-enabled inference workers
larger models at interactive latency
CPU fallback for overflow
alsoOCI container imagesOffline installationPrivate network operationOptional system-service installKubernetes integration per project
07 · Security and privacy

Built for environments where privacy is a requirement — not an option.

Built for environments where cloud processing is not an option. Every control below is a property of the software you run, verifiable on your own hosts.

Regulatory compliance depends on your deployment, configuration, policies and operating environment. gensft Speech provides controls that support a compliant deployment; it does not by itself constitute certification under any regime.

Processing remains within customer-controlled infrastructure
No audio or transcript persistence by default
Configurable retention policies
TLS and optional mutual TLS
Authentication and authorisation integration points
Request and resource limits
Model checksum validation
Redacted structured logging
Software bill of materials
Signed release artifacts
Offline operational diagnostics
08 · Use cases

Where the recording cannot leave.

Confidential meetings

Board, deal and HR conversations become searchable minutes without a recording ever leaving the room's network.

Legal interviews and evidence

Recorded statements are transcribed with timestamps that hold up to review, under chain-of-custody your team controls.

Healthcare documentation

Clinical dictation and consultations are captured on-site, so patient audio stays with the institution that recorded it.

Government and public sector

Hearings, consultations and casework recordings are processed inside the department's own accredited environment.

Contact centres

Every call is transcribed for quality and compliance review at a fixed infrastructure cost, not a per-minute one.

Research interviews

Interview corpora are transcribed and translated in bulk, without participant audio being shared with a third party.

Media monitoring and archives

Decades of broadcast audio become text you can search, on hardware sized to the backlog.

Secure multilingual operations

Teams working across languages get translated transcripts from a system that is never reachable from the internet.

09 · Performance
gensft Speech — benchmark sheethardware profile: TBD
01Word error rateBenchmark pending
02Real-time factorBenchmark pending
03Time to first partial resultBenchmark pending
04Concurrent streamsBenchmark pending
05Peak RAMBenchmark pending
06Peak GPU memoryBenchmark pending
07Supported model profileBenchmark pending

Performance depends on the selected model, quantisation, hardware, audio quality, language and concurrency. Figures are published per hardware profile once measured on reference workloads.

10 · Integration

Private transcription API for your existing systems.

gRPC with Protocol Buffers. Batch calls for files, a bidirectional stream for live audio, and health and capability endpoints so your orchestrator knows what a node can do before it sends work.

Bidirectional streaming for live audio
Stable, documented error semantics
Request cancellation honoured mid-stream
Deadlines propagated to inference workers
Health and capability endpoints for orchestration
Talk through your integration
speech/v1/speech.protoillustrative
service Speech {
  rpc Transcribe(TranscribeRequest) returns (Transcript);
  rpc StreamTranscribe(stream AudioChunk)
      returns (stream TranscriptEvent);
  rpc GetCapabilities(Empty) returns (Capabilities);
  rpc Check(HealthRequest) returns (HealthStatus);
}

message TranscriptEvent {
  uint32 segment_id  = 1;
  bool   is_final    = 2;
  int64  start_ms    = 3;
  int64  end_ms      = 4;
  string text        = 5;
  string translation = 6;  // optional
}
11 · Under the hood
Modern C++The service core: ownership, scheduling, limits and lifecycle.
whisper.cppSpeech recognition inference on CPU and NVIDIA GPU.
FFmpegDecoding and resampling of the media formats your systems produce.
gRPC + Protocol BuffersThe typed API surface for batch and streaming.
CTranslate2Optional translation of completed segments, also on-premise.
Structured observabilityMetrics, health and redacted logs your existing tooling can ingest.
Hardware-aware schedulingWork placed per backend so throughput stays predictable.
12 · Questions

No. Ingest, inference, translation and delivery all run on the hosts you deploy. The service makes no outbound connections as part of processing.

13 · Next step

Let’s map speech to your environment.

Bring your deployment constraints. We’ll discuss how gensft Speech fits your infrastructure and what to evaluate before you commit.

01

Your security boundary

Private network, on-premise or air-gapped requirements.

02

Your workload

Languages, live streams, batch volumes and available hardware.

03

Your integration

Where transcripts go and how the API fits your existing systems.

gensftWe build speech infrastructure for organisations that cannot send their audio elsewhere.hello@gensft.com
Get in touch

Arrange a technical demo

Tell us your name, organisation, languages, and expected workload. Tell us where you plan to deploy and about any hardware or integration requirements.

Your details are stored privately for our team to review. Please don’t include passwords or sensitive documents. Prefer email? hello@gensft.com