NVIDIA Magpie TTS locally: German speech output as a microservice
The speech recognition is in place: with Parakeet (Part 2) and Canary (Part 3) I covered the input...
Read More
Category: Top story
NVIDIA Canary locally: multilingual speech recognition and translation as a NIM
In Part 2 I set up Parakeet as a streaming-capable ASR NIM for German and ran it as a live service...
Read More
NVIDIA NIM locally: running German speech recognition as a microservice
In my last post I ran NVIDIA Nemotron ASR Streaming directly with NeMo locally. That was the...
Read More
Install NVIDIA Nemotron ASR Streaming Locally – Step-by-Step Guide
Real-time speech recognition is one of the building blocks I absolutely want to self-host for...
Read More
Hermes Agent as a Native Desktop App on Windows
Nous Research has given its open-source Hermes Agent something with the “Surface...
Read More
llama-benchy: llama-bench-style LLM benchmarks for any OpenAI-compatible endpoint
If, like me, you run your models locally and sovereignly, you know the problem: I want to know how...
Read More
Fully Local Web Search – How I Wean My Hermes Agent off the Cloud Drip
My Hermes Agent has been able to search the web and extract page content for a while now. Until...
Read More
Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator
Anyone documenting complex infrastructures quickly hits the limits of static diagrams and MS...
Read More
Firecrawl in Your Own LAN: Sovereign Web Scraping with a Local Ollama Server
It has been itching me for quite a while: Firecrawl self-hosted, in my own LAN, with no cloud...
Read More
Sovereign AI on a 10-year-old office PC: NemoClaw on a Dell OptiPlex 5040 with my own Ollama server
Why NemoClaw is moving into my AI workshop Over the past few weeks I’ve shown you in several...
Read More
Sovereign AI in the Home Network: Running the Hermes Agent Dashboard Securely as a systemd Service
My Hermes Agent has been running productively on my application server for several weeks: as a...
Read More
An MCP Server for Multi-GPU Monitoring – Step by Step with Python, pynvml and EMA Smoothing
In my last posts I built the inference layer (Ollama, TensorRT-LLM) and the orchestrator layer...
Read More
- NVIDIA Magpie TTS locally: German speech output as a microservice
The speech recognition is in place: with Parakeet (Part 2) and Canary (Part 3) I covered the input direction, speech to text, natively on NVIDIA. Now comes the opposite direction, the voice output. In this post I run NVIDIA Magpie TTS as a local NIM and have German text read aloud naturally. This is the… Read more: NVIDIA Magpie TTS locally: German speech output as a microservice - NVIDIA Canary locally: multilingual speech recognition and translation as a NIM
In Part 2 I set up Parakeet as a streaming-capable ASR NIM for German and ran it as a live service with low latency. In this post I take on the sister model: NVIDIA Canary as a NIM. Canary does not shine at latency but at accuracy, and it can do something Parakeet cannot: translate.… Read more: NVIDIA Canary locally: multilingual speech recognition and translation as a NIM - NVIDIA NIM locally: running German speech recognition as a microservice
In my last post I ran NVIDIA Nemotron ASR Streaming directly with NeMo locally. That was the “bare” route via the framework. In this post I go one step further and dive into NVIDIA NIM. NIM stands for NVIDIA Inference Microservices, the microservice variant NVIDIA uses to ship its models as ready-made, optimized containers. The… Read more: NVIDIA NIM locally: running German speech recognition as a microservice - Install NVIDIA Nemotron ASR Streaming Locally – Step-by-Step Guide
Real-time speech recognition is one of the building blocks I absolutely want to self-host for sovereign voice agents. My vision is always to run everything locally – without a cloud API, without my audio recording ever leaving my network. With the model updated in March 2026, NVIDIA Nemotron ASR Streaming (0.6B), there is now a… Read more: Install NVIDIA Nemotron ASR Streaming Locally – Step-by-Step Guide - Hermes Agent as a Native Desktop App on Windows
Nous Research has given its open-source Hermes Agent something with the “Surface Release” (version 0.16.0, June 2026) that I had been waiting for a long time: a true native desktop app for macOS, Linux, and Windows. Until now, Hermes Agent was a command-line and gateway tool. But with the new release, there is now a… Read more: Hermes Agent as a Native Desktop App on Windows
The tutorial offers a clear and practical guide for setting up and running the Tensorflow Object Detection Training Suite. Could…
This works using an very old laptop with old GPU >>> print(torch.cuda.is_available()) True >>> print(torch.version.cuda) 12.6 >>> print(torch.cuda.device_count()) 1 >>>…
Hello Valentin, I will not share anything related to my work on detecting mines or UXO's. Best regards, Maker
Hello, We are a group of students at ESILV working on a project that aim to prove the availability of…