Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator
Anyone documenting complex infrastructures quickly hits the limits of static diagrams and MS...
Read More
Category: Software
TensorRT-LLM on the RTX A6000 Ada: Preparing for the Edge-LLM Ecosystem
With TensorRT Edge-LLM, NVIDIA has released a C++-only inference framework for embedded platforms....
Read More
How to Install and Use OpenAI’s Whisper Locally for Automatic Transcription and Translation
Imagine having an effortless way to convert your favorite podcasts, YouTube videos, or conference...
Read More
Real-Time Landmine Detection: Robotic Integration of FLIR Camera Module, RGB Camera, and YOLO Neural Network
The first robot which I used to search for land mines / metal in the ground was build 2015 by...
Read More
Installation of Anaconda on Ubuntu LTS version
I wrote this post because I always install my programs and associated packages such as drivers in...
Read More
CUDA driver installation under Ubuntu
I most often use Ubuntu as my operating system when it comes to trying out new developments in the...
Read More
oobabooga – text-generation-webui mit Llama 2 – local Installation
I always wanted to try a Llama model of META and with the release of Llama 2 it was then so far...
Read More
YOLOv5 – Optimization of training data for PFM-1 antipersonnel mine detection
After training the first 31 models for anti-personnel mine detection, my data set has grown...
Read More
YOLOv5 – Training a neural network for PFM-1 antipersonnel mine detection
This paper is about training a neural network based on YOLOv5. This YOLO network should be able to...
Read More
Segment Anything – Introduction
This time it’s about the exciting topic of image segmentation or as META calls it Segment...
Read More
Dalai a simple ChatGPT clone runs locally without cloud connection
I would like to start my article by briefly describing what Alpaca-LLaMA is for a project. It is...
Read More
Mein neues Buch
Souveräne KI
Strategie und Aufbau der eigenen Open-Source-Infrastruktur
Eigene LLMs betreiben, unabhängig von der Cloud. Von der Hardware bis zum laufenden System.
Jetzt bei Amazon bestellenRoboter-Autos mit dem ESP32
Bauen, programmieren, steuern
Vom ersten Chassis bis zur WLAN-Steuerung. Schritt für Schritt zum eigenen Roboter-Auto.
Jetzt bei Amazon bestellenBuch und E-Book, Rheinwerk Verlag
Werbung / Affiliate-Link
- Local Voice Agent: Wiring ASR, LLM and TTS into a Loop with NVIDIA Pipecat Locally
Every building block is now available locally: ASR (Parakeet, Canary), TTS (Magpie), an LLM via my Ollama server and the orchestrator (NAT, Part 5). Now I’m connecting them into a continuous, interruptible speech loop. This will be my first small local voice agent. What I’m aiming for is a kind of general-purpose agent: I speak,… Read more: Local Voice Agent: Wiring ASR, LLM and TTS into a Loop with NVIDIA Pipecat Locally - NVIDIA NeMo Agent Toolkit (NAT): set up the agent orchestrator locally
The two halves of a voice agent are in place: with Parakeet (Part 2) and Canary (Part 3) the agent listens, with Magpie (Part 4) it answers. What’s still missing is the brain: the layer that turns recognized text into a decision and triggers the matching answer or action. That’s exactly what I take on… Read more: NVIDIA NeMo Agent Toolkit (NAT): set up the agent orchestrator locally - NVIDIA Magpie TTS locally: German speech output as a microservice
The speech recognition is in place: with Parakeet (Part 2) and Canary (Part 3) I covered the input direction, speech to text, natively on NVIDIA. Now comes the opposite direction, the voice output. In this post I run NVIDIA Magpie TTS as a local NIM and have German text read aloud naturally. This is the… Read more: NVIDIA Magpie TTS locally: German speech output as a microservice - NVIDIA Canary locally: multilingual speech recognition and translation as a NIM
In Part 2 I set up Parakeet as a streaming-capable ASR NIM for German and ran it as a live service with low latency. In this post I take on the sister model: NVIDIA Canary as a NIM. Canary does not shine at latency but at accuracy, and it can do something Parakeet cannot: translate.… Read more: NVIDIA Canary locally: multilingual speech recognition and translation as a NIM - NVIDIA NIM locally: running German speech recognition as a microservice
In my last post I ran NVIDIA Nemotron ASR Streaming directly with NeMo locally. That was the “bare” route via the framework. In this post I go one step further and dive into NVIDIA NIM. NIM stands for NVIDIA Inference Microservices, the microservice variant NVIDIA uses to ship its models as ready-made, optimized containers. The… Read more: NVIDIA NIM locally: running German speech recognition as a microservice
The tutorial offers a clear and practical guide for setting up and running the Tensorflow Object Detection Training Suite. Could…
This works using an very old laptop with old GPU >>> print(torch.cuda.is_available()) True >>> print(torch.version.cuda) 12.6 >>> print(torch.cuda.device_count()) 1 >>>…
Hello Valentin, I will not share anything related to my work on detecting mines or UXO's. Best regards, Maker
Hello, We are a group of students at ESILV working on a project that aim to prove the availability of…