Install LibreChat on Gigabyte AI TOP ATOM: Professional Chat Interface for Local LLM Models
After showing in my previous posts how to install Ollama, Open WebUI, ComfyUI, LLaMA Factory,...
Read More
Category: Gigabyte AI TOP ATOM
Installing LM Studio on Gigabyte AI TOP ATOM: User-friendly GUI with OpenAI-compatible API for local LLMs
After showing in my previous posts how to install Ollama, Open WebUI, LLaMA Factory, vLLM,...
Read More
Install AI Toolkit on Gigabyte AI TOP ATOM – Step-by-Step Guide – Part 2-2
Phase 8: Compiling and Starting the Web UI Now I can compile and start the web UI. First, I switch...
Read More
Install AI Toolkit on Gigabyte AI TOP ATOM – Step-by-Step Guide – Part 1-2
After showing in my previous posts how to install Ollama, Open WebUI, LLaMA Factory, vLLM, and...
Read More
Install vLLM on Gigabyte AI TOP ATOM: High-Performance LLM Inference with OpenAI-Compatible API – Part 3-3
Download and Run Additional Models Locally Since you already downloaded models locally in Phase 4,...
Read More
Install vLLM on Gigabyte AI TOP ATOM: High-Performance LLM Inference with OpenAI-Compatible API – Part 2-3
Configuring vLLM for Production Deployment (More Complex) For production use, I want to run the...
Read More
Install vLLM on Gigabyte AI TOP ATOM: High-Performance LLM Inference with OpenAI-Compatible API – Part 1-3
After showing you how to install Ollama, Open WebUI, ComfyUI, and LLaMA Factory on the Gigabyte AI...
Read More
Installing LLaMA Factory on Gigabyte AI TOP ATOM: Fine-tuning Language Models with LoRA and QLoRA – Part 2-2
Phase 7: Start Fine-Tuning Training Before I start the training, I might need to log in to the...
Read More
Installing LLaMA Factory on Gigabyte AI TOP ATOM: Fine-tuning Language Models with LoRA and QLoRA – Part 1-2
After showing how to install Ollama, Open WebUI, and ComfyUI on the Gigabyte AI TOP ATOM in my...
Read More
Installing ComfyUI on Gigabyte AI TOP ATOM: AI Image Generation with Stable Diffusion on Your Own Network Part 2-2
Phase 7: Start ComfyUI Server Now comes the crucial step: I start the ComfyUI server so that it is...
Read More
Installing ComfyUI on Gigabyte AI TOP ATOM: AI Image Generation with Stable Diffusion on Your Own Network Part 1-2
After showing you how to install Ollama and Open WebUI on the Gigabyte AI TOP ATOM in my previous...
Read More
Open WebUI on the Gigabyte AI TOP ATOM: ChatGPT-like Chat Interface for Your Own Network
After showing you in the last post how to install Ollama on the Gigabyte AI TOP ATOM and configure...
Read More
Mein neues Buch
Souveräne KI
Strategie und Aufbau der eigenen Open-Source-Infrastruktur
Eigene LLMs betreiben, unabhängig von der Cloud. Von der Hardware bis zum laufenden System.
Jetzt bei Amazon bestellenRoboter-Autos mit dem ESP32
Bauen, programmieren, steuern
Vom ersten Chassis bis zur WLAN-Steuerung. Schritt für Schritt zum eigenen Roboter-Auto.
Jetzt bei Amazon bestellenBuch und E-Book, Rheinwerk Verlag
Werbung / Affiliate-Link
- Local Voice Agent: Wiring ASR, LLM and TTS into a Loop with NVIDIA Pipecat Locally
Every building block is now available locally: ASR (Parakeet, Canary), TTS (Magpie), an LLM via my Ollama server and the orchestrator (NAT, Part 5). Now I’m connecting them into a continuous, interruptible speech loop. This will be my first small local voice agent. What I’m aiming for is a kind of general-purpose agent: I speak,… Read more: Local Voice Agent: Wiring ASR, LLM and TTS into a Loop with NVIDIA Pipecat Locally - NVIDIA NeMo Agent Toolkit (NAT): set up the agent orchestrator locally
The two halves of a voice agent are in place: with Parakeet (Part 2) and Canary (Part 3) the agent listens, with Magpie (Part 4) it answers. What’s still missing is the brain: the layer that turns recognized text into a decision and triggers the matching answer or action. That’s exactly what I take on… Read more: NVIDIA NeMo Agent Toolkit (NAT): set up the agent orchestrator locally - NVIDIA Magpie TTS locally: German speech output as a microservice
The speech recognition is in place: with Parakeet (Part 2) and Canary (Part 3) I covered the input direction, speech to text, natively on NVIDIA. Now comes the opposite direction, the voice output. In this post I run NVIDIA Magpie TTS as a local NIM and have German text read aloud naturally. This is the… Read more: NVIDIA Magpie TTS locally: German speech output as a microservice - NVIDIA Canary locally: multilingual speech recognition and translation as a NIM
In Part 2 I set up Parakeet as a streaming-capable ASR NIM for German and ran it as a live service with low latency. In this post I take on the sister model: NVIDIA Canary as a NIM. Canary does not shine at latency but at accuracy, and it can do something Parakeet cannot: translate.… Read more: NVIDIA Canary locally: multilingual speech recognition and translation as a NIM - NVIDIA NIM locally: running German speech recognition as a microservice
In my last post I ran NVIDIA Nemotron ASR Streaming directly with NeMo locally. That was the “bare” route via the framework. In this post I go one step further and dive into NVIDIA NIM. NIM stands for NVIDIA Inference Microservices, the microservice variant NVIDIA uses to ship its models as ready-made, optimized containers. The… Read more: NVIDIA NIM locally: running German speech recognition as a microservice
The tutorial offers a clear and practical guide for setting up and running the Tensorflow Object Detection Training Suite. Could…
This works using an very old laptop with old GPU >>> print(torch.cuda.is_available()) True >>> print(torch.version.cuda) 12.6 >>> print(torch.cuda.device_count()) 1 >>>…
Hello Valentin, I will not share anything related to my work on detecting mines or UXO's. Best regards, Maker
Hello, We are a group of students at ESILV working on a project that aim to prove the availability of…