TensorRT-LLM on the RTX A6000 Ada: Preparing for the Edge-LLM Ecosystem
With TensorRT Edge-LLM, NVIDIA has released a C++-only inference framework for embedded platforms....
Read More
Author: Maker
ESP-IDF v5.5.4 einrichten und ESP-Claw bauen – Schritt für Schritt
After I introduced the vision in Part 1 of my ESP-Claw series – bringing a local AI agent to life...
Read More
Sovereign AI on a Microcontroller: Bringing an AI Agent to Life on HMI Hardware with ESP32-Claw – Series Kickoff
After I showed you in my post on “Sovereign AI” how I built my own independent LLM...
Read More
Building an AI – Generated Browser Game with Qwen 3.6 A Creative Experiment
I’ve been exploring the intersection of local AI inference and creative generation, and I...
Read More
Install LibreChat on Gigabyte AI TOP ATOM: Professional Chat Interface for Local LLM Models
After showing in my previous posts how to install Ollama, Open WebUI, ComfyUI, LLaMA Factory,...
Read More- Fully Local Web Search – How I Wean My Hermes Agent off the Cloud Drip
My Hermes Agent has been able to search the web and extract page content for a while now. Until recently I handled that with Tavily for search and a self-hosted Firecrawl for extraction. The setup worked flawlessly, right up until my Hermes Agent had burned through the free 1,000 API requests to Tavily. And one… Read more: Fully Local Web Search – How I Wean My Hermes Agent off the Cloud Drip - Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator
Anyone documenting complex infrastructures quickly hits the limits of static diagrams and MS PowerPoint as tools. A setup consisting of multiple machines, two different LANs and a handful of Docker containers can certainly be described in text with many sentences – but an animated diagram that actually shows the data flow is much faster for… Read more: Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator - Firecrawl in Your Own LAN: Sovereign Web Scraping with a Local Ollama Server
It has been itching me for quite a while: Firecrawl self-hosted, in my own LAN, with no cloud dependencies, connected to my local Ollama server. Web scraping is one of the key capabilities a AI agent needs if it is supposed to do serious research and also have access to up-to-date information from the internet.… Read more: Firecrawl in Your Own LAN: Sovereign Web Scraping with a Local Ollama Server - Sovereign AI on a 10-year-old office PC: NemoClaw on a Dell OptiPlex 5040 with my own Ollama server
Why NemoClaw is moving into my AI workshop Over the past few weeks I’ve shown you in several posts how I’m building up my own AI infrastructure piece by piece: a local inference server with two RTX A6000 GPUs running Ollama, an ESP-Claw agent on a Guition JC1060P470 as an embedded agent, and my own… Read more: Sovereign AI on a 10-year-old office PC: NemoClaw on a Dell OptiPlex 5040 with my own Ollama server - Sovereign AI in the Home Network: Running the Hermes Agent Dashboard Securely as a systemd Service
My Hermes Agent has been running productively on my application server for several weeks: as a Telegram gateway, with a connected MCP server for GPU monitoring, and with a few cron jobs for daily background tasks. So far, I’ve configured everything via the CLI and directly in ~/.hermes/config.yaml. That works wonderfully, but it’s not always… Read more: Sovereign AI in the Home Network: Running the Hermes Agent Dashboard Securely as a systemd Service
The tutorial offers a clear and practical guide for setting up and running the Tensorflow Object Detection Training Suite. Could…
This works using an very old laptop with old GPU >>> print(torch.cuda.is_available()) True >>> print(torch.version.cuda) 12.6 >>> print(torch.cuda.device_count()) 1 >>>…
Hello Valentin, I will not share anything related to my work on detecting mines or UXO's. Best regards, Maker
Hello, We are a group of students at ESILV working on a project that aim to prove the availability of…