Adding a new board to ESP-Claw: Board adaptation for the Guition JC1060P470
After I showed you in Part 2 of my ESP-Claw series how I compiled ESP-Claw for the first time,...
Read More
Author: Maker
Preparing an Ubuntu 24.04 Server for AI Inference: CUDA, Docker, NVIDIA Container Toolkit
Whether I later want to run TensorRT-LLM, Ollama, vLLM, or any other container-based inference...
Read More
TensorRT-LLM in Numbers: FP16 vs. FP8 on the RTX A6000 Ada
In the first three posts of this little series I explained why I’m tackling TensorRT-LLM on...
Read More
TensorRT-LLM Pipeline: Building Persistent Engines with FP16 and FP8
In the second part I set up TensorRT-LLM inside a Docker container and validated with TinyLlama...
Read More
TensorRT-LLM on Ubuntu 24.04: Setup with Docker and Helper Scripts
In the previous part I described why I’m tackling TensorRT-LLM on my RTX A6000 Ada: as...
Read More- Fully Local Web Search – How I Wean My Hermes Agent off the Cloud Drip
My Hermes Agent has been able to search the web and extract page content for a while now. Until recently I handled that with Tavily for search and a self-hosted Firecrawl for extraction. The setup worked flawlessly, right up until my Hermes Agent had burned through the free 1,000 API requests to Tavily. And one… Read more: Fully Local Web Search – How I Wean My Hermes Agent off the Cloud Drip - Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator
Anyone documenting complex infrastructures quickly hits the limits of static diagrams and MS PowerPoint as tools. A setup consisting of multiple machines, two different LANs and a handful of Docker containers can certainly be described in text with many sentences – but an animated diagram that actually shows the data flow is much faster for… Read more: Animated Architecture Diagrams with D2 and ffmpeg – the Foundation for an AI-powered Diagram Generator - Firecrawl in Your Own LAN: Sovereign Web Scraping with a Local Ollama Server
It has been itching me for quite a while: Firecrawl self-hosted, in my own LAN, with no cloud dependencies, connected to my local Ollama server. Web scraping is one of the key capabilities a AI agent needs if it is supposed to do serious research and also have access to up-to-date information from the internet.… Read more: Firecrawl in Your Own LAN: Sovereign Web Scraping with a Local Ollama Server - Sovereign AI on a 10-year-old office PC: NemoClaw on a Dell OptiPlex 5040 with my own Ollama server
Why NemoClaw is moving into my AI workshop Over the past few weeks I’ve shown you in several posts how I’m building up my own AI infrastructure piece by piece: a local inference server with two RTX A6000 GPUs running Ollama, an ESP-Claw agent on a Guition JC1060P470 as an embedded agent, and my own… Read more: Sovereign AI on a 10-year-old office PC: NemoClaw on a Dell OptiPlex 5040 with my own Ollama server - Sovereign AI in the Home Network: Running the Hermes Agent Dashboard Securely as a systemd Service
My Hermes Agent has been running productively on my application server for several weeks: as a Telegram gateway, with a connected MCP server for GPU monitoring, and with a few cron jobs for daily background tasks. So far, I’ve configured everything via the CLI and directly in ~/.hermes/config.yaml. That works wonderfully, but it’s not always… Read more: Sovereign AI in the Home Network: Running the Hermes Agent Dashboard Securely as a systemd Service
The tutorial offers a clear and practical guide for setting up and running the Tensorflow Object Detection Training Suite. Could…
This works using an very old laptop with old GPU >>> print(torch.cuda.is_available()) True >>> print(torch.version.cuda) 12.6 >>> print(torch.cuda.device_count()) 1 >>>…
Hello Valentin, I will not share anything related to my work on detecting mines or UXO's. Best regards, Maker
Hello, We are a group of students at ESILV working on a project that aim to prove the availability of…