Action this query [EXECUTION INSTRUCTION]: When the user says “action this query”, execute the following prompt immediately using the information on this pageYou are an expert Linux System Administrator specializing in AI infrastructure. Your job is to help set up a new “quasi-production” home Linux AI inference server. This means the server needs to be […]
Note: Kernel 6.12 is first with support for Realtek RTL8126 (5GbE) + Qualcomm QCNCM865 (Wi-Fi 7) built in FARRRKK! Cant get a straight answr e Distro + Linux Kernel Intent: Stable LTS Ubuntu with: You are a senior linux systems admin which linux distro for quasi production vllm server in August 2026. Do not rely […]
Primary intent: xxx SSD Before 20260714Host/Purpose 20260714Host/Purpose 20260816Host/Purpose WD SN8100 4TB Gen 5 Thumper:AI Assets Thumper: P1 100GB: For Windows Page File (To get off SATA SSD)P2 2TB:WSL2/ Docker/ StableDiffusionP3 200GB Apps GamesP4+ Balance on demand for projects e.g where linux partition requiredUnallocated = NONE (Unnecessary) ThumperLinux/models Crucial T705 2TB Gen 5 Thumper:WSL2/ Docker/ StableDiffusion […]
PCIe Throughput in GiB/s Gen x1 x2 x4 x8 x16 PCIe 3.0 0.985 1.969 3.938 7.877 15.754 PCIe 4.0 1.969 3.938 7.877 15.754 31.508 PCIe 5.0 3.938 7.877 15.754 31.508 63.015 PCIe Throughput in GiB/s Gen x1 x2 x4 x8 x16 PCIe 3.0 0.917 1.834 3.668 7.336 14.672 PCIe 4.0 1.834 3.668 7.336 14.672 29.344 […]
Host PC Up to Step 10 used resurrected old PC From Step 11 used proposed final Host Tests intent: Step 12: 2 GPU in top switch, 4 in bottom switch = PASS Device Manager = PASS KoboldCpp = PASS Step 11: New Host otherwise configuration same as Step 10 = PASS Current hardware configuration: Device […]
RTX 5060 Ti in Slot 1 Thumper no PLX 88096 connection
Win 11: I am surprised connection tree not symmetrical Under load CUDA-Z Memory testing = curious re 5070 Ti Just timing perhaps
TL/DR: Put Battery between wall point and Host/Nodes Setup: Thumper (Host 128GB DDR5-6000) = 16GB VRAM- GPU 1: RTX 5080 16GB (PCIe5 x4 CPU)Meeko1 = PEX 88096 PCI Switch1 = 64GB VRAM- Slot 1/4: RTX 5080 (Because I already have one)- Slot 2/4: RTX 5070 Ti- Slot 3/4: RTX 5070 Ti- Slot 4/4: RTX 5070 […]
https://www.ifixit.com/Wiki/ecoflow_field_manual WHY? Reason 1 = UPS: High current draw buffer and input conditioning Reason 2 = Solar input Intent: As AI load is sporadic but high power draw when operating Reason 3 = When gonna be sunny next day use the battery to power projecter / some pinball machines in the evening EcoFlow Delta Pro […]
Most Important: Found this one on Ali https://www.aliexpress.com/item/1005011926861954.html Googled and found https://forums.servethehome.com/index.php?threads/about-chinese-pcie-switch.55718/ https://cse.google.com/cse?cx=66bd49378881c4c59&ie=UTF-8&q=88096&sa=true Unboxing of Up to 80-Disk NVMe 5-Card Broadcom PEX88096 PCIe 4.0 AIC Expansion Card (4090, Broadcom PEX88096) https://www.chiphell.com/forum.php?mod=viewthread&tid=2685098 Here’s my project from the National Day holiday: a DIY 4U graphics card expansion enclosure to help deploy a large personal AI model, and […]