Open-IOV vGPU-IO: host-side GSP emulation for unmodified NVIDIA guest drivers https://git.vgpu.io/open-iov.git/atom?h=archive%2Fpre-squash 2026-09-22T13:43:22+00:00 2026-09-22T13:43:22+00:00 Arthur Hanson Rasmusson arthur@vgpu.io 2026-09-22T13:43:22+00:00 urn:sha1:60da11fe771968bbc0cc65b8f629cc5e6b3f44a1 Root causes of host GSP crash (WPR2 stuck, 'unexpected WPR2 already up'): 1. stack_manager load-nvidia tried to load our submodule nvidia.ko (610.57.04-base) alongside/over apt nvidia 570.211.01 -> GSP crash during driver conflict. Fix: skip submodule when apt nvidia is already loaded (not needed for QEMU). 2. BAR3 (32MB instance memory window) was mapped to the physical GPU's real BAR3, so guest BAR3 writes could corrupt the host GPU's instance memory. Fix: vzalloc'd shadow buffer (like BAR1 emulated vidmem), per-page mmap. 3. GSP-RM garbage element handler declared GSP death on teardown queue garbage, preventing driver cleanup frees from completing. Fix: stop polling quietly, let Booter-unload kick handle reset. Verified: full lifecycle (load, mdev create, QEMU guest boot, guest probe, mdev remove, unload, reload) with host nvidia-smi (apt 570.211.01) stable throughout. No GSP crash, no WPR2 stuck, no module unload hang. 2026-09-22T09:16:37+00:00 Arthur Hanson Rasmusson arthur@vgpu.io 2026-09-22T09:16:37+00:00 urn:sha1:9b891254b05e9e46f27b8ff53decfbbb429d1cc4 Guest VRAM (BAR1) was mapped to the host GPU's real BAR1 (managed by nvidia.ko) - guest VRAM accesses hit the broken host GPU. Now a dedicated 256MB vzalloc buffer backs guest VRAM; BAR1 mmap uses per-page vmalloc_to_pfn (like BAR0 shadow). vfree on cleanup. 2026-09-13T22:36:21+00:00 Arthur Hanson Rasmusson arthur@vgpu.io 2026-09-13T22:36:21+00:00 urn:sha1:00e54c13c7c9030c4d5f7151467f2d85a3730e29 - Firmware decompilation: GSP 570.144W (28.5MB ELF, RV64IMAC), 132 decompiled C files - Kernel modules: nvidia.ko (34MB, OpenRM), open-iov-vfio.ko (2.8MB, VFIO mdev), gsp-vgpu.ko (1.8MB, guest driver) - Userspace: libiov.so/libvgpu.so (76KB), example_vgpu (28KB), rpc_emulator.c - PCI config space emulation (256B with PM, MSI, MSI-X, PCIe caps) - 12 RPC types fully mapped from firmware decompilation - BAR trap, WPR, scheduling, notification, migration emulation - Helper scripts: load_vgpu_stack, create_mdev, launch_qemu_vgpu, test_vgpu_stack, setup_guest_driver, unload_vgpu_stack - Architecture documentation - Wiki: 10 technical documents - Git LFS for large binaries (.ko, .bin, .iso, .img, .o, ghidra repos) - nvidia-open-gpu-kernel-modules as submodule