diff options
| author | Arthur Hanson Rasmusson <arthur@vgpu.io> | 2026-09-23 00:41:46 -0400 |
|---|---|---|
| committer | Arthur Hanson Rasmusson <arthur@vgpu.io> | 2026-09-23 00:41:46 -0400 |
| commit | 7aef82a5112ee72ee2fc5a430db072085933e927 (patch) | |
| tree | d3b7da78151dde79f9c4bdf73d94f2b9622af672 /kernel/gsp_rm_tu104.h | |
| parent | d28e5bb94752ba523b826945409e5ad3206dad5a (diff) | |
| download | open-iov-7aef82a5112ee72ee2fc5a430db072085933e927.tar.gz open-iov-7aef82a5112ee72ee2fc5a430db072085933e927.zip | |
kernel: serve GMMU static info + per-VF fault/access-counter sizes for UVM
Three fixes that clear all driver-visible errors in UVM's device create
(cuInit still fails later in UVM_REGISTER_GPU):
1. GSP_RM_CONTROL 0x20800a59 INTERNAL_GMMU_GET_STATIC_INFO (new handler):
kgmmu.pStaticInfo->replayableFaultBufferSize feeds
kgmmuFaultBufferReplayableAllocate (called by faultbufConstruct when UVM
opens the device). The generic zero reply made it a 0-page allocation:
"faultbufConstruct_IMPL: Failed to setup Replayable Fault buffer
(status=0x51)". Report 64KB replayable / 4KB legacy, mirroring
kgmmuSetAndGetDefaultFaultBufferSize_TU102 defaults.
2. VF-window NV_VIRTUAL_FUNCTION_PRIV_MMU_FAULT_BUFFER_SIZE(0/1)
(BAR0+0xB83010/0xB83030, plus plain aliases) pre-filled with _VAL in
NVC369_BUF_SIZE units (0x800=64KB, 0x80=4KB) so the local (non-RPC)
path reads the same values the control handler reports.
3. VF-window NV_VIRTUAL_FUNCTION_PRIV_ACCESS_COUNTER_NOTIFY_BUFFER_SIZE
(BAR0+0xB83110, plus plain alias) = 0x1000 (the value the host's
physical TU104 reports; x32B = 128KB). uvmGetAccessCounterBufferSize_
TU102 multiplied our zero and uvmInitializeAccessCntrBuffer failed with
NV_ERR_NO_MEMORY at mem_desc.c:1353.
Also note (companion finding, no code change): the guest must be placed
behind a pcie-root-port; on the Q35 root bus QEMU rewrites the PCIe cap to
Root Complex Integrated Endpoint and zeroes LNKCAP/LNKCTL/DeviceCaps
(vfio_setup_pcie_cap: "On a Root Complex bus Endpoints become Root Complex
Integrated Endpoints, which changes the type and clears the LNK & LNK2
fields"), which is what made getPCIELinkRateMBps read speed 0.
Diffstat (limited to 'kernel/gsp_rm_tu104.h')
| -rw-r--r-- | kernel/gsp_rm_tu104.h | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/kernel/gsp_rm_tu104.h b/kernel/gsp_rm_tu104.h index 2edeeb4..ab97307 100644 --- a/kernel/gsp_rm_tu104.h +++ b/kernel/gsp_rm_tu104.h @@ -700,6 +700,7 @@ static const struct tu104_internal_device_info tu104_internal_device_table[] = { #define TU104_CTRL_INTERNAL_DISPLAY_GET_IP_VERSION 0x20800a4b #define TU104_CTRL_I2C_TRANSACTION 0x402c0105 #define TU104_CTRL_CE_GET_FAULT_METHOD_BUFFER_SIZE 0x20802a08 +#define TU104_CTRL_INTERNAL_GMMU_GET_STATIC_INFO 0x20800a59 #define TU104_CTRL_STATIC_KGR_GET_GLOBAL_SM_ORDER 0x20800a22 #define TU104_CTRL_STATIC_KGR_GET_INFO 0x20800a2a #define TU104_CTRL_STATIC_KGR_GET_CONTEXT_BUFFERS_INFO 0x20800a32 @@ -956,6 +957,15 @@ struct tu104_gr_global_sm_order { * Turing inherits: 135 * (13*totalCes + 2), page-aligned; TU104 has 5 PCEs) */ #define TU104_CE_FAULT_METHOD_BUFFER_SIZE 12288 +/* GMMU static info (kgmmuSetAndGetDefaultFaultBufferSize_TU102 semantics): + * the hardware default is reported in NV_VIRTUAL_FUNCTION_PRIV_MMU_FAULT_ + * BUFFER_SIZE_VAL units of NVC369_BUF_SIZE (32B). UVM's faultbufConstruct + * allocates replayableFaultBufferSize and fails with NV_ERR_NO_MEMORY when + * it reads back 0. Turing defaults are 64KB replayable / 4KB legacy; both + * must stay within NV2080_CTRL_INTERNAL_GMMU_FAULT_BUFFER_MAX_PAGES (256). */ +#define TU104_GMMU_REPLAYABLE_FAULT_BUFFER_SIZE 0x10000 +#define TU104_GMMU_NONREPLAYABLE_FAULT_BUFFER_SIZE 0x1000 + /* Turing display IP version (DISP v04.00 per DispIpHal halspec) */ #define TU104_DISPLAY_IP_VERSION 0x04000000 |