They are a lot more likely to think about Windows, as they actively decided to avoid using it by moving to Linux. That is in stark contrast to the subset of Windows users that would never give it a second thought, as they are unaware of what an operating system even is, nevermind having an overview of which ones exist and what their respective advantages may be.
I would avoid it, if you care at all about availability and downtime. The result will probably not be great, you need to ensure the server side gets enough resources under load, and setting it up may require constant restarts if things aren’t immediately working as expected.
Nonetheless, here is a link where someone did essentially exactly that on NixOS: https://astrid.tech/2022/09/22/0/nixos-gpu-vfio/