nvme-cli | NVMe management command line interface | Command Line Interface library

You certainly can invoke system calls (listed in syscalls(2)) from different threads (otherwise it won't be possible to write programs which do IO on several threads, like most multi-threaded web servers do).

However, some ioctl (or other weird system calls) may be blocking or take some long time (several seconds or tenths of seconds) to execute. For a good example, ejecting a CDROM tray is done by some ioctl and it takes some visible time (perhaps half a second) to perform (because it is some mechanical action).

I guess that NVME being related to SSD technology, some operations are slow (because the hardware itself is slow). Your bottleneck could be the hardware itself, then any kind of parallelisation won't help. It could happen -I don't really know- that you might use the same ioctl (on the same file descriptor) in several threads but that the kernel would serialize its processing.

When the kernel is doing some blocking or long-running ioctl (or any other system call) it uses its scheduler to run other tasks (processes or threads) and do some locking. Then your process is in a D state (see proc(5) and /proc/self/stat or /proc/1234/stat for process of pid 1234) and don't even handle signals (see signal(7)) which are postponed.