ceenhttpd | lightweight HTTP compliant web server written in C | HTTP library

Background

On Linux or BSD, it is possible to send handles to open files or sockets between unrelated processes with SCM_RIGHTS, and I have this working, such that on process is listening for connections, and then forwards the handles to a process that performs the communication.

Problem

I am unable to figure out how to free the socket handle from the listening process without shutting down the socket.

There are two conflicting descriptions in man close(3):

When all file descriptors associated with an open file description have been closed, the open file description shall be freed.

And

If fildes refers to a socket, close() shall cause the socket to be destroyed.

I originally thought that this means that calling close() will just decrement the reference count for the kernel object that has the socket, such that the last description from man close(3) meant "destroy when the last descriptor is closed".

EDIT: This is how it is supposed to work, and also how it works.

But, when I run tests, it appears that as soon as I call close() on the socket descriptor in the listening process, it will start closing the socket, sending either RST or FIN, depending on what the other process is doing with the socket at the time.

One solution would be to have a callback from the handing process with "you can now close socket nnn", but this would keep a number of socket descriptors open in the listening process and add some overhead as well.

I know I can force the socket to start the shutdown process by calling shutdown() directly from either process, but I want to prevent it.

I assume there exists a simple solution, but I cannot find it.

Question

Is there a way to de-register the socket descriptor from the listening process such that it is no longer in the file descriptor table of the process, but without activating the socket shutdown?

Source code

The SCM_RIGHTS implementation used to send the socket is here (send_fds and native_close):

• https://github.com/kenkendk/SockRock/blob/master/src/ScmRightsImplementation.cs

The code that sends the socket and then closes it is here:

• https://github.com/kenkendk/ceenhttpd/blob/master/Ceen.Httpd.Cli/Runner/SubProcess/SpawnRemoteInstance.cs#L488-L497

If I comment out line 497 everything works, but obviously get a large file descriptors leak.

The receiving end of SCM_RIGHTS is here:

• https://github.com/kenkendk/ceenhttpd/blob/master/Ceen.Httpd.Cli/Runner/SubProcess/SpawnedRunner.cs#L313