linux - C streams: Copy data from one stream to another directly, without using a buffer

Question

I want to copy data from one stream to another. Now normally, I would do it this way:

n = fread(buffer, 1, bufsize, fin);
fwrite(buffer, 1, n, fout);

Is there a way to write the data directly from fin to fout, without going through a buffer, i.e. instead of fin->buffer->fout, I want to directly do fin->fout (no buffer).

Is it possible to do so in ANSI C? If not, is it possible to do it with POSIX functions? Or a Linux-specific solution?

Answer 1

2 possible Linux-only solutions are splice() and sendfile(). What they do is copy data without it ever leaving kernel space, thus making a potentially significant performance optimization.

Note that both have limitations:

• sendfile() requires a socket for its output for Linux kernels before 2.6.33, after that, any file can be the output, and also it requires the input to support mmap() operations, meaning the input can't be stdin or a pipe.

• splice() requires one of the input or output streams to be a pipe (not sure about both), and also for kernel versions 2.6.30.10 and older, it requires the file system for the stream that is not a pipe to support splicing.

Edit: Note that some filesystems might not support splicing for Linux 2.6.30.10 and below.