Ok. I’m not familiar with Fourier Transform algorithms, but I get the general idea of what you want. The only suggestion I can give you is to look at Mesa3d. (http://www.mesa3d.org) You won’t be able to use the MS implementation of OpenGL, because that requires you to create a window in one form or another in order to initialize it. Obviously, you can’t do that with plain old DOS programming. I haven’t looked at Mesa, but from what I understand it is an OpenSource software rasterizer that uses OpenGL commands. You might be able to do something with it to make it work with DOS. Actually… I just made a quick check on their page.
All you need is an ANSI C compiler and the X development environment to use Mesa. Others have contributed drivers for the Amiga, Apple Macintosh, BeOS, NeXT, OS/2, MS-DOS, VMS, Windows 9x/NT, and Direct3D.