The first place I would suggest to start is the Bindless Images extension that has been developed.
You can see the IWOCL presentation here that explains more about it.
What kind of algorithms (image processing) could achieve 100x performance ? I tried gaussian filter on large kernel and image size but could only achieve 10x performance compared to CPU.