Best co-ordinate system for axis-angle matrix

Can any one give me the suggestion which is the finest co-ordinate system for transformations, Modification of a set of points.


Do you mean “finest” as in best? There is only the standard answer to such a generic question: It’s the coordinate system that suits the problem best.
If you mean fine as opposed to coarse, I’m not sure what your measure of “fine-ness” is? OpenGL uses floating point (by default single precision) for transformations.