is doing calculations in a matrix possible. Will this continuously update the calculation answer

You are asking if you can update the matrices OpenGL is using?

Yes, you can load/store them but the standard way is to use the OpenGL functions instead of doing it direct.

glMultMatrix

or you can do any computations yourself and then load the resulting matrix with glLoadMatrix