Nothing prevents you from using procedural methods with a noise texture. The cost memory-wise would be of one (or maybe a few) noise textures.
exactly, you just sample the same noise texture with a greater and greater texcoord scale, interpolating between one sample and another based on the distance the fragment is from the viewer. It gives the impression of recursive noise.