Collision detection with pixel test?

I am trying to create collision detection for my racer by setting boundries around the track, as defined by two offset circles, which each share the same radius as the turn (see image). However, it hit me that a simple method for collision detection is to restrict vehicle movement, by testing the color of adjacent pixels. Is the pixel read method slow? Thanks.