I've noticed this sign before, and finally had my camera with me. Apparently racing is ok from 5:01am to 9:59pm, provided there is no one watching.