IF they are off until you turn them on at the controller, then won't turn off when you turn the controller off, you have a couple of options.
First, and simplest, is unplug the controller. Don't just turn it off.
If that works you have a controller/wiring problem.
If that doesn't work, turn off water, find the valves. Open them up, clean the parts and any debris. Rebuild and test.