More like that whether its on or off, a switch is still a switch. Even if the switch is broken and cant turn on, wont turn on, frozen in the off position, it's still a switch.
A lack of belief is absolutely a belief. You can't describe it in any other way "I believe there is no god." It's an assertion with its own impact, its own theology and theologians.