You can now change your flying speed in spectator mode with the command /speed [number]. In the config.yml, admins can change what the max speed is (default 5).
Enjoy!