Proposals for longer opening hours at KFC in South Street have been refused amid concerns over possible "disturbance".