Concerns have been raised over the impact that a proposed housing development could have on a traditional mass football game.