People in Stanground say plans to build industrial units on land opposite a public green space "shouldn't happen".