Rocks which crashed to earth when a section of 400-year-old battlements at Antrim Castle collapsed could have potentially crushed dozens of people to death, a local councillor has said.