bricks are crafted from clay, which is essentially just mud. In almost all cases, they're safe for use in the garden. There's an exception for where they were sourced; for example, bricks sourced ...

Increasing urbanization and infrastructure development in emerging economies present significant opportunities for the clay ...