That statement is incorrect. It also becomes your problem when it's your stray bullets in the neighbor's house, or your kid's room.hogwash (edited to add that, don't get to use it enough)
anything that will penetrate deep enough to stop an attacker will penetrate several walls of drywall.
over-penetration is the neighbor's concern.