If there is no sign whatever of hatchling or eggs then a predator of some sort got to them. If it was the male being destructive you would see egg shells, and dead baby birds (because they would all be fairly fully developed at this point). Opossum, or something of the sort, is very likely if the nest was robbed at night.