Bugs, pests, and animals, at least where I live. Unless you build a green house, clear the yard of all other foliage, or somehow fortify your garden, only produce with natural defenses like peppers will make it to harvest. However, I am jealous of my friends on the west coast, who don’t really have to worry about bugs or other critters eating from their fruit trees just passively growing in their yard.