Harry had depleted uranium, which is "weakly radioactive" and illegal to own without a license. I'm not sure what weakly radioactive means. I know granite is also radioactive, but we use it for countertops.
Generally speaking, it's legal to own human bones in America.
I doubt Harry has collected a lot of illegal stuff yet.