Third-party storage also makes sense when it comes to silver IRAs. IRS rules require the assets in retirement accounts be held by a third party, but that does not mean investors are stuck with paper.