No – not while the metal is meant to stay inside the IRA. Under IRC Section 408(m), gold and other metals held in a Gold IRA must be held by an IRS-approved custodian in an approved depository. Taking personal possession of it is treated as a distribution, which can trigger ordinary income tax and, if you’re under 59.5, a 10% early-withdrawal penalty on top of that.

This isn’t a minor technicality – it’s been tested in court. In the 2021 McNulty Tax Court case, a taxpayer who stored IRA-owned gold coins in a home safe was found to have taken a taxable distribution of the full amount, despite the coins technically being titled to an LLC owned by the IRA. The court treated physical control as the deciding factor.

The metal only becomes yours to hold once you actually take a distribution from the IRA (at which point normal distribution tax rules apply) or once you reach the point of taking required or voluntary withdrawals in retirement.