IRS migration data found that California lost more than $340 million in 2021 IRS tax revenue due to residents moving. New York experienced the second-biggest drop losing just under $300 million from its yearly tax base.