Shackling the tax man

Pub date August 15, 2006
WriterG.W. Schulz

› gwschulz@sfbg.com
Late last month, David Cay Johnston of the New York Times managed to get a story about IRS layoffs picked up by the San Francisco Chronicle and placed on page three. That’s no small challenge, even in one of the most politically charged cities in the nation. It was not a sexy story, neither to liberals nor to conservatives.
But the story’s timing was impeccable.
Johnston reported that the IRS was poised to lay off 157 of its 345 estate- and gift-tax attorneys working at agency offices throughout the country — a division of investigators that generates more revenue for the federal treasury by catching tax cheats than any other group of auditors, about $2,200 for every hour that they work.
Dismantling the estate tax has been among the most aggressive crusades taken up by the Republican Party and its friendliest contributors for at least the last decade. Leaked to the Times by IRS whistle-blowers, the story about the layoffs surfaced just days before Congress rejected for the fifth time since 2001 an attempt by fiscal conservatives to get rid of the estate tax. The legislation failed despite Republican control of both the House and Senate. Even tempting Democrats with the first federal minimum-wage hike in 10 years couldn’t do the trick.
So how could defending the estate tax and the right of the IRS to collect it survive two branches of the federal government dominated by a political party that holds most taxation in contempt? It’s because families awash in seemingly infinite wealth are the only ones who get hit by the tax — despite false claims made by the GOP that the estate tax kills small businesses.
California filed more estate-tax returns in 2001 than any other state in the country by a margin of thousands. The only state that came close was Florida, and California still filed around 6,000 more returns, according to the most recent IRS numbers.
In other words, the Golden State is filthy, stinking rich and more vulnerable to the estate tax than other states. GOP party leaders in Washington insist the issue will return in the form of a new bill, and the IRS is behaving as if the estate tax has already disappeared. If it does, the richest families in the United States — highly concentrated in California and the Bay Area — stand to collectively save billions of dollars.
The Bay Area contains within its sloping hills and mammoth upstart tech firms higher income levels and more general wealth than almost anywhere else in the country. In fact, the San Francisco metropolitan area is the fourth wealthiest in the nation, according to Merrill Lynch, and two tiny cities between here and Mountain View, where Google is based, have the highest per capita median income in the United States. Those two cities, Atherton and Hillsborough, have a combined population of about 17,000, and while many of these techie tycoons are young, the day will come when they die and pass millions of dollars on to their descendants. Will there be enough tax investigators available to audit those estates? Will there even be an estate tax?
Following Johnston’s revelations, a Times editorial suggested the layoffs were a politically motivated attempt by the Bush White House to circumvent the legislative process. What it can’t accomplish through Congress it can do by handcuffing the tax police.
“This is an election year issue,” said Jay Adkisson, a private sector tax lawyer from Laguna Niguel who documents egregious cases of fraud on his Web site, Quatloos! “They’re trying to appease Republican voters who were angry over the failure of Congress to do something about the estate tax.”
The story of the IRS layoffs didn’t just catch the attention of readers. Congress responded too. Twenty-three lawmakers — including, somewhat predictably, Democrat Tom Lantos of California’s 12th District — immediately fired off a letter to Bush-appointed IRS commissioner Mark Everson demanding to know if the agency could now effectively investigate estate-tax avoiders.
None but the most obscenely wealthy Americans pay even a dime in taxes when they earn an inheritance upon a death in the family. Estates aren’t hit with taxes until they reach a value of $2 million, or $4 million for a married couple. Only estates exceeding those amounts are assessed any tax, according to the Center on Budget and Policy Priorities (CBPP).
And if the family hires a savvy tax attorney or estate planner, those nontaxable values could easily rise to $10 million, according to Adkisson.
A research director at the Brookings Institution named Diane Lim Rogers opined in the Chronicle last May that because of current exemptions, about one half of one percent of dead people will actually be followed to the grave by the tax man. Besides, it’s the beneficiaries of an inheritance who pay. Despite grand claims made by Republicans that the beneficiaries of an estate will be paying half of what they’re handed in taxes, even the estates eligible for taxation see on average a 20 percent rate, according to the CBPP, which relied on the IRS for its statistics. For those who do pay estate taxes, deep discounts are available through charitable donations.
“The argument made about lots of people being ‘burdened’ by estate taxes is that they go through lots of convoluted tax-planning strategies in order to avoid the estate tax, so even if they don’t end up paying any estate tax, they are still adversely affected [burdened] by the existence of the tax,” Rogers wrote in an e-mail to the Guardian.
But even considering the cost of estate planning, Rogers said, no one would rationally spend more avoiding taxes than they would actually paying them.
Keith Schiller, a respected private sector tax attorney based in Orinda, earns princely sums teaching millionaires how to take advantage of loopholes in the federal tax code. He’s not opposed to the estate tax on principle; he just wants to simplify the way his clients pay their dues.
“I do believe the estate tax serves a social function of breaking down generational dynastic wealth,” he said in a phone interview.
Schiller said the IRS is conducting nowhere near the estate-tax audits it once did and that may be the only justification for laying off auditors. Still, the knowledge required by agency investigators to analyze and understand complex estate-tax avoidance schemes is immense. About 50 estate- and gift-tax attorneys based in Southern California and the Bay Area exclusively handle returns filed for the IRS from inside the state.
David Dean, president of the San Jose–based National Treasury Employees Union (NTEU) Local 238, said it’s not clear which offices will have layoffs. All 350 estate-tax auditors are being offered buyout deals that include their pensions plus up to $25,000, or $13,000 after taxes.
Dean and the NTEU, which represents the auditors and opposes the layoffs, insist the IRS isn’t entirely sure how much money is hidden from the agency each year through either elaborate trusts or simple refusals to file. It’s known as the “tax gap,” and three days after Johnston’s story appeared, the inspector general of the IRS, J. Russell George, told Congress that the agency’s estimated figures for delinquent estate taxes hadn’t been updated in years. His report described a self-fulfilling prophecy in which the IRS expressed no desire to update the figures because “consideration is being given to eliminating or reducing the number of people required to pay estate taxes.” The last estimate was about $8 billion, but that figure is for the most part unreliable, he testified.
But the law still exists, regardless of whether an anti–estate tax agenda eventually succeeds in Congress.
“If a law is on the books, you still have to close down on the cheaters,” said JJ MacNab, an estate planner who spent 18 years in the Bay Area working for tech clients. “If you don’t enforce a law on the books, no one’s going to have faith in the system.”
MacNab now lives in Washington and as a hobby assists people who buy into tax-avoidance schemes that turn out to be illegal. She said these days, it’s low-income earners who are likelier to be audited, a conclusion Johnston also came to in his 2003 best-seller, Perfectly Legal: The Covert Campaign to Rig Our Tax System to Benefit the Super Rich — and Cheat Everybody Else. The book shows how the recent layoffs are a small part of a larger movement to weaken the IRS’s investigative capabilities.
And that movement begins with those who can afford to fund it. Who are they? Well, they’re not your average farmer.
Consistently during the debate over estate taxes, the GOP has co-opted the populist language that once dominated America’s agrarian communities by claiming that the “death tax” bleeds poor farming families dry. It’s a spectacular rhetorical tool, but it’s an ugly distortion.
In fact, it’s the nation’s wealthiest families who have led the charge to dismantle the estate tax, not its small farmers, according to an April report put together by two groups, Public Citizen and United for a Fair Economy. The analysis identified a handful of enormously wealthy families that stand to save more than $70 billion if their lobbying efforts succeed. And that lobbying effort, the report notes, has amounted to around $490 million in direct and indirect lobbying expenditures since 1998.
The list includes Ernest Gallo of the E & J Gallo Winery, based in Modesto, and John A. Sobrato of Sobrato Development, listed by Forbes as one of the largest commercial landlords in Silicon Valley, with a familial net worth of approximately $2 billion. The Gallo family is reportedly worth about $1 billion.
The rest of the list is in part a who’s who of America’s billionaires: Wal-Mart’s Walton family; Charles and David Koch of the nation’s largest privately held company, the Kansas-based Koch Industries (also benefactors of libertarian think tank the Cato Institute, founded in San Francisco); and the Dorrance family of the Campbell Soup Co.
Ernest Gallo’s participation in antitax measures is particularly well documented. Elected officials he has supported with contributions in the past sponsored federal legislation in the ’70s and ’80s that allowed for millions of dollars in estate-tax exemptions for the Gallo family. One bill was even dubbed by estate-tax supporters the “Gallo amendment.”
The Public Citizen report links the Gallos to anti–estate tax lobbyist Patricia Soldano and her Orange County–based Policy and Taxation Group (PTG), which has spent $4 million lobbying solely against the estate tax since 1998. While the authors are unable to pinpoint exactly how much the Gallos had given to PTG directly, both the Sobratos and the Gallos are listed as clients of the group. The Gallos have reportedly spent hundreds of thousands of their own dollars supporting individual candidates.
It’s doubtful that very many people who actually paid estate taxes last year would know how to repair a grain harvester. In 2001, Johnston of the Times famously challenged the anti–estate tax American Farm Bureau Federation and the Bush administration to find just one example of a farm estate being sold to pay the taxes on it. Johnston reported they were unable to do so.
Estate planner Schiller likened opponents of the estate tax to medieval villagers who complained of gout to prove how well nourished they were.
“People want to believe they have an estate-tax problem,” he said, “so they can feel successful.” SFBG