The problem is land is taxed on what the county thinks it's worth. You'll get a big tax bill on those trees, whether you make anything off of them or not. It becomes a question of whether you want to spend money for the privilege of keeping what you already have, or do you want to put the money in the bank and just pay taxes on the interest.
A man I used to work with told me that he saw a lot of old farms in the Shenandoah Valley developed back in the '70's, and he couldn't understand why someone would cut down an apple orchard for a housing development, until he found out that it was because of inheritance taxes. The land values were so high that the heirs had to sell to pay the inheritance taxes.
It's like the Eagles song: "And they called it paradise, I don't know why, call a place paradise, kiss it good bye."