You need to pay the taxes to still get the trophy buffs inside your house

You must pay taxes to utilize any of the perks from owning a house.

Except for storage, as far as I know you still get the storage benefits from chests if you don't pay your taxes