Should holiday-home owners pay the same rates as residents?

If councils are willing to raise rates to pay for infrastructure and influence housing behaviour, where should they draw the line?