Plans to convert a shop to a holiday let in a Calderdale town well known as a visitor hotspot have been rejected.