A property developer has applied to knock down the historic Gorringe’s huts in Lewes to make way for new housing.