The cause of this problem is most likely caterpillars. I would suggest spraying with Neem Oil. In the colder weather try cutting the plant back. As the new growth comes away it will not be effected because the caterpillars do not like the cold weather.