The Uni Form designer on rosemary, rock bottom and why his greatest design icons are the people making clothes beside him