Is there a penalty for not getting a permit?

Yes.  If a permit is not obtained prior to work, a Cease and Desist Order may be give and there is a possibility of a fine of up to $100.00 a day.  In addition, you may be asked to remove any work you've completed that is not in compliance with the City's Zoning Ordinance.