418.23 Limitation on power of districts.—The charter of any recreation district may contain such limitations and restrictions on any of the powers named in s. 418.22 as the governing body of the municipality or county may from time to time determine, but no such restriction shall result in impairing the ability of a district to carry out any contract made by such district prior to the adoption of such restriction.