In calculating whether the improvement would effect a permanent increase of the yearly value of the lands exceeding the yearly amount proposed to be charged thereon, the commissioners shall take into account the effect on such value of any sum expended by the landowner in erecting or adding to such mansion house and appurtenances beyond the sum proposed to be charged.