Provided also, and be it further enacted, That the Probate or Letters of Administration so to be stamped on Credit as aforesaid shall be deposited with the said Commissioners of Stamps, and shall not be delivered up to the Executor or Administrator until Payment of the Duty, together with such Interest as aforesaid, if any shall become due; but the same shall nevertheless be produced in Evidence by some Officer of the Commissioners of Stamps at the Expense of the Executor or Administrator, as Occasion shall require.