When, in pursuance of this Act, any person is convicted by a court of summary jurisdiction of an offence, and such person did not plead guilty or admit the truth of the information, or when in the case of any application to the court under section five of this Act, any party thereto thinks himself aggrieved by any order or decision of the court, he may appeal against such conviction, or order, or decision, in England and Ireland to a court of general or quarter sessions, and in Scotland to the High Court of Justiciary in the manner provided by the [38 & 39 Vict. c. 62.] Summary Prosecutions Appeals (Scotland) Act, 1875, or any Act amending the same.