- The Life of James Renwick (A Historical Sketch of His Life, Labours and Martyrdom and a Vindication of His Character and Testimony)
- The Newcastle sportsmen; or, a race to hell! between three noted characters of the present day, ... with a postscript. A satire. By Thomas Houston. ... by his learned friend, Cuthbert Cudgel, Esq.
- Term Day; or, the Unjust Steward. A comedy, in five acts [and in prose].
- The Christian Magistrate: A Discourse, with an Appendix (Classic Reprint)
- The Lord's Supper: Its Nature, Ends, and Obligations, and Mode of Administration