Numerous public and private structures on the island have historical significance. Four of those structures are on the U.S. National Register of Historic Places:
Westport Town Hall (former Meeting House)
Westport Community Church
Squire Tarbox Inn
Josiah Parsons House