Almost certainly Great Yarmouth.
Amazing history of sea-fairing people.
In 1660 Edward Hyde, Earl of Clarendon, was High Steward of the Borough, perhaps this adds to the likelyhood?
For a view of the history see;
Chart showing the number of references in each month of the diary’s entries.