The area shown on the map is approximate, based on this 1680 map and pp.480-1 of the Latham & Matthews Companion.
The overlays that highlight 17th century London features are approximate and derived from Wenceslaus Hollar’s maps:
Open location in Google Maps: 51.503787, -0.125420
in Aqua Scripto • Link
Known as Privy Garden, containing sixteen isles of beauty, a Sun Dial,16 statutes, bounded on the Thame's side by The Stone Gallery,Matted and Long Galleries, then there is the Bowling Green on the southe side, on the West side, by a street that has gates at both ends,then on the North side by offices of state and the Banqueting Hall. Over looking the games played, be two complexes of residences, taking care of the Kings extended family and important advisors, available for quick consultation as there be no Cell phone, Fax , or other interrupting device, to get instant advice.
Privy Garden, behind Whitehall, now called Whitehall Gardens, a square of ground containing 3 1/4 acres, between Parliament Street and the Thames, and appertaining to the King's Palace at Whitehall.
The Privy Garden, when Mr. Pepys was in it, was laid out into sixteen square compartments of grass, each compartment having a standing statue in the centre. The garden was concealed from the street by a lofty wall; from the river by the Stone Gallery and state apartments; from the court behind the Banqueting House by the lodgings of the chief attendants on the King; and from the Bowling-green, to which it led, by a row of lofty trees. It would appear to have been in every respect a private garden. In the original Privy Garden Charles I., when Prince of Wales, caused a dial to be set up, and by command of James I. there was written, "The Description and use of his Majesty's Dial in Whitehall Garden, by Edmund Gunter, London, 1624," 4to. It was defaced and went to ruin in King Charles II.'s time.
This place for a dial was too insecure,
Since a guard and a garden could not it defend;
For so near to the Court they will never endure
Any witness to show how their time they misspend.
---London, Past and Present. H.B. Wheatley, 1891.
Chart showing the number of references in each month of the diary’s entries.