The Mason's Pit was behind the Mason's Arms pub.

Raphael Samuel wrote in Village Life and Labour (1976):

The largest and most enduring of Quarry's pits – it is still substantially there today – was the Mason's Pit at the back of the “Mason's Arms”, which Vallis tells us in his memoir was the original nucleus of the village settlement. It was for many years a favourite haunt of gipsies, “the real old-fashioned gypsies”, as they are spoken of by old habitués of the Mason's, and in the early 1900s was the centre of a free-lance community of well-diggers, rabbit-catchers, horse-dealers and poachers, who lived in a cluster of little courts – Hunt's Row, School Place and Carr Matthew's Alley.

It was probably in this pit that in 1861 four gipsy families headed by Wisdom Smith, Thomas Smith, Reconcile Smith, and Mrs Ann Smith were camping with their families, and there were still gipsies living there in the 1920s.

Nathaniel “Natty” Rivers, landlord of the Mason's Arms who died in 1894, lived in a little cottage near the bottom of the Mason’s Pit.

Samuel goes on to write:

The Mason's Pit is remembered as being full of children. “There was a crowd of ’em … used to get in that pit … a proper playground … we used to slide down the bank … on tea-trays” (one of its uses in the early 1900s, according to an old villageer, was an an ambush for Mr Bickley, the very unpopular headmaster of Quarry School).