The records I have for the place in Bury St Edmunds (TL858657, now covered by the sugar factory) all lack the apostrophe: Mer Maid Pitts 1783 Hodskinson's map, Mermaid Pits 1905 OS 6", etc.