The first established Masonic lodge of record in Levy County was chartered at Levyville on January 16, 1867. The Brown Lodge No. 51, Free & Accepted Masons was named for Thomas M. Brown (1785-1867), Grand Master of the Grand Lodge of Florida in 1849.
On May 27, 1870, the Levy County Board of County Commissioners sold the old courthouse situated at Levyville and the one acre lot on which it stood, to the lodge for the sum of $510.