The four-acre garden that once graced this site was a destination for travelers to Columbia beginning in the 1820s. A visitor in 1860 noted, "The gardens here have ever been the admiration of all travelers, and certainly they surpass anything I have ever seen in pleasure grounds. The most beautiful place here, and the prettiest I have ever seen, is ex-Senator Preston's, although there are a few here that almost equal its beauty."