Cottage gardens became popular in Victorian England. But, as noted, they have ancient origins. Early cottage gardens were very practical and contained vegetables and herbs. Cottagers may have gained their small plots and cottages during the Black Death. The cottage garden was more about growing fruits, vegetables, and medicinal plants than aesthetics. But eventually, as times became less dire, flowers were planted in among the more "serviceable" plantings.
