Anne Hvides house or gaard is the oldest building in Svendborg. It was build around 1560 by the noblelady Anne Hvide who was married to Jesper Friis of Rødkilde(estate on sydfyn). she died in 1577 and the house had several noble owners until the year 1769. It was bought by a navigator named Christen Børgesen. He transformed it into an guest house for the most important men of the town. After Christens death his widow and son took over.

Later the son and his wife Dorthea continued the business with even greater success. Dorthea became very famous in town by the name "Madam Børgesen" and she managed to keep it going for many years until her death in 1867. Over 30 years. The house remained in the Børgesen family but ceased as a guest house. The brother, who owned it, moved to USA and leased it for instance as classrooms. Svendborg library rented the rooms once.
In 1900 it got bought by the town council of Svendborg and was used for different purposes.

For instance as the mayer's office. In 1912 it was handed over to the museum of Svendborg, who started a restauration of the house whereby the coat of armor of Anne Hvide was discovered.

The house isn't what is has been anymore. It is know that when Christen Børgesen bought the house in 1769 it also had a half roofed building to the back and a two-stories half-timbered garden house. To the south was a front house with nine windows. A great part of the house had allready been removed when the town counsil bought it in 1900.