The original castle was built around 868 by Count Baldwin I, rebuilt and expanded by the Count of Flanders around 1180. The Gravensteen was the seat of the Council of Flanders