He married on 30 July 1313 to Anastasia of Schwerin (c. 1291 – after 1316), a daughter of Nicholas I of Schwerin, and had the following children with her:
Gerhard V of Holstein-Plön (c. 1315 – 22 September 1350), canon at Lübeck Cathedral, potential future Count of Holstein-Plön until his early death.
An early seal from his time as Provost of Lübeck reads: S (IGILLUM) * DEI * GRA * GHERARDI (TIA) * P (RAE) POSITION (U.S.) * LUBIC (E) N (SIS) "Seal of Gerhard, provost of Lübeck by the grace of God"