To make push up popsicles easier to un-mold (and bite into), allow them to sit at room temperature for a few minutes, or until just slightly thawed, before eating. If using popsicle molds, dip them briefly in hot water, repeating as needed, until popsicles release from molds.