Run the screwdriver down the side of the housing and you can then pry most of the seal out. It can be hard to get started but moves easier once you get going. If it is particularly difficult, use a little dish soap and water to lubricate the seal on the wires.
