how old is the seal and how old is your engine installation? The faces do not last for ever and on an older installation the mounts can compress ever so slightly throwing un even pressure on the seal if the alignment has not been checked for a long time.
If you want to do an in water inspection hop over the side armed with some blue tack or plasticine to seal around the shaft, then you can pull the seal back to have a look at it