I have the answer, what you need are plastic razor blades. They are magical, you can scrape off almost anything and not damage the surface, then a scrub with citrus cleaner or meths to remove the residue.
I buy mine from aliexpress. Not sure who locally sells them.
I removed boat window sealant, and even a van roof with baked on vinyl wrap.