The files are always only in the Python folder tree, so at least you don’t have to hunt around the disk for anything elsewhere.
Registry entries have to be cleared by hand in RegEdit. Search with F3 first for ActiveState and then for Python, but you may find other non-activestate Pythons with registry entries, so be careful what you remove. Last time I had to do that it took a couple of hours, so plan accordingly.