No it won't be in all programs, it's not something you ever have to run in itself, it just required to enable some other things to work.
You can look in add remove programs in control panel and remove all but the latest version of JAVA though as it tends to leave the old versions installed.