The swelling either suggests you've done serious damage to a blood vessel and it's basically bleeding or it's quite possibly broken and the swelling is there to protect it. If it gets reset badly however that might require an op to fix it.
It is possible that the swelling is also natural reaction as sometimes it can take weeks to go down, but a doc might be able to give you something to ease that.
One bad thing about swelling is that it *could* trap nerves and put pressure on other areas which could then lead to a lot more problems like tissue damage, blood vessel damage, nerve damage etc. due to the pressure.
As for other options - leave it to go down and then figure out what damage it's done.
Oh, did I mention blood poisoning...?