I'd rather be the pain that you remember, rather than the love that you forget.
Refusing to be in a place with someone that you don't necessarily want to be with them in life can lead to hurting someone worse later on by doing the things that one is actually interested in doing, and being with the people that one is actually interested in being with. Remember that being the pain that someone remembers may not always work out best for you, and sometimes it is better for a couple to go their separate ways while they are still able to if they know in their hearts their isnt to be much of a future involved.