Pain, by definition, comes with the desire to be removed; otherwise, it wouldn't be called pain. So, the pains in your life (suffering), whatever they are, come with a (by definition) desire to be reduced]. No one would say "my situation wouldn't be any different if I didn't have this painful situation*." So, you do care no matter how apathetic you may claim to be.
Here is my thoughts on this thing.