Yes, when growing spiritually, it can seem like you're losing something. At least it seems that way in the beginning, but you gain far more in the long run. The losses are like the dry land just before the tide turns and you end up with a tsunami only in a good way.