Not true...
I stopped paying for my life insurance and I got a better package that combined both life insurance and a pension/savings plan. If you've only payed 3 years, then you still have time. Don't think about the money you've already spent in the past 3 years. Think of the money you will be saving for the next 17 years.
Also, if you have a life insurance policy, you will not start getting dividends until the third year. At this point, whatever dividends you earn will not make a difference in your premium. It's a waste to use your dividends on your premium this early because you lose out on the compound interest.
My advice to you... reevaluate! If you have to, stop paying and get a better plan! But shop around first.