If my contributions are not currently taxable, do I need to make any adjustments to my tax returns each year?

No.  Your employer will make the necessary adjustments on your W-2 form, lowering your gross wages by the amount that you contributed in each tax year.