I was so scared of caffeine that I stopped tea completely in my first trimester, but my doctor laughed and said one cup is totally fine. Just don't drink 3-4 cups a day!
You can have a light cup of tea, but make sure it doesn't interfere with your morning thyroid medication if you have any. Keep getting your regular blood tests done.