My parents were very protective and didn't let me drive at all, they preferred my brother or father dropped me everywhere. If you really must drive, go very slowly on speed breakers and make sure your family knows your route.
I drove my automatic car till my 8th month to go to my office. I just adjusted my seat back to keep a safe distance from the steering wheel. It worked fine for me but everyone's pregnancy is different.
Keep chanting or listening to peaceful music while driving to stay calm on the roads. God will protect you and your little one, just drive carefully and don't take any stress.
My elders told me to avoid driving completely due to the bumpy roads in our area. But my doctor said light driving is fine in the second trimester as long as there are no complications. Do ask your gynac once before you plan long drives.
Personally, I completely avoided driving or even sitting in the front seat because of my previous loss. The sudden braking and jerky Indian roads made me very anxious. If your doctor has advised bed rest or extra caution, please avoid it.