All of the road signs look just like in the US, you shouldn't be confused! You'll need to just learn a few easy French words and driving will be no sweat.
Centre-Ville = downtown (like center of the ville)
Sortie = exit. So, as in highway exit.
Ouest = West
Est = East
Nord = North
Sud = South
Nice, easy, and intuitive.
I think videos like this are boring, but this may put you at ease by getting a chance to see what driving would look like.
https://www.youtube.com/watch?v=zI3PXce8wtk