The education degree would help, but isn’t essential.
In order to be adjunct, a lot of places expect a Master’s, or a great deal of unique experience.

I would go the Master’s route- that way, you could take the opportunity to teach as a graduate student to decide if you like it.

you’ll need a Doctor’s degree in Art Teacher Education: A program that prepares individuals to teach art and art appreciation programs at various educational levels.