That depends on your intention.
If you think you can find someone or willing to work in a team who has another skill ,you can just keep practise modeling skill.
Actually,you don’t have to draw a whole picture,just some rough sketch is enough.
It would be nice if you can master both skill but it’s quite hard and take a lot of time.
Most of the people who can master both concept art and modeling is because he started from 2d picture drawing from the start and keep move on to 3d modeling.
Your choice.