Most of my first drafts tend to be mostly dialogue. I then have to go back and put in descriptors and bits of action around it so that it's easier to visualise what's going on. As you say, sometimes you need to keep going while you have some momentum!
Liv x