Once in a while I read about a successful writer who cheerfully declares, "I never know what's going to happen next, I just start writing and let the characters lead me."
Please, can you send some of those characters my way? My characters lead me, too, but usually into a dead end or another story altogether. They like going off road.
My hunch is the few writers who claim to write without a map actually do have one in their subconscious mind, and they've been at the writing game so long that their internal alarm system warns them when they're about to head into a dead end.
Either that or they're lying; throwing planning to the wind sounds much more romantic than sweating over an outline.
Christopher Markus, co-writer of "Infinity Wars," told the New York Times, "we're never writing without knowing where the end goes."
By the way, if you feel that movie was too fragmented, the writers probably wouldn't disagree. Co-author Stephen McFeeley noted, "Had we started from scratch, we would not have chosen six damn McGuffins [the infinity stones]. That's not helpful. It was difficult to get all that in." Once they knew that was the end, though, they were locked into that particular journey.
Having a strong ending is important--and difficult. Lawrence Kasdan, writer on "The Empire Strikes Back," in the same NY Times article said, "All the suspense about Act III is, how will this be resolved? People are always disappointed by the third act. 'That's all you can think of?'"
I've mentioned before that my process is kind of a hybrid. I do know the ending and usually a few key plot points, but I allow myself to write freely for about the first quarter of the project. For a screenplay that would be the first 30 or 40 pages. Then I stop and plan the rest, although not scene by scene, just the key developments. For a feature script that might be roughly a dozen important events or turning points.
I'm not suggesting you use that method, although you might want to give it a try. You have to find what works best for you, what keeps you on track without making you feel too restricted by the plan. But for sure knowing where you want the story to end will make the entire process easier.