To reproduce this, run Ensemble and load the "Advanced Media" sample. It will play the following video file:
On macOS 10.15.3 Catalina, there is a pause of roughly 1 minute before it starts playing. Then it will play fine for the rest of the video.
You can reproduce this with HelloMedia as well. If I download the file and play it using a file: URL then it starts up fine.