This can occur when sending an effects-intensive Final Cut Pro X project to Compressor and applying a Compressor setting for transcoding.
Open Compressor and close the Preview window. Do this before sending an effects-intensive Final Cut Pro X project to Compressor for transcoding to prevent unexpected behavior.