Final Cut Express Clip Transition Help

I'm editing a video through final cut express (4.0) where the subject in the shot moves around a lot and stumbles through his dialogue. I didn't film the footage myself, and cannot get another chance to film this particular person again so I have to make do with the footage I have. Throughout the video I have tried to cut out the "um's" and the awkward pauses by simply removing those frames and putting the remaining clips together. My problem is that I don't want to use any of the preset transitions (audio and video) but still want the video to run as smoothly as possible without the viewers noticing the hard skips and edits (it gets particularly bad when he says says words that begin with a p or a b). What should I do?

Any advice would be great!

Turn it into a Godzilla movie... George Lucas would have a hard time trying to smooth out all those jump cuts...without seeing your material it may be impossible without noticing each one of them....