I managed to get to work by using the setup.exe with appropriate switches, but I could only seem to get it work as a seperate software deployment action later in my template. However, weirdly it has now stopped working and failing at this stage for no apparent reason! Argh.
How do I make sure that a keep the video drivers within the image while sysprepping as you describe?