The Victor 460 (# 2966) with the 4150 series carb pad (for your Holley) is cast with passenger car size ports, which is the same port size as D3VE and D0VE heads.
On some of the ports, the actual port alignment is not dead-on with these heads because the Victor 460 intake port runners are on Cobra Jet port centers (but not the CJ port sizes). This does not affect the performance of this intake when bolted to your heads.
Therefore,the ports are not bigger as you were told but are indeed the passenger car port size. So, go ahead and buy one today as you stated.
LO
Is the #2966 the actual part # from Edelbrock on the Victor intake? If so I will call my local speed shop.