3 sounds fair, since 2 can be common nowadays.
If you do that though, might as well just have the effect be "you win the duel", since if you somehow get it out on the first turn, your opp would have no cards and a 2500 beater they'd need to get over without using card effects. Which is not possible.
The only way I see your opp winning is if they keep setting monsters and you deck out but I highly doubt that would be possible, you'd just summon other monsters. Or maybe if they ran a destiny hero defender and you weren't able to banish for more ATK, they tribute summon majesty's fiend and then you run into a mirror force. IDK what else could stop that xD