Mana potting is usually no big deal in duels. People just have really high faster cast rate and faster hit rate %'s. Makes for a lot of spam and a full belt ='s a shit load of mana.
I'd also recommend getting at least some block with Whitstans (sp) or some shit. May come in handy when that barb tries to get that kb on you.