Don't necessarily ignore it -- just remember that skills are just as important.
Eh, more important, honestly. To get a character up to 20-ish refresh to match a three or four person party, as the game book suggests, the powers wouldn't stack in a way that makes them actually more
effective, meaning they'll just get swarmed by actions. Unless you put all that refresh into wizardry, which does stack, and puts it way too far the other way.
The Black Court are a prime example -- it has a whopping 14 refresh spent. Going by the guide-book, he should qualify as a challenging rating against a 3-character, Feet in the Water party all on his own. But its Fists are only at 3, its defense is at 4. That puts him equal, on those terms, to one feet in the water character who's built to fight.
Against two, he might, barely, be able to keep up. Against three, he's getting his ass kicked -- the odds are simply against him that they'll hit him more than he hits them.
And that's without getting into his weaknesses.
But you could build an NPC with no refresh spent on powers and make him a challenge just by setting his relevant skills at 5 or 6. Then, you have someone the party
needs to maneuver against to reliably hit, one they'll need to actively and creatively defend against, instead of one they'll be more or less okay with if they just attack, attack, attack.