A stupid servent is often worth less then a none at all. I think most creatures and things that grant pacts would agree. How about this for an Eldritch Invocation
Dark Knowledge
You add your Charisma modifier to all Intelligence(arcana, history, nature, and religion) checks
Thoughts?
Throat Punch Games 
I like that and makes sense.