How about we go the other way with bonuses?
Twist Fate
Enchantment cantrip
Casting Time: reaction
Range: 50 feet
Components: V, S
Duration: next action
You curse one creature making an ability check. If the target fails a Wisdom saving throw, the target must roll a d2 and subtract the number rolled to the ability check.
Thoughts?