When the button to challenge George, Lester or Tessa is greyed out, it means that you have reached the current limit of victory counts for that character. This limit is at 220 at the moment. Don't worry though as the limit might be raised every now and then!