I just saw the season 4 trailer for TWD and I thought up the possibilty that the Governor won't appear in the first half of season 4. I believe that Rick's group are gonna try at best to deal with the problem at the prison (trying to fortify it) and then as they leave they feel relieved that they don't have to worry about a major issue and then the Governor shows up again. Thats only me though so give me your opinion.