Not so great Oatmeal

I think I have realized that the pattern of Oatmeal, as much as I like the looks of the sweater, just doesn't work for me.

I'm not sure what the issue is, but I think since this is the third time I've tried to knit it, and it's still not working, I should just cut my losses and pick a different pattern.  No matter how I try, it's just not obeying.  Time to dig on Ravelry for another pattern for the yarn.  I love Jane Richmond, and her patterns are wonderful, but this one just isn't working for me.