I don't think Sam ever really realised how hard Dean was trying at that time mid-season, especially since he had officially given up the powers at that time, and they failed to adress his powers in that interim phase or plan for the eventuality that Sam failed to keep his resolution, which could have avoided a lot of the pain they went through later.