When its time to make a choice its, Him + ME = He doesn't think about us! Just him!?

My boyfriend is a rigger. He works the winter and come spring they take a break cause the ground is too soft to work on. So they are off all summer. He was worried about finding something to do and having money cause EI pays crap. I told him to find a part time job. He calls me this morning saying he got a job, he can be making the same money and its all summer. I was so happy till I found out its 3 hours away. Summers are always hard, I don't get weekends with him cause he has to go up and see his kids. Now he takes a job where I can't seem him on the week days. I asked if he was going to talk to me about this, or if he was thinking we all move there (he lives with me and we have been together for two years) He said no, he would rent a place, stay there and visit the kids on weekends. SO really he wasn't thinking about us at all. We split last summer for a bit because he was to busy having fun with his friends to make any time for me and seeing how I can't take time off work, I never saw him. Now he's doing it again. I think my best rout is to just walk away, give up, cut my losses, cry a little and move on. But I do love him. Its like this all the time. His birthday I threw a huge party, and took him on a heli tour and my birthday, I made pizza (he bought the stuff) Picked out my own discount flowers and watched his movies. He says he loves me and I know he does but when it comes to anything, there is never any thought about us, just him. What do I do? I want to tell him when he comes home from the rigs this hitch, he should just go to his cousins, not bother coming home. He doesn't have the decency to talk to me and think about me when he makes decisions that affect us so why should I just hang around, right? Or does he not even know what he's doing to us?