I went back to work after having all of mine, and went back when Henry was 6 weeks. Luckily I only work part time and David has the kids as I work when he doesn't. There was also no pressure as I don't HAVE to work, it just gives us a little extra pocket money.
Try to look at the positives, I know it's hard but if you have to go to work and there's no other option, there's no point in upseting yourself even more and still having to do it anyway (if that makes sense

?). Good luck hun, it'll be better than you think after the initial step.