First and foremost as I understand your post, you are missing the key element, fun. It doesn't seem like you are having enough fun in your desire for perfection.
To borrow a line form SGT Hulka, "Lighten up, Francis."
No offense, but time takes time. What should you work on? You'll get a ton of advice. And without a lot of real valuable information on how you are really doing. If you truly want to improve, then you are gonna have to spend more time doing it. Get up a little earlier and throw practice putts. Get a practice basket and throw some at lunch. Find a park with an open area and a playground. Take the family and throw some too. Find a family friendly course and take them along even if its just a walk in the park and a picnic. Quality time spent with the family could actually allow them to give you some more "me" time. And for God sake if you do go with the family, don't go with the expectation of shredding the course, think about all of you having a fun time.
Find time, we are usually not as busy as we think we are.
And if you truly MUST improve NOW, start from the basket out. Remember, drive for show, putt for dough. Practice your putting until you are consistently knocking it stiff from 30+ feet. Once you're happy with that, work on the approach. An awesome approach means an easy putt. Now that you've got that mid game where it needs to be, then go big.
And lastly, while you are waiting for those magical 400+ foot drives, always, always think course management. Perhaps a well placed 200 foot drive gives you an easy 100+ foot approach for the safe 3 and a few birds too. Instead of a drive a long way, but the wrong way.
Good luck and have fun.