In the president's weekly address, Congress was singled out for doing more to create crises in Washington than doing its job in growing the American economy. An economy, Obama said, that has created over 13 million jobs over the course of 67 straight months under his leadership.

"But we would be doing even better if we didn’t have to keep dealing with crises in Congress every few months," the president said. "And especially at a time when the global economy is softening, our own growth could slow if Congress doesn’t do away with harmful austerity measures."

And though Congress was able to avoid a government shutdown last week by passing a last minute deal, the president said "that gimmick" is poised for another go around just before Christmas and is nothing more than a game of kick the can.

If that continues, the president promised to keep his signature away from any "shortsighted, short-term spending bill." Obama said bills like the one last week are "undermining the middle class" by making no distinction between good and wasteful spending.

"It’s a prescription for American decline," Obama added. "Congress should do its job, stop kicking the can down the road, and pass a serious budget rather than flirt with another shutdown."

A budget Obama can get behind is one that keeps a strong military and law enforcement, and also one that "keeps America generous" by providing for veterans and seniors. Education is another factor Obama wants more investments to be applied, especially as he pushes for universal pre-K and free community college.

"Because that’s how we’ll build on the progress of 13 million new jobs, and help the middle class get ahead," he said.