Rodrigo Ribeiro broke the deadlock in the 55th minute before Alexis Claude-Maurice sealed the win with a late goal in stoppage time.
The victory leaves Augsburg in ninth place, tied on points with Eintracht Frankfurt, while Cologne struggled with injuries but hit the crossbar.