Image restoration via Alternating Direction Method of Multipliers (ADMM) has gained large interest within the last decade. Solving standard problems of Gaussian and Poisson noise, the set of ‘Total Variation’ (TV) based regularizers proved to be efficient and versatile. In the last few years the ‘Total Generalized Variation’ (TGV) approach combined TV regularizers of different orders adaptively to better suit local regions in the image. This improved the technique significantly. The approach solved the staircase problem inherent of the first order TV while keeping the beneficial edge preservation. The iterative minimization for the augmented Lagrangian of TGV problems requires four important parameters, two penalty parameters ρ and η and two regularization parameters λ0 and λ1. The choice of penalty parameters decides on the convergence speed, the regularization parameters decide on the impact of the respective regularizer and are determined by the noise level in the image. For scientific applications of such algorithms, an automated and thus objective method to determine these parameters is essential to receive unbiased results independent of the user. Obviously, both sets of parameters are to be well-chosen to achieve optimal results, too. In this paper a method is proposed to adaptively chose optimal ρ and η values for the iteration to converge faster, based on the primal and dual residuals arising from the opti-mality conditions of the augmented Lagrangian. Further, we show how to choose λ0 and λ1 based on the inherent noise in the image.