Parameter estimates of structural economic models are often difficult to interpret at the light of the underlying economic theory. Bayesian methods have become increasingly popular as a tool for conducting inference on structural models since priors offer a way to exert control over the estimation results. Similarly to Bayesian estimation, this paper proposes a penalized indirect inference estimator that allows researchers to obtain economically meaningful parameter estimates in a frequentist setting. The asymptotic properties of the estimator are established for both correctly and incorrectly specified models, as well as under strong and weak parameter identification. A Monte Carlo study reveals the role of the penalty function in shaping the finite sample distribution of the estimator. The advantages of using this estimator are highlighted in the empirical study of a state-of-the-art dynamic stochastic general equilibrium model.