I don\'t target A to get to B: Swamy on attacks on Rajan