So upon replacing the trigger with a EGW Short Tank Thread I noticed that that ambi safety was bent a little towards the outside.It was very tight coming off-so I am not sure if I bent it or it was already bent.
So far I have replaced the trigger and now the safety with a EGW Low Paddle single...