If I mistakenly add someone to a group chat on ps4 and remove myself will they see this? ?

Answer 1

they might see it

Answer 2

Yes, they will be told that they have been kicked from the party and the only person able to do that is the person that 'owns' the party.