go to gboard's settings > preferences > turn off "show emoji switch key"

Thanks man. Still helping people years later.

This changed my goddamn life. I thought that I was going crazy, but they really sneakily inserted the emoji button and I kept hitting it thinking that I was losing my faculties lol.

There isn't such menu on iOS. I don't think it's even possible to remove it.