You can vote for suggestions, to change BGA, that exist to change the way to skip / expel a player function works ! 
In your case : https://boardgamearena.com/bug?id=80997 Prevent expelling if player himself is more in the negative
And others :
https://boardgamearena.com/bug?id=35239 Make "Skip Turn" / Expel a Timed-out player a Concensus Decision of All Remaining Players.
https://boardgamearena.com/bug?id=35289 Stop skipping in multiplayer tournaments
https://boardgamearena.com/bug?id=37022 Tournament mode : skip functionality is abused by some players, which ruins the overall experience
Best regards.
In your case : https://boardgamearena.com/bug?id=80997 Prevent expelling if player himself is more in the negative
And others :
https://boardgamearena.com/bug?id=35239 Make "Skip Turn" / Expel a Timed-out player a Concensus Decision of All Remaining Players.
https://boardgamearena.com/bug?id=35289 Stop skipping in multiplayer tournaments
https://boardgamearena.com/bug?id=37022 Tournament mode : skip functionality is abused by some players, which ruins the overall experience
Best regards.