The karma system is working as intended here.
You can change your behavior and help make the site a more pleasant place to play--as is you're wasting multiple players time by failing to play the game you chose to play. Allowing others to know to avoid playing with you is reasonable if you're liable to waste their time by failing to play.
You can change your behavior here easily. Stop queuing for arena and then walking away. Learn to hit the button to leave so you don't join games you can't or don't want to play. Or just play simple mode where you have to hit accept when the table fills. To be clear most games on this site take awhile to play, seems a bit wild to complain about having to wait a few minutes for the table to fill for a game that's going to last a lot longer than a couple minutes.