Finished with a more mobile (in particular - touch) friendly version. That should hopefully make it better. Waiting for review before it's released though.
Basic idea is - instead of the site sending the action straight to the server once you click on a possible wall or move location, it shows where it would place the wall or move the character and sends the action to the server ONLY if you click 'Confirm'. Slower, since every move requires 2 clicks, but a lot less error prone.