Page 3 of 5

Re: Increasing BGA service capacity [UPDATE]

Posted: 07 April 2020, 00:54
by kavide1234
data of this page are correct? https://boardgamearena.com/serverstatus ... ves_played
why after these many upgrades in last week we have still less moves played by players than 22 March.

data of <number of game played> and <time spend on site> seems correct but <number of moves played> are suspicious

Re: Increasing BGA service capacity [UPDATE]

Posted: 07 April 2020, 18:28
by Een
To increase capacity and flexibility, we have introduced a new game server this evening.

Here you can see it entering the arena:

entering_gs6.jpg
entering_gs6.jpg (86.42 KiB) Viewed 3723 times

Re: Increasing BGA service capacity [UPDATE]

Posted: 07 April 2020, 18:32
by SgtGolden
Nothing beats a nice graph :D :lol:

Re: Increasing BGA service capacity [UPDATE]

Posted: 09 April 2020, 09:45
by Een
UPDATE April 8th: service capacity at peak hour is now 30.000 simultaneous players.

Re: Increasing BGA service capacity [UPDATE]

Posted: 09 April 2020, 14:01
by T72on1
Crazy stuff. Thanks again for such a great job !!

Re: Increasing BGA service capacity [UPDATE]

Posted: 09 April 2020, 22:16
by Elcan
Een wrote: 09 April 2020, 09:45 UPDATE April 8th: service capacity at peak hour is now 30.000 simultaneous players.
This is amazing! Thanks so much for your hard work, really helping with Corona lockdown!

Re: Increasing BGA service capacity [UPDATE]

Posted: 12 April 2020, 19:56
by DPlouffe
Awesome job guys! You are providing a very valuable service during these difficult times, and reacting quickly to some major growth.

Those of us in IT appreciate the challenge you face.

May I suggest you might look at what some other online games use, making regional servers? Depending on your user distribution if you make an (Americas) and (Europe/Rest of World) lobby for example? I don't know if you provider has servers available in the different regions but that can of course also help with any latency issues as well. Splitting the users up might be tricky but I think you could take anyone who has selected Canada, United States, Mexico and all the countries in South America and move them over? And of course playing with someone on the other server would not work (or could it?)

Of course nothing is perfect, then you introduce high load on each regional server during local 'peak times' and it sits mostly idle 'off peak' vs. having everyone on one where the time zones kind of spread the load around. Not an easy problem to solve!

Hopefully you are making enough on Premium to support the infrastructure, any consideration for ads/sponsors? Something appropriate like local/smaller Game Stores, BoardGameGeek Store, etc?

(and providing the graphs is a great touch)

Re: Increasing BGA service capacity [UPDATE]

Posted: 12 April 2020, 20:02
by sourisdudesert
Hi
DPlouffe wrote: 12 April 2020, 19:56 May I suggest you might look at what some other online games use, making regional servers?
In fact we are already using regional servers, for heavy content. You can see see the world map of where our servers are located:
https://www.keycdn.com/network

However, we need a central service so everyone can play together.
DPlouffe wrote: 12 April 2020, 19:56 Hopefully you are making enough on Premium to support the infrastructure, any consideration for ads/sponsors?
Yes we are. Our current issue is to have enough developer time (an update is coming soon to explain where we are now).

Re: Increasing BGA service capacity [UPDATE]

Posted: 12 April 2020, 20:30
by sourisdudesert
UPDATE April 12th:

We are blocked at 30.000 simultaneous players for 3 days now. The main reason is that the component which is recording our game results is taking an average 300 milliseconds by game.

There are much things to do when we are recording a game results, like computing and updating your ELO, recording the game statistics and various other statistics, make you available in the lobby again, ...

300 milliseconds looks fast, but we have 200.000 games played on BGA everyday now, and this is one game every 430 milliseconds ... and way more at peak hour.

As a consequence: sometimes, you are "blocked" at the latest table you played, because we are processing the "queue" of the games results waiting to be recorded. This is not satisfactory and that's why we cannot go upper than 30k at the moment despite our servers can host more than 30k players.

We are optimizing this component at now, and hope to divide the processing time by at least 3.

In addition, we are going to add 4 more servers to the infrastructure in the 3 next days, to get some extra power.

Hopefully, if we do not met another issue like the one described above, in one week from now we should have slightly increased the capacity.

Re: Increasing BGA service capacity [UPDATE]

Posted: 12 April 2020, 21:23
by hasi6562
ich glaube ich muß mich bei Ihnen entschuldigen für meine Ungeduld und wenn ich ehrlich bin hab ich nicht daran geglaubt dass Ihr das hinkriegt.
Ich habe riesigen Respekt für das was Sie gemacht haben. Es gab doch die 2 Wochen Premiummitgliedschaft gratis. Diese 2 Wochen möchte ich das Sie sie jemanden vergeben der neu ist und noch kein Mitglied ist. Einfach mal so.

Vielen Danke