After 20 times playing, I am done with the BGA version

Forum rules
Please DO NOT POST BUGS on this forum. Please report (and vote) bugs on : https://boardgamearena.com/bugs
User avatar
jarjarjese
Posts: 1
Joined: 16 July 2022, 20:28

Re: After 20 times playing, I am done with the BGA version

Post by jarjarjese »

silentProtest wrote: 22 July 2022, 21:51
gordoz wrote: 16 July 2022, 07:02 the guy is bad not the dice. he has low elo at every single game hes tried. main character syndrome / dunning kruger
Me too ?? :D


I try to argue here: https://boardgamearena.com/bug?id=66082 that something seems off (not based on occurrence of some numbers [2-12], but based on clusters happening, of specific number, again and again per individual game)
This is exactly what my friends and I have experienced, too. The game clearly is exhibiting a tendency to cluster numbers together. We have all played catan for years, and all of us individually came to the same conclusion with the BGA version. We are in the middle of a game now where it seemed like 8’s kept coming up again and again…I went back and counted, and we had 11 of 27 rolls that were 8, often clustered as many as three in a row. That’s literally 40% of the rolls in the game up to that point.

The point is that we’ve all had games like that in real life, and they stick out because they are so memorable. “Wow, can you believe we rolled that many “X” in a row in that game?” They are the exception to the rule. With the BGA version, those games are happening every single game.
User avatar
Tisaac
Posts: 2736
Joined: 26 August 2014, 21:28

Re: After 20 times playing, I am done with the BGA version

Post by Tisaac »

jarjarjese wrote: 23 July 2022, 21:42 They are the exception to the rule. With the BGA version, those games are happening every single game.
This is clearly an exageration so can you actually go back and look at your stats to see how high is that number ?
silentProtest
Posts: 196
Joined: 26 March 2022, 20:12

Re: After 20 times playing, I am done with the BGA version

Post by silentProtest »

Meeplelowda wrote: 23 July 2022, 00:10
silentProtest wrote: 22 July 2022, 21:59 you cant compare what humans would write down as random numbers to real random numbers^^
Of course what humans would write down are not real random numbers. THAT'S THE WHOLE POINT! What people *perceive* to be random, or more importantly what they think is not random, is precisely what causes threads like this. In my example the vast majority of people perceive that repeating digits are not random, so they do not write down any repeating digits even when it is very likely to happen at least once. The human brain is a pattern seeking machine, and people come to believe one way or another that there can't be patterns in randomness, so if you find a pattern in something it can't be random. "Random means all mixed up" they think.

But I'm all for using a "better" source of randomness for BGA, just because it will prove my point that these threads will continue regardless.
I differentiated between generating "random" numbers and lets call it perceiving (since its not really analysing) random numbers. one it not the other. and about generating there is no debate. about perceiving people have different biases - the rest is in the bug report if youre actually interested. not gonna repeat it again and again.

my second point, the only way to actually analyse this would be mathematically. but the access to that data (because you need a ton of it) is missing. which I was critizising.

... just making sure you actually got my points from the post before ;)

PS: I also agree that this post will continue, even if its perfectly radnomly generated - this is why it's so hard to make a serious point about this! -.-

Edit:
Stroom wrote: 23 July 2022, 07:44 What Meeplelowda said. People who complain about randomness do not understand randomness.
I actually thought about finding papers I read, about how to evaluate RNGs/pseudo randomness ( at what point it could be considered random enough that it doesnt matter, in relation to predictability, that it's only pseudorandom ), or just googling it, because that might be faster, but it's not worth the time (for me, right now), and it wouldnt help without the large data set. My point: there are valid reasons to complain about algorithms, that are generating these "random" numbers; not that all here are, but neither are none of them.

Edit for clarification: I'm referring to this, and not something vague and non-concrete (and not to the original post of the thread)! : https://boardgamearena.com/bug?id=66082
Last edited by silentProtest on 24 July 2022, 20:11, edited 3 times in total.
silentProtest
Posts: 196
Joined: 26 March 2022, 20:12

Re: After 20 times playing, I am done with the BGA version

Post by silentProtest »

Tisaac wrote: 23 July 2022, 22:44
jarjarjese wrote: 23 July 2022, 21:42 They are the exception to the rule. With the BGA version, those games are happening every single game.
This is clearly an exageration so can you actually go back and look at your stats to see how high is that number ?
about one in three or one in four. does anyone click the links that are posted for more information(?) [on that note: let me plug that in: https://boardgamearena.com/bug?id=66082 ]

Edit for clarification: I'm referring always to this, and not something vague and non-concrete (and not to the original post of the thread)! : https://boardgamearena.com/bug?id=66082
Last edited by silentProtest on 24 July 2022, 20:11, edited 2 times in total.
User avatar
Meeplelowda
Posts: 3827
Joined: 14 March 2020, 10:31

Re: After 20 times playing, I am done with the BGA version

Post by Meeplelowda »

silentProtest wrote: 23 July 2022, 23:30My point: there are valid reasons to complain about algorithms, that are generating these "random" numbers; not that all here are, but neither are none of them.
If we were running a national security agency where true randomness was mission critical, yep, I 100% agree that there are valid reason to complain about the algorithm. You strike me as someone who would be interested in the mathematics and history behind the one-time pad: "Properly used, one-time pads are secure ... even against adversaries with infinite computational power." But one-time pads are only secure if--and it's BIG if--the keys are truly random, lest they be vulnerable to statistical frequency attacks.

If anyone is willing to take me up on it, we can set up a Pascal-Fermat Test (a shout out to the origins of probability theory). I made that term up, but it's like a Turing Test, except for probability. The evaluator will be presented with several sequences (length to be determined) of numbers generated with various methods: PHP rand algorithm, Random.org generator, and rolling actual physical dice.

My proposition is that if you can't distinguish which method produced which sequence, then any of them is good enough for rolling dice on a freakin' board game site.
Play Now lobby 4ever! https://boardgamearena.com/lobby
silentProtest
Posts: 196
Joined: 26 March 2022, 20:12

Re: After 20 times playing, I am done with the BGA version

Post by silentProtest »

Meeplelowda wrote: 24 July 2022, 01:50
silentProtest wrote: 23 July 2022, 23:30My point: there are valid reasons to complain about algorithms, that are generating these "random" numbers; not that all here are, but neither are none of them.
If we were running a national security agency where true randomness was mission critical, yep, I 100% agree that there are valid reason to complain about the algorithm. You strike me as someone who would be interested in the mathematics and history behind the one-time pad: "Properly used, one-time pads are secure ... even against adversaries with infinite computational power." But one-time pads are only secure if--and it's BIG if--the keys are truly random, lest they be vulnerable to statistical frequency attacks.

If anyone is willing to take me up on it, we can set up a Pascal-Fermat Test (a shout out to the origins of probability theory). I made that term up, but it's like a Turing Test, except for probability. The evaluator will be presented with several sequences (length to be determined) of numbers generated with various methods: PHP rand algorithm, Random.org generator, and rolling actual physical dice.

My proposition is that if you can't distinguish which method produced which sequence, then any of them is good enough for rolling dice on a freakin' board game site.
after thousands/tenthousands of rolls it took me to notice it here, I think I pass :D (and just getting suspicious, talking out and collecting data - not even sure enough yet if it's a 100% real problem - would be worlds easier to test/proof with the source code..)
but if its a php problem (or non problem) just rand(1,6) twice and look if the results (sum and/or dice combination) cluster more often then they should .... [I just wasnt sure, whether that is what the devs used]

Edit for clarification: I'm referring always to this, and not something vague and non-concrete (and not to the original post of the thread)! : https://boardgamearena.com/bug?id=66082
Last edited by silentProtest on 24 July 2022, 20:11, edited 2 times in total.
Stroom
Posts: 428
Joined: 14 July 2016, 19:10

Re: After 20 times playing, I am done with the BGA version

Post by Stroom »

silentProtest wrote: 23 July 2022, 23:30
Stroom wrote: 23 July 2022, 07:44 What Meeplelowda said. People who complain about randomness do not understand randomness.
I actually thought about finding papers I read, about how to evaluate RNGs/pseudo randomness ( at what point it could be considered random enough that it doesnt matter, in relation to predictability, that it's only pseudorandom ), or just googling it, because that might be faster, but it's not worth the time (for me, right now), and it wouldnt help without the large data set. My point: there are valid reasons to complain about algorithms, that are generating these "random" numbers; not that all here are, but neither are none of them.
You don't even need to go that far into it. The RNG issues that people have, deal with highly precise measurements. Not when reduced to 6 results (x2).
One RNG roll outputs a value between 0 and 1, with 14 digits. Then that value is multiplied by 6 and rounded to the first integer. So you will get a roll of 1-6. All this precision is lost in this calculation so it does not really matter how good the RNG actually is.

What is a problem for games like Catan is the low amount of dice rolls. Usually there are about 70 dice rolls in a game of Catan. For two 6-sided dice there are 36 combinations of dice roll results. You can rarely get a normal distribution in 70 dice rolls. Pretty much every game will feel like the dice are not favoring at least one of the players.

It's almost like flipping a coin 2x and hoping that it will always be either heads-tails or tails-heads - because that would be balanced. But it is as probable that it will be heads-heads or tails-tails. Basically you could compare it to Catan - about 50% of the time you will get a total dice statistics that seem skewed to a human observer. Not following the perceived distribution.

Also, when flipping dice, you will often get the same result many times in a row. You could have HHHHHHHHTTTHTTTHTTTT - Most of the heads appear in a cluster but if you flip long enough it will even out. Humans would perceive it as unfair but the reality is that this can still happen. If not exactly like this then some other way that seems "unfair". And there are enough of these "unfair" distribution combinations that it would exceed the amount what a human would think is "reasonable". But this is the reality and you have to get over it. For a game like Catan, the analogue is that you roll all 6s at the start of the game and later roll all the 8s... evening it out in the end. This is not good for the players who built on 8. The player who built on 6, can spread to 8 by using the previous outcomes... And he benefits from the 8 as well.

https://www.geogebra.org/m/UsoH4eNl - go and try it out - roll 100 times, reset, roll 100 times, reset. The graph will be skewed quite many times.

You have to realize some things:
Previous dice rolls do NOT affect the future rolls. Therefore, rolling the same result 4-5 times in a row is perfectly fine to happen
To achieve a perceived normal distribution with 2 dice, you'd most likely need 100x as many rolls as there are different combinations. And even then it is not guaranteed.
Saying anything like "I have 8+ cards so it is more likely that a 7 is rolled" or whatever you seem to perceive is most likely confirmation bias.
silentProtest
Posts: 196
Joined: 26 March 2022, 20:12

Re: After 20 times playing, I am done with the BGA version

Post by silentProtest »

Stroom wrote: 24 July 2022, 06:38
silentProtest wrote: 23 July 2022, 23:30
Stroom wrote: 23 July 2022, 07:44 What Meeplelowda said. People who complain about randomness do not understand randomness.
I actually thought about finding papers I read, about how to evaluate RNGs/pseudo randomness ( at what point it could be considered random enough that it doesnt matter, in relation to predictability, that it's only pseudorandom ), or just googling it, because that might be faster, but it's not worth the time (for me, right now), and it wouldnt help without the large data set. My point: there are valid reasons to complain about algorithms, that are generating these "random" numbers; not that all here are, but neither are none of them.
You don't even need to go that far into it. The RNG issues that people have, deal with highly precise measurements. Not when reduced to 6 results (x2).
One RNG roll outputs a value between 0 and 1, with 14 digits. Then that value is multiplied by 6 and rounded to the first integer. So you will get a roll of 1-6. All this precision is lost in this calculation so it does not really matter how good the RNG actually is.

What is a problem for games like Catan is the low amount of dice rolls. Usually there are about 70 dice rolls in a game of Catan. For two 6-sided dice there are 36 combinations of dice roll results. You can rarely get a normal distribution in 70 dice rolls. Pretty much every game will feel like the dice are not favoring at least one of the players.

It's almost like flipping a coin 2x and hoping that it will always be either heads-tails or tails-heads - because that would be balanced. But it is as probable that it will be heads-heads or tails-tails. Basically you could compare it to Catan - about 50% of the time you will get a total dice statistics that seem skewed to a human observer. Not following the perceived distribution.

Also, when flipping dice, you will often get the same result many times in a row. You could have HHHHHHHHTTTHTTTHTTTT - Most of the heads appear in a cluster but if you flip long enough it will even out. Humans would perceive it as unfair but the reality is that this can still happen. If not exactly like this then some other way that seems "unfair". And there are enough of these "unfair" distribution combinations that it would exceed the amount what a human would think is "reasonable". But this is the reality and you have to get over it. For a game like Catan, the analogue is that you roll all 6s at the start of the game and later roll all the 8s... evening it out in the end. This is not good for the players who built on 8. The player who built on 6, can spread to 8 by using the previous outcomes... And he benefits from the 8 as well.

https://www.geogebra.org/m/UsoH4eNl - go and try it out - roll 100 times, reset, roll 100 times, reset. The graph will be skewed quite many times.

You have to realize some things:
Previous dice rolls do NOT affect the future rolls. Therefore, rolling the same result 4-5 times in a row is perfectly fine to happen
To achieve a perceived normal distribution with 2 dice, you'd most likely need 100x as many rolls as there are different combinations. And even then it is not guaranteed.
Saying anything like "I have 8+ cards so it is more likely that a 7 is rolled" or whatever you seem to perceive is most likely confirmation bias.
since you quoted my stuff - I will repeat again: "Saying anything like "I have 8+ cards so it is more likely that a 7 is rolled" or whatever you seem to perceive is most likely confirmation bias." - not what I said. And for all the people who do, I answered the exact same thing...

this comes close: HHHHHHHHTTTHTTTHTTTT - but at 50 50, no shit there will be clusters, but at 1/36 ( if you go for same dice combination ) or 2-6/36 it appears way too consistent. What I mean by that (since noone will freakin read the bug report): like in 1 3rd or 1 4th of the games, one or two numbers [2-12] get a cluster (are rolled in a row, or are rolled in a row somewhat alternately) - this, with the exact same numbers, will happen later in the game, sometimes even multiple times, after the initial one. And this has been seen again and again , just with different numbers each game - what weirded me out, is that the same cluster repeats (within a game). Never saw that in any other implementation of catan.

Edit for clarification: I'm referring always to this, and not something vague and non-concrete (and not to the original post of the thread)! : https://boardgamearena.com/bug?id=66082
Last edited by silentProtest on 24 July 2022, 20:12, edited 2 times in total.
Stroom
Posts: 428
Joined: 14 July 2016, 19:10

Re: After 20 times playing, I am done with the BGA version

Post by Stroom »

silentProtest wrote: 24 July 2022, 11:47 since you quoted my stuff - I will repeat again: "Saying anything like "I have 8+ cards so it is more likely that a 7 is rolled" or whatever you seem to perceive is most likely confirmation bias." - not what I said. And for all the people who do, I answered the exact same thing...
This was just an example of what confirmation bias is.
silentProtest wrote: 24 July 2022, 11:47 this comes close: HHHHHHHHTTTHTTTHTTTT - but at 50 50, no shit there will be clusters, but at 1/36 ( if you go for same dice combination ) or 2-6/36 it appears way too consistent. What I mean by that (since noone will freakin read the bug report): like in 1 3rd or 1 4th of the games, one or two numbers [2-12] get a cluster (are rolled in a row, or are rolled in a row somewhat alternately) - this, with the exact same numbers, will happen later in the game, sometimes even multiple times, after the initial one. And this has been seen again and again , just with different numbers each game - what weirded me out, is that the same cluster repeats (within a game). Never saw that in any other implementation of catan.
And now you make a claim that is a perfect example of a confirmation bias. Show me the exact games and where the clusters of rolls are. And why do you think it is because the RNG is broken not because it is just a chance.

If the numbers are the exact same for several different games, I will believe you. There was an issue with the RNG seed for Catan Universe a few years ago - the same seed used for different games so the dice rolls were the same. But then it was from start to finish. You could predict EVERYTHING. Even the order of development cards. Not in small clusters. If the clusters repeat but not all the time, it's just a coincidence.

Still, pretty much a confirmation bias. Catan has too few rolls to provide a fair distribution. Clusters of the same number being rolled several times in a row will happen. The game IS quite random so you have to deal with it.
silentProtest
Posts: 196
Joined: 26 March 2022, 20:12

Re: After 20 times playing, I am done with the BGA version

Post by silentProtest »

Stroom wrote: 24 July 2022, 13:40
If the numbers are the exact same for several different games, I will believe you. There was an issue with the RNG seed for Catan Universe a few years ago - the same seed used for different games so the dice rolls were the same. But then it was from start to finish. You could predict EVERYTHING. Even the order of development cards. Not in small clusters. If the clusters repeat but not all the time, it's just a coincidence.

Still, pretty much a confirmation bias. Catan has too few rolls to provide a fair distribution. Clusters of the same number being rolled several times in a row will happen. The game IS quite random so you have to deal with it.
It could still be coincidence (couple ten thousands rolls are not enough, to say anything non trivial). But claiming it being pure coincidence generally, without anything backing you up (on the objective side, in math/statistic sphere [not the psychological stuff; about, why people see stuff/patterns that isn't there, and why people complain about the "non randomness" - because with this part youre right, afaik]), is just as wrong to claim its 100% not coincidence - you just need data (either from actual games that bga COULD provide, or by running the algorithm that the devs used for catan), and some adequate tests for it. In the time we discussed it, one could easily write the code for it, if that access/information is given.

"Catan has too few rolls to provide a fair distribution." - never said that the distribution looks off .... (in the end of post games it just looks unsuspicious , like most looked everywhere, more or less)
"The game IS quite random so you have to deal with it." - without actually testing that, we just waste words; my aim was to help out the dev team to make the game better (still in alpha tester mode)... I should probably let this be, until either the devs react (bcs. bga wont^^) or it will stand out in competitive play in a couple of seasons, and finish my UI-Rework suggestions :lol:

Edit for clarification: I'm referring always to this, and not something vague and non-concrete (and not to the original post of the thread)! : https://boardgamearena.com/bug?id=66082
Last edited by silentProtest on 24 July 2022, 20:12, edited 2 times in total.
Post Reply

Return to “Catan”