We could have decided on things working entirely differently, and there are people who explore those topics[1].
[1]: https://en.wikipedia.org/wiki/Peano_axioms#Nonstandard_model...
You have a valid unsettled intuition!
I have it too, though I have given it a different explanation.
Reality is not a counted number of things, it is the “potential” of all things, broken down into the most economically scalar interactive pieces, and sure we can use numbers to count those.
“Potential distribution” nerds, get that right.
It is “whatever there is by how ever many there are” not n many {n}s.
Go watch YouTube videos on quaternions brother. Do not see it for “the math”, see it for “one layer translating upon another layer.”
Whatever it is man. If you think “discrete” number of things make up reality, you are delusional. It is potential divided. That is reality.