To begin with, I am not a mathematician, so the question might sound dumb :) Anyway, I have been playing 2048 and thinking on randomness and some things just do not seem very straight to me, when considering what is random.
Given a sequence $S=1, 2, 3, 4,..., m$, each number repeats exactly once and has the same probability to appear in a sequence: $$P(S_{n1})=P(S_{n2})=\frac{1}{n}$$ therefore it is totally random sequence.
Considering Shannon's entropy $$H(X)=-\sum_i P(x_i)\log_2P(x_i)=-\sum_{1}^{n} \frac{1}{n}\log_2\frac{1}{n}=-\log_2\frac{1}{n}$$
we get maximum possible entropy (am I right here?), what suggests remarkably random sequence.
Yet we can derive simple formula to acurately predict the next number at any point in a sequence: $$S(n+1)=S(n)+1;$$ therefore it is totally predictable and has zero randomness.
How should I treat such sequence and what actually constitutes randomness?
If a sequence is random, I should not be able to make any assumptions about the next number at any point of the sequence. At the same time, all the possible numbers should have the same probability of appearing. This implies that if in the past some numbers were more frequent, they are less likely to come up in the future, which means that in time the sequence becomes more predictable - less random, which in turn implies that no finite sequence can be truly random.
This might also mean, that a sequence has different amount of randomness at different points i.e. randomness is a parameter (function), not a property. Finally, if a sequence gets long enough slight discrepancies in frequency become statistically negligible and the sequence should still appear random, yet be of varying randomness.
it is a bit a wall of text with no exact question, but I tried to list where randomness is strange. I would really appreciate if someone would shed some light on this topic without very complicated math :)
EDIT:
Expanding on 5xum's answer: I understand that rolling a 6 five times in a row with d6 still gives probability of 6 exactly $\frac{1}{6}$. Yet, we cannot say the dice is not fair because the sample is too small. How large the sample should be so we could deduce that the dice is fair/unfair? Furthermore, in case of d6, the distribution can only be uniform (meaning total randomness) if a size of a sample is multiple of 6. Should we take such things to consideration when describing randomness of a sample or are we relying on the size of a sample and negligence of frequency differences?