I am trying to post an answer here since I personally found Gregory Grant's answer, albeit an elegant and lucid one, hard to grasp for a rusty mind like mine. I am just trying to give an explanation to my taste.
Now let b $\in X'$ and b does not take the form of $\frac{1}{k}$.
Consider $(b-\epsilon, b+\epsilon)$, we can first oberserve that b lies in some $(\frac{1}{n}, \frac{1}{n-1})$ for some fixed $n$.
Now take $\epsilon \lt min \{d(b,\frac{1}{n}),d(b,\frac{1}{n-1}) \}$, we claim that there are only finite number of m such that $\frac{1}{m} \gt d(b,\frac{1}{n}) - \epsilon$. It holds since on the real line there are finitely many integer $m$ for any $\frac{1}{m}>a$.
The other side is the same.
However this also means there can only be finite elements in $\{\frac{1}{n} + \frac{1}{m}: \ n,m \in \mathbb{Z}\}$ $\cap$ $(b-\epsilon, b+\epsilon)$
Just take $\epsilon'$ smaller than $d(b,x_{i})$ for these finite elements $x_{i}$ we have a ball without any element in $\{\frac{1}{n} + \frac{1}{m}: \ n,m \in \mathbb{Z}\} \setminus \{b\}$, therefore $b$ can never be an accumulation point.