I belive it is so. The following reasoning uses, however, the fact that $\mathrm{Ext}_\mathbb{Z}^1(\mathbb{Q}/\mathbb{Z},\mathbb{Z}/n\mathbb{Z}) \simeq \mathbb{Z}/n\mathbb{Z}$, which I do not know how to obtain.
Observe that $\mathrm{Hom}(\mathbb{Q},\mathbb{Z}/n\mathbb{Z})=0$: Whenever $(p/q)$ is mapped to some $m$, then $(p/nq)$ is mapped to some $k$ and it holds that $0=nk=m$ (in $\mathbb{Z}/n\mathbb{Z}$).
Now, consider a short exact sequence
$$0\rightarrow \mathbb{Z} \rightarrow \mathbb{Q} \rightarrow \mathbb{Q}/\mathbb{Z} \rightarrow 0 \;\; .$$
Aplying $\mathrm{Hom}(-,\mathbb{Z}/n\mathbb{Z}),$ one obtains a long exact sequence
$$0
\rightarrow\mathrm{Hom}(\mathbb{Q}/\mathbb{Z},\mathbb{Z}/n\mathbb{Z})
\rightarrow \mathrm{Hom}(\mathbb{Q},\mathbb{Z}/n\mathbb{Z})
\stackrel{\alpha}{\rightarrow}\mathrm{Hom}(\mathbb{Z},\mathbb{Z}/n\mathbb{Z})
\stackrel{\beta}{\rightarrow} \mathrm{Ext}_\mathbb{Z}^1(\mathbb{Q}/\mathbb{Z},\mathbb{Z}/n\mathbb{Z})
\stackrel{\gamma}{\rightarrow} \mathrm{Ext}_\mathbb{Z}^1(\mathbb{Q},\mathbb{Z}/n\mathbb{Z})
\stackrel{\delta}{\rightarrow} \mathrm{Ext}_\mathbb{Z}^1(\mathbb{Z},\mathbb{Z}/n\mathbb{Z})
\rightarrow \dots, $$
where:
1) $\mathrm{Hom}(\mathbb{Q},\mathbb{Z}/n\mathbb{Z})=0$, hence $\alpha=0$.
2) From exactness, $\beta$ is injective. Since $\mathrm{Hom}(\mathbb{Z},\mathbb{Z}/n\mathbb{Z})\simeq \mathbb{Z}/n\mathbb{Z} \simeq \mathrm{Ext}_\mathbb{Z}^1(\mathbb{Q}/\mathbb{Z},\mathbb{Z}/n\mathbb{Z})$, it follows that $\beta$ is an isomorphism. In particular, it is surjective.
3) From exactness it follows that $\gamma=0$.
4) Since $\mathbb{Z}$ is projective, we have $\mathrm{Ext}_\mathbb{Z}^1(\mathbb{Z},\mathbb{Z}/n\mathbb{Z})=0$. Hence $\delta=0$.
5) Now it follows by exactness that $\mathrm{Ext}_\mathbb{Z}^1(\mathbb{Q},\mathbb{Z}/n\mathbb{Z})=0$.