The confidence interval does not rely on any prior probability distribution for the fraction of penguins ($p$) that like chocolate. You may have thought it extremely unlikely that penguins would like chocolate; if so, you will still deem it unlikely (albeit less so) that the true percentage is between $93.3\%$ and $98.7\%$, even after doing this experiment. Your confidence that $p$ lies in that interval (that is, your posterior probability) could still be low.
The confidence interval describes something different. A confidence interval is a rule that assigns an interval to every possible result of your experiment, such that whatever the true value of p, it will fall in the assigned interval $95\%$ of the time.
The difference is fairly subtle, but it can be summarized this way. A confidence interval is not a particular interval that almost surely (given the randomness associated with $p$) contains the correct answer, now that the experiment has been done. It is a rule, formulated before the experiment was done, that was almost sure (given the randomness associated with the experiment) to generate an interval containing the correct answer.