It is with some degree of reluctance that I ask and answer my own question, but someone may find it curious. It is not particularly difficult to answer, but it took me an inordinate amount of time which I can only attribute to experience.
In Convex Analysis, Rockafellar defines the umbra $U$ and penumbra $P$ of a set $C$ with respect to a set $S$ to be $U=\cap_{x \in S} \{ \lambda y + (1-\lambda) x \mid \lambda \ge 1, y \in C \}$ and $P=\cup_{x \in S} \{ \lambda y + (1-\lambda) x \mid \lambda \ge 1, y \in C \}$.
Show that if $C$ is convex then $U$ is convex and if $S,C$ are convex then $P$ is convex.
A moment's thought shows that the question can be reduced to considering the sets $S=[s_1,s_2]$ and $C=[x_1,x_2]$ and showing that the resulting penumbra $P$ is convex. The notation $[x,y]$ means the convex hull of the two points $x,y$.