Assume \(H\) is a subgroup of the cyclic group \(G = \langle g \rangle\text{.}\) The trivial group \(\{1\} = \langle 1 \rangle\) is cyclic, so we assume that \(H\) is nontrivial. Define the set
\begin{equation*}
E = \left\{e \in \Z \;\middle\vert\; g^e \in H\right\} \subseteq \Z
\end{equation*}
and note it is non-empty and symmetric about \(0\) because
\begin{equation*}
e \in E \iff g^e \in H \iff g^{-e} = \left(g^{e}\right)^{-1} \in H \iff -e \in E\text{.}
\end{equation*}
Moreover, the assumption that \(H\) is non-trivial implies the existence of a non-zero element of \(E\) and thus
\begin{equation*}
E_+ = E \cap \N \subseteq \N
\end{equation*}
is non-empty. By the Well-Ordering Principle, \(E_+\) admits a minimum, \(m \in E_+\text{.}\) We prove that \(H = \langle g^m \rangle\text{.}\)
Suppose to the contrary that \(H \setminus \langle g^m \rangle\) is non-empty. By assumption, the set
\begin{equation*}
F = \left\{e \in E \;\middle\vert\; g^e \not \in \langle g^m \rangle\right\} \subseteq E
\end{equation*}
is necessarily non-empty and symmetric about zero because
\begin{equation*}
e \in F \iff g^{e} \not \in \langle g^m \rangle \iff g^{-e} = \left(g^{e}\right)^{-1} \not\in \langle g^m \rangle \iff -e \in F\text{.}
\end{equation*}
Since \(F\) is nonempty and \(g^0 = 1 \in \langle g^m \rangle\) implies \(0 \not \in F\text{,}\) it follows that \(F_+ = F \cap \N \subseteq E_+ \subseteq \N\) is non-empty. By the Well-Ordering Principle, \(F_+\) admits a minimum element, \(n\text{.}\)
We observe that \(n \in F_+ \subseteq E_+\) implies \(m \lt n\) and thus \(0 \lt n - m \lt n\text{.}\) Minimality of \(n\) forces \(g^{n-m} \in \langle g^m \rangle\text{.}\) Since \(\langle g^m \rangle\) is closed under multiplication,
\begin{equation*}
g^n = g^{n-m + m} = g^{n-m}g^m \in \langle g^m \rangle
\end{equation*}
implies \(n \not\in F_+\text{,}\) a contradiction. Therefore \(H = \langle g^m \rangle\text{,}\) as desired.