The longitudinal oscillation of a nonlinear elastic rod with lateral inertia was studied. Based on the far field and simple wave theory, a nonlinear Schrödinger (NLS) equation was established under the assumption of small amplitude and long wavelength. It is found that there are NLS envelop solitons in this system. Finally the soliton solution of the NLS equation was presented.