Glassy polymers are widely used in biomedical applications in a solvent environment, yet their long-term performance is governed by the competing effects of physical aging and solvent-induced plasticization. Here, we develop a constitutive model that explicitly couples the solvent concentration, structural relaxation, and mechanical response. This framework is built on a multiplicative decomposition of deformation and an Eyring-type flow rule, with structural evolution described by an effective temperature. A generalized shift factor is introduced to quantify how the solvent concentration and effective temperature jointly affect the relaxation time, thereby integrating physical aging and plasticization. The model is subsequently applied to methacrylate (MA)-based copolymer networks immersed in phosphate-buffered saline for up to nine months. Simulations accurately capture key experimental features, including the strong softening of highly swellable networks, the partial recovery due to aging, and the mitigating role of hydrophobic crosslinking in reducing solvent uptake. While the current single-mode description cannot reproduce the full relaxation spectrum, it establishes an efficient framework for predicting the long-term mechanical performance under coupled environmental and mechanical loading. This study provides a constitutive description of solvent-swollen glassy polymers, offering mechanistic insight into the interplay between plasticization and aging. Beyond biomedical MA networks, this framework establishes a foundation for predicting the long-term performance of polymer glasses under coupled aqueous environmental and mechanical loading.