Based on elasto-plasticity and damage mechanics, a double-medium constitutive model of geological material under uniaxial tension and compression was presented, on the assumption that rock and soil materials are the pore-fracture double-medium, and porous medium has no damage occurring, while fracture medium has damage occurring with load. To the implicit equation of the model, iterative method was adopted to obtain the complete stress-strain curve of the material. The result shows that many different distributions (uniform distribution, concentrated distribution and random distribution) of fractures in rock and soil material are the essential reasons of the daedal constitutive relations. By the reason that the double-medium constitutive model separates the material to be porous medium part, which is the main body of elasticity, and fracture medium part, which is the main body of damage, it is of important practical values and theoretical meanings to the study on failure of rock and soil or materials containing damage.