Modification of asphalt binder with crumb rubber or SBS type polymer can further enhance the viscoelastic properties of asphalt mixtures in terms of reduced permanent deformation and increased operational temperature range. In this research, the effect of different variations of crumb rubber (CR) and styrene-butadiene-styrene (SBS) consisting of Base asphalt, 4% SBS, 7% SBS, 7% CR, 15% CR and 20% have been analyzed in terms of rutting accumulation. This research is significant in terms of performance characteristics of CR and SBS modified mixtures, where based on availability and price of these modifiers, agencies can perform selection of either variations of these modifiers based on their requirement and standards in order to optimize the performance of asphalt pavements. Finite element analysis has been performed using ABAQUS, where a dual wheel having an axle load of 100 kN has been simulated with a total of 50,000 passes on a 2D model. Validated creep parameters using the Burger’s model have been utilized for simulation of material decay under creep loading for each variation. Visco step loading has been used to measure rutting progression. Results show increased rutting accumulation of base asphalt among other scenarios. Furthermore, CR-20 outperforms other variations in terms of rutting accumulation. Both CR-20 and SBS-7 yield the minimum rutting magnitude of 3.2 m and 3.3 mm respectively. SBS-7 leads to 39% less rutting magnitude when compared to that of base asphalt.