COVID-19 pandemic has impacted people all across the world. As a result, there has been a collective effort to monitor, predict, and control the spread of this disease. Among this effort is the development of mathematical models that could capture accurately the available data and simulate closely the futuristic scenarios. In this paper, a fractional-order memory-dependent model for simulating the spread of COVID-19 is proposed. In this model, the impact of governmental interventions and public perception are incorporated as part of the nonlinear time-varying transmission rate. In addition, an algorithm for approximating the optimal values of the fractional order and strength of governmental interventions is provided. This approach makes our model suitable for capturing the given data set and consequently reliable for future predictions. The model simulation is performed using the two-step generalized exponential time-differencing method and tested for data from Mainland China, Italy, Saudi Arabia and Brazil. The simulation results demonstrate that the fractional order model calibrates to the data better than its integer order counterpart. This observation is further endorsed by the calculated error metrics.