When a system has evolved far from a ground-state, the adiabatic approximations commonly used in time-dependent density functional theory calculations completely fail in some applications, while giving qualitatively good predictions in others, and sometimes even quantitative predictions. It is not clearly understood why this is so, and developing practical approximations going beyond the adiabatic approximation remains a challenge. This paper explores three different lines of investigation. First, an expression for the exact time-dependent exchange–correlation potential suggests that the accuracy of an adiabatic approximation is intimately related to the deviation between the natural orbital occupation numbers of the physical system and those of the Kohn–Sham system, and we explore this on some exactly-solvable model systems. The exact expression further suggests a path to go beyond the adiabatic approximations, and in the second part we discuss a newly proposed class of memory-dependent approximations developed in this way. Finally, we derive a new expression for the exact exchange–correlation potential from a coupling-constant path integration.