The normal state in iron chalcogenides is metallic but highly unusual, with orbital and spin degrees of freedom partially itinerant or localized depending on temperature, leading to many unusual features. In this work, we report on the observations of two of such features, the orbital-selective Mott phase (OSMP) and spin nematicity, evidenced in magnetization and magnetotransport [resistivity, Hall effect, anisotropic magnetoresistance (AMR)] of ${\mathrm{Fe}}_{1-y}{\mathrm{Ni}}_y{\mathrm{Te}}_{0.65}{\mathrm{Se}}_{0.35}$ single crystals, with $0<y<0.21$. Substitution of Ni dopes crystals with electrons, what eliminates some of the hole pockets from Fermi level, leaving only one, originating from the $d_{xy}$ orbital. This leads to electron-dominated conduction at low $T$ for $y\gtrsim 0.06$. However, at high temperatures, $T\gtrsim 125–178$ K, the conduction reverses to hole dominated. Anomalies in magnetization and resistivity are observed at temperatures which approach the high-$T$ boundary of the electron-dominated region. Analysis of these effects suggests a link with the appearance of the $d_{z^2}$ hole pockets at $X$ points of the Brillouin zone in the OSMP phase, facilitated by the localization of the $d_{xy}$ orbital, as recently reported by angular-resolved photoemission experiments [J. Huang et al., Commun. Phys. 5, 29 (2022)]. The low-$T$ AMR shows mixed fourfold and twofold rotational symmetry of in-plane magnetocrystalline anisotropy, with the fourfold term the largest at small $y$, and suppressed at intermediate $y$. These results are consistent with the mixed stripe and bicollinear magnetic correlations at small $y$, and suppression of stripe correlations at intermediate $y$, indicating development of spin nematicity with increasing Ni doping, which possibly contributes to the suppression of superconductivity.

• Received 25 November 2022
• Accepted 4 April 2024

DOI:https://doi.org/10.1103/PhysRevB.109.144518