Global climate is thought to be modulated by the supply of minerals to Earth’s surface. Whereas silicate weathering removes carbon dioxide (CO₂) from the atmosphere, weathering of accessory carbonate and sulfide minerals is a geologically relevant source of CO₂. Although these weathering pathways commonly operate side by side, we lack quantitative constraints on their co-variation across erosion rate gradients. Here we use stream-water chemistry across an erosion rate gradient of three orders of magnitude in shales and sandstones of southern Taiwan, and find that sulfide and carbonate weathering rates rise with increasing erosion, while silicate weathering rates remain steady. As a result, on timescales shorter than marine sulfide compensation (approximately 10⁶–10⁷ years), weathering in rapidly eroding terrain leads to net CO₂ emission rates that are at least twice as fast as CO₂ sequestration rates in slow-eroding terrain. We propose that these weathering reactions are linked and that sulfuric acid generated from sulfide oxidation boosts carbonate solubility, whereas silicate weathering kinetics remain unaffected, possibly due to efficient buffering of the pH. We expect that these patterns are broadly applicable to many Cenozoic mountain ranges that expose marine metasediments.