Heterotrophic Bacteria and Archaea (prokaryotes) are a major component of marine food webs and global biogeochemical cycles. Yet, there is limited understanding about how prokaryotes vary across global environmental gradients, and how their global abundance and metabolic activity (production and respiration) may be affected by climate change. Using global datasets of prokaryotic abundance, cell carbon and metabolic activity we reveal that mean prokaryotic biomass varies by just under 3-fold across the global surface ocean, while total prokaryotic metabolic activity increases by more than one order of magnitude from polar to tropical coastal and upwelling regions. Under climate change, global prokaryotic biomass in surface waters is projected to decline ~1.5% per °C of warming, while prokaryotic respiration will increase ~3.5% ( ~ 0.85 Pg C yr−1). The rate of prokaryotic biomass decline is one-third that of zooplankton and fish, while the rate of increase in prokaryotic respiration is double. This suggests that future, warmer oceans could be increasingly dominated by prokaryotes, diverting a growing proportion of primary production into microbial food webs and away from higher trophic levels as well as reducing the capacity of the deep ocean to sequester carbon, all else being equal.