The synthesis and accumulation of compatible solutes represent an essential part of the salt acclimation strategy of microorganisms. Glucosylglycerol is considered to be the typical compatible solute among marine cyanobacteria. However, genes that encode enzymes for the synthesis of glucosylglycerol were not detected in the genome sequences of marine picoplanktonic Prochlorococcus strains. Instead, we noticed the presence of genes that putatively encode for glucosylglycerate (GGA) synthesis among Prochlorococcus and most other closely related marine picocyanobacteria. Recombinant proteins from Prochlorococcus marinus SS120 and Synechococcus sp. PCC 7002 exhibited glucosyl-phosphoglycerate synthase (GpgS) activity, and GpgS is a key enzyme of GGA synthesis. GGA accumulation was found to be salt- as well as nitrogen-regulated in the coastal strain Synechococcus sp. PCC 7002. Moreover, GGA was also detected in all picoplanktonic Prochlorococcus and Synechococcus strains harbouring gpgS genes, especially under N-limiting conditions. These results suggest that marine picocyanobacteria acquired the capacity to synthesize the negatively charged compound GGA during their evolution. Our results establish GGA as the fifth most widespread compatible solute among cyanobacteria. Additionally, GGA appears to replace glutamate as an anion to counter monovalent cations in marine picocyanobacteria from N-poor environments.