Protein phosphorylation transduces a large set of intracellular signals. One mechanism by which phosphorylation mediates signal transduction is by prompting conformational changes in the target protein or interacting proteins. Previous work described an allosteric site mediating phosphorylation-dependent activation of AGC kinases. The AGC kinase PDK1 is activated by the docking of a phosphorylated motif from substrates. Here we present the crystallography of PDK1 bound to a rationally developed low-molecular-weight activator and describe the conformational changes induced by small compounds in the crystal and in solution using a fluorescence-based assay and deuterium exchange experiments. Our results indicate that the binding of the compound produces local changes at the target site, the PIF binding pocket, and also allosteric changes at the ATP binding site and the activation loop. Altogether, we present molecular details of the allosteric changes induced by small compounds that trigger the activation of PDK1 through mimicry of phosphorylation-dependent conformational changes.