Type 2 diabetes is a metabolic disorder affecting millions of people worldwide, and new drug leads or functional foods containing selective α-glucosidase inhibitors are needed. Crude extract of 24 plants were assessed for α-glucosidase inhibitory activity. Methanol extracts of Cinnamomum zeylanicum bark, Rheum rhabarbarum peel, and Rheum palmatum root and ethyl acetate extracts of C. zeylanicum bark, Allium ascalonicum peel, and R. palmatum root showed IC50 values below 20 μg/mL. Subsequently, high-resolution α-glucosidase profiling was used in combination with high-performance liquid chromatography–high-resolution mass spectrometry–solid-phase extraction–nuclear magnetic resonance spectroscopy for identification of metabolites responsible for the α-glucosidase inhibitory activity. Quercetin (1) and its dimer (2), trimer (3), and tetramer (4) were identified as main α-glucosidase inhibitors in A. ascalonicum peel, whereas (E)-piceatannol 3′-O-β-d-glucopyranoside (5), (E)-rhapontigenin 3′-O-β-d-glucopyranoside (6), (E)-piceatannol (8), and emodin (12) were identified as main α-glucosidase inhibitors in R. palmatum root.