Cellular homeostasis is continuously challenged by environmental cues and cellular stress conditions. In their defense, cells need to mount appropriate stress responses that, dependent on the cellular context, signaling intensity, and duration, may have diverse outcomes. The stress- and mitogen-activated protein kinase (SAPK/MAPK) system consists of well-characterized signaling cascades that sense and transduce an array of different stress stimuli into biological responses. However, the physical and chemical nature of stress signals and how these are sensed by individual upstream MAP kinase kinase kinases (MAP3Ks) remain largely ambiguous. Here, we review the existing knowledge of how individual members of the large and diverse group of MAP3Ks sense specific stress signals through largely non-redundant mechanisms. We emphasize the large knowledge gaps in assigning function and stress signals for individual MAP3K family members and touch on the potential of targeting this class of proteins for clinical benefit.