The failure to repress transcription of repetitive genomic elements can lead to catastrophic genome instability and is associated with various human diseases. As such, multiple parallel mechanisms cooperate to ensure repression and heterochromatinization of these elements, especially during germline development and early embryogenesis. A vital question in the field is how specificity in establishing heterochromatin at repetitive elements is achieved. Apart from trans-acting protein factors, recent evidence points to a role of different RNA species in targeting repressive histone marks and DNA methylation to these sites in mammals. Here, we review recent discoveries on this topic and predominantly focus on the role of RNA methylation, piRNAs, and other localized satellite RNAs.