We find infant faces highly attractive as a result of specific features which Konrad Lorenz termed "Kindchenschema" or "baby schema," and this is considered to be an important adaptive trait for promoting protective and caregiving behaviors in adults, thereby increasing the chances of infant survival. This review first examines the behavioral support for this effect and physical and behavioral factors which can influence it. It then provides details of the increasing number of neuroimaging and electrophysiological studies investigating the neural circuitry underlying this baby schema effect in parents and non-parents of both sexes. Next it considers potential hormonal contributions to the baby schema effect in both sexes and the neural effects associated with reduced responses to infant cues in post-partum depression, anxiety and drug taking. Overall the findings reviewed reveal a very extensive neural circuitry involved in our perception of cuteness in infant faces, with enhanced activation compared to adult faces being found in brain regions involved in face perception, attention, emotion, empathy, memory, reward and attachment, theory of mind and also control of motor responses. Both mothers and fathers also show evidence for enhanced responses in these same neural systems when viewing their own as opposed to another child. Furthermore, responses to infant cues in many of these neural systems are reduced in mothers with post-partum depression or anxiety or have taken addictive drugs throughout pregnancy. In general reproductively active women tend to rate infant faces as cuter than men, which may reflect both heightened attention to relevant cues and a stronger activation in their brain reward circuitry. Perception of infant cuteness may also be influenced by reproductive hormones with the hypothalamic neuropeptide oxytocin being most strongly associated to date with increased attention and attraction to infant cues in both sexes.