It is widely assumed that learning and memory processes play an important role in the pathogenesis, expression, maintenance and therapy of anxiety disorders, such as phobias or post-traumatic stress disorder (PTSD). Memory retrieval is involved in symptom expression and maintenance of these disorders, while memory extinction is believed to be the underlying mechanism of behavioral exposure therapy of anxiety disorders. There is abundant evidence that stress and stress hormones can reduce memory retrieval of emotional information, whereas they enhance memory consolidation of extinction training. In this study we aimed at investigating if stress affects these memory processes in a fear conditioning paradigm in healthy human subjects. On day 1, fear memory was acquired through a standard differential fear conditioning procedure. On day 2 (24h after fear acquisition), participants either underwent a stressful cold pressor test (CPT) or a control condition, 20min before memory retrieval testing and extinction training. Possible prolonged effects of the stress manipulation were investigated on day 3 (48h after fear acquisition), when memory retrieval and extinction were tested again. On day 2, men in the stress group showed a robust cortisol response to stress and showed lower unconditioned stimulus (US) expectancy ratings than men in the control group. This reduction in fear memory retrieval was maintained on day 3. In women, who showed a significantly smaller cortisol response to stress than men, no stress effects on fear memory retrieval were observed. No group differences were observed with respect to extinction. In conclusion, the present study provides evidence that stress can reduce memory retrieval of conditioned fear in men. Our findings may contribute to the understanding of the effects of stress and glucocorticoids on fear symptoms in anxiety disorders and suggest that such effects may be sex-specific.