On demanding visual memory tasks like the Rey Complex Figure Test and Recognition Trial (RCFT), left-handers often outperform right-handers and participants with mixed handedness. Left-handers’ apparent visual memory superiority develops during late childhood and early adolescence and is established by young adulthood. Though many studies have examined RCFT performance in older adults and found that visual memory deteriorates with age, investigations of the relationship between handedness and visual memory abilities in older adults have been scarce. In the present study I sought to determine whether a left-handed RCFT performance advantage would be evident among older adults. I examined RCFT and handedness data from 800 older adults (Females = 152, Males = 648; M age = 69.86, SD = 5.18 years; range 60–85 years), who took part in prior research (Whitehall II Phase 11 sub-study). Among these participants, handedness predicted both immediate and delayed RCFT recall, with left-handers outperforming both mixed- and right-handers and with performance unrelated to gender. The absence of a left-handed advantage for copy accuracy suggests that the effects observed for recall do not stem from differences in participants’ perceptual abilities and/or motor control. Instead, these data suggest that left-handers’ superior performances stem from their advantage for visual memory. As visual memory predicts both motor learning capacity and motor skill retention in older adults, these results have potentially important implications for rehabilitation efficacy.