When we bring to mind something we have seen before, our eyes spontaneously reproduce a pattern strikingly similar to that made during the original encounter. Eye-movements can then serve the opposite purpose to acquiring new visual information; they can serve as self-generated cues, pointing to memories already stored. By isolating separable properties within the closely bound chain of where and when we look, we demonstrate that specific components of dynamically reinstated eye-movement sequences, facilitate different aspects of episodic remembering. We also show that the fidelity with which a series of connected eye-movements from initial encoding is reproduced during subsequent retrieval, predicts the quality of the recalled memory. Our findings indicate that eye movements are “replayed” to assemble visuospatial relations as we remember. Distinct dimensions of these scanpaths differentially contribute depending on the goal-relevant memory.