The prediction of current scientific impact of papers and authors has been extensively studied to help researchers find valuable papers and recent research directions, also help policymakers make recruitment decisions or funding allocation. However, how to accurately evaluate the future impact of them, especially for new papers and young researchers, is the focus of scientific impact prediction research, and is less explored. Existing graph-based methods heavily depend on the global structure information of heterogeneous academic network and ignore the local structure information and text information, which may provide important clues to identify influential papers and authors with novel perspective. In this paper, we propose a hybrid model called ESMR to predict the future influence of papers and authors by mainly exploiting these information mentioned above. Specifically, we first put forward a novel network embedding-based model, which can capture not only the local structure information, but also the text information of papers into a unified embedding representation. Then, the future impact of papers and authors is mutually ranked by integrating the learned embedding representations into a multivariate random-walk model. Empirical results on two real datasets demonstrate that the proposed method significantly outperforms the existing state-of-the-art ranking methods.