Alzheimer’s disease (AD) is a progressive disorder associated with cognitive dysfunction that alters the brain’s functional connectivity. Assessing these alterations has become a topic of increasing interest. However, a few studies have examined different stages of AD from a complex network perspective that cover different topological scales. This study analyzed the trend of functional connectivity alterations from a cognitively normal (CN) state through early and late mild cognitive impairment (EMCI and LMCI) and to Alzheimer’s disease. The analyses had been done at the local (hubs and activated links and areas), meso (clustering, assortativity, and rich-club), and global (small-world, small-worldness, and efficiency) topological scales. The results showed that the trends of changes in the topological architecture of the functional brain network were not entirely proportional to the AD progression, and these trends behaved differently at the earliest stage of the disease, i.e., EMCI. Further, it has been indicated that the diseased groups engaged somatomotor, frontoparietal, and default mode modules compared to the CN group. The diseased groups also shifted the functional network towards more random architecture. In the end, The methods introduced in this paper enable us to gain an extensive understanding of the pathological changes of the AD process.