Does interactivity on Twitter by political elites yield dividends either in terms of a direct outcome (winning elections) or an indirect outcome (political mobilizations)? We answer this question using a unique dataset of Twitter users (N=27,640) who were among those thanked for their support by the Indian Prime Minister Narendra Modi in his tweets on 16thMarch, 2019 during his campaigning for the general election. We extracted tweets (tweets, retweets and replies) from these users from 10thJanuary (beginning of the campaign) to 19th May 2019 (the day the election ended), which yielded a total of 36.62 million tweets, and proceeded to classify these users based on their activeness on Twitter, for a comprehensive analysis of their Twitter activity over a period of 18 weeks to understand the impact of Modi’s intervention. A controlled intervention analysis using Autoregressive Integrated Moving Average (ARIMA) models was carried out with a control group comprising a similar set of Twitter users (N=27,610) supporting Modi's campaign, but were not mentioned by Modi. Our results suggest that, on average, the aggregate number of tweets shared by users had increased after mentions by Modi. However, our findings do not provide any evidence for the prominence of the activation behavior among less active Twitter users. We discuss the implications of our findings for the use of Twitter by political elites during electoral campaigns. Inferences about political activity on Twitter may also offer important insights into overall political activeness outside Twitter, as evidenced by the use of Twitter activity to capture social trends validated by other studies.