The protection of the underlying networking infrastructure against illegal access, misuse, or theft is known as network security. It entails establishing a secure infrastructure that allows devices, applications, users, and applications to operate safely. The primary purpose of this study is to improve the RSA algorithm's security. As a result, improvements in the Feistel (F) function integrating RSA, RK, and Game Theory's Mixed Strategy concepts are being made to improve the safety of the RSA cryptographic algorithm. The impact of the RK-GT-RSA algorithm has been analyzed using a number of performance metrics. By improving its Avalanche Effect, Speed, Throughput, and Power Consumption performance, the RK-GT-RSA algorithms are presented. The performance of the RK-GT-RSA algorithm has been improved, and experimental results have been shown.