A Hybrid Algorithm for Enhancement of the Data Security During Network Transmission Based on RSA, DH, and AES

The connected digital environment generates massive amounts of data that must be protected from unauthorized disclosure.Technological advancements and the creative techniques attackers use can exacerbate data security breaches.Security protocols and cryptographic algorithms are the two components of information security, the last being information security's basis and fundamental technology.The cryptographic conception will improve and assure security while also protecting network resources that are exchanged.The goal of this study is to demonstrate the few encryption algorithms that are used to encrypt data on an unsecured network.This research presents a new hybrid encryption strategy for encrypting data.MRDAES encrypts data using Rivest, Shamir, Adleman (RSA), Diffie Hellman (DH), and the Advanced Encryption System.The data will be encoded in two stages: the first by producing the encoded data using the XOR function, and the second by using AES to encode data and obtain the final result to be shared with intended reception with high-security complexity compared to other methods in terms of performance and avalanche effect.The proposed study examines the three most widely used cryptographic symmetric and asymmetric algorithms, RSA, Diffie-Hellman, and AES, and how they operate and impact security and complexity when integrated into a unified hybrid (MRDAES) computation with the proper adjustments.The study also presents an approach for increasing data security while minimizing the number of mathematical equations and obtaining highsecurity complexity while slightly increasing execution time with chosen large random prime numbers.The results indicate that the new hybrid technique (MRDAES) has more efficient performance and avalanche effect inputs with a minor increase in execution time.The proposed approach MRDAES produced more advanced complexity than classical RSA existing methods and others.According to avalanche effect data, the proposed technique provides better results with a higher percentage than existing algorithms on modified RSA Random Bit Insertion Algorithm (RBMRSA) and classical Rivest, Shamir, and Adleman (RSA).The proposed approach enhances the avalanche effect by 88% compared to 48% achieved by an RBMRSA, with a 40% increase and 87.80% compared to RSA.