# Pesidious | Malware Mutation Using Reinforcement Learning And Generative Adversarial Networks **URL:** \ **Category:** Tools & Scripts\ **Tags:** business, ai\ **Created:** [May 27, 2021, 12:03pm UTC](https://onehack.st/t/pesidious-malware-mutation-using-reinforcement-learning-and-generative-adversarial-networks/186010 "2021-05-27T12:03:47Z")\ **Posts on this page:** 1\ **Page:** 1
**Author:** ![TheStrength](https://onehack.st/user_avatar/onehack.st/thestrength/32/46753_2.png) [@TheStrength](https://onehack.st/u/TheStrength)\ **Post date:** [May 27, 2021, 12:03pm UTC](https://onehack.st/t/pesidious-malware-mutation-using-reinforcement-learning-and-generative-adversarial-networks/186010/1 "2021-05-27T12:03:47Z")
![image](https://onehack.st/uploads/default/original/3X/2/2/22354fb5ea94bd8f621952b3dc8042d1e1f4c756.png) # Malware Mutation using Deep Reinforcement Learning and GANs The purpose of the tool is to use artificial intelligence to mutate a malware (PE32 only) sample to bypass AI powered classifiers while keeping its functionality intact. In the past, notable work has been done in this domain with researchers either looking at reinforcement learning or generative adversarial networks as their weapons of choice to modify the states of a malware executable in order to deceive anti-virus agents. Our solution makes use of a combination of deep reinforcement learning and GANs in order to overcome some of the limitations faced while using these approaches independently as showen below. [![Diagram](https://github.com/CyberForce/Pesidious/raw/master/Pesidious%20architecture%20(simplified).png)](https://github.com/CyberForce/Pesidious/blob/master/Pesidious%20architecture%20(simplified).png) Find our full documentation for the tool [here](https://vaya97chandni.gitbook.io/pesidious/) ## Installation Instructions > ⚠ Since this tool deals with malware files, it is strongly recommended to use a virtual machine. After installation of the tool, make sure to disconnect from the network. The following steps will guide you through all the installations required to set up the environment. 1. [Install and set up Python 3.6.](https://realpython.com/installing-python/) 2. Clone the repository. git clone [https://github.com/CyberForce/Pesidious](https://github.com/CyberForce/Pesidious) 1. Move into the project directory. cd Pesidious 1. [Set up and activate a virtual environment with Python 3.6](https://docs.python.org/3/tutorial/venv.html) > It is recommended to use a virtual environment to avoid conflicts between packages used by different applications 1. Make sure that you have pip 8.1.1 installed and set up. > This is due to later versions of pip not playing well with the PyTorch libary. pip install pip==8.1.1 1. Install all the required libraries, by installing the requirements.txt file. pip install -r pip\_requirements/requirements.txt ### Mutate Your Malware The output from GAN has already been stored as (`RL_Features/adverarial_imports_set.pk` and `RL_Features/adverarial_sections_set.pk`) which will be used for when adding imports and sections to the malware for mutation. 1. You can test the sample classifier to score malware files. ```auto python classifier.py -d /path/to/directory/with/malware/files ``` 1. Run the `mutate.py` python script to mutate your malware samples. ```auto python mutate.py -d /path/to/directory/with/malware/files ``` 1. The mutated malware files will be stored in a directory called Mutated\_malware in the following format ```auto Mutated_malware/mutated_ ``` 1. Once the malware files are mutated, you can run the classifier again to score the mutated malware. ```auto python classifier.py -d Mutated_malware/ ``` ## Known Issues and Fixes > ⚠ WARNING: This segment is currently under construction. We apologize for any inconvinience caused. Please proceed to the next section. [click here](https://github.com/CyberForce/Pesidious#to-do) 1. `pip install -r requirements.txt` gives you an error.Solution: ```auto pip install tqdm pip install sklearn pip install lief ``` 1. **ModuleNotFoundError: No module named ‘tensorboardX’** error while running `python main_malgan.py` script.Solution: ```auto pip install tensorboardX ``` 1. \*\*Error with the execution of import-append, section-append (not found)\*\*Solution Give execute permission to these executables using the following commands on your terminal ```auto cd portable-executable/ chmod 777 project-add-sections/bin/Debug/project-append-section chmod 777 project-add-imports/bin/Debug/project-append-imports ``` ## Built With - [PyTorch](https://pytorch.org/) - Open source machine learning library based on the Torch library. - [Lief](https://github.com/lief-project/LIEF) - A cross platform library which can parse, modify and abstract ELF, PE and MachO formats. - [PE Bliss](https://github.com/BackupGGCode/portable-executable-library) - PE libarry for rebuilding PE files, written in C++. - [Gym-Malware](https://github.com/endgameinc/gym-malware/) - Malware manipulation environment for OpenAI’s gym. - [MalwareGAN](https://github.com/ZaydH/MalwareGAN) - Adversarial Malware Generation Using GANs. ## Authors - **Chandni Vaya** - _X-Force Incident Response, IBM Security_ - [Github](https://github.com/Chandni97) - **Bedang Sen** - _X-Force Incident Response, IBM Security_ - [Github](http://github.com/bedangSen/) ## Acknowledgments - Gym-Malware Environment: [https://github.com/endgameinc/gym-malware](https://github.com/endgameinc/gym-malware). The environment was modified to add GAN and the mutations were added/changed/removed to improve the evasiveness of the malware and maintain functionality. - Yanming Lai’s ([https://github.com/yanminglai/Malware-GAN](https://github.com/yanminglai/Malware-GAN)) and - Zayd Hammoudeh’s ([https://github.com/ZaydH/MalwareGAN](https://github.com/ZaydH/MalwareGAN)) work on implementation on Han and Tan’s MalGAN played a crucial role in our understanding of the architecture. A majority of the implementation of the MalGAN used in this project has been forked off Hammoudeh’s work. ## References Anderson, H., Kharkar, A., Filar, B., Evans, D. and Roth, P. (2018). Learning to Evade Static PE Machine Learning Malware Models via Reinforcement Learning. [online] [arXiv.org](http://arXiv.org). Available at: [https://arxiv.org/abs/1801.08917](https://arxiv.org/abs/1801.08917). [Docs.microsoft.com](http://Docs.microsoft.com). (n.d.). PE Format - Windows applications. [online] Available at: [https://docs.microsoft.com/en-us/windows/win32/debug/pe-format#general-concepts](https://docs.microsoft.com/en-us/windows/win32/debug/pe-format#general-concepts). Fang, Z., Wang, J., Li, B., Wu, S., Zhou, Y. and Huang, H. (2019). Evading Anti-Malware Engines With Deep Reinforcement Learning. [online] [Ieeexplore.ieee.org](http://Ieeexplore.ieee.org). Available at: [https://ieeexplore.ieee.org/abstract/document/8676031](https://ieeexplore.ieee.org/abstract/document/8676031) [Accessed 25 Aug. 2019]. [https://resources.infosecinstitute.com](https://resources.infosecinstitute.com/). (2019). Malware Researcher’s Handbook (Demystifying PE File). [online] Available at: [https://resources.infosecinstitute.com/2-malware-researchers-handbook-demystifying-pe-file/#gref](https://resources.infosecinstitute.com/2-malware-researchers-handbook-demystifying-pe-file/#gref). Hu, W. and Tan, Y. (2018). Generating Adversarial Malware Examples for Black-Box Attacks Based on GAN. [online] [arXiv.org](http://arXiv.org). Available at: [https://arxiv.org/abs/1702.05983](https://arxiv.org/abs/1702.05983). ## GitHub: > **[GitHub - CyberForce/Pesidious: Malware Mutation Using Reinforcement Learning and...](https://github.com/CyberForce/Pesidious)** > > Malware Mutation Using Reinforcement Learning and Generative Adversarial Networks