# Photon | extract data emails, social media accounts, amazon buckets etc. while crawling **URL:** \ **Category:** Tools & Scripts\ **Tags:** tools, programming\ **Created:** [June 23, 2020, 2:13pm UTC](https://onehack.st/t/photon-extract-data-emails-social-media-accounts-amazon-buckets-etc-while-crawling/93356 "2020-06-23T14:13:47Z")\ **Posts on this page:** 2\ **Page:** 1
**Author:** ![Hannah](https://onehack.st/user_avatar/onehack.st/hannah/32/174875_2.png) [@Hannah](https://onehack.st/u/Hannah)\ **Post date:** [June 23, 2020, 2:13pm UTC](https://onehack.st/t/photon-extract-data-emails-social-media-accounts-amazon-buckets-etc-while-crawling/93356/1 "2020-06-23T14:13:47Z")
[![Photon](https://camo.githubusercontent.com/058a6ecc6d704f3f39d37a8312c5d5670c330e27/68747470733a2f2f696d6167652e6962622e636f2f68354f5a414b2f70686f746f6e736d616c6c2e706e67)](https://github.com/s0md3v/Photon) Photon #### Incredibly fast crawler designed for OSINT. [![](https://camo.githubusercontent.com/4c514e33055481204a0d443e363f9dc7eec18326/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f72656c656173652f73306d6433762f50686f746f6e2e737667) ](https://github.com/s0md3v/Photon/releases)[![pypi](https://camo.githubusercontent.com/dfe87ee05d64c6c9c2dd33947c6e1a8a102753f4/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f707970692d4070686f746f6e2d7265642e7376673f7374796c653d7374796c653d666c61742d737175617265) ](https://pypi.org/project/photon/)[![](https://camo.githubusercontent.com/37b501da99559dafc343cea9b5a101374376a2b2/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f6973737565732d636c6f7365642d7261772f73306d6433762f50686f746f6e2e737667) ](https://github.com/s0md3v/Photon/issues?q=is%3Aissue+is%3Aclosed)[![](https://camo.githubusercontent.com/276326d3683733039a9d3ef9a8ff3c9bec8bca00/68747470733a2f2f696d672e736869656c64732e696f2f7472617669732f636f6d2f73306d6433762f50686f746f6e2e737667)](https://travis-ci.com/s0md3v/Photon) [![demo](https://camo.githubusercontent.com/b75075f36f058337fa0186ab0e3079827205d416/68747470733a2f2f696d6167652e6962622e636f2f6b515355637a2f64656d6f2e706e67)](https://camo.githubusercontent.com/b75075f36f058337fa0186ab0e3079827205d416/68747470733a2f2f696d6167652e6962622e636f2f6b515355637a2f64656d6f2e706e67) [Photon Wiki](https://github.com/s0md3v/Photon/wiki) • [How To Use](https://github.com/s0md3v/Photon/wiki/Usage) • [Compatibility](https://github.com/s0md3v/Photon/wiki/Compatibility-&-Dependencies) • [Photon Library](https://github.com/s0md3v/Photon/wiki/Photon-Library) • [Contribution](https://github.com/s0md3v/Photon#contribution--license) • [Roadmap](https://github.com/s0md3v/Photon/projects/1) ### Key Features #### Data Extraction Photon can extract the following data while crawling: - URLs (in-scope & out-of-scope) - URLs with parameters ( `example.com/gallery.php?id=2` ) - Intel (emails, social media accounts, amazon buckets etc.) - Files (pdf, png, xml etc.) - Secret keys (auth/API keys & hashes) - JavaScript files & Endpoints present in them - Strings matching custom regex pattern - Subdomains & DNS related data The extracted information is saved in an organized manner or can be [exported as json](https://github.com/s0md3v/Photon/wiki/Usage#export-formatted-result). [![save demo](https://camo.githubusercontent.com/1485c10d7e033a7289a9c96cc65f90b1f2db8500/68747470733a2f2f696d6167652e6962622e636f2f64533142714b2f636172626f6e5f322e706e67)](https://camo.githubusercontent.com/1485c10d7e033a7289a9c96cc65f90b1f2db8500/68747470733a2f2f696d6167652e6962622e636f2f64533142714b2f636172626f6e5f322e706e67) #### Flexible Control timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff. The extensive range of [options](https://github.com/s0md3v/Photon/wiki/Usage) provided by Photon lets you crawl the web exactly the way you want. #### Genius Photon’s smart thread management & refined logic gives you top notch performance. Still, crawling can be resource intensive but Photon has some tricks up it’s sleeves. You can fetch URLs archived by [archive.org](https://archive.org/) to be used as seeds by using `--wayback` option. #### Plugins - **[wayback](https://github.com/s0md3v/Photon/wiki/Usage#use-urls-from-archiveorg-as-seeds)** - **[dnsdumpster](https://github.com/s0md3v/Photon/wiki/Usage#dumping-dns-data)** - **[Exporter](https://github.com/s0md3v/Photon/wiki/Usage#export-formatted-result)** #### Docker Photon can be launched using a lightweight Python-Alpine (103 MB) Docker image. $ git clone [https://github.com/s0md3v/Photon.git](https://github.com/s0md3v/Photon.git) $ cd Photon $ docker build -t photon . $ docker run -it --name photon photon:latest -u [google.com](http://google.com) To view results, you can either head over to the local docker volume, which you can find by running `docker inspect photon` or by mounting the target loot folder: $ docker run -it --name photon -v “$PWD:/Photon/google.com” photon:latest -u [google.com](http://google.com) #### Frequent & Seamless Updates Photon is under heavy development and updates for fixing bugs. optimizing performance & new features are being rolled regularly. If you would like to see features and issues that are being worked on, you can do that on [Development](https://github.com/s0md3v/Photon/projects/1) project board. Updates can be installed & checked for with the `--update` option. Photon has seamless update capabilities which means you can update Photon without losing any of your saved data. ### Contribution & License You can contribute in following ways: - Report bugs - Develop plugins - Add more “APIs” for ninja mode - Give suggestions to make it better - Fix issues & submit a pull request Please read the [guidelines](https://github.com/s0md3v/Photon/wiki/Guidelines) before submitting a pull request or issue. Do you want to have a conversation in private? Hit me up on my [twitter](https://twitter.com/s0md3v/), inbox is open 🙂 **Photon** is licensed under [GPL v3.0 license](https://www.gnu.org/licenses/gpl-3.0.en.html) [https://github.com/s0md3v/Photon](https://github.com/s0md3v/Photon) ---
**Author:** ![ArtTouch\_Luxury\_Car](https://onehack.st/user_avatar/onehack.st/arttouch_luxury_car/32/138379_2.png) [@ArtTouch\_Luxury\_Car](https://onehack.st/u/ArtTouch_Luxury_Car)\ **Post date:** [December 16, 2023, 6:09pm UTC](https://onehack.st/t/photon-extract-data-emails-social-media-accounts-amazon-buckets-etc-while-crawling/93356/2 "2023-12-16T18:09:07Z")
good posst