# Galer | A Fast Tool To Fetch URLs From HTML Attributes By Crawl-In

**URL:** <https://onehack.st/t/galer-a-fast-tool-to-fetch-urls-from-html-attributes-by-crawl-in/173137>\
**Category:** Tools & Scripts\
**Tags:** programming, browsers\
**Created:** [February 19, 2021, 2:26pm UTC](https://onehack.st/t/galer-a-fast-tool-to-fetch-urls-from-html-attributes-by-crawl-in/173137 "2021-02-19T14:26:13Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![TheStrength](https://onehack.st/user_avatar/onehack.st/thestrength/32/46753_2.png) [@TheStrength](https://onehack.st/u/TheStrength)\
**Post date:** [February 19, 2021, 2:26pm UTC](https://onehack.st/t/galer-a-fast-tool-to-fetch-urls-from-html-attributes-by-crawl-in/173137/1 "2021-02-19T14:26:13Z")

</div>

![image](https://onehack.st/uploads/default/original/3X/0/b/0bd01feb73f84c28cdfa4f674c265cd9aef14693.jpeg)

A fast tool to fetch URLs from HTML attributes by crawl-in. Inspired by the [@omespino Tweet](https://twitter.com/omespino/status/1318605084989837312), which is possible to extract `src`, `href`, `url` and `action` values by evaluating JavaScript through Chrome DevTools Protocol.

**Installation**

**from Binary**

The installation is easy. You can download a prebuilt binary from [releases page](https://github.com/dwisiswant0/galer/releases), unpack and run! or with

```auto
             ____ _ _(_ ) _____ /'_ '/'_' )| | /'__'( '__)( (_) ( (_| || |( ___| |'__'__,_(___'____(_)( )_) |___/' @dwisiswant0

```

**from Source**

If you have go1.15+ compiler installed and configured:

```auto
 (sudo) curl -sSfL https://git.io/galer | sh -s -- -b /usr/local/bin

```

**from GitHub**

```auto
 GO111MODULE=on go get github.com/dwisiswant0/galer

```

**Usage**

**Basic Usage**

Simply, galer can be run with:

```auto
 git clone https://github.com/dwisiswant0/galer cd galer go build . (sudo) mv galer /usr/local/bin

```

**Flags**

```auto
 galer -u "http://domain.tld"

```

This will display help for the tool. Here are all the switches it supports.

| **Flag** | **Description** |
| --- | --- |
| -u, –url | Target to fetches _(single target URL or list)_ |
| -e, –extension | Show only certain extensions _(comma-separated, e.g. js,php)_ |
| -c, –concurrency | Concurrency level _(default: 50)_ |
| –in-scope | Show in-scope URLs/same host only |
| -o, –output | Save fetched URLs output into file |
| -t, –timeout | Maximum time _(seconds)_ allowed for connection _(default: 60)_ |
| -s, –silent | Silent mode _(suppress an errors)_ |
| -v, –verbose | Verbose mode show error details unless you weren’t use silent |
| -h, –help | Display its helps |

**Examples**

**Single URL**

```auto
 galer -h

```

**URLs from list**

```auto
 galer -u "http://domain.tld"

```

**from Stdin**

```auto
 galer -u /path/to/urls.txt

```

In case you want to chained with other tools:

```auto
 cat urls.txt | galer

```

You can use **galer** as library.

```auto
 subfinder -d domain.tld -silent | httpx -silent | galer

```

For example:

```auto
 go get github.com/dwisiswant0/galer/pkg/galer

```

**TODOs**

- Enable to set extra HTTP headers
- Provide randomly User-Agent
- Bypass headless browser
- Add exception for specific extensions

**Help & Bugs**

If you are still confused or found a bug, please [open the issue](https://github.com/dwisiswant0/galer/issues). All bug reports are appreciated, some features have not been tested yet due to lack of free time.

**License**

**galer** released under MIT. See `LICENSE` for more details.

**Version**

**Current version is 0.0.2** and still development.

**Pronunciation**

`id_ID` • **/gäˈlər/** — kalau _galer_ jangan dicium baunya, langsung cuci tangan, _bego_!

**Acknowledgement**

- [Omar Espino](https://twitter.com/omespino) for the idea, that’s why this tool was made!

## GitHub:

> **[GitHub - dwisiswant0/galer: A fast tool to fetch URLs from HTML attributes by...](https://github.com/dwisiswant0/galer)**
>
> A fast tool to fetch URLs from HTML attributes by crawl-in.