Rapid7 Vulnerability & Exploit Database

Metasploit Web Crawler

Back to Search

Metasploit Web Crawler



This auxiliary module is a modular web crawler, to be used in conjunction with wmap (someday) or standalone.


  • et <et@metasploit.com>


Module Options

To display the available options, load the module within the Metasploit console and run the commands 'show options' or 'show advanced':

msf > use auxiliary/crawler/msfcrawler
msf auxiliary(msfcrawler) > show actions
msf auxiliary(msfcrawler) > set ACTION < action-name >
msf auxiliary(msfcrawler) > show options
    ...show and set options...
msf auxiliary(msfcrawler) > run 

Time is precious, so I don’t want to do something manually that I can automate. Leveraging the Metasploit Framework when automating any task keeps us from having to re-create the wheel as we can use the existing libraries and focus our efforts where it matters.

– Jim O’Gorman | President, Offensive Security