如何进行crawlergo、rad、burpsuite和awvs爬虫的对比

前言

最近在写代码,涉及了web爬取链接的方面,在百度过程中了解到了这篇文章:superSpider,突然就好奇平时常见的爬虫 工具和扫描器里的爬虫模块能力如何,所以来测试下。

主要测试1个自己手写的瞎眼爬虫,还有crawlergoradburpsuite pro v202012、awvs 2019

一 手写的基准爬虫

只抓取a标签下的href和script标签下的src;

from urllib.parse import urlparse,urljoinfrom bs4 import BeautifulSoupimport requestsimport validatorsfrom queue import Queueimport threadingrequests.packages.urllib3.disable_warnings()class jsfinder():    def __init__(self,url,cookie=""):        self.baseUrl = self.return_entire_url(url)        self.headers = {            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.108 Safari/537.36",            "cookie": cookie}        self.q = Queue()        self.crawed_list = set()        self.urlList = []        self.q.put(url)        self.spider_status = 1    def return_entire_url(self,url):        if url is not None:            if url.startswith('http') or urlparse(url).scheme:                return url.strip()            else:                if self.baseUrl == "":                    self.baseUrl = "http://" + url                    print(self.baseUrl)                return urljoin(self.baseUrl,url.strip())        else:            pass    def spider(self):        while(not self.q.empty() or self.spider_status):            url = self.q.get()            if url in self.crawed_list :                continue            print("requesting:",url)            try:                resp = requests.get(url=url, headers=self.headers, timeout=5, verify=False)                self.htmlParse(resp)                self.crawed_list.add(url)            except:                print("requests error:",url)            if self.spider_status == 1:                time.sleep(5)                self.spider_status = 0            print(self.q.qsize())    def htmlParse(self,response):        tempList = []        blacklist = ['#',None,'javascript:']        soup = BeautifulSoup(response.text.encode('utf-8'), 'html.parser')        for href in soup.find_all('a'):            #print(self.urlParse(href.get('href')))            tempList.append(href.get('href'))        for href in soup.find_all('script'):            #print(self.urlParse(href.get('src')))            tempList.append(href.get('src'))        tempList = list(set(tempList)-set(blacklist))        for i in tempList:            url = self.return_entire_url(i)            if validators.url(url):                print("get:",url)                #print(i,self.return_entire_url(i))                if url not in self.crawed_list :                    self.urlList.append(url)                    if urlparse(url).netloc in self.baseUrl:                        self.q.put(url)if __name__ == "__main__":    A = jsfinder("http://testphp.vulnweb.com")    t = threading.Thread(target=A.spider)    t.start()    t.join()    for i in list(set(A.urlList)):        print(i)

结果:
46个链接,夹杂着很多其他域名的链接,有很多带参数的链接

http://testphp.vulnweb.com/product.php?pic=3http://testphp.vulnweb.com/cart.phphttps://www.acunetix.com/blog/articles/prevent-sql-injection-vulnerabilities-in-php-applications/http://testphp.vulnweb.com/hpp/http://testphp.vulnweb.com/product.php?pic=7http://testphp.vulnweb.com/guestbook.phphttp://testphp.vulnweb.com/listproducts.php?cat=2http://testphp.vulnweb.com/Details/network-attached-storage-dlink/1/http://testphp.vulnweb.com/categories.phphttp://testphp.vulnweb.com/artists.phphttp://www.eclectasy.com/Fractal-Explorer/index.htmlhttp://testphp.vulnweb.com/artists.php?artist=1http://testphp.vulnweb.com/showimage.php?file=./pictures/5.jpghttp://testphp.vulnweb.com/showimage.php?file=./pictures/4.jpghttp://testphp.vulnweb.com/listproducts.php?artist=1http://testphp.vulnweb.com/product.php?pic=1http://testphp.vulnweb.com/showimage.php?file=./pictures/7.jpghttp://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/product.php?pic=5http://testphp.vulnweb.com/listproducts.php?artist=3http://www.acunetix.comhttp://testphp.vulnweb.com/showimage.php?file=./pictures/2.jpghttp://testphp.vulnweb.com/Details/color-printer/3/http://testphp.vulnweb.com/listproducts.php?artist=2http://testphp.vulnweb.com/disclaimer.phphttp://testphp.vulnweb.com/login.phphttp://testphp.vulnweb.com/listproducts.php?cat=1http://testphp.vulnweb.com/artists.php?artist=2http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpghttp://testphp.vulnweb.com/Details/web-camera-a4tech/2/https://www.acunetix.com/vulnerability-scanner/php-security-scanner/http://testphp.vulnweb.com/listproducts.php?cat=4http://testphp.vulnweb.com/privacy.phphttp://testphp.vulnweb.com/AJAX/index.phphttp://testphp.vulnweb.com/listproducts.php?cat=3https://www.acunetix.com/vulnerability-scanner/http://testphp.vulnweb.com/signup.phphttp://testphp.vulnweb.com/product.php?pic=2http://testphp.vulnweb.com/showimage.php?file=./pictures/3.jpghttps://www.acunetix.com/http://testphp.vulnweb.com/index.phphttp://testphp.vulnweb.com?pp=12http://testphp.vulnweb.com/Mod_Rewrite_Shop/http://testphp.vulnweb.com/artists.php?artist=3http://blog.mindedsecurity.com/2009/05/client-side-http-parameter-pollution.htmlhttp://testphp.vulnweb.com/product.php?pic=4

二 crawlergo爬取

在官方示例代码上加了几行

#!/usr/bin/python3# coding: utf-8import simplejsonimport subprocessdef main():    target = "http://testphp.vulnweb.com/"    cmd = ["/home/loser/MySimpleScanner-master-v2/tools/crawlergo", "-c", "/usr/bin/google-chrome", "-o", "json", target]    rsp = subprocess.Popen(cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)    output, error = rsp.communicate()	#  "--[Mission Complete]--"  是任务结束的分隔字符串    result = simplejson.loads(output.decode().split("--[Mission Complete]--")[1])    req_list = result["req_list"]    for req in req_list:        print(req)    #print(req_list[0])if __name__ == '__main__':    main()

结果:
48条

{'url': 'http://testphp.vulnweb.com/', 'method': 'GET', 'headers': {'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Target'}{'url': 'https://testphp.vulnweb.com/', 'method': 'GET', 'headers': {'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Target'}{'url': 'http://testphp.vulnweb.com/artists.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/index.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/categories.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/disclaimer.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/guestbook.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/AJAX/index.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/cart.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/login.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/privacy.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/hpp/', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/Mod_Rewrite_Shop/', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'searchFor=Crawlergo', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'searchFor=Crawlergo&goButton=go', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/signup.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uname=crawlergo%40gmail.com&pass=Crawlergo6.', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/categories.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/artists.php?artist=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/comment.php?aid=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'OpenWindow'}{'url': 'http://testphp.vulnweb.com/AJAX/artists.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/AJAX/categories.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/AJAX/titles.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/AJAX/showxml.php', 'method': 'POST', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36', 'content-type': 'text/xml'}, 'data': '<xml><node name="nodename1">nodetext1</node><node name="nodename2">nodetext2</node></xml>', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/hpp/?pp=12', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/hpp/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/listproducts.php?artist=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php?artist=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/signup.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uuname=carwalwelregrogo%40gmail.com&upass=Crawlergo6.&upass2=Crawlergo6.&urname=crawlergo%40gmail.com&ucc=Crawlergo&uemail=crawlergo%40gmail.com&uphone=18812345678&uaddress=Cr', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/signup.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uuname=carwalwelregrogo%40gmail.com&upass=Crawlergo6.&upass2=Crawlergo6.&urname=crawlergo%40gmail.com&ucc=Crawlergo&uemail=crawlergo%40gmail.com&uphone=18812345678&uaddress=Cr&signup=signup', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160', 'method': 'GET', 'headers': {'Accept': 'image/avif,image/webp,image/apng,image/*,*/*;q=0.8', 'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/product.php?pic=2', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/comment.php?pid=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'OpenWindow'}{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uname=crawlergo%40gmail.com&pass=Crawlergo6.', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&Submit=Submit&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}{'url': 'http://testphp.vulnweb.com/hpp/params.php?', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/hpp/params.php?aaaa%2F=Submit', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/AJAX/showxml.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/cart.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/product.php?pic=2', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'price=800&addcart=2', 'source': 'XHR'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&Submit=Submit&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'Navigation'}{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}

清洗后:

http://testphp.vulnweb.com/https://testphp.vulnweb.com/http://testphp.vulnweb.com/artists.phphttp://testphp.vulnweb.com/index.phphttp://testphp.vulnweb.com/categories.phphttp://testphp.vulnweb.com/disclaimer.phphttp://testphp.vulnweb.com/guestbook.phphttp://testphp.vulnweb.com/AJAX/index.phphttp://testphp.vulnweb.com/cart.phphttp://testphp.vulnweb.com/login.phphttp://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/privacy.phphttp://testphp.vulnweb.com/hpp/http://testphp.vulnweb.com/Mod_Rewrite_Shop/http://testphp.vulnweb.com/search.php?test=queryhttp://testphp.vulnweb.com/search.php?test=queryhttp://testphp.vulnweb.com/signup.phphttp://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/listproducts.php?cat=1http://testphp.vulnweb.com/artists.php?artist=1http://testphp.vulnweb.com/comment.php?aid=1http://testphp.vulnweb.com/AJAX/artists.phphttp://testphp.vulnweb.com/AJAX/categories.phphttp://testphp.vulnweb.com/AJAX/titles.phphttp://testphp.vulnweb.com/AJAX/showxml.phphttp://testphp.vulnweb.com/hpp/?pp=12http://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/search.php?test=queryhttp://testphp.vulnweb.com/listproducts.php?artist=1http://testphp.vulnweb.com/secured/newuser.phphttp://testphp.vulnweb.com/secured/newuser.phphttp://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160http://testphp.vulnweb.com/product.php?pic=2http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpghttp://testphp.vulnweb.com/comment.php?pid=1http://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12http://testphp.vulnweb.com/hpp/params.php?http://testphp.vulnweb.com/hpp/params.php?aaaa%2F=Submithttp://testphp.vulnweb.com/AJAX/showxml.phphttp://testphp.vulnweb.com/secured/newuser.phphttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/cart.phphttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/comment.php

3 rad 爬取

./rad_linux_amd64 --target http://testphp.vulnweb.com --text-output rad.log
结果:42条 , 由于存在get和post的区别,清洗后去重为39条

GET http://testphp.vulnweb.com/GET http://testphp.vulnweb.com/index.phpGET http://testphp.vulnweb.com/artists.phpGET http://testphp.vulnweb.com/cart.phpGET http://testphp.vulnweb.com/guestbook.phpGET http://testphp.vulnweb.com/AJAX/index.phpGET http://testphp.vulnweb.com/images/GET http://testphp.vulnweb.com/login.phpPOST http://testphp.vulnweb.com/search.php?test=queryGET http://testphp.vulnweb.com/categories.phpGET http://testphp.vulnweb.com/disclaimer.phpGET http://testphp.vulnweb.com/userinfo.phpPOST http://testphp.vulnweb.com/guestbook.phpPOST http://testphp.vulnweb.com/userinfo.phpGET http://testphp.vulnweb.com/Flash/GET http://testphp.vulnweb.com/AJAX/artists.phpGET http://testphp.vulnweb.com/privacy.phpGET http://testphp.vulnweb.com/AJAX/infoartist.php?id=1GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/GET http://testphp.vulnweb.com/hpp/GET http://testphp.vulnweb.com/artists.php?artist=1GET http://testphp.vulnweb.com/comment.php?aid=1GET http://testphp.vulnweb.com/signup.phpGET http://testphp.vulnweb.com/listproducts.php?cat=1GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/images/GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/GET http://testphp.vulnweb.com/hpp/?pp=12POST http://testphp.vulnweb.com/comment.phpPOST http://testphp.vulnweb.com/secured/newuser.phpGET http://testphp.vulnweb.com/product.php?pic=1GET http://testphp.vulnweb.com/listproducts.php?artist=1GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-1.htmlGET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/GET http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpgGET http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-1/POST http://testphp.vulnweb.com/cart.phpGET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-2/GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-2.htmlGET http://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/

4 burpsuite v202012

爬取较耗费时间,截图的时候是49个,但是随着时间增加数量还在上升,在后面回看的时候数量已经一百多了

如何进行crawlergo、rad、burpsuite和awvs爬虫的对比

http://testphp.vulnweb.com	GET	/	burp.f5s@306052ce	200	5175	HTML	Home of Acunetix Art		1611359458449http://testphp.vulnweb.com	GET	/AJAX/	burp.f5s@cd68998	200	4453	HTML	ajax test		1611359674072http://testphp.vulnweb.com	GET	/AJAX/index.php	burp.f5s@126828be	200	4453	HTML	ajax test		1611359674872http://testphp.vulnweb.com	GET	/Flash/	burp.f5s@510aed85	200	514	HTML	Index of /Flash/		1611359682400http://testphp.vulnweb.com	GET	/Flash/add.fla	burp.f5s@63ce2348	200	154877	HTML			1611359714830http://testphp.vulnweb.com	GET	/Flash/add.swf	burp.f5s@5becece0	200	17674	flash			1611359684049http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/	burp.f5s@81212fb	200	1191	HTML			1611359686649http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-1/	burp.f5s@ef2a0b9	200	316	HTML			1611359784523http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/	burp.f5s@1cb4164c	200	291	HTML			1611359788669http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/2.php	burp.f5s@200362d6	200	386	script			1611360605080http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/3.php	burp.f5s@389e39e7	200	386	script			1611360605176http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/BuyProduct-3/	burp.f5s@23f2b125	200	291	HTML			1611360609454http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/cart/	burp.f5s@1fc8c561	200	291	HTML			1611360609615http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/	burp.f5s@2466019c	200	291	HTML			1611360609749http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/Mod_Rewrite_Shop	burp.f5s@6d7e45f6	200	386	script			1611360666497http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/index	burp.f5s@5bb3bae5	200	386	script			1611360665770http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/logo	burp.f5s@2099f3f	200	386	script			1611360665634http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/cgi-bin/	burp.f5s@16f71403	200	291	HTML			1611360609615http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/	burp.f5s@9b9a2de	200	308	HTML			1611359793221http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/RateProduct-1.asp	burp.f5s@4f1b459e	200	386	script			1611360727449http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/params.php	burp.f5s@1a5db25	200	386	script			1611360725439http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/privacy.aspx	burp.f5s@2fdc801e	200	386	script			1611360725841http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/product.asp	burp.f5s@6b377869	200	386	script			1611360727028http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/	burp.f5s@7e95f724	200	529	HTML			1611359733180http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/1/	burp.f5s@51c66720	200	535	HTML			1611360417812http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/2/	burp.f5s@1ad1d176	200	495	HTML			1611360417956http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/	burp.f5s@4af51675	200	535	HTML			1611359721331http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/Details.php	burp.f5s@1b88f4d8	200	386	script			1611360185772http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/Flash.html	burp.f5s@79957fee	200	386	script			1611360185898http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/disclaimer.html	burp.f5s@6d5b4bcb	200	386	script			1611360185841http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/favicon.html	burp.f5s@f7faeab	200	386	script			1611360185721http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/	burp.f5s@538da5a8	200	495	HTML			1611359725032http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/Mod_Rewrite_Shop/	burp.f5s@135ca38	200	386	script			1611360306031http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/	burp.f5s@3607ccc6	200	386	script			1611360304942http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-1.htm	burp.f5s@447f265b	200	386	script			1611360785562http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-2.htm	burp.f5s@7ae17b99	200	386	script			1611360786103http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-3.htm	burp.f5s@55aa0af7	200	386	script			1611360784930http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/artists.php	burp.f5s@5d438d78	200	386	script			1611360785810http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/network-attached-storage-dlink/	burp.f5s@60333575	200	386	script			1611360306304http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/RateProduct-1.html	burp.f5s@11ffb759	200	316	HTML			1611359785570http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/RateProduct-3.html	burp.f5s@1487ea23	200	308	HTML			1611359795219http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/images/	burp.f5s@55ee8d86	200	656	HTML	Index of /Mod_Rewrite_Shop/images/		1611359714160http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/index.php	burp.f5s@2c8f82d3	200	1191	HTML			1611360008044http://testphp.vulnweb.com	GET	/admin/	burp.f5s@40a6ad64	200	405	HTML	Index of /admin/		1611359695435http://testphp.vulnweb.com	GET	/admin/create.sql	burp.f5s@6b5b91a1	200	771	script			1611359768567http://testphp.vulnweb.com	GET	/categories.php	burp.f5s@4af8b3f1	200	6332	HTML	picture categories		1611359533220http://testphp.vulnweb.com	GET	/hpp/	burp.f5s@1ab12967	200	419	HTML	HTTP Parameter Pollution Example		1611359684548http://testphp.vulnweb.com	GET	/hpp/params.php	burp.f5s@6f896ad8	200	214				1611359777049http://testphp.vulnweb.com	GET	/images/	burp.f5s@58683811	200	520	HTML	Index of /images/		1611359667907http://testphp.vulnweb.com	GET	/secured/	burp.f5s@57007fd6	200	214				1611359774940http://testphp.vulnweb.com	GET	/secured/newuser.php	burp.f5s@44698e40	200	631	HTML	add new user		1611359776066http://testphp.vulnweb.com	GET	/AJAX	burp.f5s@6012f3bf	301	371	HTML	301 Moved Permanently		1611359538410http://testphp.vulnweb.com	GET	/Flash	burp.f5s@7923f71c	301	372	HTML	301 Moved Permanently		1611359540411http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop	burp.f5s@2d09c921	301	383	HTML	301 Moved Permanently		1611359667359http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/images	burp.f5s@251a494e	301	390	HTML	301 Moved Permanently		1611359707781http://testphp.vulnweb.com	GET	/admin	burp.f5s@52e2d959	301	372	HTML	301 Moved Permanently		1611359667311http://testphp.vulnweb.com	GET	/hpp	burp.f5s@341f4f0e	301	370	HTML	301 Moved Permanently		1611359538318http://testphp.vulnweb.com	GET	/images	burp.f5s@57bcd86d	301	373	HTML	301 Moved Permanently		1611359667272http://testphp.vulnweb.com	GET	/artists.php	burp.f5s@209bbbed	0	0				0http://testphp.vulnweb.com	GET	/cart.php	burp.f5s@647786b6	0	0				0http://testphp.vulnweb.com	GET	/disclaimer.php	burp.f5s@2a5ec209	0	0				0http://testphp.vulnweb.com	GET	/guestbook.php	burp.f5s@1b90189f	0	0				0http://testphp.vulnweb.com	GET	/index.php	burp.f5s@66298cd3	0	0				0http://testphp.vulnweb.com	GET	/login.php	burp.f5s@3e33e496	0	0				0http://testphp.vulnweb.com	GET	/privacy.php	burp.f5s@622137d3	0	0				0http://testphp.vulnweb.com	GET	/userinfo.php	burp.f5s@79ee9fe8	0	0				0

五 awvs

扫描相对burp很快,不知道是不是自家网站缘故,扫描结果数量405,但是很多都是Mod_Rewrite模块下的

http://testphp.vulnweb.com/http://testphp.vulnweb.com/.idea/http://testphp.vulnweb.com/.idea/.namehttp://testphp.vulnweb.com/.idea/acuart.imlhttp://testphp.vulnweb.com/.idea/encodings.xmlhttp://testphp.vulnweb.com/.idea/misc.xmlhttp://testphp.vulnweb.com/.idea/modules.xmlhttp://testphp.vulnweb.com/.idea/scopes/http://testphp.vulnweb.com/.idea/scopes/scope_settings.xmlhttp://testphp.vulnweb.com/.idea/vcs.xmlhttp://testphp.vulnweb.com/.idea/workspace.xmlhttp://testphp.vulnweb.com/404.phphttp://testphp.vulnweb.com/AJAX/http://testphp.vulnweb.com/AJAX/artists.phphttp://testphp.vulnweb.com/AJAX/categories.phphttp://testphp.vulnweb.com/AJAX/htaccess.confhttp://testphp.vulnweb.com/AJAX/index.phphttp://testphp.vulnweb.com/AJAX/infoartist.phphttp://testphp.vulnweb.com/AJAX/infocateg.phphttp://testphp.vulnweb.com/AJAX/infotitle.phphttp://testphp.vulnweb.com/AJAX/showxml.phphttp://testphp.vulnweb.com/AJAX/styles.csshttp://testphp.vulnweb.com/AJAX/titles.phphttp://testphp.vulnweb.com/CVS/http://testphp.vulnweb.com/CVS/Entrieshttp://testphp.vulnweb.com/CVS/Entries.Loghttp://testphp.vulnweb.com/CVS/Repositoryhttp://testphp.vulnweb.com/CVS/Roothttp://testphp.vulnweb.com/Connections/http://testphp.vulnweb.com/Connections/DB_Connection.phphttp://testphp.vulnweb.com/Flash/http://testphp.vulnweb.com/Flash/add.flahttp://testphp.vulnweb.com/Flash/add.swfhttp://testphp.vulnweb.com/Mod_Rewrite_Shop/http://testphp.vulnweb.com/Mod_Rewrite_Shop/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/details.php3/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/.htaccesshttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/rate.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-3.htmlhttp://testphp.vulnweb.com/Mod_Rewrite_Shop/buy.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/details.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/images/http://testphp.vulnweb.com/Mod_Rewrite_Shop/index.phphttp://testphp.vulnweb.com/Mod_Rewrite_Shop/rate.phphttp://testphp.vulnweb.com/Templates/http://testphp.vulnweb.com/Templates/main_dynamic_template.dwt.phphttp://testphp.vulnweb.com/_mmServerScripts/http://testphp.vulnweb.com/_mmServerScripts/MMHTTPDB.phphttp://testphp.vulnweb.com/_mmServerScripts/mysql.phphttp://testphp.vulnweb.com/adm1nPan3l/http://testphp.vulnweb.com/adm1nPan3l/index.phphttp://testphp.vulnweb.com/admin/http://testphp.vulnweb.com/admin/create.sqlhttp://testphp.vulnweb.com/artists.phphttp://testphp.vulnweb.com/bxss/http://testphp.vulnweb.com/bxss/adminPan3l/http://testphp.vulnweb.com/bxss/adminPan3l/index.phphttp://testphp.vulnweb.com/bxss/adminPan3l/style.csshttp://testphp.vulnweb.com/bxss/cleanDatabase.phphttp://testphp.vulnweb.com/bxss/database_connect.phphttp://testphp.vulnweb.com/bxss/index.phphttp://testphp.vulnweb.com/bxss/test.jshttp://testphp.vulnweb.com/bxss/vuln.phphttp://testphp.vulnweb.com/cart.phphttp://testphp.vulnweb.com/categories.phphttp://testphp.vulnweb.com/clearguestbook.phphttp://testphp.vulnweb.com/clientaccesspolicy.xmlhttp://testphp.vulnweb.com/comment.phphttp://testphp.vulnweb.com/crossdomain.xmlhttp://testphp.vulnweb.com/database_connect.phphttp://testphp.vulnweb.com/disclaimer.phphttp://testphp.vulnweb.com/guestbook.phphttp://testphp.vulnweb.com/hpp/http://testphp.vulnweb.com/hpp/index.phphttp://testphp.vulnweb.com/hpp/params.phphttp://testphp.vulnweb.com/hpp/test.phphttp://testphp.vulnweb.com/images/http://testphp.vulnweb.com/index.bakhttp://testphp.vulnweb.com/index.phphttp://testphp.vulnweb.com/listproducts.phphttp://testphp.vulnweb.com/login.phphttp://testphp.vulnweb.com/logout.phphttp://testphp.vulnweb.com/medias/http://testphp.vulnweb.com/medias/css/http://testphp.vulnweb.com/medias/css/main.csshttp://testphp.vulnweb.com/medias/img/http://testphp.vulnweb.com/medias/js/http://testphp.vulnweb.com/medias/js/common_functions.jshttp://testphp.vulnweb.com/pictures/http://testphp.vulnweb.com/pictures/1.jpg.tnhttp://testphp.vulnweb.com/pictures/2.jpg.tnhttp://testphp.vulnweb.com/pictures/3.jpg.tnhttp://testphp.vulnweb.com/pictures/4.jpg.tnhttp://testphp.vulnweb.com/pictures/5.jpg.tnhttp://testphp.vulnweb.com/pictures/6.jpg.tnhttp://testphp.vulnweb.com/pictures/7.jpg.tnhttp://testphp.vulnweb.com/pictures/8.jpg.tnhttp://testphp.vulnweb.com/pictures/WS_FTP.LOGhttp://testphp.vulnweb.com/pictures/credentials.txthttp://testphp.vulnweb.com/pictures/ipaddresses.txthttp://testphp.vulnweb.com/pictures/path-disclosure-unix.htmlhttp://testphp.vulnweb.com/pictures/path-disclosure-win.htmlhttp://testphp.vulnweb.com/pictures/wp-config.bakhttp://testphp.vulnweb.com/privacy.phphttp://testphp.vulnweb.com/product.phphttp://testphp.vulnweb.com/redir.phphttp://testphp.vulnweb.com/search.phphttp://testphp.vulnweb.com/secured/http://testphp.vulnweb.com/secured/database_connect.phphttp://testphp.vulnweb.com/secured/index.phphttp://testphp.vulnweb.com/secured/newuser.phphttp://testphp.vulnweb.com/secured/office.htmhttp://testphp.vulnweb.com/secured/office_files/http://testphp.vulnweb.com/secured/office_files/filelist.xmlhttp://testphp.vulnweb.com/secured/phpinfo.phphttp://testphp.vulnweb.com/secured/style.csshttp://testphp.vulnweb.com/sendcommand.phphttp://testphp.vulnweb.com/showimage.phphttp://testphp.vulnweb.com/signup.phphttp://testphp.vulnweb.com/style.csshttp://testphp.vulnweb.com/userinfo.phphttp://testphp.vulnweb.com/wvstests/http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/scripts/http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/scripts/version.php

六 比较

由上所有数据可以看出,awvs和burpsuite爬取的数据量是属于非常多的一层的,crawlergo和rad和我手写的爬虫好像是一层。。仅数据量来说。。

再看下数据质量,这里我主要看手写的爬虫(下面称为基准),和rad 、crawlergo

首先,我们先把基准数据和rad的数据比较
先取交集,
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比

存在17个交集数据,各自减去交集后的数据,排序,对比
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比

细心查看的话会发现中间那栏基准数据基本path基本都能在左边交集栏查看到,而右侧rad栏黄色部分基本都是左侧即基准数据里没有的。本人查看了前面的burpsuite和awvs报告,他们多出的部分基本都是http://testphp.vulnweb.com/Mod_Rewrite_Shop/目录下的,这边基准爬虫和rad里都存在了这个目录。

再看下基准与crawlergo比较
存在18个交集
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比
依然是右侧有的左边基本都没有,但是左右那几个details目录右侧也没有发现

看下crawlergo与rad的比较
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比
惊人的相似-_- ,

七 简单的总结

几款工具都扫描出了手写代码里没扫除的目录、路径,其实力都是蛮强的。

其中,crawlergo和rad扫描的数量和质量类似,burpsuite和awvs的扫描结果类似,都是数量非常多,但是burpsuite的扫描速度个人感觉有点慢

当然,数量多少的问题是由于burosuite和awvs存在系列安全扫描及其他用途的缘由,对于纯粹只为获取url的话还是得靠crawlergo和rad方便些。

crawlergo和rad的区别存在crawlergo返回的数据中包含了所有headers,包括其自动填充的表单数据,rad返回的只有请求方法+url,如Get http://xxx

最后自己做了一张表,仅代表自己观点,也不一定准确
如何进行crawlergo、rad、burpsuite和awvs爬虫的对比

看完上述内容是否对您有帮助呢?如果还想对相关知识有进一步的了解或阅读更多相关文章,请关注亿速云行业资讯频道,感谢您对亿速云的支持。

文章标题:如何进行crawlergo、rad、burpsuite和awvs爬虫的对比,发布者:亿速云,转载请注明出处:https://worktile.com/kb/p/29858

(1)
打赏 微信扫一扫 微信扫一扫 支付宝扫一扫 支付宝扫一扫
亿速云的头像亿速云认证作者
上一篇 2022年9月26日 上午1:50
下一篇 2022年9月26日 上午1:52

相关推荐

  • windows xbox商店常见问题怎么解决

    xbox商店常见问题解决方法: 1、Xbox商店其实就是微软win10商店(Microsoft Store)。 2、我们可以直接在菜单中打开Microsoft Store,进行游戏的查看等。 3、我们也可以直接在搜索栏中搜索Xbox,然后打开“Xbox 控制台小帮手” 4、我们能够在侧栏目中点击“商…

    2022年9月22日
    47900
  • MySQL中一条SQL是怎么执行的

    大体来说,MySQL 可以分为 Server 层和存储引擎层两部分。 Server层 主要包括连接器、查询缓存、分析器、优化器、执行器等,涵盖 MySQL 的大多数核心服务功能,以及所有的内置函数 (如日期、时间、数学和加密函数等),所有跨存储引擎的功能都在这一层实现,比如存储过程、触发器、视图等。…

    2022年9月18日
    64700
  • Apache Shiro 1.2.4反序列化漏洞实例分析

    0x00 Apache Shiro 这个组件的漏洞很久之前就爆出来了,但是最近工作中又遇到了,刚好最近也在看Java反序列化的东西,所以决定拿出来再分析一下,期间也遇到了一些奇怪的问题。 网上的分析文章中大部分都是手动添加了commons-collections4-4.0的依赖,目的是为了使用yso…

    2022年9月16日
    45800
  • cad文件的后缀有哪些

    cad文件的后缀:1、“.Dwg”,Dwg格式是cad文件的标准文件格式;2、“.dxf”,dxf格式是一种绘图交换文件,是进行CAD数据交换的CAD数据文件格式;3、“.dws”,dws格式的cad文档只能查看不能修改;4、“.dwt”,dwt是CAD的模板文件。 本教程操作环境:windows1…

    2022年9月8日
    1.4K00
  • 电脑0x000007b蓝屏如何修复

    启动无限蓝屏0x000007b修复方法: 方法一: 1、先强制重启电脑,等待开机画面出现后按下快捷键“F12”进入bios系统中。 2、进入bios启动项设置界面,用方向键将光标移动到“advanced”。 3、然后再次选择“SATA Configuration”并按下回车键进行确认。 4、之后会出…

    2022年9月16日
    68100
  • 如何进行授权的APK渗透测试

    作为一个渗透测试小白,本文的目的是希望能为那些和我一样的小白提供一些测试思路。涉及的内容可能比较基础,表哥们见谅。APK 解包拿到 apk 之后直接用 7-Zip 解压可以得到几个文件夹、一个 AndroidManifest.xml 文件、一个dex文件。使用 dex2jar https://sou…

    2022年9月18日
    45800
  • vue项目打包后怎么部署到服务器

    一 ,打包项目 1 , vscode打开你的vue项目 — > 点终端- > 新终端- >输入npm run build 按回车 , 显示正在打包..稍等一会 2 , 打包成功 , 生成了dist文件夹, 打包好的文件存放在里面 二 , 用一个工具, 把打包好的文件上传…

    2022年9月20日
    1.9K00
  • windows ecshop模板如何修改

    ecshop模板修改方法: 1、首先我们下载一个模板,将他放入软件目录下的“themes”文件夹。 2、接着打开ecshop,点击“模板管理”下的“模板选择” 3、然后点击下方你要更换的模板。(建议备份当前模板) 4、网站会弹出提示,如图所示,点击“确定” 5、修改完成后去到网站,就可以发现模板已经…

    2022年9月22日
    37300
  • MySQL的基础架构和日志系统实例分析

    一、MySQL基础架构 MySQL可以分为Server层和存储引擎层两部分 Server层包括连接器、查询缓存、分析器、优化器、执行器等,涵盖MySQL的大多数核心服务功能,以及所有的内置函数(如日期、时间、数学和加密函数等),所有跨存储引擎的功能都在这一层实现,比如存储过程、触发器、视图等 存储引…

    2022年9月16日
    62400
  • mysql的2002错误怎么解决

    在mysql中,2022错误指的是编译的时候没有指定socket,所以mysql命令连接的时候还是使用的默认值,因为socket位置变了,而mysql命令不知道,所以就出现了这样的错误,可以修改“/etc/my.cnf”文件来解决该错误。 本教程操作环境:windows10系统、mysql8.0.2…

    2022年9月1日
    1.0K00
站长微信
站长微信
电话联系

400-800-1024

工作日9:30-21:00在线

分享本页
返回顶部