欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  IT编程

Crawler利用python尝试获取cn-proxy代理的IP地址(Jason niu)

程序员文章站 2022-05-30 19:50:53
Crawler利用python尝试获取cn-proxy代理的IP地址(Jason niu) import urllib.request import re import...

Crawler利用python尝试获取cn-proxy代理的IP地址(Jason niu)

import urllib.request
import re 
import os

print(os.getcwd())

def open_url(url):
    req=urllib.request.Request(url) 
    req.add_header("User-Agent", "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.90 Safari/537.36 2345Explorer/9.2.1.17116")
    page=urllib.request.urlopen(req)
    html=page.read().decode("utf-8")
    
    return html

def get_img(html):
    p=r'(?:(?:[0,1])?\d?\d|2[0-4]\d|25[0-5]\.){3}(?:[0,1]?\d?\d|2[0-4]\d|25[0-5]))' 
    iplist=re.findall(p,html)
    
    for each in iplist: 
        print(each)
        
    
if __name__=="__mian__":
    url="https://cn-proxy.com"  
    get_img(open_url(url))   
    
url="https://cn-proxy.com"     
get_img(open_url(url))