asp代理采集的核心函数代码
程序员文章站
2022-07-01 23:37:15
function proxypage(url) set retrieval = createobject("msxml2.serverxmlhttp.5.0") with...
function proxypage(url)
set retrieval = createobject("msxml2.serverxmlhttp.5.0")
with retrieval
.setproxy 2 , "255.0.0.0:80" '代理ip:代理端口
.open "get", url, false, "", ""
.setrequestheader "referer","http://www.baidu.com/" '伪造referer
.send
proxypage = bytestobstr(.responsebody)
end with
set retrieval = nothing
end function
附bytestobstr过程,你采集的时候可以定义网页是utf-8还是gb2312,utf="true"为 utf-8
function bytestobstr(body)
dim objstream
set objstream = server.createobject("ad"&""&"odb.st"&""&"ream")
objstream.type = 1
objstream.mode =3
objstream.open
objstream.write body
objstream.position = 0
objstream.type = 2
if utf="true" then
objstream.charset = "utf-8"
else
objstream.charset = "gb2312"
end if
bytestobstr = objstream.readtext
objstream.close
set objstream = nothing
end function
代码解释:
如果你系统是win 2003 只能使用以下代码
createobject("msxml2.serverxmlhttp.4.0")
若为xp
createobject("msxml2.serverxmlhttp.5.0")
伪造referer用处很一般,不过对于一些站还是有用的,所以代码我加上了,可以注释掉,
注意:
如果你不会写asp采集,那么代码你可能不懂,那就不是我这次发帖所讨论了,希望对大家有用。
set retrieval = createobject("msxml2.serverxmlhttp.5.0")
with retrieval
.setproxy 2 , "255.0.0.0:80" '代理ip:代理端口
.open "get", url, false, "", ""
.setrequestheader "referer","http://www.baidu.com/" '伪造referer
.send
proxypage = bytestobstr(.responsebody)
end with
set retrieval = nothing
end function
附bytestobstr过程,你采集的时候可以定义网页是utf-8还是gb2312,utf="true"为 utf-8
function bytestobstr(body)
dim objstream
set objstream = server.createobject("ad"&""&"odb.st"&""&"ream")
objstream.type = 1
objstream.mode =3
objstream.open
objstream.write body
objstream.position = 0
objstream.type = 2
if utf="true" then
objstream.charset = "utf-8"
else
objstream.charset = "gb2312"
end if
bytestobstr = objstream.readtext
objstream.close
set objstream = nothing
end function
代码解释:
如果你系统是win 2003 只能使用以下代码
createobject("msxml2.serverxmlhttp.4.0")
若为xp
createobject("msxml2.serverxmlhttp.5.0")
伪造referer用处很一般,不过对于一些站还是有用的,所以代码我加上了,可以注释掉,
注意:
如果你不会写asp采集,那么代码你可能不懂,那就不是我这次发帖所讨论了,希望对大家有用。