欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  后端开发

求助,关于php采集url地址

程序员文章站 2022-05-11 12:42:12
...
我想在如下网页采集所有的帖子url地址
http://www.discuz.net/forum-10-1.html


帖子格式为
http://www.discuz.net/thread-3265731-1-1.html


只要url链接,得出的结果一行一个

回复讨论(解决方案)

$url = 'http://www.discuz.net/forum-10-1.html';$ch = curl_init();curl_setopt($ch, CURLOPT_URL,$url);curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);curl_setopt($ch, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (.NET CLR 3.5.30729)');$htmls = curl_exec($ch);curl_close($ch);$doc = new DOMDocument();libxml_use_internal_errors(true);$doc->loadHTML($htmls);$xpath = new DOMXPath($doc);$nodeList = $xpath->query('//a/@href');for ($i = 0; $i length; $i++) {	if(preg_match('@\/thread\-@',$nodeList->item($i)->value,$match)){		echo $nodeList->item($i)->value. "
"; }}