ÈçºÎÕÒµ½ºìÌÒ¹Ù·½Òþ²ØÈë¿Ú¼°»á¼û¼¼ÇÉ

À´Ô´£ºÖ¤È¯Ê±±¨Íø×÷Õߣº
×ÖºÅ

»ñÈ¡ÓÎÏ·½Ì³ÌºÍ¹¥ÂÔ

ÔÚÓÎÏ·³õÆÚ £¬¿ÉÒÔͨ¹ýһЩ½Ì³ÌºÍ¹¥ÂÔÀ´ÊìϤÓÎÏ·¹æÔòºÍ²Ù×÷ÒªÁì¡£Õâ²»µ«ÄÜÈÃÄã¸ü¿ìµØÉÏÊÖÓÎÏ· £¬»¹ÄÜÌá¸ßÄãÔÚÓÎÏ·ÖеÄÌåÏÖ¡£

ͨ¹ýÒÔÉÏÕâЩҪÁì £¬Äã²»µ«ÄÜÕÒµ½ºìÌÒÆ½Ì¨µÄÒþ²ØÈë¿Ú £¬»¹ÄÜͨ¹ýһЩʵÓõĻá¼û¼¼ÇɸßЧµØ»á¼û²¢ÏíÊܺìÌÒÆ½Ì¨Éϵĸ»ºñÓÎÏ·ÄÚÈÝ¡£ÎÞÂÛÄãÊÇÐÂÊÖÕÕ¾É×ÊÉîÍæ¼Ò £¬ÕâЩ¼¼Çɶ¼ÄÜ×ÊÖúÄã¸üºÃµØ?ÌåÑéÕâ¸öÔÚÏßÓéÀÖÆ½Ì¨¡£

uppeteer

PuppeteerÊÇÒ»¸öÓÃÓÚ¿ØÖÆChrome»òChromiumµÄNode.js¿â £¬Äã¿ÉÒÔÓÃËüÀ´Ä£Äâä¯ÀÀÆ÷ÐÐΪ¡£

constpuppeteer=require('puppeteer');(async()=>{constbrowser=awaitpuppeteer.launch();constpage=awaitbrowser.newPage();awaitpage.goto('http://www.hongtao.com');awaitpage.screenshot({path:'example.png'});consttitle=awaitpage.title();console.log(title);awaitbrowser.close();})();

crapy

ScrapyÊÇÒ»¸öÓÃÓÚÍøÒ³×¥È¡µÄ¿ò¼Ü £¬ºÜÊÇÊʺϽøÐдó¹æÄ£µÄ?Êý¾Ýץȡ¡£

importscrapyclassHongTaoSpider(scrapy.Spider):name='hongtao'start_urls='http://www.hongtao.com'defparse(self,response):yield{'title':response.xpath('//title/text()').get(),'content':response.xpath('//body//text()').getall()}

ʹÓÃBeautifulSoup¿â

BeautifulSoup¿â¿ÉÒÔ×ÊÖúÄã½âÎöHTMLºÍXMLÎĵµ £¬ÌáÈ¡ÄãÐèÒªµÄÐÅÏ¢¡£

frombs4importBeautifulSoupimportrequestsurl='http://www.hongtao.com'response=requests.get(url)soup=BeautifulSoup(response.text,'html.parser')print(soup.title.string)

×ܽá

ÔÚºìÌÒÆ½Ì¨ÉÏ £¬ÕÒµ½Òþ²ØÈë¿ÚºÍÕÆÎÕ¸ßЧµÄ»á¼û¼¼ÇÉ £¬¿ÉÒÔÈÃÄãµÄÓÎÏ·ÌåÑéÔ½·¢Ë³³©ºÍÓä¿ì¡£ÎÞÂÛÄãÊÇͨ¹ýÉ罻ýÌå¡¢ÅóÓÑÍÆ¼öÕվɹٷ½Í¨Öª·¢Ã÷Òþ²ØÈë¿Ú £¬¶¼ÐèÒª¼á³Ö¾¯Ìè £¬È·±£ÐÅÏ¢µÄÕæÊµÐÔºÍÄþ¾²ÐÔ¡£Í¨¹ýÓÅ»¯ÍøÂçÁ¬½Ó¡¢Ñ¡ÔñºÏÊʵÄÉ豸¡¢ÀûÓÃÓÎÏ·ÄÚµÄÉèÖúͿͷþϵͳµÈÒªÁì £¬Äã¿ÉÒÔ¸üºÃµØÏíÊܺìÌÒÆ½Ì¨Éϵĸ»ºñÓÎÏ·ÄÚÈÝ¡£

¼ÇµÃºÏÀí°²ÅÅÓÎϷʱ¼ä £¬±£»¤¸öÈËÒþ˽ºÍÕË»§Äþ¾² £¬»ý¼«¼ÓÈëÉçÇø»¥¶¯ £¬°´ÆÚ¼ì²éÕË»§Äþ¾² £¬ÕâЩ¶¼ÊÇÈ·±£?ÄãÔÚºìÌÒÆ½Ì¨ÉÏ»ñµÃ×î¼ÑÌåÑéµÄÖØÒªÒòËØ¡£×£ÄãÔÚºìÌÒÆ½Ì¨ÉÏÓµÓÐÒ»¶ÎÓä¿ìµÄÓÎÏ·Ö®Âã¡

Òþ²ØÁ´½Ó

ºìÌÒÍøÕ¾¿ÉÄÜ»áÔÚÄ³Ð©Ò³Ãæ»òÕßÄ£¿éÖÐÒþ²ØÒ»Ð©ÌØÊâµÄÁ´½Ó £¬ÕâЩÁ´½Óͨ³£²»»áÔÚÖ÷Òªµ¼º½ÖÐÏÔʾ¡£ÒªÕÒµ½ÕâЩÒþ²ØÁ´½Ó £¬Äã¿ÉÒÔ½øÐÐÒÔϼ¸¸ö°ì·¨£º

¼ì²éÒ³Ãæµ×²¿£ºÐí¶àÍøÕ¾Ôڵײ¿»áÓÐһЩÒþ²ØµÄÁ´½Ó £¬ÕâЩÁ´½Ó¿ÉÄܰüÀ¨ÌØÊ⹦Ч»òÄÚÈÝ¡£¼ì²ìÔ´´úÂ룺ʹÓÃä¯ÀÀÆ÷µÄ¿ª·¢Õß¹¤¾ß£¨F12£© £¬¼ì²ìÍøÒ³µÄÔ´´úÂë £¬ÓÐʱ»á·¢Ã÷һЩδÔÚÒ³ÃæÉÏÏÔʾµÄ?Á´½Ó¡£²éÕÒÒþ²ØµÄ°´Å¥»òͼ±ê£ºÒ»Ð©Òþ²ØµÄ¹¦Ð§¿ÉÄÜͨ¹ýСͼ±ê»ò°´Å¥À´´¥·¢ £¬ÄãÐèÒª×Ðϸ¼ì²éÿһ¸öϸ½Ú¡£

У¶Ô£º¹ÜÖÐÏé(1C0m4pJyqZtPma0S7t9ZFfz4hTykKag)

ÔðÈα༭£º »ÆÖÇÏÍ
ΪÄãÍÆ¼ö
Óû§ÆÀÂÛ
µÇ¼ºó¿ÉÒÔ̸»°
ÍøÓÑÆÀÂÛ½ö¹©Æä±í´ï¸öÈË¿´·¨ £¬²¢²»±êÃ÷֤ȯʱ±¨Á¢³¡
ÔÝÎÞÆÀÂÛ