CSS選擇器實(shí)現(xiàn)字段解析

發(fā)布時(shí)間：2018-01-31 16:21:05 作者：佚名

這篇文章主要介紹了CSS選擇器實(shí)現(xiàn)字段解析的相關(guān)資料,需要的朋友可以參考下

根據(jù)上面所學(xué)的CSS基礎(chǔ)語(yǔ)法知識(shí)，現(xiàn)在來(lái)實(shí)現(xiàn)字段的解析。首先還是解析標(biāo)題。打開(kāi)網(wǎng)頁(yè)開(kāi)發(fā)者工具，找到標(biāo)題所對(duì)應(yīng)的源代碼。

發(fā)現(xiàn)是在div class="entry-header"下面的h1節(jié)點(diǎn)中，于是打開(kāi)scrapy shell 進(jìn)行調(diào)試

但是我不想要<h1>這種標(biāo)簽該咋辦，這時(shí)候就要使用CSS選擇器中的偽類方法。如下所示。

注意的是兩個(gè)冒號(hào)。使用CSS選擇器真的很方便。同理我用CSS實(shí)現(xiàn)字段解析。代碼如下

# -*- coding: utf-8 -*-  
import scrapy  
import re  
class JobboleSpider(scrapy.Spider):  
    name = 'jobbole'  
    allowed_domains = ['blog.jobbole.com']  
    start_urls = ['http://blog.jobbole.com/113549/']  
    def parse(self, response):  
        # title = response.xpath('//div[@class = "entry-header"]/h1/text()').extract()[0]  
        # create_date = response.xpath("//p[@class = 'entry-meta-hide-on-mobile']/text()").extract()[0].strip().replace("·","").strip()  
        # praise_numbers = response.xpath("//span[contains(@class,'vote-post-up')]/h10/text()").extract()[0]  
        # fav_nums = response.xpath("//span[contains(@class,'bookmark-btn')]/text()").extract()[0]  
        # match_re = re.match(".*?(\d+).*",fav_nums)  
        # if match_re:  
        #     fav_nums = match_re.group(1)  
        # comment_nums = response.xpath("//a[@href='#article-comment']/span").extract()[0]  
        # match_re = re.match(".*?(\d+).*", comment_nums)  
        # if match_re:  
        #     comment_nums = match_re.group(1)  
        # content = response.xpath("//div[@class='entry']").extract()[0]  
#通過(guò)CSS選擇器提取字段  
        title = response.css(".entry-header h1::text").extract()[0]  
        create_date = response.css(".entry-meta-hide-on-mobile::text").extract()[0].strip().replace("·","").strip()  
        praise_numbers = response.css(".vote-post-up h10::text").extract()[0]  
        fav_nums = response.css("span.bookmark-btn::text").extract()[0]  
        match_re = re.match(".*?(\d+).*", fav_nums)  
        if match_re:  
            fav_nums = match_re.group(1)  
        comment_nums = response.css("a[href='#article-comment'] span::text").extract()[0]  
        match_re = re.match(".*?(\d+).*", comment_nums)  
        if match_re:  
            comment_nums = match_re.group(1)  
        content = response.css("div.entry").extract()[0]  
        tags = response.css("p.entry-meta-hide-on-mobile a::text").extract()[0]  
        pass