Python實(shí)現(xiàn)提取谷歌音樂(lè)搜索結(jié)果的方法
本文實(shí)例講述了Python實(shí)現(xiàn)提取谷歌音樂(lè)搜索結(jié)果的方法。分享給大家供大家參考。具體如下:
Python的簡(jiǎn)單腳本,用于提取谷歌音樂(lè)搜索頁(yè)面中的歌曲信息,包括歌曲名,作者,專輯名,現(xiàn)在鏈接等,最多只提取10頁(yè)結(jié)果。
#! /usr/bin/env python
#coding=utf-8
'''
Created on 2011-8-19
@author: yaoboyuan
'''
from urllib import request,parse
import re,sys
def extractSongRawData(text):
'抓取每一首歌的原始數(shù)據(jù)'
text = re.sub('\n+','',text)
songList = re.findall('\<tbody.*?\</tbody>',text)
nums = len(songList)
print('search ' + str(nums) + ' songs')
return songList
def translate(text):
'去掉text中的無(wú)用字符,轉(zhuǎn)換unicode碼'
text = re.sub('\<b>','',text)
text = re.sub('\</b>','',text)
#find the 成 and translate into chinese
s = re.findall('&#([0-9]+);',text)
if len(s)<=0:
return text
else:
text = ''
for i in range(len(s)):
value = int(s[i],10) #from str'123' to 10 base's int 124
text += chr(value) #from value to char
return text
def extractSongName(song):
'提取歌曲名字'
td = re.findall('(?:\<td class\="Title).*(?:\</td>)',song)
name = re.findall('.+?\<a.+?>(.*?)\</a>',td[0])
songName = translate(name[0])
return songName
def extractAuthorName(song):
'提取作者名字'
td = re.findall('(?:\<td class\="Artist).*(?:\</td>)',song)
name = re.findall('.+?\<a.+?>(.*?)\</a>',td[0])
authorName = name[0]
authorName = translate(authorName)
return authorName
def extrackAlbumName(song):
'提取專輯名字'
td = re.findall('(?:\<td class\="Album).*(?:\</td>)',song)
name = re.findall('.+?\<a.+?>(.*?)\</a>',td[0])
albumName = translate(name[0])
return albumName
def extractID(song):
'提取歌曲id'
td = re.findall('''\<tbody id\="([a-zA-Z0-9]+)"''',song)
if len(td)>0:
return td[0]
else:
return song
def extractLink(song):
'提取歌曲下載鏈接'
td = re.findall('''\<td class\="Icon.*?(?=title\="下載").*?onclick\="(.*?)>''',song)
if len(td) == 0:
return 'NULL'
s = str(td[0])
rawLink = re.findall('http.*?(?=\?)',s)
if len(rawLink) == 0:
return s
link = rawLink[0]
link = re.sub('%3D','=',link)
id = extractID(song)
return link + '?id=' + id
def extractPageNums(text):
'提取返回結(jié)果的頁(yè)數(shù),最多要10頁(yè)'
pageList = re.findall('page_link',text)
return len(pageList)
def extractSongInfo(song):
'提取歌曲信息,返回歌曲列表'
songList = []
for i in range(len(song)):
songName = extractSongName(song[i])
authorName = extractAuthorName(song[i])
albumName = extrackAlbumName(song[i])
link = extractLink(song[i])
songItem = [songName,authorName,albumName,link]
songList.append(songItem)
index = ''
if i<9:
index = '0' + str(i+1)
else:
index = str(i + 1)
#print(index + ' ' + songName + ' ' + authorName + ' ' + albumName + ' ' + link)
return songList
def main():
while True:
url = 'http://www.google.cn/music/search?q='
key = input('請(qǐng)輸入歌曲名字或關(guān)鍵字:')
key = parse.quote(key) #統(tǒng)一編碼成utf-8
url += key
mf = request.urlopen(url)
c = mf.readall()
c = str(c,encoding = 'utf-8')
num = extractPageNums(c)
print(str(num+1) + ' pages found')
song = extractSongRawData(c)
songList = extractSongInfo(song)
#if the result great than 2 pages, then request all pages
if num>0:
for i in range(num):
start = (i+1)*20
next_page = '&cat=song&start=%d'%(start)
#next_page = parse.quote(next_page) #統(tǒng)一編碼成utf-8
url += next_page
mf = request.urlopen(url)
c = mf.readall()
c = str(c,encoding = 'utf-8')
song = extractSongRawData(c)
songList += extractSongInfo(song) #find all results
for i in range(len(songList)): #print the result
index = ''
if i<9:
index = '0' + str(i+1)
else:
index = str(i + 1)
print(index + ' ' + str(songList[i]))
if __name__ == '__main__':
main()
希望本文所述對(duì)大家的Python程序設(shè)計(jì)有所幫助。
相關(guān)文章
Python自定義函數(shù)計(jì)算給定日期是該年第幾天的方法示例
這篇文章主要介紹了Python自定義函數(shù)計(jì)算給定日期是該年第幾天的方法,結(jié)合具體實(shí)例形式分析了Python日期時(shí)間計(jì)算相關(guān)操作技巧,需要的朋友可以參考下2019-05-05
Python程序中的觀察者模式結(jié)構(gòu)編寫示例
觀察者模式是最常用的設(shè)計(jì)模式之一,旨在觀察目標(biāo)和觀察者之間建立一個(gè)抽象的耦合,減少對(duì)象之間的耦合,這里我們就來(lái)看一下Python程序中的觀察者模式結(jié)構(gòu)編寫示例2016-05-05
代碼詳解django中數(shù)據(jù)庫(kù)設(shè)置
在本篇文章里小編給大家分享了關(guān)于django中數(shù)據(jù)庫(kù)設(shè)置的相關(guān)實(shí)例內(nèi)容,有興趣的朋友們跟著學(xué)習(xí)下。2019-01-01
Python實(shí)現(xiàn)曲線的肘部點(diǎn)檢測(cè)詳解
肘部法則是經(jīng)常使用的法則。很多時(shí)候,可以憑人工經(jīng)驗(yàn)去找最優(yōu)拐點(diǎn),但有時(shí)需要自動(dòng)尋找拐點(diǎn)。本文為大家介紹了Python實(shí)現(xiàn)曲線的肘部點(diǎn)檢測(cè)的方法,希望對(duì)大家有所幫助2023-02-02
python opencv 簡(jiǎn)單閾值算法的實(shí)現(xiàn)
這篇文章主要介紹了python opencv 簡(jiǎn)單閾值算法的實(shí)現(xiàn),文中通過(guò)示例代碼介紹的非常詳細(xì),對(duì)大家的學(xué)習(xí)或者工作具有一定的參考學(xué)習(xí)價(jià)值,需要的朋友們下面隨著小編來(lái)一起學(xué)習(xí)學(xué)習(xí)吧2019-08-08

