python爬蟲字體加密的解決
更新時間：2023年03月03日 08:33:39 作者：L'y
本文主要介紹了python爬蟲字體加密的解決，文中通過示例代碼介紹的非常詳細，對大家的學習或者工作具有一定的參考學習價值，需要的朋友們下面隨著小編來一起學習學習吧
直接點 某8網(wǎng) https://*****.b*b.h*****y*8*.com/
具體網(wǎng)址格式就是這樣的但是為了安全起見,我就這樣打碼了.
拋出問題
我們看到這個號碼是在頁面上正常顯示的
F12 又是這樣就比較麻煩,不能直接獲取.
用requests庫也是獲取不到正常想要的 源碼的,因為字體加密了.
查看頁面源代碼又是這樣的.所以就是我們想怎么解密呢.
解決步驟
- 獲取到真正的源碼
- 找到對應的字體庫
- 進行解析操作.
獲取到真正的源碼
為什么用webdriver,因為
requests拿不到真正的源碼.
from selenium import webdriver
# --- 進行chrome的配置
options = webdriver.ChromeOptions()
prefs = {"profile.managed_default_content_settings.images": 2} # 設置無圖模式
options.add_experimental_option("prefs", prefs)
options.add_argument("service_args = ['–ignore-ssl-errors = true', '–ssl-protocol = TLSv1']")
options.binary_location = r'C:\Program Files\Google\Chrome\Application\chrome.exe'
# ---- chrome進行端口接管調用
options.add_argument('-incognito')
driver = webdriver.Chrome(options=options)
driver.set_page_load_timeout(5)
# --- 設置寬和高位置
driver.maximize_window()
# --- 攔截webdriver檢測代碼
driver.execute_cdp_cmd("Page.addScriptToEvaluateOnNewDocument",
{"source": """
Object.defineProperty(navigator, 'webdriver', {
get: () => undefined
})
"""})
找到對應的字體庫
這上面進行申明了告訴了我們這個是字體
base64,然后就是那下來然后生成文件.
# 示例
import base64
# 省略了很長的...
b64_code = 'AAEAAAAKAIAAAwAgT1MvMla19RMAAACsAAAAYGNtYXAGQAPOAAABDAAAAa5nbHlmZrwdwAAAArwAAAakaGVhZBQx4JoAAAlgAAAANmhoZWEFswFxAAAJmAAAACRobXR4DVYBYgAACbwAAAAubG9jYQwQCnYAAAnsAAAAIm1heHAAFABOAAAKEAAAACBuYW1lUuodRwAACjAAAAGecG9zdDHgxUkAAAvQAAAAdAAEAgsBkAAFAAACmQLMAAAAjwKZAswAAAHrADMBCQAAAgAGAwAAAAAAAAAAAAEQAAAAAAAAAAAAAABQZkVkAMAAI4EEAyz/LABcAywA1AAAAAEAAAAAAxgAAAAAACAAAQAAAAQAAAADAAAAJAABAAAAAABcAAMAAQAAACQAAwAKAAABYgAEADgAAAAKAAgAAgACACMAKwAtAC///wAAACMAKgAtAC/e/9j/1//WAAEAAAAAAAAAAAAAAAABBgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAAAAAAAAgMABAAFAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAAAAAABMAAAAAAAAAAUAAAAjAAAAIwAAAAEAAAAqAAAAKwAAAAIAAAAtAAAALQAAAAQAAAAvAAAALwAAAAUACID7AAiBBAAAAAYAAAACACIAAAEyAqoAAwAHAAA3ESERJzMRIyIBEO7MzAACqv1WIgJmAAAAAgAdAAACIALbABsAHwAAARUjByM3IwcjNyM1MzcjNTM3MwczNzMHMxUjByMzNyMB/4AmSCZrJ0knZnQjdoQkSSVrJkkmYnAitWwkbAEUR83Nzc1HuUjGxsbGSLm5AAAAAQAkAKQB3gI2ABEAABM3FyczBzcXBxcHJxcjNwcnNyQumSJzJZkun58umSRyIZguoAGXZ26mpGpmKClma6anbWYqAAABAEMAkwH6AkoACwAAARUjNSM1MzUzFTMVAUNKtrZKtwFKt7dJt7dJAAAAAAEAGgFCASQBrQADAAATNSEVGgEKAUJrawAAAAABAAD/gwEnAwoAAwAAFycTM0pK30h9AQOGAAAAAgAj//YCGgLmABMAJwAAARQOAiMiLgI1ND4CMzIeAgUUHgIzMj4CNTQuAiMiDgICGhw9X0NGYDwaGjxgR0JfPRz+qAgUJB0cJBUHBxQkHB0kFQgBb1WLYzY2Y4xVVYpiNTVii1VKc08qKk9zSklzTykpT3MAAAAAAQArAAACCgLfACEAADc1MzI+AjURDgMjIi4CNT4DPwEzERQeAjsBFWRUDRMNBhQiIB8PDRUQChAiJiwaSHIFCxUQUgA3Bg8aEwIBGCccDwoUHBEEDBIbEjX9mhAZEQg3AAAAAAEAJAAAAg4C5gArAAABFA4EDwEzMjY/ATMHITU3PgM1NCYjIgYVIi4CNTQ+AjMyHgIB9AsYKDtPM2fvHy0JCD0G/hyYLz0jDiomNCodMCMTHThUODpXPB4CPBgtMDZATjFhJCMf12qaMU5HRSg6NllYCxgnGxwyJhcYLD8AAAAAAQAd//YCDgLmAEQAABciLgI1ND4CMxQeAjMyPgI1NC4CKwE1MzI+AjU0JiMiDgIVIiY1ND4CMzIeAhUUDgIHHgMVFA4C+TpTNhkOGB8SEiEvHBktIxUVKDsnP0MhMSAQKyobIxMHQEUdOVQ4N1c+IRgqOSIfQTUiL01kChQiLRgTHhUKITEhEA4iOiweMSMUQBUoOCE4PxstOR4tLxsvJBQWKz4oIzouIgwFGSo/LD5VNBYAAgAOAAACKQLbABgAIwAAJRUUHgI7ARUhNTMyPgI9ASE1ATMRMxUlNDY3DgMPATMBvw0XHxEN/pkcEh4XDf7lASKPav8AAwQFFhkXBorUvz8YHQ8FNzcFDx0YPz4B3v4nQ/YtaDAMKiwoCeUAAQAp//YCBgLbADoAADcyPgI1NCYjIg4CBycTIRcjJy4DKwEUDgIPAT4DMzIeAhUUDgIjIi4CNTQ2MxQeAuwZLiIVSUMTIBsYCy8gAYQFOwgCBgsQDNUCAgMBCAgZHiIPPGBFJTBNXy85UDIXLSUMGis+ECVAL0xLAwUHAxIBYrojCQ4KBgEQGyISXgMGBAMcNlI3Q1o3GBUiLRgkIxYsIxYAAAACAC7/9gIZAuYALAA8AAABIg4CBz4DMzIeAhUUDgIjIi4CNTQ+AjMyHgIVFA4CIzQuAgMiDgIHFB4CMzI2NTQmAUkeMSMVAwobIysaL0s2HR48WDs5XUMlJEhuSjJFKxMNHS4iBg8bNw4fHBgGEh4pFygtMgKpJEVkQQcNCwcdN04yN1tBJCpWg1lVk20/EyAoFhAdFg0XLyYY/tkIDhIJSWpEIFBZU0wAAAAAAQAtAAACGwLbAAsAADcBISIGDwEjNyEVAakBEf7yHBwDBj4FAen+5QACbBsZNNcy/VcAAAMAH//2Ah4C5gAlADkATQAANzQ+AjcuATU0PgIzMh4CFRQOAgceAxUUDgIjIi4CFzI+AjU0LgInDgMVFB4CEzQuAiMiDgIVFB4CFz4DHxUoOCE9QRg4W0I2UjcbEyQzIC5BKBMkQ2E+QF4+Hf4aKx4QESU4KBEeFQ0RHit6DBgkFxUhFgsOHCkbExsSCLshNSslESNaPCRDNCAbMEInHi8nIRAXLTI2HzFLNBwfNUhiEyIvHBkpIyISCx0jLBseMiMUAgQWKyEUER8qGBsoIBkNCxkgKAAAAAIAJP/2Ag8C5gAoADYAABciLgI1NDY3HgMzMjY3DgMjIi4CNTQ+AjMyHgIVFA4CAzI2NzQuAiMiBhUUFukvQCgRGBoHFR4nGkVKBQwdJS0aLEo1HiA9Vzc3XkUmIUdvHyU1DxEcKBgsMDAKFCAqFhYfBRcoHRGVkw8ZEwobNk80N1tCJChUglpVlG9AAW4lH0JePB1WV0dJAAAAAAEAAAABAACt4Ie1Xw889QALBAAAAAAA2XTOiAAAAADZdM6IAAD/gwIpAwoAAAAIAAIAAAAAAAAAAQAAAyz/LABcAj0AAAAAAikAAQAAAAAAAAAAAAAAAAAAAAcBdgAiAj0AHQICACQCPQBDAT4AGgEnAAACPQAjACsAJAAdAA4AKQAuAC0AHwAkAAAAAAAUAEQAZgB8AIoAmADUAQYBRgGgAdYCKAJ+ApgDBANSAAAAAQAAABAATgADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAlgABAAAAAAABAA0AAAABAAAAAAACAAYADQABAAAAAAADAA0AEwABAAAAAAAEAA0AIAABAAAAAAAFAB4ALQABAAAAAAAGAA0ASwADAAEECQABABoAWAADAAEECQACAAwAcgADAAEECQADABoAfgADAAEECQAEABoAmAADAAEECQAFADwAsgADAAEECQAGABoA7kxlZVRyZWVzaGFkb3dNZWRpdW1MZWVUcmVlc2hhZG93TGVlVHJlZXNoYWRvd1ZlcnNpb24gMS4wOyBGb250RWRpdG9yICh2MS4wKUxlZVRyZWVzaGFkb3cATABlAGUAVAByAGUAZQBzAGgAYQBkAG8AdwBNAGUAZABpAHUAbQBMAGUAZQBUAHIAZQBlAHMAaABhAGQAbwB3AEwAZQBlAFQAcgBlAGUAcwBoAGEAZABvAHcAVgBlAHIAcwBpAG8AbgAgADEALgAwADsAIABGAG8AbgB0AEUAZABpAHQAbwByACAAKAB2ADEALgAwACkATABlAGUAVAByAGUAZQBzAGgAYQBkAG8AdwAAAAIAAAAAAAAAMgAAAAAAAAAAAAAAAAAAAAAAAAAAABAAEAAAAAYADQAOABAAEgECAQMBBAEFAQYBBwEIAQkBCgELBHplcm8Db25lA3R3bwV0aHJlZQRmb3VyBGZpdmUDc2l4BXNldmVuBWVpZ2h0BG5pbmU='
with open('font.ttf', 'wb') as f:
f.write(base64.decodebytes(b64_code.encode()))
from fontTools.ttLib import TTFont # 導包
font = TTFont('font.ttf')
font.saveXML('font.xml')
# 簡單封裝下
import base64
def w_tff(one_html):
res_tff = re.findall(r';base64,(.*?)"', one_html, re.S)
if res_tff and len(res_tff) == 1:
new_res_ttf = res_tff[0]
with open('123_new_ttf.ttf', 'wb') as f:
f.write(base64.decodebytes(new_res_ttf.encode()))
讀取文件找到里面的對應關系,就是 你這個數(shù)字的格式 是存儲在.ttf文件里的.
from fontTools.ttLib import TTFont
def get_num_phone(es_str: str):
# 加載字體生成映射關系
path = '123_new_ttf.ttf'
font = TTFont(path)
# font.saveXML('font.xml') # 生成xml文件
# 得到映射關系
bestcmap = font.getBestCmap()
ss = {}
for key, value in bestcmap.items():
keys = hex(key).replace('0x', '').replace("&#x", "") # 10進制轉16進制
if value == "zero":
value = 0
elif value == "one":
value = 1
elif value == "one":
value = 1
elif value == "two":
value = 2
elif value == "three":
value = 3
elif value == "four":
value = 4
elif value == "five":
value = 5
elif value == "six":
value = 6
elif value == "seven":
value = 7
elif value == "eight":
value = 8
elif value == "nine":
value = 9
elif value == "hyphen":
value = "-"
ss.update({
keys: value
})
need_re = es_str
list_phone = ""
try:
for item in need_re.split(";"):
if item:
new_item = item.replace("&#x", "")
list_phone += "".join(str(ss[new_item]))
if not list_phone or len(list_phone) < 2:
return None
return list_phone
except Exception as e:
return None
<cmap>
<tableVersion version="0"/>
<cmap_format_4 platformID="0" platEncID="3" language="0">
<map code="0x23" name="numbersign"/><!-- NUMBER SIGN -->
<map code="0x2a" name="asterisk"/><!-- ASTERISK -->
<map code="0x2b" name="plus"/><!-- PLUS SIGN -->
<map code="0x2d" name="hyphen"/><!-- HYPHEN-MINUS -->
<map code="0x2f" name="slash"/><!-- SOLIDUS -->
</cmap_format_4>
<cmap_format_0 platformID="1" platEncID="0" language="0">
<map code="0x23" name="numbersign"/>
<map code="0x2a" name="asterisk"/>
<map code="0x2b" name="plus"/>
<map code="0x2d" name="hyphen"/>
<map code="0x2f" name="slash"/>
</cmap_format_0>
<cmap_format_4 platformID="3" platEncID="1" language="0">
<map code="0x23" name="numbersign"/><!-- NUMBER SIGN -->
<map code="0x2a" name="asterisk"/><!-- ASTERISK -->
<map code="0x2b" name="plus"/><!-- PLUS SIGN -->
<map code="0x2d" name="hyphen"/><!-- HYPHEN-MINUS -->
<map code="0x2f" name="slash"/><!-- SOLIDUS -->
</cmap_format_4>
<cmap_format_12 platformID="3" platEncID="10" format="12" reserved="0" length="76" language="0" nGroups="5">
<map code="0x23" name="numbersign"/><!-- NUMBER SIGN -->
<map code="0x2a" name="asterisk"/><!-- ASTERISK -->
<map code="0x2b" name="plus"/><!-- PLUS SIGN -->
<map code="0x2d" name="hyphen"/><!-- HYPHEN-MINUS -->
<map code="0x2f" name="slash"/><!-- SOLIDUS -->
<map code="0x880fb" name="zero"/><!-- ???? -->
<map code="0x880fc" name="one"/><!-- ???? -->
<map code="0x880fd" name="two"/><!-- ???? -->
<map code="0x880fe" name="three"/><!-- ???? -->
<map code="0x880ff" name="four"/><!-- ???? -->
<map code="0x88100" name="five"/><!-- ???? -->
<map code="0x88101" name="six"/><!-- ???? -->
<map code="0x88102" name="seven"/><!-- ???? -->
<map code="0x88103" name="eight"/><!-- ???? -->
<map code="0x88104" name="nine"/><!-- ???? -->
</cmap_format_12>
</cmap>
讀取ttf文件,(再生成xml文件,第一次尋找映射關系是需要做的)
font.getBestCmap()獲取映射關系表- 我們觀察 xml文件的
cmap段進行研究 ,可以看到我們明確需要的結果 keys = hex(key).replace('0x', '').replace("&#x", "")10進制轉16進制 ,會得到映射關系表{'23': 'numbersign', '2a': 'asterisk', '2b': 'plus', '2d': '-', '2f': 'slash', '8826e': 0, '8826f': 1, '88270': 2, '88271': 3, '88272': 4, '88273': 5, '88274': 6, '88275': 7, '88276': 8, '88277': 9}- 和從頁面上那些來的結果 進行 逐個匹配調整就行了.
注意的點
webdriver拿下來的頁面源碼有可能有點問題,所以我用了 soup_text = bs4.BeautifulSoup(driver.page_source, 'lxml').text 的方法來處理源代碼 (import bs4)
其他的就是一些小細節(jié)上的問題了.基本的思路就是這樣的.
到此這篇關于python爬蟲字體加密的解決的文章就介紹到這了,更多相關python爬蟲字體加密內容請搜索腳本之家以前的文章或繼續(xù)瀏覽下面的相關文章希望大家以后多多支持腳本之家！
相關文章
python實現(xiàn)12306登錄并保存cookie的方法示例
這篇文章主要介紹了 python實現(xiàn)12306登錄并保存cookie的方法示例，文中通過示例代碼介紹的非常詳細，對大家的學習或者工作具有一定的參考學習價值，需要的朋友們下面隨著小編來一起學習學習吧2019-12-12
大家好，本篇文章主要講的是用Python定時發(fā)送天氣郵件，感興趣的同學趕快來看一看吧，對你有幫助的話記得收藏一下2022-02-02
python使用 HTMLTestRunner.py生成測試報告
這篇文章主要介紹了python使用 HTMLTestRunner.py生成測試報告 ，具有一定的參考價值，感興趣的小伙伴們可以參考一下2017-10-10
在本文里小編給大家整理了關于Python編程中類與類的關系以及相關代碼知識點，需要的朋友們可以學習下。2019-08-08
日常工作中我們經(jīng)常會用到pdf格式的文件,大多數(shù)情況下是瀏覽或者編輯pdf信息,但有時候需要提取pdf中的文本,下面這篇文章主要給大家介紹了關于利用Python提取PDF文本的簡單方法,需要的朋友可以參考下2022-07-07
Python?PyQt5中窗口數(shù)據(jù)傳遞的示例詳解
開發(fā)應用程序時，若只有一個窗口則只需關心這個窗口里面的各控件之間如何傳遞數(shù)據(jù)。如果程序有多個窗口，就要關心不同的窗口之間是如何傳遞數(shù)據(jù)。本文介紹了PyQt5中三種窗口數(shù)據(jù)傳遞，需要的可以了解一下2022-12-12
這篇文章主要介紹了Python入門教程(十)Python布爾值,Python是一門非常強大好用的語言,也有著易上手的特性,本文為入門教程,需要的朋友可以參考下2023-04-04
在Python中處理數(shù)值數(shù)據(jù)時,可以選擇使用Python列表或NumPy數(shù)組,Python列表靈活,可存儲不同類型元素,但在大數(shù)據(jù)處理上可能較慢,NumPy數(shù)組固定類型,內存連續(xù)存儲,執(zhí)行數(shù)組操作如加法、乘法等更高效,尤其在大數(shù)據(jù)集處理上具有明顯的性能和內存使用優(yōu)勢2024-10-10
Python?matplotlib實現(xiàn)折線圖的繪制
Matplotlib作為Python的2D繪圖庫，它以各種硬拷貝格式和跨平臺的交互式環(huán)境生成出版質量級別的圖形。本文將利用Matplotlib庫繪制折線圖，感興趣的可以了解一下2022-03-03
python學習基礎之循環(huán)import及import過程
python中的import語句是用來導入模塊的，下面這篇文章主要給大家介紹了關于python學習基礎之循環(huán)import及import過程的相關資料，需要的朋友可以參考借鑒，下面隨著小編來一起學習學習吧。2018-04-04