Python提示[Errno 32]Broken pipe導(dǎo)致線程crash錯(cuò)誤解決方法
本文實(shí)例講述了Python提示[Errno 32]Broken pipe導(dǎo)致線程crash錯(cuò)誤解決方法。分享給大家供大家參考。具體方法如下：
1. 錯(cuò)誤現(xiàn)象
ThreadingHTTPServer 實(shí)現(xiàn)的 http 服務(wù)，如果客戶端在服務(wù)器返回前，主動(dòng)斷開連接，則服務(wù)器端會(huì)報(bào) [Errno 32] Broken pipe 錯(cuò)，并導(dǎo)致處理線程 crash.
下面先看個(gè)例子,python 版本: 2.7
示例代碼
#!coding=utf-8
import os
import time
import socket
import threading
from BaseHTTPServer import HTTPServer ,BaseHTTPRequestHandler
from SocketServer import ThreadingMixIn
class RequestHandler(BaseHTTPRequestHandler):
def do_GET(self):
"""
處理get請(qǐng)求
"""
query=self.path
print "query: %s thread=%s" % (query, str(threading.current_thread()))
#ret_str="<html>" + self.path + "<br>" + str(self.server) + "<br>" + str(self.responses) + "</html>"
ret_str="<html>" + self.path + "<br>" + str(self.server) + "</html>"
time.sleep(5)
try:
self.send_response(200)
self.send_header('Content-type','text/html')
self.end_headers()
self.wfile.write(ret_str)
except socket.error, e:
print "socket.error : Connection broke. Aborting" + str(e)
self.wfile._sock.close() # close socket
self.wfile._sock=None
return False
print "success prod query :%s" % (query)
return True
#多線程處理
class ThreadingHTTPServer(ThreadingMixIn,HTTPServer):
pass
if __name__ == '__main__':
serveraddr = ('',9001)
ser = ThreadingHTTPServer(serveraddr,RequestHandler)
ser.serve_forever()
sys.exit(0)
運(yùn)行服務(wù)
./thread_http_server_error.py
第1次 curl ，等待返回
<html>/hello1<br><__main__.ThreadingHTTPServer instance at 0x37483b0></html>[~]$
此時(shí)服務(wù)器端輸出日志如下：
$./thread_http_server_error.py
query: /hello1 thread=
search041142.sqa.cm4.tbsite.net – - [15/May/2014 15:02:27] “GET /hello1 HTTP/1.1″ 200 -
success prod query :/hello1
第2次 curl ，不等待返回，ctrl +C 來模擬客戶端斷開
[~]$ ctrl+C
此時(shí)服務(wù)器端輸出日志如下：
search041142.sqa.cm4.tbsite.net – - [15/May/2014 15:33:10] “GET /hello2 HTTP/1.1″ 200 -
socket.error : Connection broke. Aborting[Errno 32] Broken pipe
—————————————-
Exception happened during processing of request from ('10.232.41.142′, 48769)
Traceback (most recent call last):
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/SocketServer.py”, line 582, in process_request_thread
self.finish_request(request, client_address)
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/SocketServer.py”, line 323, in finish_request
self.RequestHandlerClass(request, client_address, self)
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/SocketServer.py”, line 639, in __init__
self.handle()
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/BaseHTTPServer.py”, line 337, in handle
self.handle_one_request()
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/BaseHTTPServer.py”, line 326, in handle_one_request
self.wfile.flush() #actually send the response if not already done.
File “/home/wuzhu/tools/python_2_7_1/lib/python2.7/socket.py”, line 303, in flush
self._sock.sendall(view[write_offset:write_offset+buffer_size])
AttributeError: 'NoneType' object has no attribute 'sendall'
2. 原因分析
“[Errno 32] Broken pipe “ 產(chǎn)生的原因還是比較明確的，由于 client 在服務(wù)器返回前主動(dòng)斷開連接，所以服務(wù)器在返回時(shí)寫 socket 收到SIGPIPE報(bào)錯(cuò)。雖然在我們的程序中也對(duì)異常進(jìn)行了處理，將handler 的 wfile._sock 對(duì)象close 掉 ，但python 的庫里BaseHTTPServer.py中BaseHTTPRequestHandler 類的成員函數(shù)handle_one_request還是會(huì)直接調(diào)用 wfile.flush ，而沒有判斷 wfile 是否已經(jīng) close。
"""Handle a single HTTP request.
You normally don't need to override this method; see the class
__doc__ string for information on how to handle specific HTTP
commands such as GET and POST.
"""
try:
self.raw_requestline = self.rfile.readline(65537)
if len(self.raw_requestline) > 65536:
self.requestline = ''
self.request_version = ''
self.command = ''
self.send_error(414)
return
if not self.raw_requestline:
self.close_connection = 1
return
if not self.parse_request():
# An error code has been sent, just exit
return
mname = 'do_' + self.command
if not hasattr(self, mname):
self.send_error(501, "Unsupported method (%r)" % self.command)
return
method = getattr(self, mname)
method()
#沒有判斷 wfile 是否已經(jīng) close 就直接調(diào)用 flush()
self.wfile.flush() #actually send the response if not already done.
except socket.timeout, e:
#a read or a write timed out. Discard this connection
self.log_error("Request timed out: %r", e)
self.close_connection = 1
return
3. 解決辦法
只要在RequestHandler重載其基類BaseHTTPRequestHandler的成員函數(shù)handle_one_reques（），在調(diào)用 wfile.flush() 前加上 wfile 是否已經(jīng) close 即可。
#!coding=utf-8
import os
import time
import socket
import threading
from BaseHTTPServer import HTTPServer ,BaseHTTPRequestHandler
from SocketServer import ThreadingMixIn
class RequestHandler(BaseHTTPRequestHandler):
def handle_one_request(self):
"""Handle a single HTTP request.
You normally don't need to override this method; see the class
__doc__ string for information on how to handle specific HTTP
commands such as GET and POST.
"""
try:
self.raw_requestline = self.rfile.readline(65537)
if len(self.raw_requestline) > 65536:
self.requestline = ''
self.request_version = ''
self.command = ''
self.send_error(414)
return
if not self.raw_requestline:
self.close_connection = 1
return
if not self.parse_request():
# An error code has been sent, just exit
return
mname = 'do_' + self.command
if not hasattr(self, mname):
self.send_error(501, "Unsupported method (%r)" % self.command)
return
method = getattr(self, mname)
print "before call do_Get"
method()
#增加 debug info 及 wfile 判斷是否已經(jīng) close
print "after call do_Get"
if not self.wfile.closed:
self.wfile.flush() #actually send the response if not already done.
print "after wfile.flush()"
except socket.timeout, e:
#a read or a write timed out. Discard this connection
self.log_error("Request timed out: %r", e)
self.close_connection = 1
return
def do_GET(self):
"""
處理get請(qǐng)求
"""
query=self.path
print "query: %s thread=%s" % (query, str(threading.current_thread()))
ret_str="<html>" + self.path + "<br>" + str(self.server) + "</html>"
time.sleep(5)
try:
self.send_response(200)
self.send_header('Content-type','text/html')
self.end_headers()
self.wfile.write(ret_str)
except socket.error, e:
print "socket.error : Connection broke. Aborting" + str(e)
self.wfile._sock.close()
self.wfile._sock=None
return False
print "success prod query :%s" % (query)
return True
#多線程處理
class ThreadingHTTPServer(ThreadingMixIn,HTTPServer):
pass
if __name__ == '__main__':
serveraddr = ('',9001)
ser = ThreadingHTTPServer(serveraddr,RequestHandler)
ser.serve_forever()
sys.exit(0)
運(yùn)行服務(wù)
./thread_http_server.py
curl ，不等待返回，ctrl +C 來模擬客戶端斷開
[~]$ ctrl+C
此時(shí)服務(wù)器端輸出日志如下：
query: /hello2 thread=<Thread(Thread-1, started 1103210816)>
search041142.sqa.cm4.tbsite.net - - [15/May/2014 15:54:09] "GET /hello2 HTTP/1.1" 200 -
socket.error : Connection broke. Aborting[Errno 32] Broken pipe
after call do_Get
after wfile.flush()
希望本文所述對(duì)大家的Python程序設(shè)計(jì)有所幫助。
相關(guān)文章
使用Python編寫一個(gè)簡單的tic-tac-toe游戲的教程
這篇文章主要介紹了使用Python編寫一個(gè)簡單的tic-tac-toe游戲的教程,有利于Python初學(xué)者進(jìn)行上手實(shí)踐,需要的朋友可以參考下2015-04-04
這篇文章主要介紹了python 讀取二進(jìn)制 顯示圖片案例，具有很好的參考價(jià)值，希望對(duì)大家有所幫助。一起跟隨小編過來看看吧2020-04-04
這篇文章主要介紹了python文件的md5加密方法,涉及Python針對(duì)文件的讀取與字符串加密的相關(guān)技巧,需要的朋友可以參考下2016-04-04
python實(shí)現(xiàn)數(shù)據(jù)圖表
plotly是現(xiàn)代平臺(tái)的敏捷商業(yè)智能和數(shù)據(jù)科學(xué)庫，它作為一款開源的繪圖庫，可以應(yīng)用于Python、R、MATLAB、Excel、JavaScript和jupyter等多種語言，主要使用的js進(jìn)行圖形繪制，實(shí)現(xiàn)過程中主要就是調(diào)用plotly的函數(shù)接口，底層實(shí)現(xiàn)完全被隱藏，便于初學(xué)者的掌握。2017-07-07
Python常用配置文件ini、json、yaml讀寫總結(jié)
用的配置文件格式有ini、json、yaml等，下面簡單給大家介紹下，Python如何讀寫這幾種格式的文件，對(duì)Python讀寫ini、json、yaml配置文件相關(guān)知識(shí)感興趣的朋友一起看看吧2021-07-07
flask中使用SQLAlchemy進(jìn)行輔助開發(fā)的代碼
在Web.py, Django, Flask, Tornado里，自帶的ORM功能比較缺乏，推薦大家使用SQLAlchemy來輔助開發(fā)2013-02-02
本篇文章主要介紹了Python3安裝Scrapy的方法步驟，小編覺得挺不錯(cuò)的，現(xiàn)在分享給大家，也給大家做個(gè)參考。一起跟隨小編過來看看吧2017-11-11
今天小編就為大家分享一篇python 切換root 執(zhí)行命令的方法，具有很好的參考價(jià)值，希望對(duì)大家有所幫助。一起跟隨小編過來看看吧2019-01-01
這篇文章主要介紹了Python模塊zipfile原理及使用方法詳解,文中通過示例代碼介紹的非常詳細(xì)，對(duì)大家的學(xué)習(xí)或者工作具有一定的參考學(xué)習(xí)價(jià)值,需要的朋友可以參考下2020-08-08
python通過PyQt5實(shí)現(xiàn)登錄界面的示例代碼
本文主要介紹了python通過PyQt5實(shí)現(xiàn)登錄界面的示例代碼，文中通過示例代碼介紹的非常詳細(xì)，具有一定的參考價(jià)值，感興趣的小伙伴們可以參考一下2021-08-08