σ ζNXc@@sΌdZddlmZddlZddlmZmZddlZddlZddl m Z ej dej ƒZ ej dej ƒZydd lmZWn9ek rΩdd lmZmZd „Zd „ZnXydd lmZWnek r d„ZnXded„Zd„Zed„Zded„Zd„ZyHyddlmZmZWn'ek rddl mZmZnXWn&ek r·d„Zdd„ZnXdS(s¦ Tools to open .py files as Unicode, using the encoding specified within the file, as per PEP 263. Much of the code is taken from the tokenize module in Python 3.2. i(tabsolute_importN(t TextIOWrappertBytesIOi(t unicode_typescoding[:=]\s*([-\w.]+)s^\s*#.*coding[:=]\s*([-\w.]+)(tdetect_encoding(tlookuptBOM_UTF8cC@s^|d jƒjddƒ}|dks7|jdƒr;dS|d ksV|jd ƒrZdS|S(s(Imitates get_normal_name in tokenizer.c.i t_t-sutf-8sutf-8-slatin-1s iso-8859-1s iso-latin-1slatin-1-s iso-8859-1-s iso-latin-1-(slatin-1s iso-8859-1s iso-latin-1(slatin-1-s iso-8859-1-s iso-latin-1-(tlowertreplacet startswith(torig_enctenc((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt_get_normal_names c@sήt‰d}d}‡fd†}‡fd†}|ƒ}|jtƒrat‰|d}d}n|sq|gfS||ƒ}|r||gfS|ƒ}|s¬||gfS||ƒ}|rΞ|||gfS|||gfS(s> The detect_encoding() function is used to detect the encoding that should be used to decode a Python source file. It requires one argment, readline, in the same way as the tokenize() generator. It will call readline a maximum of twice, and return the encoding used (as a string) and a list of any lines (left as bytes) it has read in. It detects the encoding from the presence of a utf-8 bom or an encoding cookie as specified in pep-0263. If both a bom and a cookie are present, but disagree, a SyntaxError will be raised. If the encoding cookie is an invalid charset, raise a SyntaxError. Note that if a utf-8 bom is found, 'utf-8-sig' is returned. If no encoding is specified, then the default of 'utf-8' will be returned. sutf-8c@s$y ˆƒSWntk rdSXdS(Nt(t StopIteration((treadline(sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt read_or_stop:s  c@sΊy|jdƒ}Wntk r'dSXtj|ƒ}|sAdSt|dƒ}yt|ƒ}Wn!tk r„td|ƒ‚nXˆrΆ|j dkr©tdƒ‚n|d7}n|S(Ntasciiisunknown encoding: sutf-8sencoding problem: utf-8s-sig( tdecodetUnicodeDecodeErrortNonet cookie_retfindallRRt LookupErrort SyntaxErrortname(tlinet line_stringtmatchestencodingtcodec(t bom_found(sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt find_cookie@s"   is utf-8-sigN(tFalseRR RtTrue(RRtdefaultRR"tfirsttsecond((R!RsL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyR&s,         (topencC@sVtj|dƒ}t|jƒ\}}|jdƒt||dtƒ}d|_|S(s`Open a file in read only mode using the encoding detected by detect_encoding(). trbitline_bufferingtr(tioR(RRtseekRR$tmode(tfilenametbufferRtlinesttext((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyR(rs   R cC@sΒt|tƒr|St|tƒr1t|ƒ}n|}yt|jƒ\}}Wntk rid}nX|jdƒt||d|dt ƒ}d|_ |r΄dj t |ƒƒS|j ƒSdS(s#Converts a bytes string with python source code to unicode. Unicode strings are passed through unchanged. Byte strings are checked for the python source file encoding cookie to determine encoding. txt can be either a bytes buffer or a string containing the source code. RiterrorsR*R+uN(t isinstanceRtbytesRRRRR-RR$R.tjointstrip_encoding_cookietread(ttxtR3tskip_encoding_cookieR0RRR2((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pytsource_to_unicode}s    cc@s…t|ƒ}yJt|ƒ}tj|ƒs2|Vnt|ƒ}tj|ƒsU|VnWntk rjdSXx|D] }|VqrWdS(s{Generator to pull lines from a text-mode file, skipping the encoding cookie if it is found in the first two lines. N(titertnexttcookie_comment_retmatchR(tfileliketitR&R'R((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyR7—s      cC@s<t|ƒ*}|r(djt|ƒƒS|jƒSWdQXdS(sRead a Python file, using the encoding declared inside the file. Parameters ---------- filename : str The path to the file to read. skip_encoding_cookie : bool If True (the default), and the encoding declaration is found in the first two lines, that line will be excluded from the output - compiling a unicode string with an encoding declaration is a SyntaxError in Python 2. Returns ------- A unicode string containing the contents of the file. RN(R(R6R7R8(R/R:tf((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt read_py_file©scC@siyddlm}Wn!tk r7ddlm}nX||ƒ}tj|jƒƒ}t|||ƒS(s₯Read a Python file from a URL, using the encoding declared inside the file. Parameters ---------- url : str The URL from which to fetch the file. errors : str How to handle decoding errors in the file. Options are the same as for bytes.decode(), but here 'replace' is the default. skip_encoding_cookie : bool If True (the default), and the encoding declaration is found in the first two lines, that line will be excluded from the output - compiling a unicode string with an encoding declaration is a SyntaxError in Python 2. Returns ------- A unicode string containing the contents of the file. i(turlopen(turllib.requestRDt ImportErrorturllibR,RR8R;(turlR3R:RDtresponseR0((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt read_py_urlΏs  c@stˆƒ‰‡fd†}|S(sbGiven a list, returns a readline() function that returns the next element with each call. c@s tˆƒS(N(R=((tx(sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyRΰs(R<(RKR((RKsL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyt_list_readlineΫs (tsource_from_cachetcache_from_sourcecC@s>tjj|ƒ\}}|dkr6td|ƒ‚n|dS(Ns.pycs.pyos"Not a cached Python file extensions.py(s.pycs.pyo(tostpathtsplitextt ValueError(RPtbasenametext((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyRMξs cC@s?|dkrt}ntjj|ƒ\}}|r;|dSdS(Ns.pycs.pyo(Rt __debug__RORPRQ(RPtdebug_overrideRSRT((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyRNυs  ("t__doc__t __future__RR,RRtos.pathROtret py3compatRtcompiletUNICODERR>ttokenizeRRFtcodecsRRRR(R$R;R7RCRJRLtimportlib.utilRMRNtimpR(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/utils/openpy.pyts>     G