ó æNXc @s¶dZddlZddlZddlZddlZddlZddlmZddlm Z m Z m Z m Z m Z mZmZmZmZmZmZddlmZmZmZmZmZmZmZmZmZmZejdjddd d d d d gƒƒZ ejdƒZ!ejdƒZ"d„Z#d„Z$ejdej%ƒZ&ejdej%ƒZ'd„Z(d„Z)d„Z*de+fd„ƒYZ,de,fd„ƒYZ-dS(sÞInput handling and transformation machinery. The first class in this module, :class:`InputSplitter`, is designed to tell when input from a line-oriented frontend is complete and should be executed, and when the user should be prompted for another line of code instead. The name 'input splitter' is largely for historical reasons. A companion, :class:`IPythonInputSplitter`, provides the same functionality but with full support for the extended IPython syntax (magics, system calls, etc). The code to actually do these transformations is in :mod:`IPython.core.inputtransformer`. :class:`IPythonInputSplitter` feeds the raw code to the transformers in order and stores the results. For more details, see the class docstrings below. iÿÿÿÿN(t cast_unicode( tleading_indenttclassic_promptt ipy_prompttstrip_encoding_cookiet cellmagictassemble_logical_linesthelp_endtescaped_commandstassign_from_magictassign_from_systemtassemble_python_lines( t ESC_SHELLt ESC_SH_CAPtESC_HELPt ESC_HELP2t ESC_MAGICt ESC_MAGIC2t ESC_QUOTEt ESC_QUOTE2t ESC_PARENt ESC_SEQUENCESt|s^\s+raise(\s.*)?$s^\s+raise\([^\)]*\).*$s^\s+return(\s.*)?$s^\s+return\([^\)]*\).*$s ^\s+pass\s*$s ^\s+break\s*$s^\s+continue\s*$s^([ \t\r\f\v]+)s^\s*\#cCs'tj|ƒ}|r|jƒSdSdS(s Return the number of initial spaces in a string. Note that tabs are counted as a single space. For now, we do *not* support mixing of tabs and spaces in the user's input. Parameters ---------- s : string Returns ------- n : int iN(t ini_spaces_retmatchtend(tst ini_spaces((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytnum_ini_spacesFs cCs0|s tS|jƒd}|dkp/|jƒS(sÌDetermine if the input source ends in a blank. A blank is either a newline or a line consisting of whitespace. Parameters ---------- src : string A single or multiline string. iÿÿÿÿt(tFalset splitlinestisspace(tsrctll((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt last_blank[s s \n\s*\n\s*$s .+\n\s*\n\s+$cCsR|s tSdjdg|jƒdƒ}ttj|ƒƒpQttj|ƒƒS(sÏDetermine if the input source ends in two blanks. A blank is either a newline or a line consisting of whitespace. Parameters ---------- src : string A single or multiline string. s s### iþÿÿÿ(RtjoinRtbooltlast_two_blanks_reRtlast_two_blanks_re2(R!tnew_src((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytlast_two_blanksms  cCstjdd|ƒS(sRemove all comments from input source. Note: comments are NOT recognized inside of strings! Parameters ---------- src : string A single or multiline input string. Returns ------- String with all Python comments removed. s#.*R(tretsub(R!((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytremove_comments„scCs.ttjddƒ}|dkr*d}n|S(scReturn the default standard input encoding. If sys.stdin has no encoding, 'ascii' is returned.tencodingtasciiN(tgetattrtsyststdintNone(R-((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytget_input_encoding–s  t InputSplittercBs¤eZdZdZdZdZdZdZdZ e Z dZ e Z d„Zd„Zd„Zd„Zd„Zd„Zd „Zd „Zdd d „Zd „ZRS(s$An object that can accumulate lines of Python source before execution. This object is designed to be fed python source line-by-line, using :meth:`push`. It will return on each push whether the currently pushed code could be executed already. In addition, it provides a method called :meth:`push_accepts_more` that can be used to query whether more input can be pushed into a single interactive block. This is a simple example of how an interactive terminal-based client can use this tool:: isp = InputSplitter() while isp.push_accepts_more(): indent = ' '*isp.indent_spaces prompt = '>>> ' + indent line = indent + raw_input(prompt) isp.push(line) print 'Input source was:\n', isp.source_reset(), iRcCs(g|_tjƒ|_tƒ|_dS(s-Create a new InputSplitter instance. N(t_buffertcodeoptCommandCompilert_compileR3R-(tself((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt__init__×s cCsDd|_g|j(d|_d|_t|_t|_t|_dS(s,Reset the input buffer and associated state.iRN( t indent_spacesR5tsourceR2tcodeRt _is_completet _is_invalidt _full_dedent(R9((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytresetÞs      cCs|j}|jƒ|S(s:Return the input source and perform a full reset. (R<RA(R9tout((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt source_resetès  cCsp|jƒzTy|j|ƒWntk r2dSX|jr@dS|jƒrYd|jfSdSWd|jƒXdS(syReturn whether a block of code is ready to execute, or should be continued This is a non-stateful API, and will reset the state of this InputSplitter. Parameters ---------- source : string Python input code, which can be multiline. Returns ------- status : str One of 'complete', 'incomplete', or 'invalid' if source is not a prefix of valid code. indent_spaces : int or None The number of spaces by which to indent the next line of code. If status is not 'incomplete', this is None. tinvalidt incompletetcompleteN(sinvalidN(sinvalidN(RFN(RAtpusht SyntaxErrorR2R?tpush_accepts_moreR;(R9R<((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytcheck_completeïs     c Csá|j|ƒ|j}d\|_|_t|_|jdƒrDtS|j|ƒy?t j ƒ-t j dt ƒ|j |ddƒ|_WdQXWn5tttttt fk rÇt|_t|_nX|jdk |_|jS(s÷Push one or more lines of input. This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not. Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True. Parameters ---------- lines : string One or more lines of Python input. Returns ------- is_complete : boolean True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (``_is_complete``), so it can be queried at any time. s\ terrortsymboltexecN(NN(t_storeR<R2R=R>RR?tendswitht_update_indenttwarningstcatch_warningst simplefiltert SyntaxWarningR8RHt OverflowErrort ValueErrort TypeErrort MemoryErrortTrue(R9tlinesR<((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRGs"     "   cCsÐ|js tS|jjƒd}| s3|jƒr7tS|jdkrÌt|jjƒƒdkretSytj dj |j ƒƒ}Wnt k r˜tSXt|j ƒdkrÌt|j ddƒ rÌtSntS(s¯Return whether a block of interactive input can accept more input. This method is meant to be used by line-oriented frontends, who need to guess whether a block is complete or not based solely on prior and current input lines. The InputSplitter considers it has a complete interactive block and will not accept more input when either: * A SyntaxError is raised * The code is complete and consists of a single line or a single non-compound statement * The code is complete and has a blank line at the end If the current input produces a syntax error, this method immediately returns False but does *not* raise the syntax error exception, as typically clients will want to send invalid syntax to an execution backend which might convert the invalid syntax into valid Python via one of the dynamic IPython mechanisms. iÿÿÿÿiiutbody(R>RYR<RR RR;tlentasttparseR$R5t ExceptionR[thasattr(R9t last_linetcode_ast((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRIKs   cCs»|j}|j}t|ƒ}||krH|}|dkrHt}qHn|jƒddkrk|d7}n1tj|ƒrœ|d8}|dkrœt}qœn|dkr±d}n||fS(sÓCompute the new indentation level for a single line. Parameters ---------- line : str A single new line of non-whitespace, non-comment Python input. Returns ------- indent_spaces : int New value for the indent level (it may be equal to self.indent_spaces if indentation doesn't change. full_dedent : boolean Whether the new line causes a full flush-left dedent. iiÿÿÿÿt:i(R;R@RRYtrstript dedent_reR(R9tlineR;t full_dedenttinisp((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt _find_indent†s             cCsRxKt|ƒjƒD]7}|r|jƒ r|j|ƒ\|_|_qqWdS(N(R,RR RiR;R@(R9RZRf((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRP¯sR<cCse|dkr|j}n|jdƒr7|j|ƒn|j|dƒt|||j|ƒƒdS(s‚Store one or more lines of input. If input lines are not newline-terminated, a newline is automatically appended.s N(R2R5ROtappendtsetattrt _set_source(R9RZtbuffertstore((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRN´s   cCs dj|ƒS(Nu(R$(R9Rm((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRlÃsN(t__name__t __module__t__doc__R;R-R<R2R=R5R8RR@R>R?R:RARCRJRGRIRiRPRNRl(((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyR4¥s(   $ 8 ; ) tIPythonInputSplittercBs¡eZdZdZeZeZd Ze d d d d„Z e d„ƒZ e d„ƒZ d„Zd„Zd„Zd„Zd „Zd „Zd „Zd „ZRS(sBAn input splitter that recognizes all of IPython's special syntax.RcCsàtt|ƒjƒg|_t|_|dk r=||_n-tƒt ƒt ƒt d|ƒt ƒg|_t ƒ|_ |dk rŽ||_n!tƒtƒtƒtƒg|_tƒ|_|dk rÓ||_n g|_dS(Ntend_on_blank_line(tsuperRrR:t _buffer_rawRYt _validateR2tphysical_line_transformsRRRRRRtlogical_line_transformsRRR R R tpython_line_transforms(R9tline_input_checkerRwRxRy((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyR:Ús*           cCs)|j|jg|j|jg|jS(s!Quick access to all transformers.(RwRRxR Ry(R9((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt transformsýscCsB|j}|js-||jg|j7}n||jg|jS(sTTransformers, excluding logical line transformers if we're in a Python line.(Rwtwithin_python_lineRRxR Ry(R9tt((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyttransforms_in_uses  cCsrtt|ƒjƒg|j(d|_t|_t|_x3|jD](}y|jƒWqBt k riqBXqBWdS(s,Reset the input buffer and associated state.RN( RtRrRARut source_rawRttransformer_accumulatingR|R{RH(R9R}((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRA s     cCsad„}g}x |jD]}|||ƒ}qWt|ƒ}|r]|jdj|ƒƒndS(NcssoxH|D]@}x7|jƒD])}|j|ƒ}|dk r|VqqWqW|jƒ}|dk rk|VndS(sAyield transformed lines always strings, never None transform: the current transform outs: an iterable of previously transformed inputs. Each may be multiline, which will be passed one line at a time to transform. N(RRGR2RA(t transformtoutsRBRfttmp((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt_flushs    s (R~tlistRNR$(R9R„RBR}((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pytflush_transformerss  cCs|j}|jƒ|S(s8Return raw input only and perform a full reset. (RRA(R9RB((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt raw_reset<s  cCs'z|jƒ|jSWd|jƒXdS(N(R†R<RA(R9((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRCCs  cCs$|jr tStt|ƒjƒSdS(N(R€RYRtRrRI(R9((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRIJs cCs>|jƒz"|j|ƒ|jƒ|jSWd|jƒXdS(s/Process and translate a cell of input. N(RARGR†R<(R9tcell((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyttransform_cellPs     cCsjt||jƒ}|jƒ}|s0dg}n|j||jdƒx|D]}|j|ƒ}qMW|S(s@Push one or more lines of IPython input. This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not, after processing all input lines for special IPython syntax. Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True. Parameters ---------- lines : string One or more lines of Python input. Returns ------- is_complete : boolean True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (_is_complete), so it can be queried at any time. RR(RR-RRNRut push_line(R9RZt lines_listRfRB((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRG[s   csPˆj}‡fd†}x6ˆjD]+}|j|ƒ}|dkr"||ƒSq"Wˆjs¾ˆjj|ƒ}|dkr‚|dƒSx9ˆjD]+}|j|ƒ}|dkrŒ||ƒSqŒWnˆjj|ƒ}|dkrïtˆ_|dƒSt ˆ_x6ˆj D]+}|j|ƒ}|dkr||ƒSqWt ˆ_ t t ˆƒj|ƒS(Ncs tˆ_tS(N(RYR€R(tdbg(R9(sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyt _accumulatingˆs sacc logical linesacc python line(R5RwRGR2R|RRxR RYRRyR€RtRr(R9RftbufRt transformer((R9sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRŠ…s2            N(RoRpRqRRR€R|R2RuRYR:tpropertyR{R~RAR†R‡RCRIR‰RGRŠ(((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyRrÇs""      *(.RqR]R6R*R0RQtIPython.utils.py3compatRtIPython.core.inputtransformerRRRRRRRRR R R R R RRRRRRRRtcompileR$ReRtcomment_line_reRR#t MULTILINER&R'R)R,R3tobjectR4Rr(((sR/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/inputsplitter.pyts8     LF      ÿ#