NXc@sWdZddlmZddlZddlZddlZddlZyddlZWn?ek ryddl m ZWnek re ZnXnXddl Z ddl mZddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZmZmZmZdd lm Z ed e!fd YZ"edZ#ee k rej$Z$ej%Z%n8ede&fdYZ$ede&fdYZ%edZ'defdYZ(de(fdYZ)de)fdYZ*de j+fdYZ,ej-dej.Z/dZ0dZ1dS(s* History related magics and functionality i(tprint_functionN(tdbapi2(t Configurable(t decorator(tundoc(tlocate_profile(t py3compat(tAnytBooltDicttInstancetIntegertListtUnicodet TraitError(twarntDummyDBcBs2eZdZdZdZdZdZRS(s_Dummy DB that will act as a black hole for history. Only used in the absence of sqlitecOsgS(N((targstkwargs((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytexecute1scOsdS(N((tselfRR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytcommit4scOsdS(N((RRR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt __enter__7scOsdS(N((RRR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt__exit__:s(t__name__t __module__t__doc__RRRR(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR,s    cOs.tdks|j rgS||||SdS(s9Decorator: return an empty list in the absence of sqlite.N(tsqlite3tNonetenabled(tfRtatkw((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt needs_sqlite>st DatabaseErrorcBseZdZRS(sFDummy exception when sqlite could not be imported. Should never occur.(RRR(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR"KstOperationalErrorcBseZdZRS(sFDummy exception when sqlite could not be imported. Should never occur.(RRR(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR#OscOsy||||SWnttfk rtjj|jrtjj|j\}}|d|}tj|j||jt dd|dgSnXdS(sA decorator which wraps HistoryAccessor method calls to catch errors from a corrupt SQLite database, move the old database out of the way, and create a new one. s-corrupts3ERROR! History file wasn't a valid SQLite database.sIt was moved to %ssand a new file created.N( R"R#tostpathtisfilet hist_filetsplitexttrenametinit_dbtprint(RRRR tbasetexttnewpath((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytcatch_corrupt_dbSs tHistoryAccessorBasecBsbeZdZdeeedZdeeededZddeedZeedZ RS( s(An abstract class for History Accessors i cCs tdS(N(tNotImplementedError(Rtntrawtoutputtinclude_latest((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytget_tailmst*cCs tdS(N(R1(RtpatternR3t search_rawR4R2tunique((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytsearchpsicCs tdS(N(R1(RtsessiontstarttstopR3R4((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt get_rangetscCs tdS(N(R1(RtrangestrR3R4((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytget_range_by_strwsN( RRRtTruetFalseR6RR;R?RA(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR0js  tHistoryAccessorcBs.eZdZededdZeededdZededdZ e Z dZ ddd Z dd Zed Zd Zeed ZeedZedZedeeedZedeeededZeddeedZeedZRS(sAccess the history database without adding to it. This is intended for use by standalone history tools. IPython shells use HistoryManager, below, which is a subclass of this.tconfigthelps<Path to file to use for SQLite history database. By default, IPython will put the history database in the IPython profile directory. If you would rather share one history among profiles, you can set this value in each, so that they are consistent. Due to an issue with fcntl, SQLite is known to misbehave on some NFS mounts. If you see IPython hanging, try setting this to something on a local disk, e.g:: ipython --HistoryManager.hist_file=/tmp/ipython_hist.sqlite s2enable the SQLite history set enabled=False to disable the SQLite history, in which case there will be no stored history, no SQLite connection, and no background saving thread. This may be necessary in some threaded environments where IPython is embedded. sOptions for configuring the SQLite connection These options are passed as keyword args to sqlite3.connect when establishing database conenctions. cCs_tf}tdk r'ttjf}nt||s[d|jj|f}t|ndS(sCvalidate the db, since it can be an Instance of two different typess3%s.db must be sqlite3 Connection or DummyDB, not %rN(RRRt Connectiont isinstancet __class__RR(Rtnametoldtnewtconnection_typestmsg((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt _db_changeds  tdefaultucKstt|j||r(||_n|jdkrL|j||_ntdkrw|jrwtdt |_n|j dS(sCreate a new history accessor. Parameters ---------- profile : str The name of the profile from which to open history. hist_file : str Path to an SQLite history database stored by IPython. If specified, hist_file overrides profile. config : :class:`~traitlets.config.loader.Config` Config object. hist_file can also be set through this. us?IPython History requires SQLite, your history will not be savedN( tsuperRDt__init__R't_get_hist_file_nameRRRRRCR*(RtprofileR'ttraits((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRRs   cCstjjt|dS(s(Find the history file for the given profile name. This is overridden by the HistoryManager subclass, to use the shell's active profile. Parameters ---------- profile : str The name of a profile which has a history file. shistory.sqlite(R$R%tjoinR(RRT((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRSs cCs|jst|_dStdtjtjB}|j|jtj |j ||_|jj d|jj d|jj d|jj dS(s8Connect to the database, and create tables if necessary.Nt detect_typessCREATE TABLE IF NOT EXISTS sessions (session integer primary key autoincrement, start timestamp, end timestamp, num_cmds integer, remark text)sCREATE TABLE IF NOT EXISTS history (session integer, line integer, source text, source_raw text, PRIMARY KEY (session, line))sCREATE TABLE IF NOT EXISTS output_history (session integer, line integer, output text, PRIMARY KEY (session, line))( RRtdbtdictRtPARSE_DECLTYPEStPARSE_COLNAMEStupdatetconnection_optionstconnectR'RR(RR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR*s     cCsdS(sWOverridden by HistoryManager to dump the cache before certain database lookups.N((R((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytwriteout_cachescCsl|r dnd}d}|r1d}d|}n|jjd||f||}|rhd|DS|S(sPrepares and runs an SQL query for the history database. Parameters ---------- sql : str Any filtering expressions to go after SELECT ... FROM ... params : tuple Parameters passed to the SQL query (to replace "?") raw, output : bool See :meth:`get_range` Returns ------- Tuples as :meth:`get_range` t source_rawtsourcethistorys6history LEFT JOIN output_history USING (session, line)s!history.%s, output_history.outputs!SELECT session, line, %s FROM %s css0|]&\}}}}||||ffVqdS(N((t.0tsestlintinptout((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pys s(RXR(RtsqltparamsR3R4ttogettsqlfromtcur((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_run_sqls  cCs"d}|jj||fjS(s.Get info about a session. Parameters ---------- session : int Session number to retrieve. Returns ------- session_id : int Session ID number start : datetime Timestamp for the start of the session. end : datetime Timestamp for the end of the session, or None if IPython crashed. num_cmds : int Number of commands run, or None if IPython crashed. remark : unicode A manually set description. s)SELECT * from sessions where session == ?(RXRtfetchone(RR<tquery((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytget_session_infoscCs,x%|jdddtD] }|dSWdS(sGet the last session ID currently in the database. Within IPython, this should be the same as the value stored in :attr:`HistoryManager.session_number`. R2iR5iN(R6RB(Rtrecord((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytget_last_session_id2si cCsh|j|s|d7}n|jd|fd|d|}|sXtt|dStt|S(sGet the last n lines from the history database. Parameters ---------- n : int The number of lines to get raw, output : bool See :meth:`get_range` include_latest : bool If False (default), n+1 lines are fetched, and the latest one is discarded. This is intended to be used where the function is called by a user command, which it should not return. Returns ------- Tuples as :meth:`get_range` is(ORDER BY session DESC, line DESC LIMIT ?R3R4(R_Rmtreversedtlist(RR2R3R4R5Rl((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR6<s   R7c Cs|r dnd}|r%d|}n|jd|}|f} |r^|dj|7}n|d k r|d7}| |f7} n|r|d7}n|j|| d|d |} |d k rtt| S| S( shSearch the database using unix glob-style matching (wildcards * and ?). Parameters ---------- pattern : str The wildcarded pattern to match when searching search_raw : bool If True, search the raw input, otherwise, the parsed input raw, output : bool See :meth:`get_range` n : None or int If an integer is given, it defines the limit of returned entries. unique : bool When it is true, return only unique entries. Returns ------- Tuples as :meth:`get_range` R`Rashistory.sWHERE %s GLOB ?s GROUP BY {0}s) ORDER BY session DESC, line DESC LIMIT ?s ORDER BY session, lineR3R4N(R_tformatRRmRsRt( RR8R3R9R4R2R:ttosearchtsqlformRiRl((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR;Xs"        icCsP|rd}|||f}nd}||f}|jd||d|d|S(sRetrieve input by session. Parameters ---------- session : int Session number to retrieve. start : int First line to retrieve. stop : int End of line range (excluded from output itself). If None, retrieve to the end of the session. raw : bool If True, return untranslated input output : bool If True, attempt to include output. This will be 'real' Python objects for the current session, or text reprs from previous sessions if db_log_output was enabled at the time. Where no output is found, None is used. Returns ------- entries An iterator over the desired lines. Each line is a 3-tuple, either (session, line, input) if output is False, or (session, line, (input, output)) if output is True. sline >= ? AND line < ?sline>=?sWHERE session==? AND %sR3R4(Rm(RR<R=R>R3R4t lineclauseRi((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR?s  c csUxNt|D]@\}}}x.|j|||d|d|D] }|Vq>Wq WdS(sGet lines of history from a string of ranges, as used by magic commands %hist, %save, %macro, etc. Parameters ---------- rangestr : str A string specifying ranges, e.g. "5 ~2/1-4". See :func:`magic_history` for full details. raw, output : bool As :meth:`get_range` Returns ------- Tuples as :meth:`get_range` R3R4N(textract_hist_rangesR?(RR@R3R4tsesststetline((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRAs(N(RRRR RBR'RRR R]RRXRORRRSR/R*R_RCRmR!RpRrR6RR;R?RA(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRD{s2          (%tHistoryManagercBseZdZeddeZedgZedgZeZ dZ e Z e Z eZeededdZeddedd ZeZeZed deZyeejdeZWn&ek reejdeZnXed Zed Zed Zed Z e!j"d Z#ddd Z%ddZ&e'ddZ(dZ)dZ*edZ+ddZ,ddeedZ-dddeedZ.ddZ/dZ0dZ1dZ2e'ddZ3RS(sHA class to organize all history-related functionality in one place. s1IPython.core.interactiveshell.InteractiveShellABCt allow_nonetcCs*ytjgSWntk r%gSXdS(N(RtgetcwdtOSError(R((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_dir_hist_defaults RERFs9Should the history database include output? (default: no)is}Write to database every x commands (higher values save disk access & power). Values of 1 or less effectively disable caching.s(IPython.core.history.HistorySavingThreadus(exit|quit)(\s*\(.*\))?$cKstt|jd|d||tj|_tj|_tj|_|j r|j dkrt ||_ |j j n|jdS(sGCreate a new history manager associated with a shell instance. tshellREs:memory:N(RQR~RRt threadingtEventt save_flagtLocktdb_input_cache_locktdb_output_cache_lockRR'tHistorySavingThreadt save_threadR=t new_session(RRRERU((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRRscCs"|jjj}tjj|dS(sGet default history file name based on the Shell's profile. The profile parameter is ignored, but must exist for compatibility with the parent class.shistory.sqlite(Rt profile_dirtlocationR$R%RV(RRTR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRS scCsS|dkr|j}n|/|jdtjjf}|j|_WdQXdS(sGet a new session number.sRINSERT INTO sessions VALUES (NULL, ?, NULL, NULL, "") N(RRXRtdatetimetnowt lastrowidtsession_number(RtconnRl((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRs   c Cs\|j|j:|jjdtjjt|jd|jfWdQXd|_dS(sCClose the database session, filling in the end time and line count.sRUPDATE sessions SET end=?, num_cmds=? WHERE session==?iNi(R_RXRRRtlentinput_hist_parsedR(R((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt end_sessions    #cCs0|j!|jjd||jfWdQXdS(s8Give the current session a name in the history database.s-UPDATE sessions SET remark=? WHERE session==?N(RXRR(RRJ((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt name_session&s  cCsg|jjtjg|j(|rc|jr<|jndg|j(dg|j(|j ndS(sfClear the session history, releasing all object references, and optionally open a new session.RN( t output_histtclearRRtdir_histRRRtinput_hist_rawR(RR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytreset,s     cCs5|dkr||j7}ntt|jd|S(sGet info about a session. Parameters ---------- session : int Session number to retrieve. The current session is 0, and negative numbers count back from current session, so -1 is the previous session. Returns ------- session_id : int Session ID number start : datetime Timestamp for the start of the session. end : datetime Timestamp for the end of the session, or None if IPython crashed. num_cmds : int Number of commands run, or None if IPython crashed. remark : unicode A manually set description. iR<(RRQR~Rp(RR<((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRp=s ic cs|r|jn|j}t|}|dkr=||7}n| sP||krY|}n|dkrr||7}nxTt||D]C}|r|||jj|f}n ||}d||fVqWdS(sqGet input and output history from the current session. Called by get_range, and takes similar parameters.iN(RRRtrangetoutput_hist_reprstget( RR=R>R3R4t input_histR2tiR}((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_get_range_sessionZs       cCsc|dkr||j7}n||jkrA|j||||Stt|j|||||S(s'Retrieve input by session. Parameters ---------- session : int Session number to retrieve. The current session is 0, and negative numbers count back from current session, so -1 is previous session. start : int First line to retrieve. stop : int End of line range (excluded from output itself). If None, retrieve to the end of the session. raw : bool If True, return untranslated input output : bool If True, attempt to include output. This will be 'real' Python objects for the current session, or text reprs from previous sessions if db_log_output was enabled at the time. Where no output is found, None is used. Returns ------- entries An iterator over the desired lines. Each line is a 3-tuple, either (session, line, input) if output is False, or (session, line, (input, output)) if output is True. i(RRRQR~R?(RR<R=R>R3R4((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR?ns  cCsQ|dkr|}n|jd}|jd}|jj|jrOdS|jj||jj||jF|j j|||ft |j |j kr|j j nWdQX|j|_|j|_|j|_||_d|}i|jd6|jd6|jd6|j|6}|jdk rM|jj|dtndS(sStore source and raw input in history and create input cache variables ``_i*``. Parameters ---------- line_num : int The prompt number of this input. source : str Python input. source_raw : str, optional If given, this is the raw input without any IPython transformations applied to it. If not given, ``source`` is used. s Ns_i%st_it_iit_iiit interactive(Rtrstript_exit_retmatchtstripRtappendRRtdb_input_cacheRt db_cache_sizeRtsetRRRt_i00RtpushRC(Rtline_numRaR`tnew_itto_main((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt store_inputss.            cCss|j s||jkrdS|j|}|j|jj||fWdQX|jdkro|jjndS(s5If database output logging is enabled, this saves all the outputs from the indicated prompt number to the database. It's called by run_cell after code has been executed. Parameters ---------- line_num : int The line number from which to save outputs Ni(t db_log_outputRRtdb_output_cacheRRRR(RRR4((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt store_outputs   c Cs?|3x+|jD] }|jd|jf|qWWdQXdS(Ns'INSERT INTO history VALUES (?, ?, ?, ?)(RRR(RRR}((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_writeout_input_caches c Cs?|3x+|jD] }|jd|jf|qWWdQXdS(Ns+INSERT INTO output_history VALUES (?, ?, ?)(RRR(RRR}((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_writeout_output_caches c Cs|dkr|j}n|jzty|j|Wn\tjk r|j|tdd|jy|j|Wqtjk rqXnXWdg|_ XWdQX|j Kz9y|j |Wn!tjk rtddnXWdg|_ XWdQXdS(s/Write any entries in the cache to the database.s,ERROR! Session/line number was not unique ins.database. History logging moved to new sessionNs0!! Session/line number for output was not uniques'in database. Output will not be stored.( RRXRRRtIntegrityErrorRR+RRRRR(RR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR_s0       N(4RRRR RBRR RRRRR RRR RRRCRRRRRRt_EventRtAttributeErrorRR RRRRtretcompileRRRRRSR!RRRRRpRR?RRRRR_(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR~sV                      & 2   RcBsAeZdZeZeZeZdZe dZ dZ RS(s;This thread takes care of writing history to the database, so that the UI isn't held up while that happens. It waits for the HistoryManager's save_flag to be set, then writes out the history cache. The main thread is responsible for setting the flag when the cache size reaches a defined threshold.cCsBtt|jdd||_|j|_tj|jdS(NRJtIPythonHistorySavingThread(RQRRRthistory_managerRtatexittregisterR>(RR((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRRs  cCsytj|jj|jj|_xWtr}|jjj|j rW|jj dS|jjj |jj |jq'WWn't k r}tdt|nXdS(NscThe history saving thread hit an unexpected error (%s).History will not be written to the database.(RR^RR'R]RXRBRtwaittstop_nowtcloseRR_t ExceptionR+trepr(RR|((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytruns   cCs't|_|jjj|jdS(sThis can be called from the main thread to safely stop this thread. Note that it does not attempt to write out remaining history before exiting. That should be done by calling the HistoryManager's end_session method.N(RBRRRRRV(R((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyR>(s ( RRRRBtdaemonRCRRRRR!RR>(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRs sc ((?P~?\d+)/)? (?P\d+)? ((?P[\-:]) ((?P~?\d+)/)? (?P\d+))? $ccsx|jD]}tj|}|s.q n|jd}|r}t|}|jd}|rpt|n|d}n!|jdsq nd}d }|jddkr|d7}n|jdpd}|jdp|}t|jd d}t|jd d}||ks2td ||krR|||fVq n||d fVx)t|d|D]}|dd fVqtW|d|fVq Wd S( sTurn a string of history ranges into 3-tuples of (session, start, stop). Examples -------- >>> list(extract_hist_ranges("~8/5-~7/4 2")) [(-8, 5, None), (-7, 1, 5), (0, 2, 3)] R=tendit startsesstsept-t0tendsesst~s.start session must be earlier than end sessionN( tsplittrange_reRtgrouptintRtreplacetAssertionErrorR(t ranges_strt range_strtrmatchR=RRRRz((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyRy=s6   cCs$|dkrt|Sd||fS(s0Helper function to format line numbers properly.is%s#%s(tstr(R<R}((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pyt_format_linenogs  (2Rt __future__RRRR$RRt ImportErrort pysqlite2RRRttraitlets.config.configurableRRtIPython.utils.decoratorsRtIPython.utils.pathRt IPython.utilsRt traitletsRRR R R R R RtIPython.utils.warnRtobjectRR!R"R#RR/R0RDR~tThreadRRtVERBOSERRyR(((sL/data/av2000/mvv/env_mvv/lib/python2.7/site-packages/IPython/core/history.pytsR        :   CJ. *