o ^i( @sdZdZddgZddlZddlZddlZddlZddlZddlm Z m Z ddl m Z ddl mZmZdd lmZdd lmZmZmZmZmZdd lmZdd lmZdd lmZddlmZmZm Z m!Z!m"Z"ee#dfZ$eGdddZ%GdddZ&GdddZ'd/de$dee$de#fddZ(     d0de#dee#de)d e)d!eedef d"dZ*d#e#d$e#de)fd%d&Z+ d/d'e#d(e#dee$dejfd)d*Z,d+e#de)fd,d-Z-e.d.kre/e0e- dSdS)1zZParser driver. This provides a high-level interface to parse a file into a syntax tree. z#Guido van Rossum Driver load_grammarN)IterableIterator)contextmanager) dataclassfield)Logger)IOAnyOptionalUnioncast)Grammar) TokenInfo)NL)grammarparsepgentokentokenizezos.PathLike[str]c@sFeZdZUeed<dZeeed<eedZ ee ed<d ddZ dS) ReleaseRangestartNend)default_factorytokensreturncCst|j}|j||_dSN)lenrrr)self total_eatenr"Z/var/www/html/stock_analysis/be/venv/lib/python3.10/site-packages/blib2to3/pgen2/driver.pylock.s zReleaseRange.lock)rN) __name__ __module__ __qualname__int__annotations__rr rlistrr r$r"r"r"r#r(s rc@speZdZdeddfddZededfddZdedefd d Z dd d Z defd dZ dede fddZ dS) TokenProxy generatorrNcCs||_d|_g|_dS)Nr)_tokens_counter_release_ranges)r r,r"r"r#__init__4s zTokenProxy.__init__ccs8t|j}|j|z |VW|dS|wr)rr.r/appendr$)r release_ranger"r"r#release9s   zTokenProxy.releasepointcCsP|jdj}|t|kr||S|t|kr&t|j}|||t|ks|S)N)r/rrnextr-r1)r r4 eaten_tokensrr"r"r#eatDs      zTokenProxy.eatcCs|Srr")r r"r"r#__iter__NszTokenProxy.__iter__cCsr|jD]'}|jdus J|j|j}}||jkr|kr*nq|j|j|}nqt|j}|jd7_|S)Nr)r/rrr.rr6r-)r r2rrrr"r"r#__next__Qs  zTokenProxy.__next__tocCs&z||WdStyYdSw)NFT)r8 StopIteration)r r;r"r"r# can_advanceas   zTokenProxy.can_advance)rr+)r%r&r'r r0rrr3r(r8r9r:boolr=r"r"r"r#r+3s r+c @seZdZddedeeddfddZddeed e de fd d Z dd e d ee d e de fddZdde d e de fddZde dedee e ffddZdS)rNrloggerrcCs"||_|dur tt}||_dSr)rlogging getLoggerr%r?)r rr?r"r"r#r0ms  zDriver.__init__FrdebugcCs2t|}t|j}|j|dd}d}g}d}} } } } d} |D]}|\}} } } } | ||fkrc||f| ksAJ||f| f| \}}||krU| d||7} |}d}||krc| | ||7} |}|tjtjfvr| | 7} | \}}| dr~|d7}d}q$|t j krtj | }|r|dusJ|j dt j|| | |t jkr|t| | | }d} d} n|t jkr|}|| |\} }|tt|| | | fr|r|j dn5d} |t jt jhvr|} | \}}| dr|t jt jfvr|d7}d}q$| dusJtd || | | f|jdusJ|jS) z4Parse a series of tokens and return the syntax tree.)proxyrrN z%s %r (prefix=%r)zStop.zincomplete input)r+rParserrsetuprCOMMENTrendswithrOPopmapr?rBtok_nameINDENTr1rDEDENTpop_partially_consume_prefixaddtokenrr(FSTRING_MIDDLETSTRING_MIDDLE ParseErrorrootnode)r rrBrCplinenocolumnindent_columnstypevaluerr line_textprefix quintuples_linenos_column_prefix _indent_colr"r"r# parse_tokensssz           zDriver.parse_tokensfilenameencodingcCs@t||d }|}Wdn1swY|||S)z(Parse a file and return the syntax tree.)reN)openread parse_string)r rdrerBstreamtextr"r"r# parse_files  zDriver.parse_filerjcCstj||jd}|||S)z*Parse a string and return the syntax tree.)r)rrrc)r rjrBrr"r"r#rhs zDriver.parse_stringr]rXc Csg}d}d}d}|D]J}||7}|r;|dkr:|r/||kr/d|}||t|dfS||d}d}d}q |dvrD|d7}q |dkrKd}q |dkrRd}q d}q d||fS) NrDrFrEz r T)stripjoinrr1) r r]rXlines current_linecurrent_column wait_for_nlcharresr"r"r#rPs0   z Driver._partially_consume_prefixr)F)NF)r%r&r'rr r r0rrr>rrcPathstrrkrhr(tuplerPr"r"r"r#rlsI "gt cache_dirrcCsXtj|\}}|dkrd}||dtttjd}|r*tj|tj|S|S)Nz.txtrD.z.pickle) ospathsplitextrnmaprvsys version_infobasename)rxryheadtailnamer"r"r#_generate_pickle_namesr Grammar.txtTFgpsaveforcer?cCs|dur tt}|durt|n|}|st||s6t|}|r4z||W|Sty3Y|Sw|St }| ||S)z'Load the grammar (maybe from a pickle).N) r@rAr%r_newerrgenerate_grammardumpOSErrorrrload)rxrrrr?gr"r"r#rs"     abcCs8tj|sdStj|sdStj|tj|kS)z0Inquire whether file a was written since file b.FT)r{r|existsgetmtime)rrr"r"r#r s  rpackagegrammar_sourcecCsjtj|r|r t||nd}t||dSttj||}t||}|dus*Jt }| ||S)aNormally, loads a pickled grammar by doing pkgutil.get_data(package, pickled_grammar) where *pickled_grammar* is computed from *grammar_source* by adding the Python version and using a ``.pickle`` extension. However, if *grammar_source* is an extant file, load_grammar(grammar_source) is called instead. This facilitates using a packaged grammar file when needed but preserves load_grammar's automatic regeneration behavior when possible. N)r) r{r|isfilerrrpkgutilget_datarrloads)rrryr pickled_namedatarr"r"r#load_packaged_grammars     rargscGsF|s ttjdd}tjtjtjdd|D] }t|dddqdS)zMain program, when run as a script: produce grammar pickle files. Calls load_grammar for each argument, a path to a grammar text file. rNz %(message)s)levelriformatT)rr)rwrargvr@ basicConfigINFOstdoutr)rrxr"r"r#main+s r__main__r)rNTFN)1__doc__ __author____all__ior@r{rrcollections.abcrr contextlibr dataclassesrrr typingr r r r rblib2to3.pgen2.grammarrblib2to3.pgen2.tokenizerblib2to3.pytreerrDrrrrrrvrurr+rrr>rrrrr%exitr(r"r"r"r#sp       9z