� e f� � @ s� d Z d d d d g Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d! Z d" Z d# Z d$ Z! d% Z" d& Z# d' Z$ d( Z% d) Z& d* Z' d+ Z( d, Z) d- Z* d. Z+ d/ Z, d0 Z- d1 Z. d2 Z/ d3 Z0 d4 Z1 d5 Z2 d6 Z3 d7 Z4 d8 Z5 d9 Z6 d: Z7 d; Z8 d< Z9 d= d> � e: � j; � D� Z< e j= e< j> � � d? d � Z? d@ d � Z@ dA d � ZA dB dC � ZB eC dD k r�eB � n dE S)Fz!Token constants (from "token.h").�tok_name� ISTERMINAL� ISNONTERMINAL�ISEOF� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �! �" �# �$ �% �& �' �( �) �* �+ �, �- �. �/ �0 �1 �2 �3 �4 �5 �6 � c C s> i | ]4 \ } } t | t � r | j d � r | | � q S)�_)� isinstance�int� startswith)�.0�name�value� rD �*/opt/alt/python34/lib64/python3.4/token.py� <dictcomp>G s rF c C s | t k S)N)� NT_OFFSET)�xrD rD rE r L s c C s | t k S)N)rG )rH rD rD rE r O s c C s | t k S)N)� ENDMARKER)rH rD rD rE r R s c 5 C s d d l } d d l } | j d d � } | r; | d p> d } d } t | � d k rf | d } n y t | � } WnL t k r� } z, | j j d t | � � | j d � WYd d } ~ Xn X| j � j d � } | j � | j d | j � } i } xT | D]L } | j | � } | r| j d d � \ } } t | � } | | | <qqWt | j � � } y t | � } WnL t k r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| j � j d � } | j � y& | j d � d } | j d � } Wn/ t k r=| j j d � | j d � Yn Xg } x) | D]! } | j d | | | f � qKW| | | | � <y t | d � } WnL t k r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| j d j | � � | j � d S)Nr r zInclude/token.hz Lib/token.pyzI/O error: %s � z:#define[ ][ ]*([A-Z0-9][A-Z0-9_]*)[ ][ ]*([0-9][0-9]*)r z#--start constants--z#--end constants--z&target does not contain format markersr z%s = %d�wr )�re�sys�argv�len�open�OSError�stdout�write�str�exit�read�split�close�compile� IGNORECASE�match�groupr? �sorted�keys�stderr�index� ValueError�append�join)rL rM �args� inFileName� outFileName�fp�err�lines�prog�tokens�liner[ rB �valr^ �format�start�endrD rD rE �_mainV sb rq �__main__N)D�__doc__�__all__rI �NAME�NUMBER�STRING�NEWLINE�INDENT�DEDENT�LPAR�RPAR�LSQB�RSQB�COLON�COMMA�SEMI�PLUS�MINUS�STAR�SLASH�VBAR�AMPER�LESS�GREATER�EQUAL�DOT�PERCENT�LBRACE�RBRACE�EQEQUAL�NOTEQUAL� LESSEQUAL� GREATEREQUAL�TILDE� CIRCUMFLEX� LEFTSHIFT� RIGHTSHIFT� DOUBLESTAR� PLUSEQUAL�MINEQUAL� STAREQUAL� SLASHEQUAL� PERCENTEQUAL� AMPEREQUAL� VBAREQUAL�CIRCUMFLEXEQUAL�LEFTSHIFTEQUAL�RIGHTSHIFTEQUAL�DOUBLESTAREQUAL� DOUBLESLASH�DOUBLESLASHEQUAL�AT�RARROW�ELLIPSIS�OP� ERRORTOKEN�N_TOKENSrG �globals�itemsr �extend�valuesr r r rq �__name__rD rD rD rE �<module> s� 5