3
\�2 � @ s� d Z ddlZddlZddlZddlmZ ddlmZ dddgZG dd� d�Z dd d�Z
ej d ej �j
Zd
d� Zdd� Zedkr�eej�dkr�ee � � n,ejd Zee��Zee ee�� W dQ R X dS )z8A lexical analyzer class for simple shell-like syntaxes.� N)�deque)�StringIO�shlex�split�quotec @ sf e Zd ZdZddd�Zdd� Zddd �Zd
d � Zd d
� Zdd� Z dd� Z
ddd�Z dd� Z dd� Z
dS )r z8A lexical analyzer class for simple shell-like syntaxes.NFc C s t |t�rt|�}|d k r(|| _|| _ntj| _d | _|| _|rHd | _nd| _d| _ d| _
| jrn| j
d7 _
d| _ d| _ d| _
d| _d | _d
| _t� | _d | _d | _d| _t� | _d | _|s�d}n |d
kr�d}|| _|�rt� | _| j
d7 _
| j
jtj |��}| j
j |�| _
d S )N� �#Z?abcdfeghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789_u| ßàáâãäåæçèéêëìíîïðñòóôõöøùúûüýþÿÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖØÙÚÛÜÝÞz
Fz'"�\�"� � r Tz();<>|&z~-./*?=) �
isinstance�strr �instream�infile�sys�stdin�posix�eof�
commenters� wordchars�
whitespace�whitespace_split�quotes�escape�
escapedquotes�stater �pushback�lineno�debug�token� filestack�source�punctuation_chars�_pushback_chars� maketrans�dict�fromkeys� translate)�selfr r r r# �t� r+ � /usr/lib64/python3.6/shlex.py�__init__ sJ
zshlex.__init__c C s* | j dkrtdt|� � | jj|� dS )z:Push a token onto the stack popped by the get_token methodr zshlex: pushing token N)r �print�reprr �
appendleft)r) �tokr+ r+ r, �
push_tokenD s
zshlex.push_tokenc C sp t |t�rt|�}| jj| j| j| jf� || _|| _d| _| jrl|dk r\t d| jf � nt d| jf � dS )z9Push an input source onto the lexer's input source stack.r Nzshlex: pushing to file %szshlex: pushing to stream %s)
r
r r r! r0 r r r r r. )r) � newstream�newfiler+ r+ r, � push_sourceJ s
zshlex.push_sourcec C sD | j j� | jj� \| _| _ | _| jr:td| j | jf � d| _dS )zPop the input source stack.z shlex: popping to %s, line %dr N) r �closer! �popleftr r r r. r )r) r+ r+ r, �
pop_sourceX s
zshlex.pop_sourcec C s� | j r.| j j� }| jdkr*tdt|� � |S | j� }| jdk r~x<|| jkr|| j| j� �}|rr|\}}| j||� | j � }qBW x*|| j
kr�| j s�| j
S | j � | j � }q�W | jdkr�|| j
kr�tdt|� � ntd� |S )zBGet a token from the input stream (or from stack if it's nonempty)r zshlex: popping token Nz
shlex: token=zshlex: token=EOF)
r r7 r r. r/ �
read_tokenr" �
sourcehookr5 � get_tokenr r! r8 )r) r1 �raw�specr4 r3 r+ r+ r, r; a s.
zshlex.get_tokenc C s� d}d}�x\| j r$| jr$| jj� }n | jjd�}|dkrF| jd7 _| jdkrbtd| j|f � | jd krvd| _ P q | jdk�r�|s�d | _P �qd|| j
kr�| jdkr�td � | j s�| j r |r P nq n�|| j kr�| jj
� | jd7 _n�| j o�|| jk�rd
}|| _n�|| jk�r"|| _ d
| _np|| j k�r<|| _ d | _nV|| jk�r^| j �sV|| _ || _n4| j�rt|| _ d
| _n || _ | j �s�| j r |r P nq q | j| jk�r<d }|�s�| jdk�r�td
� td��|| jk�r�| j �s�| j |7 _ d| _P nd
| _n>| j �r,|| jk�r,| j| jk�r,| j}|| _n| j |7 _ q | j| jk�r�|�sl| jdk�rdtd� td��|| jk�r�|| jk�r�||k�r�| j | j7 _ | j |7 _ || _q | jdkr |�s�d | _P q || j
k�r| jdk�r�td� d| _| j �s| j r |r P nq q || j k�rZ| jj
� | jd7 _| j �rdd| _| j �sR| j r |r P nq q | jd k�r�|| j k�r�| j |7 _ n || j
k�r�| jj|� d| _P q | j �r�|| jk�r�|| _q | j �r�|| jk�r�d
}|| _q || jk�s || jk�s | j�r| j |7 _ q | j �r&| jj|� n | jj|� | jdk�rFtd� d| _| j �s^| j r |r P q q q W | j }d| _ | j �r�| �r�|dk�r�d }| jdk�r�|�r�tdt|� � ntd� |S )NFr r �
� z&shlex: in state %r I see character: %rr � z+shlex: I see whitespace in whitespace state�a�cTz shlex: I see EOF in quotes statezNo closing quotationz shlex: I see EOF in escape statezNo escaped characterz%shlex: I see whitespace in word statez&shlex: I see punctuation in word statezshlex: raw token=zshlex: raw token=EOF)rA rB )r# r$ �popr �readr r r. r r r r r �readliner r r r �
ValueErrorr �appendr r0 r/ )r) ZquotedZ escapedstateZnextchar�resultr+ r+ r, r9 � s�
zshlex.read_tokenc C sX |d dkr|dd� }t | jt�rJtjj|� rJtjjtjj| j�|�}|t|d�fS )z(Hook called on a filename to be sourced.r r
r �r���) r
r r �os�path�isabs�join�dirname�open)r) r4 r+ r+ r, r: s
zshlex.sourcehookc C s( |dkr| j }|dkr | j}d||f S )z<Emit a C-compiler-like, Emacs-friendly error-message leader.Nz"%s", line %d: )r r )r) r r r+ r+ r, � error_leader s
zshlex.error_leaderc C s | S )Nr+ )r) r+ r+ r, �__iter__# s zshlex.__iter__c C s | j � }|| jkrt�|S )N)r; r �
StopIteration)r) r r+ r+ r, �__next__& s
zshlex.__next__)NNFF)N)NN)�__name__�
__module__� __qualname__�__doc__r- r2 r5 r8 r; r9 r: rQ rR rT r+ r+ r+ r, r s
.
FTc C s$ t | |d�}d|_|s d|_t|�S )N)r Tr )r r r �list)�sZcommentsr Zlexr+ r+ r, r , s
z[^\w@%+=:,./-]c C s, | sdS t | �dkr| S d| jdd� d S )z1Return a shell-escaped version of the string *s*.z''N�'z'"'"')� _find_unsafe�replace)rZ r+ r+ r, r 6 s
c C s( x"| j � }|sP tdt|� � qW d S )NzToken: )r; r. r/ )ZlexerZttr+ r+ r, �
_print_tokensB s
r^ �__main__r )FT)rX rK �rer � collectionsr �ior �__all__r r �compile�ASCII�searchr\ r r^ rU �len�argv�fnrP �fr+ r+ r+ r, �<module> s&