3
� �X8I � @ s� d Z ddlZddlmZ ddlmZ ddlmZ dgZej j
Z ej j
Zejj
Zej jZejjZejZejjZejZejZ ejZ ej j Z ej Z!d5dd �Z"G d
d� de�Z#G d d � d e$�Z%G d
d� de$�Z&G dd� de$�Z'G dd� de$�Z(G dd� de(�ZG dd� de(�Z)G dd� de(�Z*G dd� de)�Z+G dd � d e+�Z,G d d � d e(�ZG d d � d e(�Z-G d!d"� d"e$�Z.G d#d$� d$e(�Z/G d%d&� d&e(�Z0G d'd(� d(e$�Z1G d)d*� d*e1�Z2G d+d,� d,e1�Z3G d-d.� d.e1�Z4G d/d0� d0e1�Z5G d1d2� d2e5�Z6G d3d4� d4�Z7dS )6z�
pygments.lexers.robotframework
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lexer for Robot Framework.
:copyright: Copyright 2006-2017 by the Pygments team, see AUTHORS.
:license: BSD, see LICENSE for details.
� N)�Lexer)�Token)� text_type�RobotFrameworkLexer� c C s2 | j � } x$|d D ]}|| kr| j|d�} qW | S )N� r )�lower�replace)�string�remove�char� r
�$/usr/lib/python3.6/robotframework.py� normalize1 s
r c @ s8 e Zd ZdZdZdgZddgZdgZdd� Zd d
� Z d S ) r z�
For `Robot Framework <http://robotframework.org>`_ test data.
Supports both space and pipe separated plain text formats.
.. versionadded:: 1.6
ZRobotFrameworkZrobotframeworkz*.txtz*.robotztext/x-robotframeworkc K s" d|d< d|d< t j| f|� d S )N� �tabsizezUTF-8�encoding)r �__init__)�selfZoptionsr
r
r r F s z RobotFrameworkLexer.__init__c c sx t � }t� }d}xb|j� D ]V}xP|j|�D ]B\}}x8|j||�D ](\}}|r@||t|�fV |t|�7 }q@W q*W qW d S )Nr )� RowTokenizer�VariableTokenizer�
splitlines�tokenizer �len)r �textZ
row_tokenizerZ
var_tokenizer�index�row�value�tokenr
r
r �get_tokens_unprocessedK s z*RobotFrameworkLexer.get_tokens_unprocessedN)
�__name__�
__module__� __qualname__�__doc__�name�aliases� filenamesZ mimetypesr r r
r
r
r r 9 s c @ s e Zd Zdd� Zdd� ZdS )r c c s^ t |dd�}|jdk s"|ttfkr0||fV d S x(| j|||�D ]\}}|r@||fV q@W d S )Nz$@%&)� identifiersr )�VariableSplitter�start�COMMENT�ERROR� _tokenize)r r
r �varr r
r
r r Y s
zVariableTokenizer.tokenizec c s� |d |j � }||fV |jd tfV x$| j|jt�D ]\}}||fV q8W dtfV |jr�dtfV x$| j|jt�D ]\}}||fV qxW dtfV x,| j||jd � |�D ]\}}||fV q�W d S )N�{�}�[�])r) �
identifier�SYNTAXr �base�VARIABLEr �end)r r- r
Z
orig_tokenZbeforer r r
r
r r, b s
zVariableTokenizer._tokenizeN)r r! r" r r, r
r
r
r r W s r c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
r c C sN t � | _t� | _t� }t|j�}t� }t� }|||||||||||d� | _ d S )N) �settingsZsetting�metadata� variablesZvariable� testcasesZtestcase�keywords�keywordZ userkeywordsZ userkeyword)
� UnknownTable�_table� RowSplitter� _splitter�
TestCaseTable� SettingTable�set_default_template�
VariableTable� KeywordTable�_tables)r r: r7 r9 r; r
r
r r t s
zRowTokenizer.__init__c c s� d}d}x�t | jj|��D ]v\}}t|d d�\}}|jd�rDd}n"|dkrf|jd�rf| j|�| _d}x(| j|||||�D ]\}}||fV qzW qW | jj� d S )NF� r �#Tr �*) � enumerater@ �split�divmod�
startswith� _start_tabler> r, �end_row)r r � commented�headingr r � separatorr r
r
r r � s
zRowTokenizer.tokenizec C s t |dd�}| jj|t� �S )NrI )r )r rF �getr= )r �headerr$ r
r
r rN � s zRowTokenizer._start_tablec c sZ |r|t fV nF|r |tfV n6|r0|tfV n&x$| jj||�D ]\}}||fV q@W d S )N)r* � SEPARATOR�HEADINGr> r )r r r rP rR rQ r r
r
r r, � s zRowTokenizer._tokenizeN)r r! r" r r rN r, r
r
r
r r r s r c @ s8 e Zd Zejd�Zejd�Zdd� Zdd� Zdd� Z d S )
r? z( {2,})z((?:^| +)\|(?: +|$))c c s8 |j d�r| jp| j}x||�D ]
}|V q W dV d S )Nz| �
)rM �_split_from_pipes�_split_from_spaces)r r Zsplitterr r
r
r rK � s
zRowSplitter.splitc c s& dV x| j j|�D ]
}|V qW d S )Nr )�_space_splitterrK )r r r r
r
r rY � s z RowSplitter._split_from_spacesc c sV | j j|d�\}}}|V x0| j j|�rJ| j j|d�\}}}|V |V q W |V d S )NrG )�_pipe_splitterrK �search)r r �_rR �restZcellr
r
r rX � s
z RowSplitter._split_from_pipesN)
r r! r" �re�compilerZ r[ rK rY rX r
r
r
r r? � s
r? c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � ZdS )
� TokenizerNc C s
d| _ d S )Nr )�_index)r r
r
r r � s zTokenizer.__init__c C s8 | j || j�}| jd7 _t|tt��r4||fg}|S )NrG )r, rb �
isinstance�typer )r r Zvalues_and_tokensr
r
r r � s
zTokenizer.tokenizec C s t |t| j�d �}| j| S )NrG )�minr �_tokens)r r r r
r
r r, � s zTokenizer._tokenizec C s> |j d�r|d d� j� }t|dd�}|jdko<|jt|�kS )N�=rG z$@&)r' r ���)�endswith�stripr( r) r6 r )r r r- r
r
r �
_is_assign� s
zTokenizer._is_assign)r r! r" rf r r r, rk r
r
r
r ra � s
ra c @ s e Zd ZefZdS )�CommentN)r r! r" r* rf r
r
r
r rl � s rl c @ s6 e Zd ZeefZdZdZdZdZ ddd�Z
dd� Z dS )�Setting�
suitesetup�suiteprecondition�
suiteteardown�suitepostcondition� testsetup�testprecondition� testteardown�testpostcondition� testtemplate�library�resourcer9 �
documentationr8 � forcetags� defaulttags� testtimeoutNc C s t j| � || _d S )N)ra r �_template_setter)r �template_setterr
r
r r � s
zSetting.__init__c C s� |dkr| j r| j |� |dkrdt|�}|| jkr@tdd�| _qv|| jkrTt� | _qv|| jkrvtS n| jrv| jj |�S t
j | ||�S )NrG r F)�support_assign) r} r �_keyword_settings� KeywordCall�_custom_tokenizer�_import_settings�
ImportSetting�_other_settingsr+ r ra r, )r r r Z
normalizedr
r
r r, � s
zSetting._tokenize) rn ro rp rq rr rs rt ru rv )rw rx r9 )ry r8 rz r{ r| )N) r r! r" �SETTING�ARGUMENTrf r� r� r� r� r r, r
r
r
r rm � s
rm c @ s e Zd ZeefZdS )r� N)r r! r" �IMPORTr� rf r
r
r
r r� � s r� c @ s e Zd Zd Zf Zd
Zd d
� Zd S )�TestCaseSetting�setup� precondition�teardown�
postcondition�templatery �tags�timeoutc C sJ |dkr<t j| |dd� |�}dtf|dd� |fdtfgS t j| ||�S )Nr rG r0 r1 rh rh )rm r, r3 )r r r rd r
r
r r, s zTestCaseSetting._tokenizeN)r� r� r� r� r� )ry r� r� )r r! r" r� r� r� r, r
r
r
r r� � s
r� c @ s e Zd ZdZd ZdS )
�KeywordSettingr� ry � arguments�returnr� r� N)r� )ry r� r� r� r� )r r! r" r� r� r
r
r
r r� s r� c @ s e Zd ZeefZdd� ZdS )�Variablec C s& |dkr| j |� rtS tj| ||�S )Nr )rk r+ ra r, )r r r r
r
r r, s zVariable._tokenizeN)r r! r" r3 r� rf r, r
r
r
r r� s r� c @ s& e Zd ZeefZddd�Zdd� ZdS )r� Tc C s t j| � | | _d| _d S )Nr )ra r �_keyword_found�_assigns)r r r
r
r r s
zKeywordCall.__init__c C sR | j r$| j|�r$| jd7 _tS | j r>tj| ||| j �S d| _ t� j|t�S )NrG T) r� rk r� r3 ra r, �GherkinTokenizerr �KEYWORD)r r r r
r
r r, s zKeywordCall._tokenizeN)T)r r! r" r� r� rf r r, r
r
r
r r� s
r� c @ s" e Zd Zejdej�Zdd� ZdS )r� z^(Given|When|Then|And) c C sB | j j|�}|s||fgS |j� }|d |� tf||d � |fgS )N)�_gherkin_prefix�matchr6 �GHERKIN)r r r r� r6 r
r
r r * s
zGherkinTokenizer.tokenizeN)r r! r" r_ r` �
IGNORECASEr� r r
r
r
r r� ' s r� c @ s e Zd ZefZdS )�TemplatedKeywordCallN)r r! r" r� rf r
r
r
r r� 2 s r� c @ s e Zd Zdd� Zdd� ZdS )�ForLoopc C s t j| � d| _d S )NF)ra r �
_in_arguments)r r
r
r r 8 s
zForLoop.__init__c C s$ | j r
tp t}|j� dkr d| _ |S )N�IN�IN RANGET)r� r� )r� r� r3 �upper)r r r r r
r
r r, < s zForLoop._tokenizeN)r r! r" r r, r
r
r
r r� 6 s r� c @ sB e Zd ZdZddd�Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dS )�_TableNc C s | j � | _|| _g | _d S )N)�_tokenizer_class�
_tokenizer�_prev_tokenizer�_prev_values_on_row)r �prev_tokenizerr
r
r r F s
z_Table.__init__c c sL | j ||�r | j| _|tfV n x| j||�D ]
}|V q.W | jj|� d S )N)�
_continuesr� r� r3 r, r� �append)r r r Zvalue_and_tokenr
r
r r K s
z_Table.tokenizec s |dko t � fdd�� jD ��S )Nz...c 3 s | ]}� j |�V qd S )N)� _is_empty)�.0�t)r r
r � <genexpr>U s z$_Table._continues.<locals>.<genexpr>)�allr� )r r r r
)r r r� T s z_Table._continuesc C s |dkS )Nr �\)r r� r
)r r r
r
r r� X s z_Table._is_emptyc C s | j j|�S )N)r� r )r r r r
r
r r, [ s z_Table._tokenizec C s | j | jd� d S )N)r� )r r� )r r
r
r rO ^ s z_Table.end_row)N)
r r! r" r� r r r� r� r, rO r
r
r
r r� C s
r� c @ s e Zd ZeZdd� ZdS )r= c C s dS )NFr
)r r r r
r
r r� e s zUnknownTable._continuesN)r r! r" rl r� r� r
r
r
r r= b s r= c @ s e Zd ZeZdS )rD N)r r! r" r� r� r
r
r
r rD i s rD c @ s* e Zd ZeZddd�Zdd� Zdd� ZdS ) rB Nc C s t j| |� || _d S )N)r� r r} )r r~ r� r
r
r r p s zSettingTable.__init__c C s. |dkr t |�dkr t| j�| _tj| ||�S )Nr rv )r rm r} r� r� r, )r r r r
r
r r, t s zSettingTable._tokenizec C s | j | j| jd� d S )N)r� )r r} r� )r r
r
r rO y s zSettingTable.end_row)N)r r! r" rm r� r r, rO r
r
r
r rB m s
rB c @ sd e Zd ZeZdZdZedd� �Zdd� Z dd� Z
dd � Z d
d � Z d d
� Z
dd� Zdd� Zdd� ZdS )rA Nc C s | j s| jr| j dk rtS tS )NF)�_test_template�_default_templater� r� )r r
r
r r� � s
z TestCaseTable._tokenizer_classc C s |dkot j| ||�S )Nr )r� r� )r r r r
r
r r� � s zTestCaseTable._continuesc C s� |dkr |rd | _ t� j|t�S |dkr\| j|�r\| j|�rRd| _ | j| j�| _n
| j� | _|dkrv| j |�rvt
� | _|dkr�| j |�r�|t fgS t
j| ||�S )Nr rG F)r� r� r �
TC_KW_NAME� _is_setting� _is_template�_setting_class�set_test_templater� � _is_for_loopr� r� r3 r� r, )r r r r
r
r r, � s
zTestCaseTable._tokenizec C s |j d�o|jd�S )Nr0 r1 )rM ri )r r r
r
r r� � s zTestCaseTable._is_settingc C s t |�dkS )Nz
[template])r )r r r
r
r r� � s zTestCaseTable._is_templatec C s |j d�ot|dd�dkS )N�:)r �for)rM r )r r r
r
r r� � s zTestCaseTable._is_for_loopc C s | j |�| _d S )N)�_is_template_setr� )r r� r
r
r r� � s z TestCaseTable.set_test_templatec C s | j |�| _d S )N)r� r� )r r� r
r
r rC � s z"TestCaseTable.set_default_templatec C s t |�dkS )Nr r� �none�${empty})r r� r� r� )r )r r� r
r
r r� � s z TestCaseTable._is_template_set)r r! r" r� r� r� r� �propertyr� r� r, r� r� r� r� rC r� r
r
r
r rA } s rA c @ s e Zd ZeZeZdd� ZdS )rE c C s dS )NFr
)r r r
r
r r� � s zKeywordTable._is_templateN)r r! r" r� r� r� r� r� r
r
r
r rE � s rE c @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd S ) r( c C sZ d | _ d | _d | _d| _d| _|| _d| _y| j|� W n tk
rL Y n
X | j � d S )NrG Frh rh )
r2 r4 r r) r6 � _identifiers� _may_have_internal_variables�_split�
ValueError� _finalize)r r
r' r
r
r r � s zVariableSplitter.__init__c C s | j r|j| j�S | jS )N)r� Zreplace_stringr4 )r r9 r
r
r �get_replaced_base� s z"VariableSplitter.get_replaced_basec C sj | j d | _dj| j dd� �| _| jt| j � | _| j� rfdj| jdd� �| _ | jt| j�7 _d S )Nr r r rG rh rh )
�_variable_charsr2 �joinr4 r) r r6 � _has_list_or_dict_variable_index�#_list_and_dict_variable_index_charsr )r r
r
r r� � s zVariableSplitter._finalizec C s | j o| j d dkS )NrG r1 rh )r� )r r
r
r r� � s z1VariableSplitter._has_list_or_dict_variable_indexc C s� | j |�\}}|| _d| _| j| _|| dg| _g | _|| _|d7 }x`t||d � �D ]L\}}||7 }y| j||� W n t k
r� d S X ||krV| j
� rVd S qVW d S )NrG r. r ) �_find_variabler) � _open_curly�_variable_state�_stater� r� �_stringrJ �
StopIteration� _scanning_list_variable_index)r r
� start_indexZ max_indexr r r
r
r r� � s zVariableSplitter._splitc C s | j | j| jgkS )N)r� �"_waiting_list_variable_index_state�_list_variable_index_state)r r
r
r r� � s z.VariableSplitter._scanning_list_variable_indexc C s^ |j d�}|dkrtd��| j||�r8| j|d |� �S | j|d|�}|dkrVtd��||fS )Nr/ rG zNo variable end foundzNo variable start foundrh rh )�rfindr� � _is_escapedr� �_find_start_index)r r
Z
max_end_indexr� r
r
r r� � s
z VariableSplitter._find_variablec C s@ |j d||�d }|dk r dS | j||�r.|S | j||d |�S )Nr. rG r r rh )�find�_start_index_is_okr� )r r
r) r6 r r
r
r r� � s z"VariableSplitter._find_start_indexc C s || | j ko| j||� S )N)r� r� )r r
r r
r
r r� s z#VariableSplitter._start_index_is_okc C s4 d}x*|dkr.||d dkr.|d8 }| }qW |S )NFr rG r� r
)r r
r Zescapedr
r
r r� s
z VariableSplitter._is_escapedc C sh | j j|� |dkrR| j| j|� rR| jd8 _| jdkrd| j� sHt�| j| _n|| j krd| j
| _d S )Nr/ rG r ) r� r� r� r� r� �_is_list_or_dict_variabler� r� r� r� � _internal_variable_start_state)r r r r
r
r r� s
z VariableSplitter._variable_statec C s | j d dkS )Nr �@�&)r� r� )r� )r r
r
r r� s z*VariableSplitter._is_list_or_dict_variablec C sB | j | _|dkr2| jj|� | jd7 _d| _n | j ||� d S )Nr. rG T)r� r� r� r� r� r� )r r r r
r
r r� s z/VariableSplitter._internal_variable_start_statec C s$ |dkr t �| jj|� | j| _d S )Nr0 )r� r� r� r� r� )r r r r
r
r r� ' s z3VariableSplitter._waiting_list_variable_index_statec C s | j j|� |dkrt�d S )Nr1 )r� r� r� )r r r r
r
r r� - s z+VariableSplitter._list_variable_index_stateN)r r! r" r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r
r
r
r r( � s r( )r )8r# r_ Zpygments.lexerr Zpygments.tokenr Z
pygments.utilr �__all__ZGenericZHeadingrV ZKeywordZ Namespacer� �Namer� Z
Subheadingr� ZFunctionr� �Stringr� r� r5 rl r* Z PunctuationrU r3 ZEmphr� �Errorr+ r r �objectr r r? ra rm r� r� r� r� r� r� r� r� r= rD rB rA rE r( r
r
r
r �<module>
sP
0
3