3
� �XSI � @ s� d Z ddlZddlmZmZmZmZmZmZ ddl m
Z
m Z m Z m
Z
mZmZmZmZmZ ddddgZG d d
� d
e�ZG d d� de�ZG d d� de�ZG d
d� de�ZG dd� de�ZdS )z�
pygments.lexers.data
~~~~~~~~~~~~~~~~~~~~
Lexers for data file format.
:copyright: Copyright 2006-2017 by the Pygments team, see AUTHORS.
:license: BSD, see LICENSE for details.
� N)�
RegexLexer�ExtendedRegexLexer� LexerContext�include�bygroups�inherit) �Text�Comment�Keyword�Name�String�Number� Punctuation�Literal�Error� YamlLexer� JsonLexer�JsonBareObjectLexer� JsonLdLexerc s e Zd ZdZ� fdd�Z� ZS )�YamlLexerContextz'Indentation context for the YAML lexer.c s. t t| �j||� g | _d| _d| _d | _d S )N� r ���)�superr �__init__� indent_stack�indent� next_indent�block_scalar_indent)�self�args�kwds)� __class__� �/usr/lib/python3.6/data.pyr s
zYamlLexerContext.__init__)�__name__�
__module__� __qualname__�__doc__r �
__classcell__r" r" )r! r# r s r c st e Zd ZdZdZdgZddgZdgZdd� Zd d
� Z dgd d
�Z
dhdd�Z dd� Z dd� Z
dd� Zdd� Zdefdefdejfde ej�d fd e ej�d fd e ej�d fd!e
ed"d#�difgdefdejfd%ed&fgd'eee�d(fgd)eeejeej�d(fgd*ee�d&fd+e
e�fd,e ej�fd-e
e�d.fgd/ee�d.fd0efe d1�e d2�e d3�d4eej �d5fgd6ejfd7ejfd8ej fd9ej fgd:e ejd"d;�fd<ejdjfgd?ejd@fdAejdBfdCe dDfdEe dFfgd0efdefdejfdGejfe d1�e d3�dHeej �dIfge dJ�dKejd.fge dJ�dLejd.fgd%efdMe
eej �fdNee�fdOej fgdPe ej�d(fdQe ej�d(fgdRefdSefdefd0ej fge dT�dUe j!fdVe fdCe d.fge dT�dWe fdXe j!fdYe fdZe d.fgdMefdefd[eej�d\fdNee�d.fgd]ee�d.fd^ed.fdSefded_fd0e"j#j$fd`e"j#j$fgdaee�d.fd^ed.fdRefdSefdefd0ej fdbej fgdc�Z%dk� fdedf� Z&� Z'S )lr z}
Lexer for `YAML <http://yaml.org/>`_, a human-friendly data serialization
language.
.. versionadded:: 0.11
ZYAMLZyamlz*.yamlz*.ymlz text/x-yamlc s � fdd�}|S )z Do not produce empty tokens.c 3 s. |j � }|sd S |j� � |fV |j� |_d S )N)�group�start�end�pos)�lexer�match�context�text)� token_classr" r# �callback0 s
z%YamlLexer.something.<locals>.callbackr" )r1 r2 r" )r1 r# � something. s zYamlLexer.somethingc s � fdd�}|S )z Reset the indentation levels.c 3 s> |j � }g |_d|_d|_d |_|j� � |fV |j� |_d S )Nr r r )r) r r r r r* r+ r, )r- r. r/ r0 )r1 r" r# r2 : s z(YamlLexer.reset_indent.<locals>.callbackr" )r1 r2 r" )r1 r# � reset_indent8 s zYamlLexer.reset_indentFc s � �fdd�}|S )z"Save a possible indentation level.c 3 s� |j � }d}� rnt|�|_|j|jk r�x |j|jk rB|jj� |_q(W |j|jkr�||jd � }|d |j� }n| jt|�7 _|r�|j� �|fV |r�|j� t|� �j|fV |j� |_ d S )N� )
r) �lenr r r �popr* r r+ r, )r- r. r/ r0 Zextra)r* r1 r" r# r2 F s
z'YamlLexer.save_indent.<locals>.callbackr" )r1 r* r2 r" )r* r1 r# � save_indentD s zYamlLexer.save_indentc s � �fdd�}|S )z+Set the previously saved indentation level.c 3 s^ |j � }|j|jk r*|jj|j� |j|_� s@| jt|�7 _|j� �|fV |j� |_d S )N) r) r r r �appendr6 r* r+ r, )r- r. r/ r0 )�implicitr1 r" r# r2 \ s z&YamlLexer.set_indent.<locals>.callbackr" )r1 r: r2 r" )r: r1 r# �
set_indentZ s zYamlLexer.set_indentc s � fdd�}|S )z5Set an explicit indentation level for a block scalar.c 3 sd |j � }d |_|sd S |j d�}|rBt|jd�}t|�}|| |_|r`|j� � |fV |j� |_d S )Nr r )r) r �maxr �intr* r+ r, )r- r. r/ r0 Z incrementZcurrent_indent)r1 r" r# r2 i s
z3YamlLexer.set_block_scalar_indent.<locals>.callbackr" )r1 r2 r" )r1 r# �set_block_scalar_indentg s
z!YamlLexer.set_block_scalar_indentc s � �fdd�}|S )z(Process an empty line in a block scalar.c 3 s� |j � }|jd ks t|�|jkr6|rx|j� �|fV nB|d |j� }||jd � }|j� �|fV |j� |j � |fV |j� |_d S )N)r) r r6 r* r+ r, )r- r. r/ r0 � indentationZcontent)�content_token_class�indent_token_classr" r# r2 z s
z9YamlLexer.parse_block_scalar_empty_line.<locals>.callbackr" )rA r@ r2 r" )r@ rA r# � parse_block_scalar_empty_linex s
z'YamlLexer.parse_block_scalar_empty_linec s � fdd�}|S )z-Process indentation spaces in a block scalar.c 3 s� |j � }|jd krJt|�t|jd�kr>|jj� |jj� d S t|�|_n&t|�|jk rp|jj� |jj� d S |r�|j� � |fV |j� |_ d S )Nr )
r) r r6 r< r �stackr7 r* r+ r, )r- r. r/ r0 )r1 r" r# r2 � s
z5YamlLexer.parse_block_scalar_indent.<locals>.callbackr" )r1 r2 r" )r1 r# �parse_block_scalar_indent� s z#YamlLexer.parse_block_scalar_indentc s � fdd�}|S )z-Process indentation spaces in a plain scalar.c 3 sP |j � }t|�|jkr.|jj� |jj� d S |rL|j� � |fV |j� |_d S )N)r) r6 r rC r7 r* r+ r, )r- r. r/ r0 )r1 r" r# r2 � s
z5YamlLexer.parse_plain_scalar_indent.<locals>.callbackr" )r1 r2 r" )r1 r# �parse_plain_scalar_indent� s z#YamlLexer.parse_plain_scalar_indentz [ ]+(?=#|$)z\n+z#[^\n]*z^%YAML(?=[ ]|$)zyaml-directivez^%TAG(?=[ ]|$)z
tag-directivez^(?:---|\.\.\.)(?=[ ]|$)�
block-linez [ ]*(?!\s|$)T)r* r? z\nz#pop:2z([ ]+)([0-9]+\.[0-9]+)z ignored-linez;([ ]+)(!|![\w-]*!)([ ]+)(!|!?[\w;/?:@&=+$,.!~*\'()\[\]%-]+)z[ ]*$z[ ]+(?=[?:-](?:[ ]|$))z[?:-](?=[ ]|$)z[ ]*z#popz [ ]*(?=#|$)z[ ]+� descriptorsz block-nodesz
flow-nodesz'(?=[^\s?:,\[\]{}#&*!|>\'"%@`-]|[?:-]\S)z plain-scalar-in-block-contextz!!<[\w#;/?:@&=+$,.!~*\'()\[\]%-]+>z+!(?:[\w-]+!)?[\w#;/?:@&=+$,.!~*\'()\[\]%-]+z&[\w-]+z\*[\w-]+z
:(?=[ ]|$))r: z[|>]�block-scalar-content�block-scalar-headerz\[z
flow-sequencez\{z flow-mappingz\'zsingle-quoted-scalarz\"zdouble-quoted-scalarz[?:,]z (?=[^\s?:,\[\]{}#&*!|>\'"%@`])z plain-scalar-in-flow-contextzflow-collectionz\]z\}z^[ ]+$z^[ ]*z[\S\t ]+z([1-9])?[+-]?(?=[ ]|$)z[+-]?([1-9])?(?=[ ]|$)z^[ ]+z[ ]+$zquoted-scalar-whitespacesz\'\'z[^\s\']+z\\[0abt\tn\nvfre "\\N_LP]z5\\(?:x[0-9A-Fa-f]{2}|u[0-9A-Fa-f]{4}|U[0-9A-Fa-f]{8})z [^\s"\\]+�"z^(?=---|\.\.\.)z#pop:3z[ ]*(?=:[ ]|:$)z [ ]+(?=#)z&plain-scalar-in-block-context-new-linez(?::(?!\s)|[^\s:])+z[ ]*(?=[,:?\[\]{}])z[^\s,:?\[\]{}]+)�rootz ignored-linezyaml-directivez
tag-directiver? z
block-linerG z block-nodesz
flow-nodeszflow-collectionz
flow-sequencez flow-mappingzblock-scalar-contentzblock-scalar-headerzquoted-scalar-whitespaceszsingle-quoted-scalarzdouble-quoted-scalarz&plain-scalar-in-block-context-new-linez plain-scalar-in-block-contextz plain-scalar-in-flow-contextNc s$ |d krt |d�}tt| �j||�S )Nr )r r r �get_tokens_unprocessed)r r0 r/ )r! r" r# rL � s
z YamlLexer.get_tokens_unprocessed)F)F)rF r? )rH rI )NN)(r$ r% r& r' �name�aliases� filenames� mimetypesr3 r4 r8 r; r> rB rD rE r r �Singler �TagZ Namespacer r
r
ZTyper Z Indicatorr ZVariableZLabelr �ConstantZEscaper ZScalarZPlain�tokensrL r( r" r" )r! r# r ! s�
c @ s� e Zd ZdZdZdgZdgZdgZej Z
dZ dZ dZ
d efgd
ejfd e� ejfe ejfd ejfged
�defdedfdedfged�d ejdfdedfged�ed
�defdedfged�ed�dedfdedfged
�gd�Zd S ) r z>
For JSON data structures.
.. versionadded:: 1.5
ZJSONZjsonz*.jsonzapplication/jsonz-?(0|[1-9]\d*)z\.\d+z[eE](\+|-)?\d+z\s+z(true|false|null)\bzB%(int_part)s(%(frac_part)s%(exp_part)s|%(exp_part)s|%(frac_part)s)z"(\\\\|\\"|[^"])*"�value�:�,z#popz\}z#pop:2�
whitespace�objectattributez\]� simplevaluez\{� objectvaluez\[�
arrayvalue)rX rZ rY r[ r\ rU rK N) r$ r% r& r' rM rN rO rP �re�DOTALL�flagsZint_partZ frac_partZexp_partr r
rS �varsr
ZFloatZIntegerr �Doubler r r rR rT r" r" r" r# r � s@
c @ sB e Zd ZdZdZdgZg ZdgZdefe d�gdefe
gd�Z dS ) r za
For JSON data structures (with missing object curly braces).
.. versionadded:: 2.2
ZJSONBareObjectz json-objectzapplication/json-objectz\}r[ )rK rY N) r$ r% r& r' rM rN rO rP r r r rT r" r" r" r# r s c @ s< e Zd ZdZdZddgZdgZdgZddej d fe
giZ d
S ) r zV
For `JSON-LD <http://json-ld.org/>`_ linked data.
.. versionadded:: 2.0
zJSON-LDZjsonldzjson-ldz*.jsonldzapplication/ld+jsonr[ zU"@(context|id|value|language|type|container|list|set|reverse|index|base|vocab|graph)"rY N) r$ r% r& r' rM rN rO rP r Z Decoratorr rT r" r" r" r# r s )r' r] Zpygments.lexerr r r r r r Zpygments.tokenr r r
r r r
r r r �__all__r r r r r r" r" r" r# �<module>
s , O