3
�;�e� � ? @ s� d Z ddlZddlmZmZ ddlmZmZ ddlm Z ddl
m Z ddl m
Z
ddlmZ dd lmZmZ dd
lmZ dd lmZmZmZmZmZmZm Z m Z m Z dd l m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+ dd
l,m-Z-m.Z. ddddddddddddddd d d d d d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4d5d6d7d8d9d:d;d<d=d>d?d@dAdBdCdDdEdFdGdHdIdJdKdLg?Z/G dMd� de�Z0G dNd� de�Z1G dOd<� d<e�Z2G dPd=� d=e�Z3G dQd>� d>e�Z4G dRd � d e�Z5G dSd&� d&e�Z6G dTd'� d'e�Z7G dUd(� d(e�Z8G dVd*� d*e�Z9G dWd)� d)e�Z:G dXd+� d+e�Z;G dYd,� d,e�Z<G dZd-� d-e�Z=G d[d.� d.e�Z>G d\d/� d/e�Z?G d]d0� d0e�Z@G d^d_� d_e�ZAG d`d2� d2e�ZBG dad3� d3e�ZCG dbd4� d4e�ZDG dcd5� d5e�ZEG ddd#� d#e�ZFG dedf� dfe�ZGG dgd"� d"e�ZHG dhd!� d!e�ZIG did%� d%e�ZJG djd$� d$e�ZKG dkd� de�ZLG dld� de�ZMG dmd� de�ZNG dnd� de�ZOG dod� de�ZPG dpd� de�ZQG dqd� de�ZRG drd� de�ZSG dsd� de�ZTG dtd� de�ZUG dud� de�ZVG dvd� de�ZWG dwd � d e�ZXG dxd � d e�ZYG dyd � d e�ZZG dzd � d e�Z[G d{d|� d|e�Z\G d}d1� d1e�Z]G d~d6� d6e�Z^G dd7� d7e�Z_G d�d8� d8e�Z`G d�d9� d9e�ZaG d�d�� d�e�ZbG d�d:� d:e�ZcG d�d;� d;e�ZdG d�d?� d?e�ZeG d�d�� d�e�ZfG d�d@� d@e�ZgG d�dA� dAe�ZhG d�dB� dBe�ZiG d�dC� dCe�ZjG d�dD� dDe�ZkG d�dE� dEe�ZlG d�dF� dFe�ZmG d�dG� dGe�ZnG d�dH� dHe�ZoG d�dI� dIe�ZpG d�dJ� dJe�ZqG d�dK� dKe�ZrG d�dL� dLe�ZsdS )�z�
pygments.lexers.templates
~~~~~~~~~~~~~~~~~~~~~~~~~
Lexers for various template engines' markup.
:copyright: Copyright 2006-2017 by the Pygments team, see AUTHORS.
:license: BSD, see LICENSE for details.
� N)� HtmlLexer�XmlLexer)�JavascriptLexer�
LassoLexer)�CssLexer)�PhpLexer)� PythonLexer)� PerlLexer)� JavaLexer� TeaLangLexer)� YamlLexer) �Lexer�DelegatingLexer�
RegexLexer�bygroups�include�using�this�default�combined) �Error� Punctuation�
Whitespace�Text�Comment�Operator�Keyword�Name�String�Number�Other�Token)�html_doctype_matches�looks_like_xml� HtmlPhpLexer� XmlPhpLexer� CssPhpLexer�JavascriptPhpLexer�ErbLexer�
RhtmlLexer� XmlErbLexer� CssErbLexer�JavascriptErbLexer� SmartyLexer�HtmlSmartyLexer�XmlSmartyLexer�CssSmartyLexer�JavascriptSmartyLexer� DjangoLexer�HtmlDjangoLexer�CssDjangoLexer�XmlDjangoLexer�JavascriptDjangoLexer� GenshiLexer�HtmlGenshiLexer�GenshiTextLexer�CssGenshiLexer�JavascriptGenshiLexer� MyghtyLexer�MyghtyHtmlLexer�MyghtyXmlLexer�MyghtyCssLexer�MyghtyJavascriptLexer�
MasonLexer� MakoLexer�
MakoHtmlLexer� MakoXmlLexer�MakoJavascriptLexer� MakoCssLexer�JspLexer� CheetahLexer�CheetahHtmlLexer�CheetahXmlLexer�CheetahJavascriptLexer� EvoqueLexer�EvoqueHtmlLexer�EvoqueXmlLexer�ColdfusionLexer�ColdfusionHtmlLexer�ColdfusionCFCLexer�
VelocityLexer�VelocityHtmlLexer�VelocityXmlLexer�SspLexer�TeaTemplateLexer�LassoHtmlLexer�
LassoXmlLexer�
LassoCssLexer�LassoJavascriptLexer�HandlebarsLexer�HandlebarsHtmlLexer�YamlJinjaLexer� LiquidLexer� TwigLexer�
TwigHtmlLexer�
Angular2Lexer�Angular2HtmlLexerc @ sF e Zd ZdZdZdgZdgZejdej �Z
dd� Z dd � Z d
d � Z
d S )
r( a
Generic `ERB <http://ruby-doc.org/core/classes/ERB.html>`_ (Ruby Templating)
lexer.
Just highlights ruby code between the preprocessor directives, other data
is left untouched by the lexer.
All options are also forwarded to the `RubyLexer`.
ZERBZerbz application/x-ruby-templatingz*(<%%|%%>|<%=|<%#|<%-|<%|-%>|%>|^%[^%].*?$)c K s* ddl m} |f |�| _tj| f|� d S )Nr )� RubyLexer)Zpygments.lexers.rubyrc �
ruby_lexerr
�__init__)�self�optionsrc � rh � /usr/lib/python3.6/templates.pyre C s zErbLexer.__init__c c s0 | j j|�}|j� d }}�y��x�|dkrR|j� }|t|fV |t|�7 }d}q$|dk�r�|j� }|dkr�|t|fV |d7 }d}�q|dkr�|tj|fV |j� }|d t|fV |dt|� 7 }d}�q|dk�r>|tj|fV |t|�7 }|j� }d}x,| jj |�D ] \}} }
|| | |
fV �q W |t|�7 }d}n�|dk�rf|t
|fV |t|�7 }d}n`|tj|d fV d}x8| jj |dd
� �D ] \}} }
|d | | |
fV �q�W |t|�7 }d}q$|dkr$|j� }|dk�r�|t|fV n|tj|fV |t|�7 }d}q$W W n t k
�r* d
S X d
S )z�
Since ERB doesn't allow "<%" and other tags inside of ruby
blocks we have to use a split approach here that fails for
that too.
r � �<%%�%%>� z<%#� �<%�<%=�<%-�%>�-%>N)rk rl )ro rp rq )rr rs )rr rs ) � _block_re�split�reverse�popr �lenr �Preprocrd �get_tokens_unprocessedr �
IndexError) rf �text�tokens�state�idx�val�tag�dataZr_idxZr_tokenZr_valuerh rh ri rz H sh
z ErbLexer.get_tokens_unprocessedc C s d| krd| krdS d S )Nz<%z%>g�������?rh )r| rh rh ri � analyse_text� s zErbLexer.analyse_textN)�__name__�
__module__� __qualname__�__doc__�name�aliases� mimetypes�re�compile�Mrt re rz r� rh rh rh ri r( 2 s Dc
@ s� e Zd ZdZdZdgZdgZdgZej ej
B Z de fde
ejeej�fde
ejeed d
�ej�fd e
ejeje�dfd ejdfgd
efd ejdfdejdfdejfdejfdefdejfdefdejfdej fdej fg d�Z dd� Z d S ) r- z�
Generic `Smarty <http://smarty.php.net/>`_ template lexer.
Just highlights smarty code between the preprocessor directives, other
data is left untouched by the lexer.
ZSmarty�smartyz*.tplzapplication/x-smartyz[^{]+z(\{)(\*.*?\*)(\})z(\{php\})(.*?)(\{/php\})T)Z startinlinez(\{)(/?[a-zA-Z_]\w*)(\s*)z\{z\s+z#pushz\}z#popz#[a-zA-Z_]\w*#z\$[a-zA-Z_]\w*(\.\w+)*z[~!%^&*()+=|\[\]:;,.<>/?@-]z(true|false|null)\bz>[0-9](\.[0-9]*)?(eE[+-][0-9])?[flFLdD]?|0[xX][0-9a-fA-F]+[Ll]?z"(\\\\|\\"|[^"])*"z'(\\\\|\\'|[^'])*'z [a-zA-Z_]\w*)�rootr� c C sX d}t jd| �r|d7 }t jd| �r,|d7 }t jd| �r@|d7 }t jd| �rT|d7 }|S )Ng z\{if\s+.*?\}.*?\{/if\}g333333�?z\{include\s+file=.*?\}z \{foreach\s+.*?\}.*?\{/foreach\}z \{\$.*?\}g{�G�z�?)r� �search)r| �rvrh rh ri r� � s zSmartyLexer.analyse_textN) r� r� r� r� r� r� � filenamesr� r� � MULTILINE�DOTALL�flagsr r r ry r r r �Functionr �Variabler r �Constantr r �Double�Single� Attributer} r� rh rh rh ri r- � s8
c @ s� e Zd ZdZdZdgZddgZejej B Z
dZ de fde
ejeej�fd e
eje�fd
e d e
ejejeje�d fd
e d
e
ejejej�fdedfge ejfdedfde d e
eej�dfdedfed�gdefdedfde d ejfed�gdefed�d edfgdedfd efd efd ejfd ejfd!efd"efd#e j fdedfd$edfd%edfdedfdedfd edfgd&�Z d'd(� Z d)S )*rR z�
Generic `Velocity <http://velocity.apache.org/>`_ template lexer.
Just highlights velocity directives and variable references, other
data is left untouched by the lexer.
ZVelocityZvelocityz*.vmz*.fhtmlz [a-zA-Z_]\w*z[^{#$]+z(#)(\*.*?\*)(#)z
(##)(.*?$)z(#\{?)(z
)(\}?)(\s?\()�directiveparamsz)(\}|\b)z\$\{?�variablez\(�
funcparamsz(\.)(�)z#pushz\}z#popz=(&&|\|\||==?|!=?|[-<>+*%&|^/])|\b(eq|ne|gt|lt|ge|le|not|in)\bz\[�
rangeoperatorz\bz\.\.z\]z\s+z[,:]z"(\\\\|\\"|[^"])*"z'(\\\\|\\'|[^'])*'z0[xX][0-9a-fA-F]+[Ll]?z
\b[0-9]+\bz(true|false|null)\bz\)z\{)r� r� r� r� r� c C sX d}t jd| �r|d7 }t jd| �r,|d7 }t jd| �r@|d7 }t jd| �rT|d7 }|S ) Ng z #\{?macro\}?\(.*?\).*?#\{?end\}?g �?z #\{?if\}?\(.+?\).*?#\{?end\}?g333333�?z"#\{?foreach\}?\(.+?\).*?#\{?end\}?z4\$\{?[a-zA-Z_]\w*(\([^)]*\))?(\.\w+(\([^)]*\))?)*\}?g{�G�z�?)r� r� )r| r� rh rh ri r�
s zVelocityLexer.analyse_textN) r� r� r� r� r� r� r� r� r� r� r� Z
identifierr r r ry r r� r r� r r r r r r� r� r r r� r} r� rh rh rh ri rR � s\
c s8 e Zd ZdZdZdgZddgZdgZ� fdd�Z� Z S ) rS za
Subclass of the `VelocityLexer` that highlights unlexed data
with the `HtmlLexer`.
z
HTML+Velocityz
html+velocityz*.htmlz*.fhtmlztext/html+velocityc s t t| �jttf|� d S )N)�superrS re r rR )rf rg )� __class__rh ri re ' s zVelocityHtmlLexer.__init__)
r� r� r� r� r� r� �alias_filenamesr� re �
__classcell__rh rh )r� ri rS s c s@ e Zd ZdZdZdgZddgZdgZ� fdd�Zd d
� Z � Z
S ) rT z`
Subclass of the `VelocityLexer` that highlights unlexed data
with the `XmlLexer`.
z XML+Velocityz xml+velocityz*.xmlz*.vmzapplication/xml+velocityc s t t| �jttf|� d S )N)r� rT re r rR )rf rg )r� rh ri re 8 s zVelocityXmlLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)rR r� r# )r| r� rh rh ri r� < s z VelocityXmlLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rT , s c @ s| e Zd ZdZdZddgZddgZejej B Z
de fde j
d fd
e fd ee j
eeee j
e e j
eeee j
� fd ee j
eeee j
ee j
eeee j
� fd
ee j
eeeej�dfdee j
ee�dfde fgdeeeej�fdeeeeeej�fdejfdefdejfdejfdejfdejfdejfdefdefg d efd eee j
�d fed �gd efd eee j
�d fed �d!e fgd"�Z d#d$� Z d%S )&r2 a
Generic `django <http://www.djangoproject.com/documentation/templates/>`_
and `jinja <http://wsgiarea.pocoo.org/jinja/>`_ template lexer.
It just highlights django/jinja code between the preprocessor directives,
other data is left untouched by the lexer.
z Django/JinjaZdjangoZjinjaz application/x-django-templatingzapplication/x-jinjaz[^{]+z\{\{�varz\{[*#].*?[*#]\}zJ(\{%)(-?\s*)(comment)(\s*-?)(%\})(.*?)(\{%)(-?\s*)(endcomment)(\s*-?)(%\})zB(\{%)(-?\s*)(raw)(\s*-?)(%\})(.*?)(\{%)(-?\s*)(endraw)(\s*-?)(%\})z'(\{%)(-?\s*)(filter)(\s+)([a-zA-Z_]\w*)�blockz(\{%)(-?\s*)([a-zA-Z_]\w*)z\{z(\|)(\s*)([a-zA-Z_]\w*)z#(is)(\s+)(not)?(\s+)?([a-zA-Z_]\w*)z%(_|true|false|none|True|False|None)\bzm(in|as|reversed|recursive|not|and|or|is|if|else|import|with(?:(?:out)?\s*context)?|scoped|ignore\s+missing)\bz (loop|block|super|forloop)\bz[a-zA-Z_][\w-]*z\.\w+z:?"(\\\\|\\"|[^"])*"z:?'(\\\\|\\'|[^'])*'z ([{}()\[\]+\-*/,:~]|[><=]=?)z>[0-9](\.[0-9]*)?(eE[+-][0-9])?[flFLdD]?|0[xX][0-9a-fA-F]+[Ll]?z\s+z
(-?)(\}\})z#pop�varnamesz (-?)(%\})�.)r� r� r� r� c C sP d}t jd| �d k r |d7 }t jd| �d k r4|d7 }t jd| �d k rL|d7 }|S )Ng z\{%\s*(block|extends)g�������?z\{%\s*if\s*.*?%\}g�������?z \{\{.*?\}\})r� r� )r| r� rh rh ri r� � s zDjangoLexer.analyse_textN) r� r� r� r� r� r� r� r� r� �Sr� r r ry r r r r r� r �Pseudo�Builtinr� r r� r� r r r r} r� rh rh rh ri r2 C sZ
c @ s� e Zd ZdZdZdgZddgZdgZddefd e e
j ee
j e
j e
e�e
j �fd
e e
j e
j e
j e
e�e
j �fd e e
j e
j e
e�e
j �fd e e
j e
j e
e�e
j �fd
e
j fde e
j e
e�e
j �fdefde e
j e
e�e�fde ee�fg
iZdS )r< z�
Generic `myghty templates`_ lexer. Code that isn't Myghty
markup is yielded as `Token.Other`.
.. versionadded:: 0.6
.. _myghty templates: http://www.myghty.org/
ZMyghtyZmyghtyz*.mytZ autodelegatezapplication/x-myghtyr� z\s+z3(<%(?:def|method))(\s*)(.*?)(>)(.*?)(</%\2\s*>)(?s)z#(<%\w+)(.*?)(>)(.*?)(</%\2\s*>)(?s)z(<&[^|])(.*?)(,.*?)?(&>)z(<&\|)(.*?)(,.*?)?(&>)(?s)z</&>z(<%!?)(.*?)(%>)(?s)z(?<=^)#[^\n]*(\n|\Z)z(?<=^)(%)([^\n]*)(\n|\Z)a� (?sx)
(.+?) # anything, followed by:
(?:
(?<=\n)(?=[%#]) | # an eval or comment line
(?=</?[%&]) | # a substitution or block or
# call start or end
# - don't consume
(\\\n) | # an escaped newline
\Z # end of string
)N)r� r� r� r� r� r� r� r� r r r �Tagr� r r r r r r r} rh rh rh ri r< � s0
c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )r= zy
Subclass of the `MyghtyLexer` that highlights unlexed data
with the `HtmlLexer`.
.. versionadded:: 0.6
z HTML+Myghtyz html+myghtyztext/html+myghtyc s t t| �jttf|� d S )N)r� r= re r r< )rf rg )r� rh ri re � s zMyghtyHtmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri r= � s
c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )r> zx
Subclass of the `MyghtyLexer` that highlights unlexed data
with the `XmlLexer`.
.. versionadded:: 0.6
z
XML+Myghtyz
xml+myghtyzapplication/xml+myghtyc s t t| �jttf|� d S )N)r� r> re r r< )rf rg )r� rh ri re � s zMyghtyXmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri r> � s
c s6 e Zd ZdZdZddgZdddgZ� fdd �Z� ZS )
r@ z
Subclass of the `MyghtyLexer` that highlights unlexed data
with the `JavascriptLexer`.
.. versionadded:: 0.6
zJavaScript+Myghtyz js+myghtyzjavascript+myghtyz application/x-javascript+myghtyztext/x-javascript+myghtyztext/javascript+mygthyc s t t| �jttf|� d S )N)r� r@ re r r< )rf rg )r� rh ri re � s z MyghtyJavascriptLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri r@ � s c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )r? zx
Subclass of the `MyghtyLexer` that highlights unlexed data
with the `CssLexer`.
.. versionadded:: 0.6
z
CSS+Myghtyz
css+myghtyztext/css+myghtyc s t t| �jttf|� d S )N)r� r? re r r< )rf rg )r� rh ri re s zMyghtyCssLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri r? � s
c @ s e Zd ZdZdZdgZdddddd gZd
gZd d efd
e e
j e j
e
j �fde e
j ee
je
j ee�e
j �fde e
j e
je
j ee�e
j �fde e
j e
jee�e
j �fde e
j e
jee�e
j �fde
j fde e
j ee�e
j �fde fde e
j ee�e�fde ee�e�fg iZdd� ZdS )rA z�
Generic `mason templates`_ lexer. Stolen from Myghty lexer. Code that isn't
Mason markup is HTML.
.. _mason templates: http://www.masonhq.com/
.. versionadded:: 1.4
ZMasonZmasonz*.mz*.mhtmlz*.mcz*.miZ autohandlerZdhandlerzapplication/x-masonr� z\s+z(<%doc>)(.*?)(</%doc>)(?s)z3(<%(?:def|method))(\s*)(.*?)(>)(.*?)(</%\2\s*>)(?s)z#(<%\w+)(.*?)(>)(.*?)(</%\2\s*>)(?s)z (<&[^|])(.*?)(,.*?)?(&>)(?s)z(<&\|)(.*?)(,.*?)?(&>)(?s)z</&>z(<%!?)(.*?)(%>)(?s)z(?<=^)#[^\n]*(\n|\Z)z(?<=^)(%)([^\n]*)(\n|\Z)a� (?sx)
(.+?) # anything, followed by:
(?:
(?<=\n)(?=[%#]) | # an eval or comment line
(?=</?[%&]) | # a substitution or block or
# call start or end
# - don't consume
(\\\n) | # an escaped newline
\Z # end of string
)c C s6 d}t jd| �d k rd}nt jd| t j�d k r2d}|S )Ng z</%(class|doc|init)%>g �?z<&.+&>g)\��(�?)r� r� r� )r| �resultrh rh ri r� < s zMasonLexer.analyse_textN)r� r� r� r� r� r� r� r� r r r r� r � Multiliner� r r r r r r r} r� rh rh rh ri rA s6
c
@ s0 e Zd ZdZdZdgZdgZdgZdee e
j e e
�fdee e
j ee�e
�fdee e
j e
�fd e
j fd
ee
j ej�d fd ee
j eje
j �fd
e
j dfdee
j ee�e
j �fdee
j ee�e
j �fdee
e�fde fg de
j fdejfed �gdeeje e�fde
j dfde fgdedfdedfdedfgd�Zd S ) rB z�
Generic `mako templates`_ lexer. Code that isn't Mako
markup is yielded as `Token.Other`.
.. versionadded:: 0.7
.. _mako templates: http://www.makotemplates.org/
ZMakoZmakoz*.maozapplication/x-makoz (\s*)(%)(\s*end(?:\w+))(\n|\Z)z(\s*)(%)([^\n]*)(\n|\Z)z(\s*)(##[^\n]*)(\n|\Z)z(?s)<%doc>.*?</%doc>z
(<%)([\w.:]+)r� z(</%)([\w.:]+)(>)z<%(?=([\w.:]+))� ondeftagsz(<%(?:!?))(.*?)(%>)(?s)z(\$\{)(.*?)(\})a\ (?sx)
(.+?) # anything, followed by:
(?:
(?<=\n)(?=%|\#\#) | # an eval or comment line
(?=\#\*) | # multiline comment
(?=</?%) | # a python block
# call start or end
(?=\$\{) | # a substitution
(?<=\n)(?=\s*%) |
# - don't consume
(\\\n) | # an escaped newline
\Z # end of string
)
z\s+z<%z'(?<=<%)(include|inherit|namespace|page)z((?:\w+)\s*=)(\s*)(".*?")z/?\s*>z#popz".*?"z'.*?'z[^\s>]+)r� r� r� �attrN)r� r� r� r� r� r� r� r� r r r ry r r r r r r� r r r� r r} rh rh rh ri rB E sB
c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )rC zw
Subclass of the `MakoLexer` that highlights unlexed data
with the `HtmlLexer`.
.. versionadded:: 0.7
z HTML+Makoz html+makoztext/html+makoc s t t| �jttf|� d S )N)r� rC re r rB )rf rg )r� rh ri re � s zMakoHtmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rC � s
c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )rD zv
Subclass of the `MakoLexer` that highlights unlexed data
with the `XmlLexer`.
.. versionadded:: 0.7
zXML+Makozxml+makozapplication/xml+makoc s t t| �jttf|� d S )N)r� rD re r rB )rf rg )r� rh ri re � s zMakoXmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rD � s
c s6 e Zd ZdZdZddgZdddgZ� fdd �Z� ZS )
rE z}
Subclass of the `MakoLexer` that highlights unlexed data
with the `JavascriptLexer`.
.. versionadded:: 0.7
zJavaScript+Makozjs+makozjavascript+makoz application/x-javascript+makoztext/x-javascript+makoztext/javascript+makoc s t t| �jttf|� d S )N)r� rE re r rB )rf rg )r� rh ri re � s z MakoJavascriptLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rE � s c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )rF zv
Subclass of the `MakoLexer` that highlights unlexed data
with the `CssLexer`.
.. versionadded:: 0.7
zCSS+Makozcss+makoz
text/css+makoc s t t| �jttf|� d S )N)r� rF re r rB )rf rg )r� rh ri re � s zMakoCssLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rF � s
c @ s e Zd ZdZdd� ZdS )�CheetahPythonLexerzI
Lexer for handling Cheetah's special $ tokens in Python syntax.
c c sN t f | j�}x<|j|�D ].\}}}|tjkr:|dkr:tj}|||fV qW d S )N�$)r rg rz r! r r ry )rf r| Zpylexer�posZtype_�valuerh rh ri rz � s
z)CheetahPythonLexer.get_tokens_unprocessedN)r� r� r� r� rz rh rh rh ri r� � s r� c @ s� e Zd ZdZdZddgZddgZddgZd d
ee �fd e fd e j
fd
e j
fdee j
e e �e j
�fdee j
e e ��fdee j
e e �e j
�fde
fdefg iZdS )rH a2
Generic `cheetah templates`_ lexer. Code that isn't Cheetah
markup is yielded as `Token.Other`. This also works for
`spitfire templates`_ which use the same syntax.
.. _cheetah templates: http://www.cheetahtemplate.org/
.. _spitfire templates: http://code.google.com/p/spitfire/
ZCheetahZcheetahZspitfirez*.tmplz*.sptzapplication/x-cheetahzapplication/x-spitfirer� z (##[^\n]*)$z#[*](.|\n)*?[*]#z#end[^#\n]*(?:#|$)z#slurp$z(#[a-zA-Z]+)([^#\n]*)(#|$)z(\$)([a-zA-Z_][\w.]*\w)z(\$\{!?)(.*?)(\})(?s)a (?sx)
(.+?) # anything, followed by:
(?:
(?=\#[#a-zA-Z]*) | # an eval comment
(?=\$[a-zA-Z_{]) | # a substitution
\Z # end of string
)
z\s+N)r� r� r� r� r� r� r� r� r r ry r r� r r r} rh rh rh ri rH � s* c s6 e Zd ZdZdZdddgZddgZ� fdd �Z� ZS )
rI z_
Subclass of the `CheetahLexer` that highlights unlexed data
with the `HtmlLexer`.
z HTML+Cheetahz html+cheetahz
html+spitfireZ htmlcheetahztext/html+cheetahztext/html+spitfirec s t t| �jttf|� d S )N)r� rI re r rH )rf rg )r� rh ri re s zCheetahHtmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rI
s
c s4 e Zd ZdZdZddgZddgZ� fdd�Z� ZS ) rJ z^
Subclass of the `CheetahLexer` that highlights unlexed data
with the `XmlLexer`.
z XML+Cheetahz xml+cheetahz xml+spitfirezapplication/xml+cheetahzapplication/xml+spitfirec s t t| �jttf|� d S )N)r� rJ re r rH )rf rg )r� rh ri re # s zCheetahXmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rJ s
c s@ e Zd ZdZdZddddgZddd d
d d gZ� fd
d�Z� ZS )rK ze
Subclass of the `CheetahLexer` that highlights unlexed data
with the `JavascriptLexer`.
zJavaScript+Cheetahz
js+cheetahzjavascript+cheetahz js+spitfirezjavascript+spitfirez application/x-javascript+cheetahztext/x-javascript+cheetahztext/javascript+cheetahz!application/x-javascript+spitfireztext/x-javascript+spitfireztext/javascript+spitfirec s t t| �jttf|� d S )N)r� rK re r rH )rf rg )r� rh ri re 8 s z CheetahJavascriptLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rK ( s c
@ s� e Zd ZdZdZdgZddgZdefdee e
�fdee e
j �d fe d
�d efgd e d
fde
e�d
fdeee e
e��d
fded
fdeee e
�d
fgdee
j e
e�e
j �fdejfgd�ZdS )r9 z]
A lexer that highlights `genshi <http://genshi.edgewall.org/>`_ text
templates.
z Genshi TextZ
genshitextzapplication/x-genshi-textz
text/x-genshiz[^#$\s]+z
^(\s*)(##.*)$z ^(\s*)(#)� directiver� z[#$\s]z\nz#popz(?:def|for|if)\s+.*z (choose|when|with)([^\S\n]+)(.*)z(choose|otherwise)\bz(end\w*)([^\S\n]*)(.*)z(?<!\$)(\$\{)(.+?)(\})z (?<!\$)(\$)([a-zA-Z_][\w.]*))r� r� r� N)r� r� r� r� r� r� r� r r r r ry r r r r r r� r} rh rh rh ri r9 = s& c
@ sH e Zd ZdZejZdefdee j
e e �e j
�fdefde
jdfde
jdfed �d
efgd efd e
jd
fde
jdfgdeee e �e�dfdeee e �e�dfdedfgd efde
jd
fd e
jdfde
jdfgdedfdedfdedfgdedfed�defgdedfed�defgdefed �gd ee j
e e �e j
�fd e
jfgd � Zd S ) �GenshiMarkupLexerzX
Base lexer for Genshi markup, used by `HtmlGenshiLexer` and
`GenshiLexer`.
z[^<$]+z(<\?python)(.*?)(\?>)z'<\s*(script|style)\s*.*?>.*?<\s*/\1\s*>z<\s*py:[a-zA-Z0-9]+�pytagz<\s*[a-zA-Z0-9:.]+r� r� z[<$]z\s+z [\w:-]+\s*=�pyattrz/?\s*>z#popz (")(.*?)(")z (')(.*?)(')z[^\s>]+z
py:[\w-]+\s*=r� �"z attr-dstring�'z attr-sstringz[^\s>]*�stringsz[^"'$]+z(?<!\$)(\$\{)(.+?)(\})z (?<!\$)(\$)([a-zA-Z_][\w\.]*)) r� r� r� r� r� z attr-dstringz attr-sstringr� r� N)r� r� r� r� r� r� r� r r r ry r r r r� r r r� r r� r} rh rh rh ri r� ` sF
r� c sD e Zd ZdZdZddgZdddgZdgZ� fd d
�Zd d � Z � Z
S )
r8 z�
A lexer that highlights `genshi <http://genshi.edgewall.org/>`_ and
`kid <http://kid-templating.org/>`_ kid HTML templates.
z HTML+Genshiz html+genshizhtml+kidz*.htmlz*.htmz*.xhtmlztext/html+genshic s t t| �jttf|� d S )N)r� r8 re r r� )rf rg )r� rh ri re � s zHtmlGenshiLexer.__init__c C sF d}t jd| �d k r |d7 }t jd| �d k r4|d7 }|tj| � d S )Ng z \$\{.*?\}g�������?z
py:(.*?)=["']g{�G�z�?)r� r� r r� )r| r� rh rh ri r� � s z HtmlGenshiLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r8 � s
c sL e Zd ZdZdZddddgZdgZdgZd d
gZ� fd d �Z d
d� Z
� Z S )r7 z�
A lexer that highlights `genshi <http://genshi.edgewall.org/>`_ and
`kid <http://kid-templating.org/>`_ kid XML templates.
ZGenshiZgenshiZkidz
xml+genshizxml+kidz*.kidz*.xmlzapplication/x-genshizapplication/x-kidc s t t| �jttf|� d S )N)r� r7 re r r� )rf rg )r� rh ri re � s zGenshiLexer.__init__c C sF d}t jd| �d k r |d7 }t jd| �d k r4|d7 }|tj| � d S )Ng z \$\{.*?\}g�������?z
py:(.*?)=["']g{�G�z�?)r� r� r r� )r| r� rh rh ri r� � s zGenshiLexer.analyse_text) r� r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r7 � s c sH e Zd ZdZdZddddgZdgZdd d
gZ� fd d �Zd
d� Z � Z
S )r; zK
A lexer that highlights javascript code in genshi text templates.
zJavaScript+Genshi Textz
js+genshitextz js+genshizjavascript+genshitextzjavascript+genshiz*.jsz application/x-javascript+genshiztext/x-javascript+genshiztext/javascript+genshic s t t| �jttf|� d S )N)r� r; re r r9 )rf rg )r� rh ri re � s z JavascriptGenshiLexer.__init__c C s t j| �d S )Ng�������?)r7 r� )r| rh rh ri r� � s z"JavascriptGenshiLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r; � s c s@ e Zd ZdZdZddgZdgZdgZ� fdd�Zd d
� Z � Z
S ) r: zK
A lexer that highlights CSS definitions in genshi text templates.
zCSS+Genshi Textzcss+genshitextz
css+genshiz*.cssztext/css+genshic s t t| �jttf|� d S )N)r� r: re r r9 )rf rg )r� rh ri re � s zCssGenshiLexer.__init__c C s t j| �d S )Ng�������?)r7 r� )r| rh rh ri r� � s zCssGenshiLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r: � s c sL e Zd ZdZdZdddgZdgZddd gZd
gZ� fd d �Z d
d� Z
� Z S )r) z�
Subclass of the ERB lexer that highlights the unlexed data with the
html lexer.
Nested Javascript and CSS is highlighted too.
ZRHTMLZrhtmlzhtml+erbz html+rubyz*.rhtmlz*.htmlz*.htmz*.xhtmlztext/html+rubyc s t t| �jttf|� d S )N)r� r) re r r( )rf rg )r� rh ri re s zRhtmlLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g �?)r( r� r" )r| r� rh rh ri r�
s zRhtmlLexer.analyse_text) r� r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r) � s
c s@ e Zd ZdZdZddgZdgZdgZ� fdd�Zd d
� Z � Z
S ) r* zo
Subclass of `ErbLexer` which highlights data outside preprocessor
directives with the `XmlLexer`.
zXML+Rubyzxml+erbzxml+rubyz*.xmlzapplication/xml+rubyc s t t| �jttf|� d S )N)r� r* re r r( )rf rg )r� rh ri re s zXmlErbLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)r( r� r# )r| r� rh rh ri r� s zXmlErbLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r* s c s@ e Zd ZdZdZddgZdgZdgZ� fdd�Zd d
� Z � Z
S ) r+ zS
Subclass of `ErbLexer` which highlights unlexed data with the `CssLexer`.
zCSS+Rubyzcss+erbzcss+rubyz*.cssz
text/css+rubyc s t t| �jttf|� d S )N)r� r+ re r r( )rf rg )r� rh ri re 1 s zCssErbLexer.__init__c C s t j| �d S )Ng�������?)r( r� )r| rh rh ri r� 4 s zCssErbLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r+ ' s c sH e Zd ZdZdZddddgZdgZdd d
gZ� fd d �Zd
d� Z � Z
S )r, z^
Subclass of `ErbLexer` which highlights unlexed data with the
`JavascriptLexer`.
zJavaScript+Rubyzjs+erbzjavascript+erbzjs+rubyzjavascript+rubyz*.jsz application/x-javascript+rubyztext/x-javascript+rubyztext/javascript+rubyc s t t| �jttf|� d S )N)r� r, re r r( )rf rg )r� rh ri re E s zJavascriptErbLexer.__init__c C s t j| �d S )Ng�������?)r( r� )r| rh rh ri r� I s z JavascriptErbLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r, 8 s c sT e Zd ZdZdZdgZdgZddddd gZd
d d d
dgZ� fdd�Z dd� Z
� Z S )r$ z�
Subclass of `PhpLexer` that highlights unhandled data with the `HtmlLexer`.
Nested Javascript and CSS is highlighted too.
zHTML+PHPzhtml+phpz*.phtmlz*.phpz*.htmlz*.htmz*.xhtmlz
*.php[345]zapplication/x-phpzapplication/x-httpd-phpzapplication/x-httpd-php3zapplication/x-httpd-php4zapplication/x-httpd-php5c s t t| �jttf|� d S )N)r� r$ re r r )rf rg )r� rh ri re ] s zHtmlPhpLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g �?)r r� r" )r| r� rh rh ri r� ` s zHtmlPhpLexer.analyse_text) r� r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r$ M s c sB e Zd ZdZdZdgZdddgZdgZ� fdd �Zd
d � Z � Z
S ) r% zT
Subclass of `PhpLexer` that highlights unhandled data with the `XmlLexer`.
zXML+PHPzxml+phpz*.xmlz*.phpz
*.php[345]zapplication/xml+phpc s t t| �jttf|� d S )N)r� r% re r r )rf rg )r� rh ri re q s zXmlPhpLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)r r� r# )r| r� rh rh ri r� t s zXmlPhpLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r% g s
c s> e Zd ZdZdZdgZdgZdgZ� fdd�Zdd � Z � Z
S )
r& zU
Subclass of `PhpLexer` which highlights unmatched data with the `CssLexer`.
zCSS+PHPzcss+phpz*.cssz text/css+phpc s t t| �jttf|� d S )N)r� r& re r r )rf rg )r� rh ri re � s zCssPhpLexer.__init__c C s t j| �d S )Ng�������?)r r� )r| rh rh ri r� � s zCssPhpLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r& { s c sD e Zd ZdZdZddgZdgZdddgZ� fd d
�Zd d � Z � Z
S )
r' z`
Subclass of `PhpLexer` which highlights unmatched data with the
`JavascriptLexer`.
zJavaScript+PHPzjs+phpzjavascript+phpz*.jsz application/x-javascript+phpztext/x-javascript+phpztext/javascript+phpc s t t| �jttf|� d S )N)r� r' re r r )rf rg )r� rh ri re � s zJavascriptPhpLexer.__init__c C s
t j| �S )N)r r� )r| rh rh ri r� � s z JavascriptPhpLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r' � s c sD e Zd ZdZdZdgZddddgZdgZ� fd d
�Zd d � Z � Z
S )
r. z�
Subclass of the `SmartyLexer` that highlights unlexed data with the
`HtmlLexer`.
Nested Javascript and CSS is highlighted too.
z HTML+Smartyz html+smartyz*.htmlz*.htmz*.xhtmlz*.tplztext/html+smartyc s t t| �jttf|� d S )N)r� r. re r r- )rf rg )r� rh ri re � s zHtmlSmartyLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g �?)r- r� r" )r| r� rh rh ri r� � s z HtmlSmartyLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r. � s c s@ e Zd ZdZdZdgZddgZdgZ� fdd�Zd d
� Z � Z
S ) r/ z]
Subclass of the `SmartyLexer` that highlights unlexed data with the
`XmlLexer`.
z
XML+Smartyz
xml+smartyz*.xmlz*.tplzapplication/xml+smartyc s t t| �jttf|� d S )N)r� r/ re r r- )rf rg )r� rh ri re � s zXmlSmartyLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)r- r� r# )r| r� rh rh ri r� � s zXmlSmartyLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r/ � s c s@ e Zd ZdZdZdgZddgZdgZ� fdd�Zd d
� Z � Z
S ) r0 z]
Subclass of the `SmartyLexer` that highlights unlexed data with the
`CssLexer`.
z
CSS+Smartyz
css+smartyz*.cssz*.tplztext/css+smartyc s t t| �jttf|� d S )N)r� r0 re r r- )rf rg )r� rh ri re � s zCssSmartyLexer.__init__c C s t j| �d S )Ng�������?)r- r� )r| rh rh ri r� � s zCssSmartyLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r0 � s c sF e Zd ZdZdZddgZddgZddd gZ� fd
d �Zd d
� Z � Z
S )r1 zd
Subclass of the `SmartyLexer` that highlights unlexed data with the
`JavascriptLexer`.
zJavaScript+Smartyz js+smartyzjavascript+smartyz*.jsz*.tplz application/x-javascript+smartyztext/x-javascript+smartyztext/javascript+smartyc s t t| �jttf|� d S )N)r� r1 re r r- )rf rg )r� rh ri re � s z JavascriptSmartyLexer.__init__c C s t j| �d S )Ng�������?)r- r� )r| rh rh ri r� � s z"JavascriptSmartyLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r1 � s c sH e Zd ZdZdZdddgZdddgZd d
gZ� fd d �Zd
d� Z � Z
S )r3 z�
Subclass of the `DjangoLexer` that highlights unlexed data with the
`HtmlLexer`.
Nested Javascript and CSS is highlighted too.
zHTML+Django/Jinjaz html+djangoz
html+jinjaZ
htmldjangoz*.htmlz*.htmz*.xhtmlztext/html+djangoztext/html+jinjac s t t| �jttf|� d S )N)r� r3 re r r2 )rf rg )r� rh ri re s zHtmlDjangoLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g �?)r2 r� r" )r| r� rh rh ri r� s z HtmlDjangoLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r3 � s
c sB e Zd ZdZdZddgZdgZddgZ� fdd �Zd
d � Z � Z
S ) r5 z]
Subclass of the `DjangoLexer` that highlights unlexed data with the
`XmlLexer`.
zXML+Django/Jinjaz
xml+djangoz xml+jinjaz*.xmlzapplication/xml+djangozapplication/xml+jinjac s t t| �jttf|� d S )N)r� r5 re r r2 )rf rg )r� rh ri re s zXmlDjangoLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)r2 r� r# )r| r� rh rh ri r� s zXmlDjangoLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r5 s c sB e Zd ZdZdZddgZdgZddgZ� fdd �Zd
d � Z � Z
S ) r4 z]
Subclass of the `DjangoLexer` that highlights unlexed data with the
`CssLexer`.
zCSS+Django/Jinjaz
css+djangoz css+jinjaz*.cssztext/css+djangoztext/css+jinjac s t t| �jttf|� d S )N)r� r4 re r r2 )rf rg )r� rh ri re + s zCssDjangoLexer.__init__c C s t j| �d S )Ng�������?)r2 r� )r| rh rh ri r� . s zCssDjangoLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r4 s c sN e Zd ZdZdZddddgZdgZdd d
d d d
gZ� fdd�Zdd� Z � Z
S )r6 zd
Subclass of the `DjangoLexer` that highlights unlexed data with the
`JavascriptLexer`.
zJavaScript+Django/Jinjaz js+djangozjavascript+djangozjs+jinjazjavascript+jinjaz*.jsz application/x-javascript+djangoz application/x-javascript+jinjaztext/x-javascript+djangoztext/x-javascript+jinjaztext/javascript+djangoztext/javascript+jinjac s t t| �jttf|� d S )N)r� r6 re r r2 )rf rg )r� rh ri re C s z JavascriptDjangoLexer.__init__c C s t j| �d S )Ng�������?)r2 r� )r| rh rh ri r� G s z"JavascriptDjangoLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri r6 2 s c @ sF e Zd ZdZdedfdefdefdefgdedfd ee�fgd
�Zd S ) � JspRootLexerzt
Base for the `JspLexer`. Yields `Token.Other` for area outside of
JSP tags.
.. versionadded:: 0.7
z<%\S?�seczC</?jsp:(forward|getProperty|include|plugin|setProperty|useBean).*?>z[^<]+�<z%>z#popz[\w\W]+?(?=%>|\Z))r� r� N) r� r� r� r� r r r r
r} rh rh rh ri r� K s r� c s> e Zd ZdZdZdgZdgZdgZ� fdd�Zdd � Z � Z
S )
rG zA
Lexer for Java Server Pages.
.. versionadded:: 0.7
zJava Server PageZjspz*.jspzapplication/x-jspc s t t| �jttf|� d S )N)r� rG re r r� )rf rg )r� rh ri re o s zJspLexer.__init__c C s: t j| �d }t| �r |d7 }d| kr6d| kr6|d7 }|S )Ng{�G�z�?g�������?z<%z%>g�������?)r
r� r# )r| r� rh rh ri r� r s zJspLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rG d s c @ s� e Zd ZdZdZdgZdgZdgZej Z
de fde j
dfd e fd
e j
fd eeejed ee�fd
eeejed eee�e�fdeeejed ee�e�fdeeej�fdeed ee�ejd d e�fde fg
de j
fde j
dfde j
dfde j
fgd�Zd S )rL zR
For files using the Evoque templating system.
.. versionadded:: 1.1
ZEvoqueZevoquez*.evoquezapplication/x-evoquez[^#$]+z#\[�commentz\$\$z\$\w+:[^$\n]*\$z'(\$)(begin|end)(\{(%)?)(.*?)((?(4)%)\})Nz>(\$)(evoque|overlay)(\{(%)?)(\s*[#\w\-"\'.]+)?(.*?)((?(4)%)\})z!(\$)(\w+)(\{(%)?)(.*?)((?(4)%)\})z(\$)(else|rof|fi)z%(\$\{(%)?)(.*?)((!)(.*?))?((?(2)%)\})�#z[^\]#]z#pushz\]#z#popz[\]#])r� r� )r� r� r� r� r� r� r� r� r� r� r� r r r� r r r r� r r r r} rh rh rh ri rL { s8
c s6 e Zd ZdZdZdgZdgZdgZ� fdd�Z� Z S )rM zy
Subclass of the `EvoqueLexer` that highlights unlexed data with the
`HtmlLexer`.
.. versionadded:: 1.1
z HTML+Evoquez html+evoquez*.htmlztext/html+evoquec s t t| �jttf|� d S )N)r� rM re r rL )rf rg )r� rh ri re � s zEvoqueHtmlLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri rM � s c s6 e Zd ZdZdZdgZdgZdgZ� fdd�Z� Z S )rN zx
Subclass of the `EvoqueLexer` that highlights unlexed data with the
`XmlLexer`.
.. versionadded:: 1.1
z
XML+Evoquez
xml+evoquez*.xmlzapplication/xml+evoquec s t t| �jttf|� d S )N)r� rN re r rL )rf rg )r� rh ri re � s zEvoqueXmlLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri rN � s c @ s� e Zd ZdZdZdgZg Zg Zej Z
de j fde j
fdefdefdefd efd
efd efd efd
ejdfdej fdefdefdejfdejfdeejee�fdejfdefdefgdejfdejfdejfdejfd
ejd fgd �Zd S ) rO z
Coldfusion statements
Z cfstatementZcfsz//.*?\nz/\*(?:.|\n)*?\*/z\+\+|--z
[-+*/^&=!]z <=|>=|<|>|==zmod\bz"(eq|lt|gt|lte|gte|not|is|and|or)\bz\|\||&&z\?r� �stringz'.*?'z\d+z�(if|else|len|var|xml|default|break|switch|component|property|function|do|try|catch|in|continue|for|return|while|required|any|array|binary|boolean|component|date|guid|numeric|query|string|struct|uuid|case)\bz(true|false|null)\bzD(application|session|client|cookie|super|this|variables|arguments)\bz([a-z_$][\w.]*)(\s*)(\()z
[a-z_$][\w.]*z[()\[\]{};:,.\\]z\s+z""z#.+?#z[^"#]+r� z#pop)r� r� N) r� r� r� r� r� r� r� r� r� �
IGNORECASEr� r r� r� r r r� r r r� r r r� r r r� ZInterpr} rh rh rh ri rO � sB
c
@ s� e Zd ZdZdZdgZg Zg Zdefe d�defgde
j dfd e
fd
e j
d fd ee j
ee�e j
�fd
ee j
ee�e j
�fgdefdeeee�e�fde j
dfe d�defdefgde
j dfde
j dfde
j fgd�ZdS )�ColdfusionMarkupLexerz
Coldfusion markup only
Z
ColdfusionZcfz[^<]+�tagsz<[^<>]*z<!---� cfcommentz(?s)<!--.*?-->z
<cfoutput.*?>�cfoutputz((?s)(<cfscript.*?>)(.+?)(</cfscript.*?>)z�(?s)(</?cf(?:component|include|if|else|elseif|loop|return|dbinfo|dump|abort|location|invoke|throw|file|savecontent|mailpart|mail|header|content|zip|image|lock|argument|try|catch|break|directory|http|set|function|param)\b)(.*?)((?<!\\)>)z[^#<]+z (#)(.*?)(#)z</cfoutput.*?>z#popz (?s)<[^<>]*r� z#pushz--->z([^<-]|<(?!!---)|-(?!-->))+)r� r� r� r� N)r� r� r� r� r� r� r� r� r r r r� r r� r r rO r r} rh rh rh ri r� s2
r� c s8 e Zd ZdZdZdgZddgZdgZ� fdd�Z� Z S ) rP z#
Coldfusion markup in html
zColdfusion HTMLZcfmz*.cfmz*.cfmlzapplication/x-coldfusionc s t t| �jttf|� d S )N)r� rP re r r� )rf rg )r� rh ri re 9 s z ColdfusionHtmlLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri rP 0 s c s4 e Zd ZdZdZdgZdgZg Z� fdd�Z� Z S )rQ zH
Coldfusion markup/script components
.. versionadded:: 2.0
zColdfusion CFCZcfcz*.cfcc s t t| �jttf|� d S )N)r� rQ re rP rO )rf rg )r� rh ri re I s zColdfusionCFCLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri rQ > s c s> e Zd ZdZdZdgZdgZdgZ� fdd�Zdd � Z � Z
S )
rU zD
Lexer for Scalate Server Pages.
.. versionadded:: 1.4
zScalate Server PageZsspz*.sspzapplication/x-sspc s t t| �jttf|� d S )N)r� rU re r r� )rf rg )r� rh ri re Y s zSspLexer.__init__c C sD d}t jd| �r|d7 }t| �r(|d7 }d| kr@d| kr@|d7 }|S )Ng z val \w+\s*:g333333�?g�������?z<%z%>g�������?)r� r� r# )r| r� rh rh ri r� \ s zSspLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rU N s c @ s@ e Zd ZdZdedfdefdefgdedfdee�fgd �Zd
S ) �TeaTemplateRootLexerz
Base for the `TeaTemplateLexer`. Yields `Token.Other` for area outside of
code blocks.
.. versionadded:: 1.5
z<%\S?r� z[^<]+r� z%>z#popz[\w\W]+?(?=%>|\Z))r� r� N) r� r� r� r� r r r r r} rh rh rh ri r� g s r� c s> e Zd ZdZdZdgZdgZdgZ� fdd�Zdd � Z � Z
S )
rV zW
Lexer for `Tea Templates <http://teatrove.org/>`_.
.. versionadded:: 1.5
ZTeaZteaz*.teaz
text/x-teac s t t| �jttf|� d S )N)r� rV re r r� )rf rg )r� rh ri re � s zTeaTemplateLexer.__init__c C s: t j| �d }t| �r |d7 }d| kr6d| kr6|d7 }|S )Ng{�G�z�?g�������?z<%z%>g�������?)r r� r# )r| r� rh rh ri r� � s z TeaTemplateLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rV } s c sP e Zd ZdZdZdgZdddddd d
d gZd d
dgZ� fdd�Zdd� Z � Z
S )rW z�
Subclass of the `LassoLexer` which highlights unhandled data with the
`HtmlLexer`.
Nested JavaScript and CSS is also highlighted.
.. versionadded:: 1.6
z
HTML+Lassoz
html+lassoz*.htmlz*.htmz*.xhtmlz*.lassoz *.lasso[89]z*.inclz*.incz*.lasztext/html+lassozapplication/x-httpd-lassoz application/x-httpd-lasso[89]c s t t| �jttf|� d S )N)r� rW re r r )rf rg )r� rh ri re � s zLassoHtmlLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g �?)r r� r" )r| r� rh rh ri r� � s zLassoHtmlLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rW � s
c sH e Zd ZdZdZdgZdddddd gZd
gZ� fd d �Zd
d� Z � Z
S )rX zz
Subclass of the `LassoLexer` which highlights unhandled data with the
`XmlLexer`.
.. versionadded:: 1.6
z XML+Lassoz xml+lassoz*.xmlz*.lassoz *.lasso[89]z*.inclz*.incz*.laszapplication/xml+lassoc s t t| �jttf|� d S )N)r� rX re r r )rf rg )r� rh ri re � s zLassoXmlLexer.__init__c C s" t j| �d }t| �r |d7 }|S )Ng{�G�z�?g�������?)r r� r# )r| r� rh rh ri r� � s zLassoXmlLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rX � s
c s> e Zd ZdZdZdgZdgZdgZ� fdd�Zdd � Z � Z
S )
rY zz
Subclass of the `LassoLexer` which highlights unhandled data with the
`CssLexer`.
.. versionadded:: 1.6
z CSS+Lassoz css+lassoz*.cssztext/css+lassoc s" d|d< t t| �jttf|� d S )NT�requiredelimiters)r� rY re r r )rf rg )r� rh ri re � s zLassoCssLexer.__init__c C s6 t j| �d }tjd| �r"|d7 }d| kr2|d7 }|S )Ng�������?z\w+:.+?;g�������?zpadding:)r r� r� r� )r| r� rh rh ri r� � s zLassoCssLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rY � s c sD e Zd ZdZdZddgZdgZdddgZ� fd d
�Zd d � Z � Z
S )
rZ z�
Subclass of the `LassoLexer` which highlights unhandled data with the
`JavascriptLexer`.
.. versionadded:: 1.6
zJavaScript+Lassozjs+lassozjavascript+lassoz*.jsz application/x-javascript+lassoztext/x-javascript+lassoztext/javascript+lassoc s" d|d< t t| �jttf|� d S )NTr� )r� rZ re r r )rf rg )r� rh ri re � s z LassoJavascriptLexer.__init__c C s t j| �d }|S )Ng�������?)r r� )r| r� rh rh ri r� � s z!LassoJavascriptLexer.analyse_text) r� r� r� r� r� r� r� r� re r� r� rh rh )r� ri rZ � s c @ sL e Zd ZdZdZdgZdefdefdeej e
�dfdeej e
�dfgd e
fd
ej d fd ej d fd
ee e �fde fdee
je
j�fdee
je�fdee e
e �fdee e
e
j�fdee e
e�dfed�g d e
fded fdee e
e
je
�fdee e
eedd��fde
jfed�gd e
jfd e
jfd e
jfged�d ejfd ejfd!efgd"�Zd#S )$r[ z�
Generic `handlebars <http://handlebarsjs.com/>` template lexer.
Highlights only the Handlebars template tags (stuff between `{{` and `}}`).
Everything else is left for a delegating lexer.
.. versionadded:: 2.0
Z
HandlebarsZ
handlebarsz[^{]+z \{\{!.*\}\}z
(\{\{\{)(\s*)r� z (\{\{)(\s*)z\s+z\}\}\}z#popz\}\}z/([#/]*)(each|if|unless|else|with|log|in(line)?)z #\*inlinez([#/])([\w-]+)z ([\w-]+)(=)z(>)(\s*)(@partial-block)z(#?>)(\s*)([\w-]+)z (>)(\s*)(\()zdynamic-partial�genericz\)z(lookup)(\s+)(\.|this)(\s+)z(lookup)(\s+)(\S+)r� )r~ z[\w-]+z[a-zA-Z][\w-]*z\.[\w-]+z (this\/|\.\/|(\.\.\/)+)[\w-]+z:?"(\\\\|\\"|[^"])*"z:?'(\\\\|\\'|[^'])*'z>[0-9](\.[0-9]*)?(eE[+-][0-9])?[flFLdD]?|0[xX][0-9a-fA-F]+[Ll]?)r� r� zdynamic-partialr� r� N)r� r� r� r� r� r� r r r �Specialr ry r r r� r� r r� r r r r r r� r� r r} rh rh rh ri r[ � sH
c s: e Zd ZdZdZdgZddgZddgZ� fdd �Z� Z S )
r\ z}
Subclass of the `HandlebarsLexer` that highlights unlexed data with the
`HtmlLexer`.
.. versionadded:: 2.0
zHTML+Handlebarszhtml+handlebarsz *.handlebarsz*.hbsztext/html+handlebarsztext/x-handlebars-templatec s t t| �jttf|� d S )N)r� r\ re r r[ )rf rg )r� rh ri re U s z HandlebarsHtmlLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri r\ H s c s< e Zd ZdZdZdddgZdgZddgZ� fd d
�Z� Z S ) r] z�
Subclass of the `DjangoLexer` that highlights unlexed data with the
`YamlLexer`.
Commonly used in Saltstack salt states.
.. versionadded:: 2.0
z
YAML+Jinjaz
yaml+jinjaZsaltZslsz*.slsztext/x-yaml+jinjaz
text/x-slsc s t t| �jttf|� d S )N)r� r] re r r2 )rf rg )r� rh ri re h s zYamlJinjaLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri r] Y s
c @ sj e Zd ZdZdZdgZdgZdefdee e
�dfdee e
e e dd ��d
fd efgd e
jd
fdee
je
�eddd�fdee
je
e �dfdeeje
e e dd �e
e �dfdeeje
e �dfdeeje
e �dfdee
jde
e �dfdeejde
e �dfd eeje
e e dd �e e
�d fd eeje
�d fg
ed�d e dfd!e d"fged�d e dDfd#eeje e
�d$fgd!e dfed%�ed&�ged�ed�d'ee e dd �e
ee
e e dd �e
e �fd(efd)ejfd*ee e dd �e
eje
e e dd ��fed�ed�ged�ed+�gd,ee
ede
�dfd-ee
eje
�dfgd e dfgd.e dEfgd/e
dfged�d0eeje
e�fd1ee e
e e dd �e
e �fed2�ed3�ed4�d5e fged6�d7efged6�ed�d7efgd.e dFfed&�gd.e dGfed8�gd9e
jfgd:ejfd;e fgd<ejfd=ejfgd>e j fd?e j fged4�ed2�ed3�ed�gd@e
fgdAee e
eje
e �dHfd7e fgdefdBee e
eje
e �dfd efgdC�Z dS )Ir^ zw
Lexer for `Liquid templates
<http://www.rubydoc.info/github/Shopify/liquid>`_.
.. versionadded:: 2.0
Zliquidz*.liquidz[^{]+z
(\{%)(\s*)z tag-or-blockz(\{\{)(\s*)([^\s}]+)r� )r~ �outputz\{z (if|unless|elsif|case)(?=\s+)� conditionz (when)(\s+)z end-of-block�
whitespacez(else)(\s*)(%\})�#popz!(capture)(\s+)([^\s%]+)(\s*)(%\})r� z(comment)(\s*)(%\})r� z(raw)(\s*)(%\})�rawz (end(case|unless|if))(\s*)(%\})Nz(end([^\s%]+))(\s*)(%\})z"(cycle)(\s+)(?:([^\s:]*)(:))?(\s*)zvariable-tag-markupz([^\s%]+)(\s*)z
tag-markupz\}\}z\|�filtersz([^\s|:]+)(:?)(\s*)z
filter-markupz
end-of-tagzdefault-param-markupz/([^\s=!><]+)(\s*)([=!><]=?)(\s*)(\S+)(\s*)(%\})z\b!z\bnot\bz*([\w.\'"]+)(\s+)(contains)(\s+)([\w.\'"]+)zend-at-whitespacez(\s*)((=|!|>|<)=?)(\s*)z(\s*)(\bcontains\b)(\s*)z%\}z\s+z([^\s=:]+)(\s*)(=|:)z (\{\{)(\s*)([^\s}])(\s*)(\}\})r� �number�keyword�,z param-markupr� zvariable-param-markupz\b(false|true)\bz [a-zA-Z_]\w*z(?<=\w)\.(?=\w)z'[^']*'z"[^"]*"z\d+\.\d+z\d+z[ \t]+z (\{%)(\s*)(endcomment)(\s*)(%\})z (\{%)(\s*)(endraw)(\s*)(%\}))r� z tag-or-blockr� r� z
filter-markupr� z
generic-value�operatorz
end-of-tagz end-of-blockzend-at-whitespacez param-markupzdefault-param-markupzvariable-param-markupz
tag-markupzvariable-tag-markupr� r� r� r� r� r� r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )!r� r� r� r� r� r� r� r r r r r r r ZReservedr r r� r r� r ZWordr� r� r� r r� r� r ZFloatZIntegerr r} rh rh rh ri r^ l s�
c @ s� e Zd ZdZdZdgZdgZejej B Z
dZ dZ de d Z
e e
Zd efd
ejd fd efd
eejeeeejeejeeeej� fdeejeeeejeejeeeej� fde eejeeeej�dfdeejee�dfdefgde eeeej�fde eeeeeej�fdejfdefdejfeejfde ejfdefde j fde j fd efd efg d efd eeej�d fe d!�gd efd"eeej�d fe d!�d#e fgd$�Z!d%S )&r_ z�
`Twig <http://twig.sensiolabs.org/>`_ template lexer.
It just highlights Twig code between the preprocessor directives,
other data is left untouched by the lexer.
.. versionadded:: 2.0
ZTwigZtwigzapplication/x-twigz[\\\w-]|[^\x00-\x7f]z(?:[\\_a-z]|[^\x00-\x7f])z(?:z)*z[^{]+z\{\{r� z \{\#.*?\#\}zB(\{%)(-?\s*)(raw)(\s*-?)(%\})(.*?)(\{%)(-?\s*)(endraw)(\s*-?)(%\})zL(\{%)(-?\s*)(verbatim)(\s*-?)(%\})(.*?)(\{%)(-?\s*)(endverbatim)(\s*-?)(%\})z (\{%%)(-?\s*)(filter)(\s+)(%s)r� z(\{%)(-?\s*)([a-zA-Z_]\w*)z\{z
(\|)(\s*)(%s)z(is)(\s+)(not)?(\s*)(%s)z (?i)(true|false|none|null)\bz�(in|not|and|b-and|or|b-or|b-xor|isif|elseif|else|importconstant|defined|divisibleby|empty|even|iterable|odd|sameasmatches|starts\s+with|ends\s+with)\bz(loop|block|parent)\bz\.z\.[0-9]+z:?"(\\\\|\\"|[^"])*"z:?'(\\\\|\\'|[^'])*'z4([{}()\[\]+\-*/,:~%]|\.\.|\?|:|\*\*|\/\/|!=|[><=]=?)z>[0-9](\.[0-9]*)?(eE[+-][0-9])?[flFLdD]?|0[xX][0-9a-fA-F]+[Ll]?z\s+z
(-?)(\}\})z#popr� z (-?)(%\})r� )r� r� r� r� N)"r� r� r� r� r� r� r� r� r� r� r� Z _ident_charZ _ident_beginZ
_ident_endZ _ident_innerr r ry r r r r r� r r� r� r� r r r� r� r r r} rh rh rh ri r_ : sb
c s6 e Zd ZdZdZdgZdgZdgZ� fdd�Z� Z S )r` zw
Subclass of the `TwigLexer` that highlights unlexed data with the
`HtmlLexer`.
.. versionadded:: 2.0
z HTML+Twigz html+twigz*.twigztext/html+twigc s t t| �jttf|� d S )N)r� r` re r r_ )rf rg )r� rh ri re � s zTwigHtmlLexer.__init__)
r� r� r� r� r� r� r� r� re r� rh rh )r� ri r` � s c @ s� e Zd ZdZdZdgZdefdeej e
�dfdee e j
e e
ee
�dfd ee e j
e e
�fd
ee e j
e e�dfd ee e j
e �fgd e
fd
ej dfdejfdejfdejfdefde jfde jfdeee
ee
ee
ee
�fg dedfdedfdedfgd�ZdS )ra ad
Generic
`angular2 <http://victorsavkin.com/post/119943127151/angular-2-template-syntax>`_
template lexer.
Highlights only the Angular template tags (stuff between `{{` and `}}` and
special attributes: '(event)=', '[property]=', '[(twoWayBinding)]=').
Everything else is left for a delegating lexer.
.. versionadded:: 2.1
ZAngular2Zng2z [^{([*#]+z (\{\{)(\s*)� ngExpressionz&([([]+)([\w:.-]+)([\])]+)(\s*)(=)(\s*)r� z ([([]+)([\w:.-]+)([\])]+)(\s*)z ([*#])([\w:.-]+)(\s*)(=)(\s*)z([*#])([\w:.-]+)(\s*)z \s+(\|\s+)?z\}\}z#popz:?(true|false)z:?"(\\\\|\\"|[^"])*"z:?'(\\\\|\\'|[^'])*'z>[0-9](\.[0-9]*)?(eE[+-][0-9])?[flFLdD]?|0[xX][0-9a-fA-F]+[Ll]?z[a-zA-Z][\w-]*(\(.*\))?z\.[\w-]+(\(.*\))?z-(\?)(\s*)([^}\s]+)(\s*)(:)(\s*)([^}\s]+)(\s*)z".*?"z'.*?'z[^\s>]+)r� r� r� N)r� r� r� r� r� r� r r r ry r r r r� r r ZBooleanr� r� r r� r} rh rh rh ri ra � s8
c s0 e Zd ZdZdZdgZdgZ� fdd�Z� ZS )rb z{
Subclass of the `Angular2Lexer` that highlights unlexed data with the
`HtmlLexer`.
.. versionadded:: 2.0
zHTML + Angular2zhtml+ng2z*.ng2c s t t| �jttf|� d S )N)r� rb re r ra )rf rg )r� rh ri re � s zAngular2HtmlLexer.__init__) r� r� r� r� r� r� r� re r� rh rh )r� ri rb � s
)tr� r� Zpygments.lexers.htmlr r Zpygments.lexers.javascriptr r Zpygments.lexers.cssr Zpygments.lexers.phpr Zpygments.lexers.pythonr Zpygments.lexers.perlr Zpygments.lexers.jvmr
r Zpygments.lexers.datar Zpygments.lexerr
r r r r r r r r Zpygments.tokenr r r r r r r r r r r r! Z
pygments.utilr" r# �__all__r( r- rR rS rT r2 r< r= r> r@ r? rA rB rC rD rE rF r� rH rI rJ rK r9 r� r8 r7 r; r: r) r* r+ r, r$ r% r& r' r. r/ r0 r1 r3 r5 r4 r6 r� rG rL rM rN rO r� rP rQ rU r� rV rW rX rY rZ r[ r\ r] r^ r_ r` ra rb rh rh rh ri �<module>
s� ,8 _8RS09D
,#@50. L OS@