3
�Pfml � @ s� d dl mZ d dlmZ d dlZd dlZd dlZd dlZd dlZ d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlZd dlZd dlZd dlZd dlmZ d dlmZmZmZ d dlmZmZm Z m Z m Z m Z d dl m!Z! d dl"m#Z# d d l$m%Z% d d
l&m'Z' e%�r d d lm(Z) n d d lm)Z) d
ddddddddddddddd d d d d d!d"d#d$gZ*e j+e,�Z-dzZ.d{Z/d|Z0d}Z1e0e. e1 e/ Z2e0e1 Z3yd dl4Z4e3e.7 Z3W n e5k
�r� e-j6d1� Y nX yd dl7Z7e3e/7 Z3W n e5k
�r� e-j6d2� Y nX d3d4� Z8d5d!� Z9d6d� Z:e'd7d8d9�d~d;d
��Z;d<d=� Z<d>d� Z=dd@d�Z>dAdB� Z?dCd� Z@dDd� ZAdEd� ZBdFd� ZCdGd� ZDejEfdHdI�ZFdJd� ZGdKd� ZHd�dMd�ZIdNd� ZJdOd� ZKdPdQ� ZLdRdS� ZMdTdU� ZNdVdW� ZOdXdY� ZPdZd[� ZQdLedLd:d:fd\d]�ZRd^d_� ZSd`da� ZTdbd� ZUdcdd� ZVd�ded �ZWdfd � ZXdgd � ZYd�did �ZZdjdk� Z[dldm� Z\G dndo� doe]�Z^G dpdq� dqe)�Z_ej`drds� �Zadtd � ZbG dudv� dve]�Zcd�dwd$�Zddxdy� ZedS )�� )�absolute_import)�dequeN)�InstallationError)�console_to_str�
expanduser� stdlib_pkgs)�
site_packages� user_site�running_under_virtualenv�virtualenv_no_global�write_delete_marker_file�distutils_scheme)�
pkg_resources)�input)�PY2)�retry)�BytesIO)�StringIO�rmtree� display_path�
backup_dir�ask�splitext� format_size�is_installable_dir� is_svn_page�
file_contents�split_leading_dir�has_leading_dir�normalize_path�renames�get_terminal_size�get_prog�
unzip_file�
untar_file� unpack_file�call_subprocess�captured_stdout�
ensure_dir�ARCHIVE_EXTENSIONS�SUPPORTED_EXTENSIONS�get_installed_version�.tar.bz2�.tbz�.tar.xz�.txz�.tlz�.tar.lz� .tar.lzma�.zip�.whl�.tar.gz�.tgz�.tarzbz2 module is not availablez lzma module is not availablec O s, yt | �S tk
r& |||��Y nX d S )N)�
__import__� ImportError)Zpkg_or_module_stringZ
ExceptionType�args�kwargs� r< � /usr/lib/python3.6/__init__.py�import_or_raiseI s r> c C sD yt j| � W n0 tk
r> } z|jtjkr.� W Y dd}~X nX dS )z os.path.makedirs without EEXIST.N)�os�makedirs�OSError�errnoZEEXIST)�path�er< r< r= r( P s
c
C sD y$t jjtjd �dkr"dtj S W n tttfk
r> Y nX dS )Nr � __main__.py�-cz %s -m pipZpip)rE rF ) r? rC �basename�sys�argv�
executable�AttributeError� TypeError�
IndexErrorr< r< r< r= r" Y s i� i� )Zstop_max_delayZ
wait_fixedFc C s t j| |td� d S )N)�
ignore_errors�onerror)�shutilr �rmtree_errorhandler)�dirrN r< r< r= r c s c C s2 t j|�jtj@ r,t j|tj� | |� dS � dS )z�On Windows, the files in .svn are read-only, so when rmtree() tries to
remove them, an exception is thrown. We catch that here, remove the
read-only attribute, and hopefully continue without problems.N)r? �stat�st_mode�S_IREAD�chmod�S_IWRITE)�funcrC �exc_infor< r< r= rQ i s
rQ c C st t jjt jj| ��} tjd dkrB| jtj� d�} | jtj � d�} | j
t j � t jj �rpd| t
t j � �d� } | S )zTGives the display value for a given path, making it relative to cwd
if possible.r � �replace�.N)r? rC �normcase�abspathrH � version_info�decode�getfilesystemencoding�encode�getdefaultencoding�
startswith�getcwd�sep�len)rC r< r< r= r x s �.bakc C s: d}|}x(t jj| | �r0|d7 }|t|� }q
W | | S )z\Figure out the name of a directory to back up the given dir to
(adding .bak, .bak2, etc)� )r? rC �exists�str)rR �ext�n� extensionr< r< r= r � s c C s2 x&t jjdd�j� D ]}||kr|S qW t| |�S )NZPIP_EXISTS_ACTION� )r? �environ�get�splitr )�message�options�actionr< r< r= �ask_path_exists� s rv c C sZ xTt jjd�rtd| ��t| �}|j� j� }||krNtd|dj|�f � q|S qW dS )z@Ask the message interactively, with the given possible responsesZ PIP_NO_INPUTz7No input was expected ($PIP_NO_INPUT set); question: %sz<Your response (%r) was not one of the expected responses: %sz, N) r? rp rq � Exceptionr �strip�lower�print�join)rs rt Zresponser< r< r= r � s c C sL | dkrd| d d S | d kr,d| d S | dkr@d| d S d| S d S )
Ni� z%.1fMBg @�@�
z%ikBz%.1fkBz%ibytesi@B i' r< )�bytesr< r< r= r � s c C s2 t jj| �sdS t jj| d�}t jj|�r.dS dS )z@Return True if `path` is a directory containing a setup.py file.Fzsetup.pyT)r? rC �isdirr{ �isfile)rC Zsetup_pyr< r< r= r � s c C s t jd| �ot jd| t j�S )zT
Returns true if the page appears to be the index page of an svn repository
z<title>[^<]*Revision \d+:z#Powered by (?:<a[^>]*?>)?Subversion)�re�search�I)Zhtmlr< r< r= r � s c C s$ t | d��}|j� jd�S Q R X d S )N�rbzutf-8)�open�readr` )�filename�fpr< r< r= r � s c c s x| j |�}|sP |V qW dS )z7Yield pieces of data from a file-like object until EOF.N)r� )�file�size�chunkr< r< r= � read_chunks� s
r� c C sh | j d�j d�} d| krHd| kr4| jd�| jd�k s<d| krH| jdd�S d| kr\| jdd�S | dfS d S )N�/�\ri ro )�lstrip�findrr )rC r< r< r= r � s $ c C sD d}x:| D ]2}t |�\}}|s"dS |dkr0|}q
||kr
dS q
W dS )zyReturns true if all the paths have the same leading path name
(i.e., everything is in one subdirectory in an archive)NFT)r )�pathsZ
common_prefixrC �prefix�restr< r< r= r � s
Tc C s2 t | �} |rtjj| �} n tjj| �} tjj| �S )zN
Convert a path to its canonical, case-normalized, absolute version.
)r r? rC �realpathr^ r] )rC Zresolve_symlinksr< r< r= r � s
c C s@ t j| �\}}|j� jd�r8|dd� | }|dd� }||fS )z,Like os.path.splitext, but take off .tar tooz.tar� N���r� )� posixpathr ry �endswith)rC �baserl r< r< r= r � s
c C s| t jj|�\}}|r0|r0t jj|� r0t j|� tj| |� t jj| �\}}|rx|rxyt j|� W n tk
rv Y nX dS )z7Like os.renames(), but handles renaming across devices.N) r? rC rr rj r@ rP Zmove�
removedirsrA )�old�new�head�tailr< r< r= r s
c C s t � s
dS t| �jttj��S )z�
Return True if path is within sys.prefix, if we're running in a virtualenv.
If we're not in a virtualenv, all paths are considered "local."
T)r
r rd rH r� )rC r< r< r= �is_local s r� c C s t t| ��S )z�
Return True if given Distribution object is installed locally
(i.e. within current virtualenv).
Always True if we're not in a virtualenv.
)r� �
dist_location)�distr< r< r= �
dist_is_local! s r� c C s t t| ��}|jt t��S )zF
Return True if given Distribution is installed in user site.
)r r� rd r )r� � norm_pathr< r< r= �dist_in_usersite, s r� c C s t t| ��jt t��S )ze
Return True if given Distribution is installed in
distutils.sysconfig.get_python_lib().
)r r� rd r )r� r< r< r= �dist_in_site_packages4 s
r� c C s, t t| ��}|jt td�d jd�d ��S )zf
Return True if given Distribution is installed in
path matching distutils_scheme layout.
ro �purelib�pythonr )r r� rd r
rr )r� r� r< r< r= �dist_in_install_path> s r� c C s8 x2t jD ](}tjj|| jd �}tjj|�rdS qW dS )z$Is distribution an editable install?z .egg-linkTF)rH rC r? r{ � project_namer )r� Z path_item�egg_linkr< r< r= �dist_is_editableH s
r� c sl | r
t �ndd� �|r dd� � ndd� � |r6dd� �ndd� �|rHt�nd d
� �� ����fd d �tjD �S )
a�
Return a list of installed Distribution objects.
If ``local_only`` is True (default), only return installations
local to the current virtualenv, if in a virtualenv.
``skip`` argument is an iterable of lower-case project names to
ignore; defaults to stdlib_pkgs
If ``editables`` is False, don't report editables.
If ``editables_only`` is True , only report editables.
If ``user_only`` is True , only report installations in the user
site directory.
c S s dS )NTr< )�dr< r< r= �
local_testj s z/get_installed_distributions.<locals>.local_testc S s dS )NTr< )r� r< r< r= �
editable_testn s z2get_installed_distributions.<locals>.editable_testc S s
t | � S )N)r� )r� r< r< r= r� q s c S s t | �S )N)r� )r� r< r< r= �editables_only_testu s z8get_installed_distributions.<locals>.editables_only_testc S s dS )NTr< )r� r< r< r= r� x s c S s dS )NTr< )r� r< r< r= � user_test~ s z.get_installed_distributions.<locals>.user_testc s: g | ]2}�|�r|j �kr� |�r�|�r�|�r|�qS r< )�key)�.0r� )r� r� r� �skipr� r< r= �
<listcomp>� s
z/get_installed_distributions.<locals>.<listcomp>)r� r� r � working_set)Z
local_onlyr� Zinclude_editablesZeditables_onlyZ user_onlyr< )r� r� r� r� r� r= �get_installed_distributionsQ s
r� c C s� g }t � r6t� r |jt� qN|jt� trN|jt� ntrD|jt� |jt� x0|D ](}tjj|| j�d }tjj |�rT|S qTW dS )a
Return the path for the .egg-link file if it exists, otherwise, None.
There's 3 scenarios:
1) not in a virtualenv
try to find in site.USER_SITE, then site_packages
2) in a no-global virtualenv
try to find in site_packages
3) in a yes-global virtualenv
try to find in site_packages, then site.USER_SITE
(don't look in global location)
For #1 and #3, there could be odd cases, where there's an egg-link in 2
locations.
This method will just return the first one found.
z .egg-linkN)
r
r �appendr r r? rC r{ r� r )r� ZsitesZsiteZegglinkr< r< r= �
egg_link_path� s
r� c C s t | �}|r|S | jS )z�
Get the site-packages location of this distribution. Generally
this is dist.location, except in the case of develop-installed
packages, where dist.location is the source code location, and we
want to know where the egg-link file is.
)r� �location)r� r� r< r< r= r� � s r� c
C s� dd� } | d�p | d�p | d�}|sZy(t jt j� t j�}| |�}t j|� W n Y nX |szt jjdd�t jjdd �f}t|d �t|d �fS )
zlReturns a tuple (x, y) representing the width(x) and the height(x)
in characters of the terminal window.c S sP y4dd l }dd l}dd l}|jd|j| |jd��}W n
d S |dkrLd S |S )Nr ZhhZ1234)r r )�fcntl�termios�struct�unpackZioctlZ
TIOCGWINSZ)�fdr� r� r� �crr< r< r= � ioctl_GWINSZ� s z'get_terminal_size.<locals>.ioctl_GWINSZr ri rZ ZLINES� ZCOLUMNS�P )r? r� �ctermid�O_RDONLY�closerp rq �int)r� r� r� r< r< r= r! � s c C s t jd�} t j| � | S )zBGet the current umask which involves having to set it temporarily.r )r? �umask)�maskr< r< r= �
current_umask� s
r� c
C s t |� t| d�}z�tj|dd�}t|j� �o0|}x�|j� D ]�}|j}|j|�}|} |rdt |�d } t
j j || �} t
j j
| �}
| jd�s�| jd�r�t | � q<t |
� t| d�} z| j|� W d| j� |jd ? } | r�tj| �r�| d
@ r�t
j| d t� d
B � X q<W W d|j� X dS ) a�
Unzip the file (with path `filename`) to the destination `location`. All
files are written based on system defaults and umask (i.e. permissions are
not preserved), except that regular file members with any execute
permissions (user, group, or world) have "chmod +x" applied after being
written. Note that for windows, any execute changes using os.chmod are
no-ops per the python docs.
r� T)Z
allowZip64ri r� r� �wbN� �I i� )r( r� �zipfileZZipFiler ZnamelistZinfolistr� r� r r? rC r{ �dirnamer� �writer� Z
external_attrrS �S_ISREGrV r� )
r� r� �flattenZzipfp�zip�leading�info�name�data�fnrR r� �moder< r< r= r# � s0
c ( C s@ t |� | j� jd�s$| j� jd�r*d}nL| j� jt�r>d}n8| j� jt�rRd}n$| j� jd�rfd}ntjd| � d }tj| |�}�z�t d
d � |j
� D ��}�x�|j
� D �]�}|j }|d kr�q�|r�t |�d
}t
jj||�}ytj|j|d�|� W n tjk
�r Y nX |j� �r"t |� q�|j� �rxy|j||� W n8 tk
�rt } ztjd| |j |� w�W Y dd}~X nX q�y|j|�} W n< ttfk
�r� } ztjd| |j |� w�W Y dd}~X nX t t
jj|�� t|d��}
tj | |
� W dQ R X | j � |j ||� |j d@ r�t
j |dt!� dB � q�W W d|j � X dS )a�
Untar the file (with path `filename`) to the destination `location`.
All files are written based on system defaults and umask (i.e. permissions
are not preserved), except that regular file members with any execute
permissions (user, group, or world) have "chmod +x" applied after being
written. Note that for windows, any execute changes using os.chmod are
no-ops per the python docs.
z.gzz.tgzzr:gzzr:bz2zr:xzz.tar�rz-Cannot determine compression type for file %szr:*c S s g | ]}|j d kr|j �qS )�pax_global_header)r� )r� �memberr< r< r= r� ( s z untar_file.<locals>.<listcomp>r� ri )r� z/In the tar file %s the member %s is invalid: %sNr� r� i� )"r( ry r� �BZ2_EXTENSIONS�
XZ_EXTENSIONS�logger�warning�tarfiler� r Z
getmembersr� r r? rC r{ Z data_filterr[ ZLinkOutsideDestinationErrorr~ ZissymZ_extract_memberrw Z extractfile�KeyErrorrK r� rP Z copyfileobjr� �utimer� rV r� ) r� r� r� Ztarr� r� r� rC �excr� Zdestfpr< r< r= r$
sh
c C s� t jj| �} |dks,| j� jt�s,tj| �rDt| || jd� d� n�|dkslt j
| �sl| j� jt t t
�rxt| |� nX|r�|jd�r�tt| ��r�ddlm} |d|j �j|� n tjd | ||� td
| ��d S ) Nzapplication/zipz.whl)r� zapplication/x-gzipz text/htmlr )�
Subversionzsvn+zZCannot unpack file %s (downloaded from %s, content-type: %s); cannot detect archive formatz%Cannot determine archive format of %s)r? rC r� ry r� �ZIP_EXTENSIONSr� Z
is_zipfiler# r� Z
is_tarfile�TAR_EXTENSIONSr� r� r$ rd r r Zpip.vcs.subversionr� Zurlr� r� �criticalr )r� r� Z content_type�linkr� r< r< r= r% ` s,
�raisec C s, |r
d }nt j}|d krng }xF| D ]>} d| ksFd| ksFd| ksFd| krVd| jdd� } |j| � q"W dj|�}tjd|� tjj � }
|r�|
j
|� y t j | t j d |||
d�} W n2 t
k
r� } ztjd | |� � W Y d d } ~ X nX |d k �rNg }
x\t| jj� �}|�sP |j� }|
j|d � tj� tjk�r:tj|� q�|d k r�|j� q�W | j� |d k �r~| j�rt|jd
� n
|jd � | j�r|d k�r�tj� tjk�r�| �r�tjd
|� tjdj|
�d � td|| j|f ��n:|dk�r�tj d|| j|� n |dk�rnt dt |� ��|�s(dj|
�S d S )N� �
�"�'z"%s"z\"zRunning command %s)�stderr�stdin�stdout�cwd�envz#Error %s while executing command %s�error�doner� z Complete output from command %s:ro z)
----------------------------------------z,Command "%s" failed with error code %s in %s�warnz$Command "%s" had error code %s in %s�ignorez Invalid value: on_returncode=%s) �
subprocess�PIPEr[ r� r{ r� �debugr? rp �copy�update�PopenZSTDOUTrw r� r r� �readline�rstripZgetEffectiveLevel� std_logging�DEBUGZspin�wait�
returncodeZfinishr� r r� �
ValueError�repr)�cmdZ show_stdoutr� Z
on_returncodeZ command_descZ
extra_environZspinnerr� Z cmd_parts�partr� �procr� Z
all_output�liner< r< r= r& � sz
c C sx t | d��}|j� }W dQ R X dtjd�dg}x4|D ],}y|j|�}W n tk
r\ w4Y nX P q4W t|�tkstt�|S )aR Return the contents of *filename*.
Try to decode the file contents with utf-8, the preferred system encoding
(e.g., cp1252 on some Windows machines), and latin1, in that order.
Decoding a byte string with latin1 will never raise an error. In the worst
case, the returned string will contain some garbage characters.
r� Nzutf-8F�latin1) r� r� �locale�getpreferredencodingr` �UnicodeDecodeError�typer} �AssertionError)r� r� r� Z encodings�encr< r< r= �read_text_file� s
r c C s t j| � t| � d S )N)r? r@ r )Z build_dirr< r< r= �_make_build_dir� s
r c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �FakeFilezQWrap a list of lines in an object with readline() to make
ConfigParser happy.c C s dd� |D �| _ d S )Nc s s | ]
}|V qd S )Nr< )r� �lr< r< r= � <genexpr> s z$FakeFile.__init__.<locals>.<genexpr>)�_gen)�self�linesr< r< r= �__init__ s zFakeFile.__init__c C sD y*y
t | j�S tk
r& | jj � S X W n tk
r> dS X d S )Nro )�nextr � NameError�
StopIteration)r r< r< r= r� s
zFakeFile.readlinec C s | j S )N)r )r r< r< r= �__iter__ s zFakeFile.__iter__N)�__name__�
__module__� __qualname__�__doc__r r� r r< r< r< r= r s r c @ s$ e Zd Zedd� �Zedd� �ZdS )�
StreamWrapperc C s || _ | � S )N)� orig_stream)�clsr! r< r< r= � from_stream s zStreamWrapper.from_streamc C s | j jS )N)r! �encoding)r r< r< r= r$ s zStreamWrapper.encodingN)r r r � classmethodr# �propertyr$ r< r< r< r= r s r c
c s@ t t| �}tt| tj|�� zt t| �V W dtt| |� X dS )z�Return a context manager used by captured_stdout/stdin/stderr
that temporarily replaces the sys stream *stream_name* with a StringIO.
Taken from Lib/support/__init__.py in the CPython repo.
N)�getattrrH �setattrr r# )Z stream_nameZ orig_stdoutr< r< r= �captured_output s
r) c C s t d�S )z�Capture the output of sys.stdout:
with captured_stdout() as stdout:
print('hello')
self.assertEqual(stdout.getvalue(), 'hello
')
Taken from Lib/support/__init__.py in the CPython repo.
r� )r) r< r< r< r= r' / s c @ s e Zd ZdZdd� Zdd� ZdS )�cached_propertyz�A property that is only computed once per instance and then replaces
itself with an ordinary attribute. Deleting the attribute resets the
property.
Source: https://github.com/bottlepy/bottle/blob/0.11.5/bottle.py#L175
c C s t |d�| _|| _d S )Nr )r' r rX )r rX r< r< r= r C s zcached_property.__init__c C s( |d kr | S | j |� }|j| j j< |S )N)rX �__dict__r )r �objr" �valuer< r< r= �__get__G s zcached_property.__get__N)r r r r r r. r< r< r< r= r* ; s r* c C s@ t jj| �}|dkr t j� }n
t j|�}|j|�}|r<|jS dS )zCGet the installed version of dist_name avoiding pkg_resources cacheN)r Z Requirement�parseZ
WorkingSetr� �version)Z dist_nameZ lookup_dirsZreqr� r� r< r< r= r+ O s
c C s t | dd� dS )z Consume an iterable at C speed.r )�maxlenN)r )�iteratorr< r< r= �consumec s r3 )r, r- )r. r/ r0 r1 r2 )r3 r4 )r5 r6 r7 )F)rh )T)T)TNr� NNN)N)fZ
__future__r � collectionsr �
contextlibrB �ior Zloggingr� r� r? r� rP rS r� rH r� r� Zpip.exceptionsr Z
pip.compatr r r Z
pip.locationsr r r
r r r
Z pip._vendorr Zpip._vendor.six.movesr Zpip._vendor.sixr Zpip._vendor.retryingr r r �__all__Z getLoggerr r� r� r� r� r� r) r* �bz2r9 r� Zlzmar> r( r" r rQ r r rv r r r r r �DEFAULT_BUFFER_SIZEr� r r r r r r� r� r� r� r� r� r� r� r� r! r� r# r$ r% r& r r �objectr r �contextmanagerr) r' r* r+ r3 r< r< r< r= �<module> s�
5%
+S!
_