3
\�me�= � @ s. d dl Z d dlZd dlZd dlZd dlZd dlmZ d dlZd dlm Z d dl
m Z d dl m
Z
d dlmZmZmZmZmZ d dlmZmZ d dlmZ d d lmZmZ d d
l m Z d d l m Z ej e!�Z"d d
gZ#dZ$dZ%dZ&G dd� dej'j(�Z)dd� Z*dd� Z+G dd� dej,�Z-e-ej.ffgZ/dd� Z0dS )� N)�urlparse)�ConnectionError)�HTTPConnection)� PoolManager)�dmi�net�sources�
url_helper�util)�
EventScope� EventType)�NoDHCPLeaseError)�EphemeralDHCPv4�EphemeralIPv6Network)�DataSourceHostname)�ProcessExecutionErrorzhttp://169.254.42.42zhttp://[fd00:42::42]� � �
c s* e Zd ZdZ� fdd�Zddd�Z� ZS )�SourceAddressAdapterzF
Adapter for requests to choose the local address to bind to.
c s || _ tt| �jf |� d S )N)�source_address�superr �__init__)�selfr �kwargs)� __class__� �(/usr/lib/python3.6/DataSourceScaleway.pyr + s z SourceAddressAdapter.__init__Fc C s0 t jtjtjdfg }t|||| j|d�| _d S )N� )Z num_pools�maxsize�blockr �socket_options)r Zdefault_socket_options�socketZ
SOL_SOCKETZ SO_REUSEPORTr r Z poolmanager)r Z connectionsr r r! r r r �init_poolmanager/ s z%SourceAddressAdapter.init_poolmanager)F)�__name__�
__module__� __qualname__�__doc__r r# �
__classcell__r r )r r r & s r c C s` y&t j| d|d|dd� d�}tj|j�S t jk
rZ } z|jdkrHdS � W Y dd}~X nX dS )aQ
Retrieve user data or vendor data.
Scaleway user/vendor data API returns HTTP/404 if user/vendor data is not
set.
This function calls `url_helper.readurl` but instead of considering
HTTP/404 as an error that requires a retry, it considers it as empty
user/vendor data.
Also, be aware the user data/vendor API requires the source port to be
below 1024 to ensure the client is root (since non-root users can't bind
ports below 1024). If requests raises ConnectionError (EADDRINUSE), the
caller should retry to call this function on an other port.
Nr c S s |j dkot|jtjj� S )Ni� )�code�
isinstance�cause�requests�
exceptionsr )�_�excr r r �<lambda>W s
z%query_data_api_once.<locals>.<lambda>)�data�timeout�retriesZsessionZ exception_cbi� )r �readurlr
�
decode_binary�contents�UrlErrorr) )� api_addressr2 �requests_session�respr/ r r r �query_data_api_once< s
r; c
C s" �xt dt|d��D �] }y�tjd| |� tj� }d}yRt|�j}|}|d dkr^|dd� }tj |dtj
d�d d } | tj kr�d }W n t k
r� Y nX |j
d
t||fd �� t|||d �}
tjd
| � |
S tjk
�r } z$tjd| | � tjd� | } wW Y dd} ~ X qX qW | �dS )a/ Get user or vendor data.
Handle the retrying logic in case the source port is used.
Scaleway metadata service requires the source port of the client to
be a privileged port (<1024). This is done to ensure that only a
privileged user on the system can access the metadata service.
r r z*Trying to get %s data (bind on port %d)...z0.0.0.0r �[N)�protoz0::zhttp://)r )r2 r9 z%s-data downloadedz%Error while trying to get %s data: %s� ���)�range�max�LOG�debugr, ZSessionr �netlocr" � getaddrinfo� IPPROTO_TCP�AF_INET6�
ValueErrorZmountr r; r r7 �warning�timeZsleep)
Zapi_typer8 r3 r2 Zportr9 Z localhostZ url_address�address�
addr_protor1 r/ �last_excr r r �query_data_apid s>
rN c s� e Zd ZdZejejejej hiZ
� fdd�Z dd� Z dd� Z
edd � �Zd
d � Zd d
� Zedd� �Zedd� �Zdd� Zdd� Zd dd�Zedd� �Zedd � �Z� ZS ) �DataSourceScaleway�Scalewayc s� t t| �j|||� tjtj|ddgi �g�| _t| jjdt ��| _
t| jjdt ��| _ t| jjdt
��| _d | _tj| _t| _d | _d | _d | _d| _d| jj� kr�| j| jd 7 _d S )NZ
datasourcerP r3 r2 �max_waitT�
metadata_urls)r rO r r
Z
mergemanydictZget_cfg_by_pathZds_cfg�int�get�DEF_MD_RETRIESr3 �DEF_MD_TIMEOUTr2 �DEF_MD_MAX_WAITrQ �_fallback_interfacer �UNSET�_network_config� DS_BASE_URLSrR � userdata_url�vendordata_url�ephemeral_fixed_address�has_ipv4�keys)r Zsys_cfg�distro�paths)r r r r � s zDataSourceScaleway.__init__c C s| t j � }tj|| j| jdd�\}}|rZtjd|� |� d�| _|� d�| _|� d�| _ dS tjd|t
t j � | �� t �dS ) zO
Define metadata_url based upon api-metadata URL availability.
F)�urlsrQ r2 Zconnect_synchronouslyz%s is reachablez/conf?format=jsonz/user_data/cloud-initz/vendor_data/cloud-initNz3Unable to reach api-metadata at %s after %s seconds) rJ r Z wait_for_urlrQ r2 rB rC � metadata_urlr\ r] rS r )r rc Z
start_timeZ avail_urlr. r r r �_set_metadata_url� s" z$DataSourceScaleway._set_metadata_urlc C sZ t j| j| j| jd�}tjtj|j ��| _
t d| j | j| j�| _
t d| j| j| j�| _d S )N)r2 r3 z user-dataz vendor-data)r r4 rd r2 r3 �json�loadsr
r5 r6 �metadatarN r\ Z userdata_rawr] Zvendordata_raw)r r: r r r �_crawl_metadata� s z"DataSourceScaleway._crawl_metadatac C s> t jd�} | dkrdS tjjd�r&dS tj� }d|kr:dS dS )a
There are three ways to detect if you are on Scaleway:
* check DMI data: not yet implemented by Scaleway, but the check is
made to be future-proof.
* the initrd created the file /var/run/scaleway.
* "scaleway" is in the kernel cmdline.
zsystem-manufacturerrP Tz/var/run/scalewayZscalewayN)r Z
read_dmi_data�os�path�existsr
Z get_cmdline)Z vendor_nameZcmdliner r r � ds_detect� s
z DataSourceScaleway.ds_detectc C s� |dkrt jd|� g S g }x�|D ]~}t|�j}|d dkrH|dd � }tj|d tjd�d d }|tjkr�|dkr�||g7 }q"q"|tjkr"|dkr"||g7 }q"q"W |S )
N�ipv4�ipv6zInvalid IP version : %sr r< r )r= )rn ro r? ) rB rC r rD r" rE rF ZAF_INETrG )r r= rc Z
filtered_urlsZurlrK rL r r r �_set_urls_on_ip_version� s$
z*DataSourceScaleway._set_urls_on_ip_versionc ! C s4 | j d krtj� | _ | jr�y`t| j| j ��H}tjtj d| j
| j fd� tjtj d| j d� |d | _
d| jd< W d Q R X W n> tttfk
r� } z tjtt|�� d| _W Y d d }~X nX | j�s0yVt| j| j ��> tjtj d | j
| j fd� tjtj d| j d� d
| jd< W d Q R X W n tk
�r. dS X d S ) Nz3Set api-metadata URL depending on IPv4 availability)�logfunc�msg�func�argszCrawl of metadata service)rq rr rs z
fixed-addressrn Z
net_in_useFz3Set api-metadata URL depending on IPv6 availabilityro T)rX r �find_fallback_nicr_ r ra r
Zlog_timerB rC re rR ri r^ rh r
r r Zlogexc�strr )r rn �er r r � _get_data sV
z DataSourceScaleway._get_datac C s� | j dkr tjdtj� tj| _ | j tjkr2| j S | jdkrFtj� | _| jd dk�rFi }i }x�| jd D ]�}|d | j kr�d|d< dd d
�g|d < qjd |j
� kr�|d |d � d
|d � �f7 < n |d � d
|d � �f|d < |d dkrj|d dd�}d |j
� k�r |d |g7 < qj|g|d < qjW ||| j< d|d�| _ n�dd| j d�}ddig}| jd �r�|dd| jd d d| jd d d d d| jd d d �gd �g7 }||d < d!|gd"�| _ tj d#| j � | j S )$z`
Configure networking according to data received from the
metadata API.
Nz5Found None as cached _network_config. Resetting to %sZ
private_ipZ
public_ipsrK TZdhcp4z169.254.42.42/32z
62.210.0.1)�to�via�routesZ addresses�/�netmaskZfamilyZinet6�gatewayz::/0)rz ry r )�versionZ ethernetsZphysicalz%s)�type�namer� ro Zstaticz::�0)Znetwork�prefixr~ )r� rK r} r{ �subnetsr )r �configznetwork_config : %s) rZ rB rI r rY rX r ru rh r^ r` rC )r ZnetcfgZip_cfgZipZrouter� r r r �network_configM sV
z!DataSourceScaleway.network_configc C s d S )Nr )r r r r � launch_index� s z DataSourceScaleway.launch_indexc C s
| j d S )N�id)rh )r r r r �get_instance_id� s z"DataSourceScaleway.get_instance_idc C sb dd� | j d D �}d}t|�}x<| j jdg �D ]*}|j|�s@q0|j||d � jdd�� q0W |S )Nc S s g | ] }|d �qS )�keyr )�.0r� r r r �
<listcomp>� s z:DataSourceScaleway.get_public_ssh_keys.<locals>.<listcomp>Zssh_public_keyszAUTHORIZED_KEY=Ztagsr. � )rh �lenrT �
startswith�append�replace)r Zssh_keysZakeypreZplen�tagr r r �get_public_ssh_keys� s
z&DataSourceScaleway.get_public_ssh_keysFc C s t | jd d�S )NZhostnameF)r rh )r ZfqdnZ
resolve_ipZ
metadata_onlyr r r � get_hostname� s z DataSourceScaleway.get_hostnamec C s d S )Nr )r r r r �availability_zone� s z$DataSourceScaleway.availability_zonec C s d S )Nr )r r r r �region� s zDataSourceScaleway.region)FFF)r$ r% r& Zdsnamer ZNETWORKr ZBOOT_NEW_INSTANCEZBOOTZ BOOT_LEGACYZdefault_update_eventsr re ri � staticmethodrm rp rx �propertyr� r� r� r� r� r� r� r( r r )r r rO � s$
A M
rO c C s t j| t�S )N)r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_list� s r� )1rf Zloggingrj r" rJ Z urllib.parser r, Zrequests.exceptionsr Zurllib3.connectionr Zurllib3.poolmanagerr Z cloudinitr r r r r
Zcloudinit.eventr r Zcloudinit.net.dhcpr
Zcloudinit.net.ephemeralr r Zcloudinit.sourcesr Zcloudinit.subpr Z getLoggerr$ rB r[ rU rW rV ZadaptersZ HTTPAdapterr r; rN Z
DataSourcerO ZDEP_FILESYSTEMr� r� r r r r �<module> s8
(4 $