3
\�me7D � @ s: d Z ddlZddlZddlZddlZddlZddlmZmZ ddl m
Z
ddl m Z m
Z
mZmZmZmZmZ ddlZddlmZ ddlmZ ddlmZ dd lmZm Z m Z m Z m Z dd
l m!Z! ej"e#�Z$d Z%d Z&d
Z'ddddddd�Z(e)d�dd�Z*d9eee) e
e)e f d�dd�Z+G dd� de�Z,G dd� de�Z-G d d � d e�Z.e)e/d �d d �Z0G d!d"� d"e j1�Z2e3d�d#d$�Z4d:ej5e)e3d&�d'd(�Z6d;ej5e)e3ej7d)�d*d+�Z8G d,d-� d-e�Z9G d.d/� d/�Z:e&e9j;fe)e9e/d0�d1d2�Z<e2e j=ffgZ>d3d4� Z?e#d5k�r6ddl@Z@d6ZAe@jBeAd7�ZCeCjD� eEejFe<e9j;d8��� dS )<a� Datasource for LXD, reads /dev/lxd/sock representation of instance data.
Notes:
* This datasource replaces previous NoCloud datasource for LXD.
* Older LXD images may not have updates for cloud-init so NoCloud may
still be detected on those images.
* Detect LXD datasource when /dev/lxd/sock is an active socket file.
* Info on dev-lxd API: https://documentation.ubuntu.com/lxd/en/latest/dev-lxd/
� N)�Flag�auto)�JSONDecodeError)�Any�Dict�List�Optional�Tuple�Union�cast)� HTTPAdapter)�HTTPConnection)�HTTPConnectionPool)�
atomic_helper�sources�subp�
url_helper�util)�find_fallback_nicz
/dev/lxd/sockz1.0z
http://lxdz user-dataznetwork-configz vendor-data)zcloud-init.user-datazcloud-init.network-configzcloud-init.vendor-datazuser.user-datazuser.network-configzuser.vendor-data)�returnc C s� d} t jd�r�yt j dg�\}}W n. t jk
rP } ztjd|� | S d }~X nX |j� d
kr�tj� d d }|dkrzd S |d
kr�d S d S | S )NZeth0zsystemd-detect-virtzHUnable to run systemd-detect-virt: %s. Rendering default network config.�kvm�qemu�uname� Zppc64leZenp0s5Zs390xZenc9Zenp5s0)r r )r ZwhichZProcessExecutionError�LOG�warning�stripr Z system_info)Z default_nameZ virt_type�_�errZarch� r �#/usr/lib/python3.6/DataSourceLXD.py� _get_fallback_interface_name/ s&
r! )�nicsr c C sF t � }|rtjd|� nt� }tjd|� dd|ddd�gd�gd �S )
zCReturn network config V1 dict representing instance network config.zCLXD datasource generating network from discovered active device: %szVLXD datasource generating network from systemd-detect-virt platform default device: %s� ZphysicalZdhcpr )�typeZcontrol)r$ �nameZsubnets)�version�config)r r �debugr! )r" Z primary_nicr r r �generate_network_configI s r) c s$ e Zd Z� fdd�Zdd� Z� ZS )�SocketHTTPConnectionc s t � jd� || _d S )N� localhost)�super�__init__� socket_path)�selfr. )� __class__r r r- p s z SocketHTTPConnection.__init__c C s$ t j t jt j�| _| jj| j� d S )N)�socketZAF_UNIXZ SOCK_STREAMZsock�connectr. )r/ r r r r2 t s z SocketHTTPConnection.connect)�__name__�
__module__� __qualname__r- r2 �
__classcell__r r )r0 r r* o s r* c s$ e Zd Z� fdd�Zdd� Z� ZS )�SocketConnectionPoolc s || _ t� jd� d S )Nr+ )r. r, r- )r/ r. )r0 r r r- z s z SocketConnectionPool.__init__c C s
t | j�S )N)r* r. )r/ r r r � _new_conn~ s z SocketConnectionPool._new_conn)r3 r4 r5 r- r8 r6 r r )r0 r r7 y s r7 c @ s e Zd Zddd�ZdS )�LXDSocketAdapterNc C s t t�S )N)r7 �LXD_SOCKET_PATH)r/ �urlZproxiesr r r �get_connection� s z LXDSocketAdapter.get_connection)N)r3 r4 r5 r< r r r r r9 � s r9 )�
metadata_typer c C s� t |t�r|S |dkri S ytj|�}W n8 tk
r` } z tjdj| |d��|�W Y dd}~X nX |dkr~tjdj| |d���|S )a6 Convert raw instance data from str, bytes, YAML to dict
:param metadata_type: string, one of as: meta-data, vendor-data, user-data
network-config
:param metadata_value: str, bytes or dict representing or instance-data.
:raises: InvalidMetaDataError on invalid instance-data content.
NzAInvalid {md_type}. Expected str, bytes or dict but found: {value})Zmd_type�valuez:Invalid {md_type} format. Expected YAML but found: {value})�
isinstance�dictr � load_yaml�AttributeErrorr �InvalidMetaDataException�format)r= Zmetadata_valueZparsed_metadata�excr r r �_raw_instance_data_to_dict� s
rF c s� e Zd ZU dZejZeee f ejZ
eee f
ej j d Z e
e df dZed d
�� fd d � Zeed
�dd��Zed
�dd�Ze d
�dd�Ze d
�dd�Zeed
�dd��Z� ZS )�
DataSourceLXDZLXD�user.meta-data�user.vendor-data�user.user-data�cloud-init.user-data�cloud-init.vendor-data.TN)�ci_pkl_versionr c s t � j|� d| _d S )NT)r, � _unpickle�skip_hotplug_detect)r/ rM )r0 r r rN � s zDataSourceLXD._unpickle)r c C s t � S )z@Check platform environment to report if this datasource may run.)�is_platform_viabler r r r � ds_detect� s zDataSourceLXD.ds_detectc C s� t jtjdtd�| _td| jjd��| _| jjdi �}|jdi �}|rPtd|�}t | jt
�stt j t j | j�|g�| _d| jkr�| jd | _
d| jkr�td| jd �| _d| jkr�| jd | _d S )
z=Crawl LXD socket API instance data and return True on successzCrawl of metadata service)Zlogfunc�msg�funcz meta-datar' zuser.meta-dataz user-dataznetwork-configz vendor-dataT)r Zlog_timer r( �
read_metadata�_crawled_metadatarF �get�metadatar? r@ Z
mergemanydictrA Z userdata_raw�_network_configZvendordata_raw)r/ r' Z
user_metadatar r r � _get_data� s,
zDataSourceLXD._get_datac C s dj ttd�S )z.Return subplatform details for this datasourcez"LXD socket API v. {ver} ({socket}))Zverr1 )rD �LXD_SOCKET_API_VERSIONr: )r/ r r r �_get_subplatform� s z DataSourceLXD._get_subplatformc C sB t tjd�}|jdi �}t|t�s,tj|�}|jd�| jjd�kS )z%Return True if instance_id unchanged.)�
metadata_keysz meta-dataz instance-id) rT � MetaDataKeys� META_DATArV r? r@ r rA rW )r/ Zsys_cfg�response�mdr r r �check_instance_id� s
z DataSourceLXD.check_instance_idc C s� | j tjkr~| jtjkr | j� t| jt�r~| jjd�rPtj d� | jd | _ n.| jjd�r~dd� | jd j
� D �}t |�| _ | j tjkr�tj d� t � | _ t t| j �S )z�Network config read from LXD socket config/user.network-config.
If none is present, then we generate fallback configuration.
znetwork-configz,LXD datasource using provided network config�devicesc S s g | ]\}}|d dkr|�qS )r$ Znicr )�.0�k�vr r r �
<listcomp>� s z0DataSourceLXD.network_config.<locals>.<listcomp>z8LXD datasource generating network config using fallback.)
rX r �UNSETrU rY r? r@ rV r r( �itemsr) r )r/ rb r r r �network_config� s"
z DataSourceLXD.network_config)rH rI rJ rK rL )r3 r4 r5 Zdsnamer rg rX r
r �strrU �
DataSourceZsensitive_metadata_keysr rO �intrN � staticmethod�boolrQ rY r[ ra �propertyr@ ri r6 r r )r0 r rG � s$
rG c C s" t jjt�r tjt jt�j�S dS )z=Return True when this platform appears to have an LXD socket.F)�os�path�existsr: �stat�S_ISSOCK�lstat�st_moder r r r rP s rP T)�sessionr; �do_raisec C sr t | ||�}|js*tjd||j|j� i S y|j� S tk
rl } z tj dj
||jd��|�W Y d d }~X nX d S )NzSkipping %s on [HTTP:%d]:%szFUnable to process LXD config at {url}. Expected JSON but found: {resp})r; �resp) � _do_request�okr r( � status_code�textZjsonr r rC rD )rw r; rx Z url_responserE r r r �_get_json_response s r~ )rw r; rx r c C s� xHt ddd
�D ]8}| j|�}d|jkrDtjd� tjd|j||� qP qW tjd|j|� |r�|j r�t j
dj |j||j d ���|S ) N� r r# i� g�������?z,[GET] [HTTP:%d] %s, retrying %d more time(s)z[GET] [HTTP:%d] %sz3Invalid HTTP response [{code}] from {route}: {resp})�codeZroutery ���)
�rangerV r| �timeZsleepr r r( r{ r rC rD r} )rw r; rx Zretriesr_ r r r rz , s$
rz c @ s0 e Zd Ze� Ze� Ze� Ze� ZeeB eB ZdS )r] N) r3 r4 r5 r ZNONE�CONFIG�DEVICESr^ �ALLr r r r r] I s
r] c @ s@ e Zd Zefed�dd�Zejed�dd�Z e
ed�dd �Z d
S ) �_MetaDataReader)� api_versionc C s || _ tjt| j �| _d S )N)r� r � combine_url�LXD_URL� _version_url)r/ r� r r r r- R s z_MetaDataReader.__init__)rw r c C s� di i}t j| jd�}t||�}x�t|�D ]�}t jt|�}t||dd�}|jsdtj d||j
|j � q*|j d�d
}|j |d |< |t
kr*t
| |kr�|j |t
| < q*tjd||jdd d�� q*W |S ) a� Iterate on LXD API config items. Promoting CONFIG_KEY_ALIASES
Any CONFIG_KEY_ALIASES which affect cloud-init behavior are promoted
as top-level configuration keys: user-data, network-data, vendor-data.
LXD's cloud-init.* config keys override any user.* config keys.
Log debug messages if any user.* keys are overridden by the related
cloud-init.* key.
r' F)rx zSkipping %s on [HTTP:%d]:%s�/r# z,Ignoring LXD config %s in favor of %s value.�userz
cloud-initr� )r r� r� r~ �sortedr� rz r{ r r( r| r} �
rpartition�CONFIG_KEY_ALIASESr �replace) r/ rw r' Z
config_urlZ
config_routesZ config_routeZconfig_route_urlZconfig_route_responseZcfg_keyr r r �_process_configV s0
z _MetaDataReader._process_config)r\ r c C s� t j� ��}|j| jt� � d| ji}tj|krLtj | jd�}t
||�j |d< tj |krf|j
| j|�� tj|kr�tj | jd�}t||dd�}|r�||d< |S Q R X d S )NZ_metadata_api_versionz meta-datarb F)rx )�requests�SessionZmountr� r9 r� r] r^ r r� rz r} r� �updater� r� r~ )r/ r\ rw r` Zmd_router; rb r r r �__call__� s
z_MetaDataReader.__call__N) r3 r4 r5 rZ rj r- r� r� r@ r� r] r� r r r r r� Q s 7r� )r� r\ r c C s t | d�|d�S )a8 Fetch metadata from the /dev/lxd/socket routes.
Perform a number of HTTP GETs on known routes on the devlxd socket API.
Minimally all containers must respond to <LXD_SOCKET_API_VERSION>/meta-data
when the LXD configuration setting `security.devlxd` is true.
When `security.devlxd` is false, no /dev/lxd/socket file exists. This
datasource will return False from `is_platform_viable` in that case.
Perform a GET of <LXD_SOCKET_API_VERSION>/config` and walk all `user.*`
configuration keys, storing all keys and values under a dict key
LXD_SOCKET_API_VERSION: config {...}.
In the presence of the following optional user config keys,
create top level aliases:
- user.user-data -> user-data
- user.vendor-data -> vendor-data
- user.network-config -> network-config
:param api_version:
LXD API version to operated with.
:param metadata_keys:
Instance of `MetaDataKeys` indicating what keys to fetch.
:return:
A dict with the following optional keys: meta-data, user-data,
vendor-data, network-config, network_mode, devices.
Below <LXD_SOCKET_API_VERSION> is a dict representation of all raw
configuration keys and values provided to the container surfaced by
the socket under the /1.0/config/ route.
)r� )r\ )r� )r� r\ r r r rT � s #rT c C s t j| t�S )N)r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_list� s r� �__main__z*Query LXD metadata and emit a JSON object.)� description)r\ )N)T)T)G�__doc__Zloggingrp r1 rs r� �enumr r Z json.decoderr Ztypingr r r r r r
r r� Zrequests.adaptersr Zurllib3.connectionr
Zurllib3.connectionpoolr Z cloudinitr r r r r Z
cloudinit.netr Z getLoggerr3 r r: rZ r� r� rj r! r) r* r7 r9 r@ rF rk rG rn rP r� r~ ZResponserz r] r� r� rT ZDEP_FILESYSTEMr� r� �argparser� �ArgumentParser�parser�
parse_args�printZ
json_dumpsr r r r �<module> sd $
$
j
Q
'