3
\�me�< � @ s d dl Z d dlZd dlZd dlZd dlmZmZmZ d dlm Z d dl
m Z ej e
�ZdZd%d&d'd(d)gZG dd� dej�ZG dd� de�Zdd� Zdd� Zdd� Zddeddfdd�Zdd� ZG d d � d e�ZG d d � d e�Zeej ffeej ej ffgZ d d!� Z e
d"k�rd#d$� Z e � dS )*� N)�sources�
url_helper�util)�KlibcNetworkConfigSource)�NetworkConfigSourcez
2012-03-01�meta-data/instance-idF�meta-data/local-hostname�meta-data/public-keysT�meta-data/vendor-data� vendor-data� user-datac @ s` e Zd ZdZdZdZdZdd� Zedd� �Z dd � Z
d
d � Z d d
� Z dd� Z
dd� Zdd� ZdS )�DataSourceMAASz�
DataSourceMAAS reads instance information from MAAS.
Given a config metadata_url, and oauth tokens, it expects to find
files under the root named:
instance-id
user-data
hostname
vendor-data
�MAASNc C s: t jj| |||� d | _tjj|jd�| _t| j �| _
d S )NZmaas) r �
DataSource�__init__�base_url�os�path�join�seed_dir�get_id_from_ds_cfg�ds_cfg�id_hash)�self�sys_cfgZdistro�paths� r �$/usr/lib/python3.6/DataSourceMAAS.pyr . s zDataSourceMAAS.__init__c C s | j st| j�| _ | j S )N)�
_oauth_helper�get_oauth_helperr )r r r r � oauth_helper4 s zDataSourceMAAS.oauth_helperc C s t jj| �}d|| jf S )Nz%s [%s])r r �__str__r )r �rootr r r r! : s zDataSourceMAAS.__str__c C s� | j }y| j| jt| j�� dS tk
r2 Y n4 tk
rd } ztjd| j|� � W Y d d }~X nX |jdd �}|szdS y0| j |�s�dS | j|t
|| j j | j
dd�� dS tk
r� tjtd|� dS X d S )NTz%s was malformed: %s� metadata_urlF� )�read_file_or_urlr �retriesz$Failed fetching metadata from url %s)r � _set_datar �read_maas_seed_dir�MAASSeedDirNone�MAASSeedDirMalformed�LOG�warning�get�wait_for_metadata_service�read_maas_seed_urlr �readurlr � Exceptionr �logexc)r �mcfg�exc�urlr r r � _get_data> s4
zDataSourceMAAS._get_datac C sp || _ |\}}}|| _|| _|| _|rlytj|�| _W n4 tk
rj } ztj d|� d | _W Y d d }~X nX d S )Nz"Invalid content in vendor-data: %s)
r Z userdata_raw�metadataZvendordata_purer Zconvert_vendordataZvendordata_raw�
ValueErrorr+ r, )r r5 �dataZud�md�vd�er r r r' e s
zDataSourceMAAS._set_datac C s
d| j S )z/Return the subplatform metadata source details.z
seed-dir (%s))r )r r r r �_get_subplatforms s z DataSourceMAAS._get_subplatformc C s
| j }d}yt|jd|��}W n" tk
r@ tjtd|� Y nX |dkrNdS d}y ||krlt|jd|��}W n tk
r� tjd|� Y nX tj� }|j d �r�|d d� }d |t
f }|g}| j j |||d �\}}|r�tj
d
|� ntjd|ttj� | �� t|�S )N�x �max_waitz Failed to get max wait. using %sr F�2 �timeoutz Failed to get timeout, using %s�/r$ z%s/%s/meta-data/instance-id)�urlsr? rA zUsing metadata source: '%s'z(Giving up on md from %s after %i seconds���)r �intr- r1 r r2 r+ r, �time�endswith�
MD_VERSIONr Z wait_for_url�debugZcritical�bool) r r5 r3 r? rA Z starttimeZ check_urlrC Z _responser r r r. w s8
z(DataSourceMAAS.wait_for_metadata_servicec C s0 | j dkrdS tj|d| jfi �}| j t|�kS )a locally check if the current system is the same instance.
MAAS doesn't provide a real instance-id, and if it did, it is
still only available over the network. We need to check based
only on local resources. So compute a hash based on Oauth tokens.NF�
datasource)r r Zget_cfg_by_path�dsnamer )r r Zncfgr r r �check_instance_id� s
z DataSourceMAAS.check_instance_id)�__name__�
__module__� __qualname__�__doc__rL r r r �propertyr r! r6 r' r= r. rM r r r r r
s '&r
c s0 e Zd ZejejejejfZ� fdd�Z � Z
S )�DataSourceMAASLocalc s, t � j� stjd� dS tjd� t� j� S )Nz No initramfs applicable configFz!Found initramfs applicable config)r Z
is_applicabler+ rI �superr6 )r )� __class__r r r6 � s
z DataSourceMAASLocal._get_data) rN rO rP r ZCMD_LINEZ
SYSTEM_CFGZDSZ INITRAMFSZnetwork_config_sourcesr6 �
__classcell__r r )rU r rS � s
rS c s& d}t � fdd�|D ��}tjf |�S )z�Return an oauth helper instance for values in cfg.
@raises ValueError from OauthUrlHelper if some required fields have
true-ish values but others do not.� consumer_key�consumer_secret� token_key� token_secretc s g | ]}|� j |�f�qS r )r- )�.0�r)�cfgr r �
<listcomp>� s z$get_oauth_helper.<locals>.<listcomp>)rW rX rY rZ )�dictr ZOauthUrlHelper)r] �keys�kwargsr )r] r r � s r c s4 d }dj � fdd�|D ��}dtj|jd��j� S )
z;Given a config, generate a unique identifier for this node.rW rY rZ � c s g | ]}� j |d ��qS )� )r- )r[ �f)r r r r^ � s z&get_id_from_ds_cfg.<locals>.<listcomp>zv1:zutf-8)rW rY rZ )r �hashlibZsha256�encodeZ hexdigest)r ZfieldsZidstrr )r r r � s r c C sN | j d�r| dd � } tjj| � s6ttj| ��dkr>td��td| d d�S )Nzfile://� r z%s: not a directoryz file://%s)�version)�
startswithr r �isdir�len�listdirr) r/ )Zseed_dr r r r( � s
r( c C s |dkrt j}| jd�r$| dd
� } i }x�tD ]�\}}} }
|dkrPd| |f } nd| ||f } yXtj|�} || ||| d�}
|
j� r�| r�|
j||< q�tj|
j�||< nt j
d| |
j � W q. t j k
�r } z:|j dkr�|
r�t
d ||f �|�n|j dk�r |�W Y dd}~X q.X q.W t|| �S ) a�
Read the maas datasource at seed_url.
read_file_or_url is a method that should provide an interface
like util.read_file_or_url
Expected format of seed_url is are the following files:
* <seed_url>/<version>/meta-data/instance-id
* <seed_url>/<version>/meta-data/local-hostname
* <seed_url>/<version>/user-data
If version is None, then <version>/ will not be used.
NrB r$ z%s/%sz%s/%s/%s)r& rA � ssl_detailsz4Fetching from %s resulted in an invalid http code %si� zMissing required %s: %srD )r r% rG � DS_FIELDSr Zfetch_ssl_details�ok�contentsZ
decode_binaryr+ r, �codeZUrlErrorr* �check_seed_contents)Zseed_urlr% rA rh r r& r: r Z _dictnameZbinary�optionalr5 rm Zrespr< r r r r/ � s:
r/ c
C s� i }g }xrt D ]j\}}}}|| kr2|s|j|� qd|krl|jd�\}} }
||krZi ||< | | || |
< q| | ||< qW t|�dkr�td| ��|r�td||f ��d} |jd�r�t� } tj |jd�| td�} | | kr�td��|jd �|jd
�| fS ) z�Validate if dictionary content valid as a return for a datasource.
Either return a (userdata, metadata, vendordata) tuple or
Raise MAASSeedDirMalformed or MAASSeedDirNone
rB r z%s: no data files foundz%s: missing files %sNz vendor-data)�defaultZallowedz%vendor-data was not loadable as yaml.z user-dataz meta-data)
rn �append� partitionrk r) r* r- �objectr Z load_yaml)
ZcontentZseed�retZmissingZspathZdpathZ_binaryrs �top�_�pZvd_data�errr r r rr s2
rr c @ s e Zd ZdS )r) N)rN rO rP r r r r r) 9 s r) c @ s e Zd ZdS )r* N)rN rO rP r r r r r* = s r* c C s t j| t�S )N)r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_listI s r~ �__main__c s. ddl } ddl}ddl}| jdd�}|jddddd� |jd d
d dd� |jd d
d
dd� |jddddd� |jddddd� |jdddtd� |jddd�}x0dCD ](\}}|j||d �}|jd!d"d#dd$� q�W |j� }|j |j
|j |j d%�} |j
dk�rJxNdDD ]F}
d(|
d) } tjj| ��r tj| tj��r |jjd*| � | |_
�q W |j
�r�tj|j
�} d+| k�rt| d+ d, } x6| j� D ]*}
|
| k�r~| |
dk�r~| |
| |
< �q~W |jdk�r�d-| k�r�| d- |_|jdk�r�|jjd.� |jd/� t| ���fd0d1���fd2d3��� ��fd4d5�� |jd k�r�|jjd6|j � �j }|jd d7k�s`|jj d8��rrt |j�\}}}nt |j|j |d9d:�\}}}t!d;� t!|dk�r�d<n|j"� � t!d=� |j|� t!d>� |j|dk�r�d<n|� nH|jd k�r��|j� n0|jdk�r*|jj#d7��s d?|j |_� |j� dS )Ez�
Call with single argument of directory or http or https url.
If url is given additional arguments are allowed, which will be
interpreted as consumer_key, token_key, token_secret, consumer_secret
r NzInteract with MAAS DS)� descriptionz--config�filezspecify DS config file)�metavar�helprt z--ckey�keyz the consumer key to auth withz--tkeyzthe token key to auth withz--csecZsecretz the consumer secret (likely '')rc z--tsecz the token secret to auth withz--apiverrh z the apiver to use ( can be used)Z subcommands�subcmd)�title�dest�crawl�crawl the datasourcer- � do a single GET of provided url�
check-seed�read and verify seed at url)r� r5 zthe datasource url�?)r� �nargsrt )rW rY rZ rX �91_kernel_cmdline_url� 90_dpkg_maasz/etc/cloud/cloud.cfg.d/z.cfgzUsed config in %s.
rK r r# z)Must provide a url or a config with url.
r$ c s � j | dd�jS )Nr$ )r& )r0 rp )r5 )r r r �geturl� s zmain.<locals>.geturlc s t d| � | �j� f � d S )Nz == %s ==
%s
)�print�decode)r5 )r� r r �printurl� s zmain.<locals>.printurlc sx | j d�rlxh�| �j� j� D ]J}|j d�r<� d| |f � q |dkrV� d| df � q �d| |f � q W n�| � d S )NrB z%s%sz meta-dataz
meta-data/)rG r� �
splitlines)r5 �line)r� r� r� r r r� � s
zmain.<locals>.crawlzChecking seed at %s
rB zfile://� )rh r% r& z=== user-data ===zN/Az=== meta-data ===z=== vendor-data ===z%s/�r� r� �r- r� �r� r� )r� r� r� )r� r� )$�argparse�pprint�sys�ArgumentParser� add_argumentrH Zadd_subparsersZ
add_parser�
parse_argsZckeyZtkeyZtsecZcsec�configr r �exists�access�R_OK�stderr�writer Z read_confr` r5 �exitr r� r0 ri r( r/ Zapiverr� r� rG )r� r� r� �parserZsubcmds�namer� r{ �argsZcredsZfnameZfpathr] r� r0 Zuserdatar7 r; r )r� r� r r� r �mainO s�
r� )r r FF)r r FF)r r FT)r
r TT)r r TT)!re Zloggingr rF Z cloudinitr r r Zcloudinit.net.cmdliner Zcloudinit.sourcesr Z getLoggerrN r+ rH rn r r
rS r r r( r/ rr r1 r) r* ZDEP_FILESYSTEMZ DEP_NETWORKr} r~ r� r r r r �<module> sD
4'