3
\�me�. � @ s� d dl Z d dlZd dlmZ d dlmZ d dlmZmZm Z m
Z
d dl m Z m
Z
mZmZ d dlmZ d dlmZ d dlmZ d d lmZ d d
lmZ eje�Z d Z G d d
� d
e �Z dd� Z dd� Z e e!e"d�dd�Z#G dd� d�Z$dS )� N)� signature)�
ModuleType)�Dict�List�
NamedTuple�Optional)�config�importer�
type_utils�util)� ALL_DISTROS)� ConfigMerger)�ReportEventStack)� FREQUENCIES)�InitZcc_c @ s" e Zd ZU eeeee dS )�
ModuleDetailsN)
�__name__�
__module__� __qualname__r �module�str�name� frequencyr �run_args� r r � /usr/lib/python3.6/modules.pyr s
r c C sX | j dd�}|j� jd�r.|dt|�d � }|j� }|s>d S |jt�sTdt|f }|S )N�-�_z.pyr � z%s%s)�replace�lower�endswith�len�strip�
startswith�
MOD_PREFIX)r Z
canon_namer r r �form_module_name& s
r& c C s� t | d� s d| jks d| jkr6td| � d|� d���| jd tkrftd| � d|� d| jd � d���t | d �r�td| � d|� d
���d S ) N�metar �distroszModule 'z
' with name 'z4' MUST have a 'meta' attribute of type 'MetaSchema'.z' has an invalid frequency �.ZschemazX' has a JSON 'schema' attribute defined. Please define schema in cloud-init-schema,json.)�hasattrr' �
ValueErrorr )�modr r r r �validate_module2 s
r- )�module_details�cfg�returnc C s2 t | jjjdi ��}|s dS |j|j� �s.dS dS )NZactivate_by_schema_keysTF)� frozensetr r' �get� intersection�keys)r. r/ Z activate_by_schema_keys_keysr r r �
_is_activeH s r5 c @ sx e Zd Zded�dd�Zeejd�dd��Ze e
d�dd �Z e e d�d
d �Z
e e d �d
d�Zddd�Zdd� ZdS )�ModulesN)�initc C s2 || _ || _d | _|d kr(tdddd�}|| _d S )Nzmodule-reporterz module-descF)r � descriptionZreporting_enabled)r7 � cfg_files� _cached_cfgr �reporter)�selfr7 r9 r; r r r �__init__T s zModules.__init__)r0 c C s< | j d kr0t| jj| jj| j| jjd�}|j| _ tj| j �S )N)�paths�
datasourceZadditional_fnsZbase_cfg) r: r
r7 r> r? r9 r/ �copy�deepcopy)r< Zmergerr r r r/ a s
z Modules.cfgc C sh g }|| j kr|S | j j|�}|s&|S �x:|D �]0}|s:q.t|t�rX|jd|j� i� q.t|t�r�i }t|�dkr�|d j� |d< t|�dkr�|d j� |d< t|�dkr�|dd� |d< |r�|j|� q.t|t��rJi }d }d
|k� r�|d
j� |d< d }d |k�r|d j� |d< d|k�r2|d �p,g |d< |�r`|�r`|j|� q.t d
|t
j |�f ��q.W |S )aU Read the modules from the config file given the specified name.
Returns a list of module definitions. E.g.,
[
{
"mod": "bootcmd",
"freq": "always",
"args": "some_arg",
}
]
Note that in the default case, only "mod" will be set.
r, � r � �freqr N�argsFr Tr z3Failed to read '%s' item in config, unknown type %s) r/ r2 �
isinstancer �appendr# �listr" �dict� TypeErrorr
�obj_name)r< r Z module_listZcfg_mods�item�contentsZvalidr r r �
_read_moduleso sL
zModules._read_modulesc C s� g }x�|D ]�}|d }|j d�}|j d�p,g }t|�}|s<q
|rZ|tkrZtjd||� d}tj|dtjt �gdg�\}} |s�tjd|| � q
tj
|d �}
t |
|� |dkr�|
j d
}|j
t|
|||d �� q
W |S ) z�Convert list of returned from _read_modules() into new format.
Invalid modules and arguments are ignored.
Also ensures that the module has the required meta fields.
r, rD rE z6Config specified module %s has an unknown frequency %sN� �handlez,Could not find module named %s (searched %s)r r )r r r r )r2 r& r �LOGZwarningr � find_moduler
rK r �
import_moduler- r' rG r ) r< �raw_mods� mostly_modsZraw_modZraw_namerD r �mod_nameZmod_locsZ looked_locsr, r r r �_fixup_modules� sB
zModules._fixup_modules)rU c C sF | j j� }g }g }�x(|D �] \}}}}y�tjd|||� |j|� d|� �} d| |f }
t| |
| jd�} || j||d�} | �p t|j �}
|
j
}t |�dkr�t j
ddd � | jd
ti� |j| |j | |d �\}}|r�d | | _n
d
| | _W d Q R X W q tk
�r8 } z$t jtd||� |j||f� W Y d d }~X qX qW ||fS )Nz(Running module %s (%s) with frequency %szconfig-z running %s with frequency %s)r r8 �parent)r r/ ZcloudrE � z%Config modules with a `log` parameterz23.2)Z
deprecatedZdeprecated_version�log)rD z%s ran successfullyz%s previously ranz Running module %s (%s) failed)r7 ZcloudifyrQ �debugrG r r; r/ r rP Z
parametersr" r Z deprecate�updateZrun�message� ExceptionZlogexc)r< rU ZccZfailuresZ which_ranr, r rD rE Zrun_nameZdescZmyrepZ func_argsZfunc_signatureZ func_paramsZranZ_r�er r r � _run_modules� sB
$zModules._run_modulesc C s& |||d�}|g}| j |�}| j|�S )N)r, rE rD )rW r` )r< rV rE rD Z mod_to_berT rU r r r �
run_single s
zModules.run_singlec C s | j |�}| j|�}| jjj}g }g }| jjdg �}g }g } x�|D ]�}
|
\} } }
}| dkr\qB| jd }t|
| j�s~|j | � qB|r�|t
gkr�||kr�| |kr�|j | � qB|j | � | j | | |
|g� qBW |r�t j ddj
|�� |r�t j ddj
|�|� |�rt j ddj
|�� | j| �S ) z�Runs all modules in the given section.
section_name - One of the modules lists as defined in
/etc/cloud/cloud.cfg. One of:
- cloud_init_modules
- cloud_config_modules
- cloud_final_modules
Zunverified_modulesNr( z?Skipping modules '%s' because no applicable config is provided.�,zSkipping modules '%s' because they are not verified on distro '%s'. To run anyway, add them to 'unverified_modules' in config.z running unverified_modules: '%s'z, )rN rW r7 Zdistror r/ r2 r' r5 rG r rQ �info�joinr` )r< Z section_namerT rU Z distro_nameZskippedZforcedZ
overriddenZinapplicable_modsZ active_modsr. r, r Z_freqZ_argsZworked_distrosr r r � run_section sF
zModules.run_section)NN)NN)r r r r r= �propertyr ZConfigr/ r r rN r rW r` ra re r r r r r6 S s
;02
r6 )%r@ Zlogging�inspectr �typesr Ztypingr r r r Z cloudinitr r r
r Zcloudinit.distrosr Zcloudinit.helpersr
Zcloudinit.reporting.eventsr Zcloudinit.settingsr Zcloudinit.stagesr Z getLoggerr rQ r% r r& r- rI �boolr5 r6 r r r r �<module> s"