3
\�me"T � @ s* U d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m
Z
m Z ddl m
Z
ddlmZ ddlmZ ddlmZ ddlmZmZmZ dd lmZ dd
lmZ dd l m Z m Z dd l m Z m!Z! dd
l"m#Z# dZ$e#Z%ddde$e ge%ed�ed�gg d�Z&e &e e&�Z ddgdd�Z'ed�Z(G dd� d�Z)ej*e+�Z,e-e!e.d �d d �Z/G d d � d e0�Z1G d!d"� d"e
�Z2G d#d$� d$e2�Z3G d%d&� d&e2�Z4G d'd(� d(e2�Z5d)d*� Z6d+d,� Z7d-d.� Z8d/d0� Z9e:d1�d2d3�Z;d4d5� Z<ee-e-f d1�d6d7�Z=d8d9� Z>e-eee.dd:�d;d<�Z?d=e3fd>e4fd?e5ffZ@dS )@zGrowpart: Grow partitions� N)�ABC�abstractmethod)�suppress)�Path)�dedent)�Tuple)�subp�
temp_utils�util)�Cloud)�Config)�
MetaSchema� get_meta_doc)� ALL_DISTROS�Distro)�
PER_ALWAYSa6 Growpart resizes partitions to fill the available disk space.
This is useful for cloud instances with a larger amount of disk space available
than the pristine image uses, as it allows the instance to automatically make
use of the extra space. Note that this only works if the partition to be
resized is the last one on a disk with classic partitioning scheme (MBR, BSD,
GPT). LVM, Btrfs and ZFS have no such restrictions.
The devices on which to run growpart are specified as a list under the
``devices`` key.
There is some functionality overlap between this module and the ``growroot``
functionality of ``cloud-initramfs-tools``. However, there are some situations
where one tool is able to function and the other is not. The default
configuration for both should work for most cloud instances. To explicitly
prevent ``cloud-initramfs-tools`` from running ``growroot``, the file
``/etc/growroot-disabled`` can be created. By default, both ``growroot`` and
``cc_growpart`` will check for the existence of this file and will not run if
it is present. However, this file can be ignored for ``cc_growpart`` by setting
``ignore_growroot_disabled`` to ``true``. For more information on
``cloud-initramfs-tools`` see: https://launchpad.net/cloud-initramfs-tools
On FreeBSD, there is also the ``growfs`` service, which has a lot of overlap
with ``cc_growpart`` and ``cc_resizefs``, but only works on the root partition.
In that configuration, we use it, otherwise, we fall back to ``gpart``.
Note however, that ``growfs`` may insert a swap partition, if none is present,
unless instructed not to via ``growfs_swap_size=0`` in either ``kenv(1)``, or
``rc.conf(5)``.
Growpart is enabled by default on the root partition. The default config for
growpart is::
growpart:
mode: auto
devices: ["/"]
ignore_growroot_disabled: false
Z cc_growpartZGrowpartzGrow partitionsz� growpart:
mode: auto
devices: ["/"]
ignore_growroot_disabled: false
z� growpart:
mode: growpart
devices:
- "/"
- "/dev/vdb1"
ignore_growroot_disabled: true
)�id�name�title� descriptionZdistros� frequencyZexamplesZactivate_by_schema_keys�auto�/F)�mode�devices�ignore_growroot_disabledz/cc_growpart_keydatac @ s e Zd ZdZdZdZdZdS )�RESIZE�SKIPPED�CHANGED�NOCHANGE�FAILEDN)�__name__�
__module__� __qualname__r r r r � r$ r$ �!/usr/lib/python3.6/cc_growpart.pyr o s r )r �distror c C s� d }| dkrFx*t D ]"\}}||�}|j|d�r|}P qW |s�td��n^i }xt D ]\}} | ||< qPW | |krxtd| ��|| |�}
|
j|d�r�|
}|s�td| ��|S )Nr )r zNo resizers availablezunknown resize mode %szmode %s not available)�RESIZERS� available�
ValueError� TypeError) r r& r Z resize_class�_name�resizerZcurZmmap�k�vZmclassr$ r$ r% �resizer_factoryy s(
r/ c @ s e Zd ZdS )�ResizeFailedExceptionN)r! r" r# r$ r$ r$ r% r0 � s r0 c @ s: e Zd Zed�dd�Zeeed�dd��Zedd� �Z d S )
�Resizer)r& c C s
|| _ d S )N)�_distro)�selfr& r$ r$ r% �__init__� s zResizer.__init__)r �returnc C s d S )Nr$ )r3 r r$ r$ r% r( � s zResizer.availablec C s d S )Nr$ )r3 �diskdev�partnum�partdevr$ r$ r% �resize� s zResizer.resizeN)
r! r" r# r r4 r �list�boolr( r9 r$ r$ r$ r% r1 � s r1 c @ s" e Zd Zed�dd�Zdd� ZdS )�ResizeGrowPart)r c C sX t jj� }d|d< y*tjddg|d�\}}tjd|�r:dS W n tjk
rR Y nX dS ) N�C�LANG�growpartz--help)�envz --update\s+TF)�os�environ�copyr �re�search�ProcessExecutionError)r3 r �myenv�outZ_errr$ r$ r% r( � s
zResizeGrowPart.availablec
& C s8 t jj� }d|d< t|�}| jj� }tj|dd���}t jj |d�}t jj
|�sZt j |d� ||d< yt j dd||g|d � W nJ t j
k
r� } z,| jd
kr�tjtd ||� t| �| �||fS d } ~ X nX yt j d||g|d � W n@ t j
k
�r } z tjtd ||� t| �| �W Y d d } ~ X nX W d Q R X |t|�fS )
Nr= r> T)�dirZ needs_exer? i� ZTMPDIRz --dry-run)r@ � z&Failed growpart --dry-run for (%s, %s)zFailed: growpart %s %s)rA rB rC �get_sizer2 Zget_tmp_exec_pathr Ztempdir�path�join�exists�mkdirr rF � exit_coder
�logexc�LOGr0 )
r3 r6 r7 r8 rG �beforeZtmp_dirZtmpdZ growpart_tmp�er$ r$ r% r9 � s6
&zResizeGrowPart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% r< � s
r< c @ s& e Zd ZdZed�dd�Zdd� ZdS )� ResizeGrowFSa�
Use FreeBSD ``growfs`` service to grow root partition to fill available
space, optionally adding a swap partition at the end.
Note that the service file warns us that it uses ``awk(1)``, and as
such requires ``/usr`` to be present. However, cloud-init is installed
into ``/usr/local``, so we should be fine.
We invoke the ``growfs`` with ``service growfs onestart``, so it
doesn't need to be enabled in ``rc.conf``.
)r c C s t jjd�o|dgkS )z'growfs only works on the root partitionz/etc/rc.d/growfsr )rA rL �isfile)r3 r r$ r$ r% r( � s zResizeGrowFS.availablec C sd t |�}y| jjddd� W n: tjk
rV } z tjtd� t|�|�W Y d d }~X nX |t |�fS )NZonestart�growfs)�actionZservicez Failed: service growfs onestart) rK r2 Zmanage_servicer rF r
rQ rR r0 )r3 r6 r7 r8 rS rT r$ r$ r% r9 � s zResizeGrowFS.resizeN)r! r" r# �__doc__r: r( r9 r$ r$ r$ r% rU � s rU c @ s" e Zd Zed�dd�Zdd� ZdS )� ResizeGpart)r c C s^ t jj� }d|d< y0tjddg|ddgd�\}}tjd|�r@d S W n tjk
rX Y nX d
S ) Nr= r> �gpart�helpr rJ )r@ �rcszgpart recover TF)rA rB rC r rD rE rF )r3 r rG Z_out�errr$ r$ r% r( � s
zResizeGpart.availablec C s� yt j dd|g� W nF t jk
rZ } z(|jdkrJtjtd|� t|�|�W Y dd}~X nX t|�}yt j ddd||g� W n> t jk
r� } z tjtd||� t|�|�W Y dd}~X nX |t|�fS ) a9
GPT disks store metadata at the beginning (primary) and at the
end (secondary) of the disk. When launching an image with a
larger disk compared to the original image, the secondary copy
is lost. Thus, the metadata will be marked CORRUPT, and need to
be recovered.
r[ Zrecoverr zFailed: gpart recover %sNr9 z-iz Failed: gpart resize -i %s %s)r rF rP r
rQ rR r0 rK )r3 r6 r7 r8 rT rS r$ r$ r% r9 s
zResizeGpart.resizeN)r! r" r# r: r( r9 r$ r$ r$ r% rZ � s
rZ c C s0 t j| t j�}zt j|dt j�S t j|� X d S )Nr )rA �open�O_RDONLY�lseek�SEEK_END�close)�filename�fdr$ r$ r% rK s rK c C s� t jj| �}t jj|�}d| }tj� rVdtj| � }tjd|�}|rV|d |d fS t jj |�srt
d| |f ��t jj |d�}t jj |�s�t d| ��tj
|�j� }t jj|�}t jj|�} tj
t jj | d��j� }
t jjd |
�} | |fS )
Nz/sys/class/block/%sz/dev/z/^(?P<dev>/dev/.+)[sp](?P<part_slice>\d+[a-z]*)$�devZ
part_slicez%s had no syspath (%s)� partitionz%s not a partitionz
/dev/block/%s)rA rL �realpath�basenamer
Zis_BSDZfind_freebsd_partrD rE rN r) rM r* Z load_file�rstrip�dirname) ZdevpathZrpathZbnameZsyspathZfpart�mZptpath�ptnumZrsyspathZ disksyspathZ
diskmajminZ diskdevpathr$ r$ r% �device_part_info& s( rn c C st | j d�r| S tj| �}|s$td��|d }tj� }|dkrp| rptjtj� �}|d krptjj |�rh|S td��|S )Nz/dev/z,Could not determine device of '%s' % dev_entr z /dev/rootz!Unable to find device '/dev/root')
�
startswithr
Zget_mount_infor) Z is_containerZrootdev_from_cmdlineZ get_cmdlinerA rL rN )�devent�resultrf Z containerr$ r$ r% �
devent2devQ s
rr c C s, t jj| �}|jd�r(tjd| |� |S dS )a Returns underlying block device for a mapped device.
If it is mapped, blockdev will usually take the form of
/dev/mapper/some_name
If blockdev is a symlink pointing to a /dev/dm-* device, return
the device pointed to. Otherwise, return None.
z/dev/dm-z$%s is a mapped device pointing to %sN)rA rL rh ro rR �debug)�blockdevrh r$ r$ r% �get_mapped_deviceh s
ru )r5 c C s� t jd�stjd� dS yt j dd| g� W nH t jk
rt } z*|jdkrXtjd| � ntjd|j� dS d}~X nX tt j��" t j dd |g� tjd
| � d S Q R X dS ) z�
Check if a device is an encrypted device. blockdev should have
a /dev/dm-* path whereas partition is something like /dev/sda1.
�
cryptsetupz6cryptsetup not found. Assuming no encrypted partitionsF�status� z#Determined that %s is not encryptedzZReceived unexpected exit code %s from cryptsetup status. Assuming no encrypted partitions.NZisLuksz Determined that %s is encryptedT)r ZwhichrR rs rF rP �warningr )rt rg rT r$ r$ r% � is_encryptedx s"
rz c C s� ddd| g}t j |�d }|jd�s2td|� ���y d|jd�d jd
�d � �S tk
r� } z td |� d |� d
��|�W Y d d }~X nX d S )NZdmsetupZdepsz--options=devnamer z1 dependz5Expecting '1 dependencies' from 'dmsetup'. Received: z/dev/z: (rJ �)zRan `z$`, but received unexpected stdout: `�`)r ro � RuntimeError�split�
IndexError)rt ZcommandZdeprT r$ r$ r% �get_underlying_partition� s
r� c 0 C s, t j� stjdfS y<t j� �}tj|�}W dQ R X |d }tj|�}|d }W n, t k
rz } zt
d�|�W Y dd}~X nX z t j dddd | g|d
� W dy t j dd d |t |�g� W n0 t j
k
r� } ztjd
|� W Y dd}~X nX y t j� W n" t k
�r tjtd� Y nX X tjd| � d�fS )z�Use 'cryptsetup resize' to resize LUKS volume.
The loaded keyfile is json formatted with 'key' and 'slot' keys.
key is base64 encoded. Example:
{"key":"XFmCwX2FHIQp0LBWaLEMiHIyfxt1SGm16VvUAVledlY=","slot":5}
zNo encryption keyfile foundN�key�slotzZCould not load encryption key. This is expected if the volume has been previously resized.rv z
--key-file�-r9 )�dataZ luksKillSlotz --batch-modez<Failed to kill luks slot after resizing encrypted volume: %sz8Failed to remove keyfile after resizing encrypted volumez'Successfully resized encrypted volume '�')� KEYDATA_PATHrN r r r_ �json�load�base64Z b64decode� Exceptionr} r �strrF rR ry �unlinkr
rQ r )rt rg �fZkeydatar� Z decoded_keyr� rT r$ r$ r% �resize_encrypted� sD
r� c = C s� t j |�}g }�x�|�r�|jd�}y t|�}W n: tk
rh } z |j|tjd| f� wW Y d d }~X nX ytj|�}W n> t k
r� } z"|j|tjd||f f� wW Y d d }~X nX tj
|j � r�tj |j � r�|j|tjd| f� qt
|�}|�r�y�t|�}t||��r^|dd� |D �k�r>|jd|� |jd|� wt||�\} }
|j|| |
f� n|j|tjd|� d�f� W q tk
�r� } z$|j|tjd |� d
|� �f� W Y d d }~X qX qyt|�\} } W nD ttfk
�r } z"|j|tjd ||f f� wW Y d d }~X nX yZ| j| | |�\}
}|
|k�rP|j|tjd | | f f� n |j|tjd
| | |
|f f� W q tk
�r� } z"|j|tjd| | |f f� W Y d d }~X qX qW |S )Nr z unable to convert to device: %szstat of '%s' failed: %sz device '%s' not a block devicec S s g | ] }|d �qS )r r$ )�.0�xr$ r$ r% �
<listcomp> s z"resize_devices.<locals>.<listcomp>zResizing mapped device (z!) skipped as it is not encrypted.zResizing encrypted device (z
) failed: z device_part_info(%s) failed: %sz no change necessary (%s, %s)z changed (%s, %s) from %s to %sz'failed to resize: disk=%s, ptnum=%s: %s)rC �poprr r) �appendr r rA �stat�OSError�S_ISBLK�st_mode�S_ISCHRru r� rz �insertr� r� r rn r* r9 r r r0 )r, r �inforp rt rT ZstatretZunderlying_blockdevrg rw �messageZdiskrm �old�newr$ r$ r% �resize_devices� s�
&
&r� )r �cfg�cloud�argsr5 c
C s� d|kr t jdt� t|d< |jd�}t|t�s>t jd� d S |jdd�}tj|�r||dkrltj ddd d
� t jd |� d S tj|jd d
��r�t
j j d�r�t jd� t jd� d S tj
|ddg�}t|�s�t jd� d S yt||j|d�}W nB ttfk
�r. } z t jd||� |dk�r |�d S d }~X nX tjt jdt||fd�} x@| D ]8\}
} } | tjk�rtt jd|
| � nt jd|
| | � �qNW d S )Nr? z.No 'growpart' entry in cfg. Using default: %sz#'growpart' in config was not a dictr r Zoffz)Growpart's 'mode' key with value '{mode}'z22.2zUse 'off' instead.)Z
deprecatedZdeprecated_versionZ
extra_messagezgrowpart disabled: mode=%sr Fz/etc/growroot-disabledz0growpart disabled: /etc/growroot-disabled existsz&use ignore_growroot_disabled to ignorer r zgrowpart: empty device list)r& r z,growpart unable to find resizer for '%s': %sr� )Zlogfunc�msg�funcr� z'%s' resized: %sz '%s' %s: %s)rR rs �DEFAULT_CONFIG�get�
isinstance�dictry r
Zis_falseZ deprecaterA rL rV Zget_cfg_option_list�lenr/ r& r) r* Zlog_timer� r r r� )
r r� r� r� Zmycfgr r r, rT Zresized�entryrX r� r$ r$ r% �handle^ sT
r� r? rW r[ )ArY r� rC r� ZloggingrA Zos.pathrD r� �abcr r �
contextlibr Zpathlibr �textwrapr Ztypingr Z cloudinitr r r
Zcloudinit.cloudr Zcloudinit.configr Zcloudinit.config.schemar
r Zcloudinit.distrosr r Zcloudinit.settingsr ZMODULE_DESCRIPTIONr �metar� r� r Z getLoggerr! rR r� r: r/ r� r0 r1 r< rU rZ rK rn rr ru r; rz r� r� r� r� r' r$ r$ r$ r% �<module> st '
3 '+7 8