Your IP : 216.73.217.13
U
�Ad � � @ s� d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZ d dlm Z m
Z
d dlm Z d dlm
Z
mZ d dlmZmZ d d lmZ d d
lmZ d d lmZ e�e�Zee j g�Z d Z d
Z G dd� d�Z dd� Z!e j"e j#gZ$G dd� de
j%�Z&G dd� de&�Z'dd� Z(dd� Z)dd� Z*d d � Z+d d � Z,d d!� Z-d"d#� Z.d$d%� Z/d&d'� Z0d(d)� Z1d*d+� Z2d5d-d.�Z3d/d0� Z4d1d2� Z5e'e
j6ffe&e
j6e
j7ffgZ8d3d4� Z9dS )6� N)�List)�dmi)�log)�net�sources)�
url_helper)�util�warnings)�
EventScope� EventType)�NoDHCPLeaseError)�EphemeralIPNetwork)�ec2)Z
datasource�Ec2Z strict_id�warnc @ s, e Zd ZdZdZdZdZdZdZdZ dZ
d S )
�
CloudNamesZaliyunZawsZ brightboxZzstack�e24cloudZoutscale�unknownzno-ec2-metadataN) �__name__�
__module__� __qualname__�ALIYUN�AWS� BRIGHTBOX�ZSTACK�E24CLOUD�OUTSCALE�UNKNOWN�NO_EC2_METADATA� r r �A/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceEc2.pyr " s r c C s | j dkod| jkS )N� zmeta-data/tags/)�code�url)� exceptionr r r �skip_404_tag_errors2 s r% c s| e Zd ZU dZdddgZdZdddgZee e d < d
Z
d Z d Z e
jZd
ZejejejejejhiZ� fdd�Zdd� Zdd� Zdd� Z e dd� �Z e dd� �Z e dd� �Z e d d � �Z!e d d � �Z"e d d!� �Z#e d"d#� �Z$d$d%� Z%d&d'� Z&d(d)� Z'd*d+� Z(d,d-� Z)e d.d/� �Z*e d0d1� �Z+d2d3� Z,e d4d5� �Z-e � fd6d7��Z.d8d9� Z/dEd:d;�Z0d<d=� Z1d>d?� Z2dFd@dA�Z3dGdCdD�Z4� Z5S )H�
DataSourceEc2r zhttp://169.254.169.254zhttp://[fd00:ec2::254]zhttp://instance-data.:8773z
2009-04-04z
2021-03-23z
2018-09-24z
2016-09-02�extended_metadata_versions�x �2 NFc s t t| ��|||� d | _d S �N)�superr& �__init__�metadata_address)�self�sys_cfg�distro�paths�� __class__r r r, e s zDataSourceEc2.__init__c C s t � S )z5Return the cloud name as identified during _get_data.)�identify_platform�r. r r r �_get_cloud_namei s z DataSourceEc2._get_cloud_namec C sL t t�| jtt�d�\}}t�d|| j| j � |dkrF| jt
j krFdS | jt
j krVdS | j
r�t�� rrt�d� dS zZt| jdd| j�� d��8}|jr�d|j� �nd }tjtjd
|� �| jd �| _W 5 Q R X W n tk
r� Y dS X ntjtjd
| jd �| _| j�sdS | j�d d �| _| j�d
d �| _| j�di ��di ��di �| _dS )N)r Nz0strict_mode: %s, cloud_name=%s cloud_platform=%s�trueFz1FreeBSD doesn't support running dhclient with -sfT)�ipv4�ipv6Ztmp_dir� � zCrawl of metadata service�Zlogfunc�msg�func� meta-data� user-data�dynamic�instance-identity�document) �read_strict_moder �get_cfg_by_pathr/ �STRICT_ID_PATH�STRICT_ID_DEFAULT�LOG�debug�
cloud_name�platformr r r �perform_dhcp_setupZ
is_FreeBSDr
�fallback_interfacer0 Zget_tmp_exec_path� state_msg�log_time�crawl_metadataZ_crawled_metadatar �get�metadataZ userdata_raw�identity)r. Z strict_modeZ_sleepZnetwrN r r r � _get_datam sp ���
��
� � ��zDataSourceEc2._get_datac C sL | j s
dS | j �di ��di �}|�di ��� D ]\}}d|kr0 dS q0dS )z6Report if this instance type is Ec2 Classic (non-vpc).F�network�
interfaces�macszvpc-idT)rR rQ �items)r. Z ifaces_mdZ_macZmac_datar r r �is_classic_instance� s z!DataSourceEc2.is_classic_instancec C s | j s
d S | j �d�S )Nzami-launch-index)rR rQ r5 r r r � launch_index� s zDataSourceEc2.launch_indexc C s. t | d�stj�� | _| js(tj�� | _| jS )N�_platform_type)�hasattrr& �dsname�lowerr[ r5 r r r rK � s
zDataSourceEc2.platformc C s dS )Nzlatest/api/tokenr r5 r r r �api_token_route� s z DataSourceEc2.api_token_routec C s dS )NZ21600r r5 r r r �imdsv2_token_ttl_seconds� s z&DataSourceEc2.imdsv2_token_ttl_secondsc C s dS )NzX-aws-ec2-metadata-tokenr r5 r r r �imdsv2_token_put_header� s z%DataSourceEc2.imdsv2_token_put_headerc C s
| j d S )Nz -ttl-seconds)ra r5 r r r �imdsv2_token_req_header� s z%DataSourceEc2.imdsv2_token_req_headerc C s | j | jgS r* )ra rb r5 r r r �imdsv2_token_redact� s z!DataSourceEc2.imdsv2_token_redactc C s� d}| � � }| jD ]�}|�| j|�}ztj||| jd�}W n2 tjk
rl } zt� d||� W 5 d}~X Y qX |j
dkr�t� d|� | S |j
dkrd}t� |||j � q| j S ) aE Get the best supported api version from the metadata service.
Loop through all extended support metadata versions in order and
return the most-fully featured metadata api version discovered.
If extended_metadata_versions aren't present, return the datasource's
min_metadata_version.
z {0}/{1}/meta-data/instance-id)r# �headers�headers_redactzurl %s raised exception %sN�� z#Found preferred metadata version %sr! z0Metadata api version %s not present. Headers: %s)
� _get_headersr' �formatr- �uhelp�readurlrc �UrlErrorrH rI r" rd �min_metadata_version)r. Zurl_tmplrd Zapi_verr# Zresp�er= r r r �get_metadata_api_version� s&
�
z&DataSourceEc2.get_metadata_api_versionc C sh | j tjkrZt| dd �sF| �� }tj|| j| j| j | j
d�� di �| _ | j � d| j
d �S | j
d S d S )NrS ��
headers_cbre � exception_cbrC Z
instanceIdz instance-id)rJ r r �getattrrn r �get_instance_identityr- rg rc �_refresh_stale_aws_token_cbrQ rS rR )r. � api_versionr r r �get_instance_id� s$ � � �z DataSourceEc2.get_instance_idc
C s� | j tkrdS g }i }| j}d}|D ]"}d�||�}|�|� |||< q$t�d� d}d}| �� } z0tj || j
| j tj | j
| j|| jdd� \}}W n tjk
r� Y nX |r�|r�|| _|| S dS )a Get an API token for EC2 Instance Metadata Service.
On EC2. IMDS will always answer an API token, unless
the instance owner has disabled the IMDS HTTP endpoint or
the network topology conflicts with the configured hop-limit.
N�PUT�{0}/{1}z Fetching Ec2 IMDSv2 API TokenF) �urls�max_wait�timeout� status_cbrp rq �request_methodre Zconnect_synchronously)rJ � IDMSV2_SUPPORTED_CLOUD_PLATFORMSr_ rh �appendrH rI �get_url_paramsri � wait_for_url�max_wait_seconds�timeout_seconds�warningrg �_imds_exception_cbrc rk �
_api_token)
r. �mdurlsry �url2base�url_pathr} r# �cur�response�
url_paramsr r r �_maybe_fetch_api_token s@
� z$DataSourceEc2._maybe_fetch_api_tokenc C sr | j }| �� }|jdkr dS |�d| j�}dd� |D �}t|�t|�krdt�dtt|�t|� �� t |�rr|}nt�
d� | j}| � |�}|�s | j t
k�r g }i }dj| jd �}d
} |D ]"}
d �|
|�} |�| � |
|| < q�t�� } tj||j|jtj
| j| j| d �\}
}
|
�r ||
}|�r8|| _t�d
| j� n2| j t
k�rPt�
d� nt�d|tt�� | �� t|�S )Nr F�
metadata_urlsc S s g | ]}t �|�r|�qS r )r Zis_resolvable_url)�.0�xr r r �
<listcomp>D s
z;DataSourceEc2.wait_for_metadata_service.<locals>.<listcomp>z,Removed the following from metadata urls: %sz+Empty metadata url list! using default listz{ver}/meta-data/instance-id)ZverZGETrx )ry rz r{ r| re rp r} zUsing metadata source: '%s'z)IMDS's HTTP endpoint is probably disabledz(Giving up on md from %s after %s seconds)�ds_cfgr� r� rQ r� �setrH rI �list�lenr� r� rJ r~ rh rl r �timeri r� r� rc rg r- Zcritical�int�bool)r. Zmcfgr� r� Zfilteredr- ry r� r� r} r# r� Z
start_time�_r r r �wait_for_metadata_service; sj
�
���
�
�z'DataSourceEc2.wait_for_metadata_servicec C s� d| j krd S d }| j d }t|t�s6t�d|� d S |�� D ],\}}||krV|} ql|dkr>|dkr>|}q>|d kr�t�d|� d S |}|�d�s�d| }tj� |�r�|S | �
tj� |��}|r�t�d||� |S |dkr�d S |S ) Nzblock-device-mappingz+block-device-mapping not a dictionary: '%s'Z ephemeralZ
ephemeral0z Unable to convert %s to a device�/z/dev/%sz Remapped device name %s => %s) rR �
isinstance�dictrH rI rX �
startswith�os�path�existsZ
_remap_device�basename)r. �name�foundZbdmZentnameZdeviceZofoundZremappedr r r �device_name_to_device� s8
z#DataSourceEc2.device_name_to_devicec C sV z:| j tjkr(| j�d| jd d �W S | jd d W S W n tk
rP Y d S X d S )NZavailabilityZoneZ placementzavailability-zone)rJ r r rS rQ rR �KeyErrorr5 r r r �availability_zone� s �z DataSourceEc2.availability_zonec C sR | j tjkr4| j�d�}| jr0|s0| jd d� }|S | j}|d k rN|d d� S d S )N�region���)rJ r r rS rQ r� )r. r� Zazr r r r� � s
zDataSourceEc2.regionc C s, |sd S | j tjkr(tt�|tt�|� d S r* )rJ r r �warn_if_necessaryr rE rF rG )r. �cfgZis_new_instancer r r �activate� s �zDataSourceEc2.activatec C s� | j tjkr| j S | jdkr*t�d� dS d}td| jkoD| jtj k�}|rjt�
d� t j tj
d| j
d� | j}| j�d�}t|t�r�t||t �| jdd�d �}| �� r�t�| j�| _| jtj �t j � | jtj �t j � n t�d
|� || _ | j S ) z@Return a network config dict for rendering ENI or netplan files.Nz8Unexpected call to network_config when metadata is None.rU zPMetadata 'network' not present: Refreshing stale metadata from prior to upgrade.z Re-crawl of metadata servicer< Z apply_full_imds_network_configT)� fallback_nic�full_network_configz%Metadata 'network' key not valid: %s.) �_network_configr �UNSETrR rH r� r� rJ r r rI r rO �get_datarM rQ r� r� �#convert_ec2_metadata_network_configZget_cfg_option_boolr� rY �copy�deepcopyZdefault_update_eventsr
�NETWORK�addr �BOOT� BOOT_LEGACY)r. �resultZno_network_metadata_on_awsZifaceZnet_mdr r r �network_config� s\
�
���
��
� � � z DataSourceEc2.network_configc s: | j d kr4t| dd �}|r(|| _ d | _n tt| �jS | j S )Nr� )Z_fallback_interfacerr r� r+ r& rM )r. Z
_legacy_fbnicr2 r r rM s
z DataSourceEc2.fallback_interfacec C s | � � s i S | �� }| j}i }| jtkr:| j}| j}d}n&| jtjkrTd }}t }n d } }}znt
j || j | j
||d�|d< t
j|| j | j
|||d�|d< | jtjkr�t
j|| j | j
||d�}d|i|d< W n( tk
r� t�td| j � i Y S X ||d < |S )
z�Crawl metadata service when available.
@returns: Dictionary of crawled metadata content containing the keys:
meta-data, user-data and dynamic.
Nro r@ )rp re rq Z retrieval_exception_ignore_cbr? rB rA z'Failed reading from metadata address %sZ_metadata_api_version)r� rn rc rJ r~ rt �#_skip_or_refresh_stale_aws_token_cbr r r% r Zget_instance_userdatar- rg Zget_instance_metadatar rs � Exceptionr ZlogexcrH )r. ru ZredactZcrawled_metadataZexc_cbZ exc_cb_udZskip_cbrS r r r rP % s^
�
�
��
z DataSourceEc2.crawl_metadatac
C s� | j tkrdS |dkr | j}t�d� | j|i}d�| j| j�}zt j
||| j dd�}W n8 t j k
r� } zt�
d||� W Y �dS d}~X Y nX |jS )z�Request new metadata API token.
@param seconds: The lifetime of the token in seconds
@return: The API token or None if unavailable.
Nz!Refreshing Ec2 metadata API tokenz{}/{}rw )rd re r} z/Unable to get API token: %s raised exception %s)rJ r~ r` rH rI rb rh r- r_ ri rj rc rk r� �contents)r. ZsecondsZrequest_headerZ token_urlr� rm r r r �_refresh_api_token\ s,
�
�z DataSourceEc2._refresh_api_tokenc C s$ t �t j||�}|sdS | �||�S )zSCallback will not retry on SKIP_USERDATA_CODES or if no token
is available.F)r Zskip_retry_on_codesZSKIP_USERDATA_CODESrt )r. r= r$ Zretryr r r r� y s �z1DataSourceEc2._skip_or_refresh_stale_aws_token_cbc C s* t |tj�r&|jdkr&t�d� d| _dS )z=Exception handler for Ec2 to refresh token if token is stale.i� z+Clearing cached Ec2 API token due to expiryNT)r� ri rk r" rH rI r� �r. r= r$ r r r rt � s
z)DataSourceEc2._refresh_stale_aws_token_cbc C sD t |tj�r@|jr@|jdkr@|jdkr2t�d� n
t�d� |�dS )a2 Fail quickly on proper AWS if IMDSv2 rejects API token request
Guidance from Amazon is that if IMDSv2 had disabled token requests
by returning a 403, or cloud-init malformed requests resulting in
other 40X errors, we want the datasource detection to fail quickly
without retries as those symptoms will likely not be resolved by
retries.
Exceptions such as requests.ConnectionError due to IMDS being
temporarily unroutable or unavailable will still retry due to the
callsite wait_for_url.
i� i� zLEc2 IMDS endpoint returned a 403 error. HTTP endpoint is disabled. Aborting.z2Fatal error while requesting Ec2 IMDSv2 API tokensN)r� ri rk r" rH r� r� r r r r� � s
��z DataSourceEc2._imds_exception_cbr; c C sN | j tkri S | j| ji}| j|kr(|S | jsB| �� | _| jsBi S | j| jiS )z�Return a dict of headers for accessing a url.
If _api_token is unset on AWS, attempt to refresh the token via a PUT
and then return the updated token header.
)rJ r~ rb r` r_ r� r� ra )r. r# Zrequest_token_headerr r r rg � s
�
zDataSourceEc2._get_headers)N)N)r; )6r r r r] r� rl r' r �str�__annotations__Z url_max_waitZ url_timeoutr� r r� r� rL r
r� r ZBOOT_NEW_INSTANCEr� r� ZHOTPLUGZsupported_update_eventsr, r6 rT rY �propertyrZ rK r_ r` ra rb rc rn rv r� r� r� r� r� r� r� rM rP r� r� rt r� rg �
__classcell__r r r2 r r& : sx
���� 8
2I3
< 7
r& c s$ e Zd ZdZdZ� fdd�Z� ZS )�DataSourceEc2Localay Datasource run at init-local which sets up network to query metadata.
In init-local, no network is available. This subclass sets up minimal
networking with dhclient on a viable nic so that it can talk to the
metadata service. If the metadata service provides network configuration
then render the network configuration for that instance based on metadata.
Tc s8 t jt jf}| j|kr*t�d|| j� dS tt| ��� S )Nz+Local Ec2 mode only supported on %s, not %sF) r r r rJ rH rI r+ r� r� )r. Zsupported_platformsr2 r r r� � s
�zDataSourceEc2Local.get_data)r r r �__doc__rL r� r� r r r2 r r� � s r� c
C sD z
t | �W S tk
r> } zt�|� | W Y �S d }~X Y nX d S r* )�parse_strict_mode�
ValueErrorrH r� )�cfgval�defaultrm r r r rD � s
rD c
C s� | dkr dS | dkrdS | s dS | � d�\}}}|dkrHtd|| f ��|r�z t|�}W q� tk
r� } ztd || f �|�W 5 d }~X Y q�X nd }||fS )
NT)r7 NF)�falseN)r r �,)r7 r� r zUInvalid mode '%s' in strict_id setting '%s': Expected one of 'true', 'false', 'warn'.z<Invalid sleep '%s' in strict_id setting '%s': not an integer)� partitionr� r� )r� �moder� �sleeprm r r r r� � s4 �� ���r� c
C sf zt | �\}}W n2 tk
rB } zt�|� W Y �d S d }~X Y nX |dkrPd S tjd|d|d� d S )Nr� Z
non_ec2_mdT)r� r� )r� r� rH r� r Z show_warning)r� r� r� r� rm r r r r� � s
r� c C s | d dkrt jS d S )N� product_namezAlibaba Cloud ECS)r r ��datar r r �identify_aliyun s r� c C s4 | d � d�r0| d dks*| d | d kr0tjS d S )N�uuidr � uuid_source�
hypervisor�serial)r� r r r� r r r � identify_aws s
��r� c C s | d � d�rtjS d S )Nr� z.brightbox.com)�endswithr r r� r r r �identify_brightbox s r� c C s | d � d�rtjS d S )N� asset_tagz
.zstack.io)r� r r r� r r r �identify_zstack s r� c C s | d dkrt jS d S )N�vendorr )r r r� r r r �identify_e24cloud$ s r� c C s* | d d� � kr&| d d� � kr&tjS d S )Nr� z3DS Outscale VMr� z 3DS Outscale)r^ r r r� r r r �identify_outscale) s
��r� c C sx t � } ttttttdd� f}|D ]R}z|| �}|r<|W S W q tk
rp } zt� d|| |� W 5 d }~X Y q X q d S )Nc S s t jS r* )r r )r� r r r �<lambda>; � z#identify_platform.<locals>.<lambda>z'calling %s with %s raised exception: %s)
�_collect_platform_datar� r� r� r� r� r� r� rH r� )r� ZchecksZcheckerr� rm r r r r4 1 s* � �r4 c C s� i } zt �d��� }d| d< W n& tk
rD t�d�}d| d< Y nX |dkrRd}|�� | d< t�d �}|dkrtd}|�� | d
< t�d �}|dkr�d}|�� | d < t�d
�}|r�|nd�� | d< t�d�}|r�|nd�� | d< | S )a� Returns a dictionary of platform info from dmi or /sys/hypervisor.
Keys in the dictionary are as follows:
uuid: system-uuid from dmi or /sys/hypervisor
uuid_source: 'hypervisor' (/sys/hypervisor/uuid) or 'dmi'
serial: dmi 'system-serial-number' (/sys/.../product_serial)
asset_tag: 'dmidecode -s chassis-asset-tag'
vendor: dmi 'system-manufacturer' (/sys/.../sys_vendor)
product_name: dmi 'system-product-name' (/sys/.../system-manufacturer)
On Ec2 instances experimentation is that product_serial is upper case,
and product_uuid is lower case. This returns lower case values for both.
z/sys/hypervisor/uuidr� r� z system-uuidr Nr; r� zsystem-serial-numberr� zchassis-asset-tagr� zsystem-manufacturerr� zsystem-product-namer� )r Z load_file�stripr� r Z
read_dmi_datar^ )r� r� r� r� r� r� r r r r� H s.
r� Tc C s� di d�}|st �� }| d d }|s�|�� D ]\}}||kr. qDq.ddd|�� i|d�}|�|�} | �d �rvd|d
< ||d |< |S d }
t|�� �D ]�\}}|�|�} | s�q�t| �d
|
��d }
d|
d i} d| dd|�� i|d�}| �d ��rd|d
< | |d< t| |�|d< |d �s$|�d� ||d |< q�t |d �dk�r~|d �
� D ],}|d | �d� |d | �dd� �qP|S )a Convert ec2 metadata to network config version 2 data dict.
@param: network_md: 'network' portion of EC2 metadata.
generally formed as {"interfaces": {"macs": {}} where
'macs' is a dictionary with mac address as key and contents like:
{"device-number": "0", "interface-id": "...", "local-ipv4s": ...}
@param: macs_to_nics: Optional dict of mac addresses and nic names. If
not provided, get_interfaces_by_mac is called to get it from the OS.
@param: fallback_nic: Optionally provide the primary nic interface name.
This nic will be guaranteed to minimally have a dhcp4 configuration.
@param: full_network_config: Boolean set True to configure all networking
presented by IMDS. This includes rendering secondary IPv4 and IPv6
addresses on all NICs and rendering network config on secondary NICs.
If False, only the primary nic will be configured and only with dhcp
(IPv4/IPv6).
@return A dict of network config version 2 based on the metadata and macs.
� )�version� ethernetsrV rW TFZ
macaddress)�dhcp4�dhcp6�match�set-name�ipv6sr� r� r z
device-number� z route-metric�d )r� �dhcp4-overridesr� r� r� zdhcp6-overrides� addressesr� N) r Zget_interfaces_by_macrX r^ rQ �sortedr� �get_secondary_addresses�popr� �keys) Z
network_mdZ macs_to_nicsr� r� ZnetcfgZ
macs_metadata�macZnic_nameZ
dev_config� nic_metadataZnic_idxZ
dhcp_overrider r r r� w sV
�
�
r� c C s� | � d�}| � d�}g }tt|t�o.t|�dk�rH|�t| d||d�� tt|t�o^t|�dk�rx|�t| d||d�� t|�S )z�Parse interface-specific nic metadata and return any secondary IPs
:return: List of secondary IPv4 or IPv6 addresses to configure on the
interface
z local-ipv4sr� r� zsubnet-ipv4-cidr-blockZ24zsubnet-ipv6-cidr-blockZ128)rQ r� r� r� r� �extend�_get_secondary_addressesr� )r� r� Zipv4sr� r� r r r r� � s0
�� ��r� c
C s� g }| � |�}|}|r(t|�d��dkrNd|kr4dnd}t�d|||||� n|�d�d }|dd� D ]} |�dj| |d �� qh|S )
z�Return list of IP addresses as CIDRs for secondary IPs
The CIDR prefix will be default_prefix if cidr_key is absent or not
parseable in nic_metadata.
r� r� r8 r9 zJCould not parse %s %s for mac %s. %s network config prefix defaults to /%sr� Nz
{ip}/{prefix})�ip�prefix)rQ r� �splitrH r� r rh )
r� Zcidr_keyr� ZipsZdefault_prefixr� Zcidrr� Zip_typer� r r r r� � s"
�
r� c C s t �| t�S r* )r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_list� s r� )NNT):r� r� r� �typingr Z cloudinitr r Zloggingr r r ri r r Zcloudinit.eventr
r Zcloudinit.net.dhcpr Zcloudinit.net.ephemeralr
Zcloudinit.sources.helpersr Z getLoggerr rH � frozensetZ NOT_FOUNDZSKIP_METADATA_URL_CODESrF rG r r% r r r~ Z
DataSourcer& r� rD r� r� r� r� r� r� r� r� r4 r� r� r� r� ZDEP_FILESYSTEMZ DEP_NETWORKr� r� r r r r �<module> s^
!
0 �
I
�