Your IP : 216.73.217.13
U
�Ad�9 � @ s� d dl Z d dlZd dlZd dlmZ d dlmZmZmZ e� e
�Z dZ ddddd gZ
G d
d � d ej�Zd d
� Zdd� Zdd� Zdde ddfdd�Zdd� ZG dd� de�ZG dd� de�ZeejejffgZdd� Ze
d kr�d d � Z e � dS ) � N)�log)�sources�
url_helper�utilz
2012-03-01)�meta-data/instance-idr FF)�meta-data/local-hostnamer FF)�meta-data/public-keysr FT)zmeta-data/vendor-data� vendor-dataTT)� user-datar
TTc @ s` e Zd ZdZdZdZdZdd� Zedd� �Z dd � Z
d
d � Z d d
� Z dd� Z
dd� Zdd� ZdS )�DataSourceMAASz�
DataSourceMAAS reads instance information from MAAS.
Given a config metadata_url, and oauth tokens, it expects to find
files under the root named:
instance-id
user-data
hostname
vendor-data
�MAASNc C s: t j�| |||� d | _tj�|jd�| _t| j �| _
d S )NZmaas) r �
DataSource�__init__�base_url�os�path�join�seed_dir�get_id_from_ds_cfg�ds_cfg�id_hash)�self�sys_cfgZdistro�paths� r �B/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceMAAS.pyr , s zDataSourceMAAS.__init__c C s | j st| j�| _ | j S �N)�
_oauth_helper�get_oauth_helperr �r r r r � oauth_helper2 s zDataSourceMAAS.oauth_helperc C s t j�| �}d|| jf S )Nz%s [%s])r r
�__str__r )r �rootr r r r! 8 s zDataSourceMAAS.__str__c
C s� | j }z| �| jt| j�� W dS tk
r4 Y n4 tk
rf } zt�d| j|� � W 5 d }~X Y nX |�dd �}|s|dS z4| � |�s�W dS | �|t
|| j j | j
dd�� W dS tk
r� t�td|� Y dS X d S )NTz%s was malformed: %s� metadata_urlF� )�read_file_or_urlr �retriesz$Failed fetching metadata from url %s)r � _set_datar �read_maas_seed_dir�MAASSeedDirNone�MAASSeedDirMalformed�LOG�warning�get�wait_for_metadata_service�read_maas_seed_urlr �readurlr � Exceptionr �logexc)r �mcfg�exc�urlr r r � _get_data< s8
�� zDataSourceMAAS._get_datac
C sp || _ |\}}}|| _|| _|| _|rlzt�|�| _W n4 tk
rj } zt� d|� d | _W 5 d }~X Y nX d S )Nz"Invalid content in vendor-data: %s)
r Z userdata_raw�metadataZvendordata_purer Zconvert_vendordataZvendordata_raw�
ValueErrorr+ r, )r r5 �dataZud�md�vd�er r r r' c s
zDataSourceMAAS._set_datac C s
d| j S )z/Return the subplatform metadata source details.z
seed-dir (%s))r r r r r �_get_subplatformq s z DataSourceMAAS._get_subplatformc C s
| j }d}zt|�d|��}W n" tk
r@ t�td|� Y nX |dkrNdS d}z ||krlt|�d|��}W n tk
r� t�d|� Y nX t�� }|� d �r�|d d
� }d |t
f }|g}| j j |||d �\}}|r�t�
d
|� nt�d|tt�� | �� t|�S )N�x �max_waitz Failed to get max wait. using %sr F�2 �timeoutz Failed to get timeout, using %s�/���z%s/%s/meta-data/instance-id)�urlsr? rA zUsing metadata source: '%s'z(Giving up on md from %s after %i seconds)r �intr- r1 r r2 r+ r, �time�endswith�
MD_VERSIONr Z wait_for_url�debugZcritical�bool) r r5 r3 r? rA Z starttimeZ check_urlrD Z _responser r r r. u s@
�
�z(DataSourceMAAS.wait_for_metadata_servicec C s0 | j dkrdS t�|d| jfi �}| j t|�kS )a locally check if the current system is the same instance.
MAAS doesn't provide a real instance-id, and if it did, it is
still only available over the network. We need to check based
only on local resources. So compute a hash based on Oauth tokens.NF�
datasource)r r Zget_cfg_by_path�dsnamer )r r Zncfgr r r �check_instance_id� s
z DataSourceMAAS.check_instance_id)�__name__�
__module__� __qualname__�__doc__rL r r r �propertyr r! r6 r' r= r. rM r r r r r s
'&r c s& d}t � fdd�|D ��}tjf |�S )z�Return an oauth helper instance for values in cfg.
@raises ValueError from OauthUrlHelper if some required fields have
true-ish values but others do not.)� consumer_key�consumer_secret� token_key� token_secretc s g | ]}|� � |�f�qS r �r- )�.0�r��cfgr r �
<listcomp>� s z$get_oauth_helper.<locals>.<listcomp>)�dictr ZOauthUrlHelper)r[ �keys�kwargsr rZ r r � s r c s4 d}d� � fdd�|D ��}dt�|�d���� S )z;Given a config, generate a unique identifier for this node.)rS rU rV � c s g | ]}� � |d ��qS )� rW )rX �f�r r r r\ � s z&get_id_from_ds_cfg.<locals>.<listcomp>zv1:zutf-8)r �hashlibZsha256�encodeZ hexdigest)r ZfieldsZidstrr rc r r � s r c C sL | � d�r| dd � } tj�| �r4tt�| ��dkr<td��td| d d�S )N�file://� r z%s: not a directoryz file://%s)�version)�
startswithr r �isdir�len�listdirr) r/ )Zseed_dr r r r( � s
r( c C s |dkrt j}| �d�r$| dd� } i }tD ]�\}}} }
|dkrNd| |f } nd| ||f } zXt�|�} || ||| d�}
|
�� r�| r�|
j||< q�t�|
j�||< nt �
d| |
j � W q, t j k
�r
} z4|j dkr�|
s�t
d ||f �|�n|j dkr�|�W 5 d}~X Y q,X q,t|| �S )
a�
Read the maas datasource at seed_url.
read_file_or_url is a method that should provide an interface
like util.read_file_or_url
Expected format of seed_url is are the following files:
* <seed_url>/<version>/meta-data/instance-id
* <seed_url>/<version>/meta-data/local-hostname
* <seed_url>/<version>/user-data
If version is None, then <version>/ will not be used.
NrB rC z%s/%sz%s/%s/%s)r& rA � ssl_detailsz4Fetching from %s resulted in an invalid http code %si� zMissing required %s: %s)r r% rG � DS_FIELDSr Zfetch_ssl_details�ok�contentsZ
decode_binaryr+ r, �codeZUrlErrorr* �check_seed_contents)Zseed_urlr% rA rh r r& r: r Z _dictname�binary�optionalr5 rm Zrespr< r r r r/ � sH
� �
��
r/ c
C s� i }g }t D ]j\}}}}|| kr0|s |�|� q d|krj|�d�\}} }
||krXi ||< | | || |
< q | | ||< q t|�dkr�td| ��|r�td||f ��d} |�d�r�t� } tj |�d�| td�} | | kr�td��|�d �|�d
�| fS ) z�Validate if dictionary content valid as a return for a datasource.
Either return a (userdata, metadata, vendordata) tuple or
Raise MAASSeedDirMalformed or MAASSeedDirNone
rB r z%s: no data files foundz%s: missing files %sNr )�defaultZallowedz%vendor-data was not loadable as yaml.r
� meta-data)
rn �append� partitionrk r) r* r- �objectr Z load_yaml)
ZcontentZseedZretZmissingZspathZdpathZ_binaryrt �top�_�pZvd_data�errr r r rr � s8
�rr c @ s e Zd ZdS )r) N�rN rO rP r r r r r) % s r) c @ s e Zd ZdS )r* Nr~ r r r r r* ) s r* c C s t �| t�S r )r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_list4 s r� �__main__c s ddl } ddl}ddl}| jdd�}|jddddd� |jd d
d dd� |jd d
d
dd� |jddddd� |jddddd� |jdddtd� |jddd�}dD ](\}}|j||d�}|jd d d dd � q�|�� }|j |j
|j |j d �} |j
dk�r<d!D ]@}
d"|
d# } tj�| �r�t�| tj�r�|j�d$| � | |_
q�|j
�r�t�|j
�} d%| k�rf| d% d& } | �� D ]*}
|
| k�rn| |
dk�rn| |
| |
< �qn|jdk�r�d'| k�r�| d' |_|jdk�r�|j�d(� |�d)� t| ���fd*d+���fd,d-��� ��fd.d/�� |jd0k�r�|j�d1|j � �j }|jd d2k�sN|j� d3��r`t |j�\}}}nt |j|j |d4d5�\}}}t!d6� t!|dk�r�d7n|�"� � t!d8� |�|� t!d9� |�|dk�r�d7n|� nH|jd:k�r�|j� n0|jd;k�r|j�#d2��sd<|j |_� |j� dS )=z�
Call with single argument of directory or http or https url.
If url is given additional arguments are allowed, which will be
interpreted as consumer_key, token_key, token_secret, consumer_secret
r NzInteract with MAAS DS)Z descriptionz--config�filezspecify DS config file)�metavar�helpru z--ckey�keyz the consumer key to auth withz--tkeyzthe token key to auth withz--csecZsecretz the consumer secret (likely '')ra z--tsecz the token secret to auth withz--apiverrh z the apiver to use ( can be used)Z subcommands�subcmd)�title�dest))�crawlzcrawl the datasource)r- z do a single GET of provided url)�
check-seedzread and verify seed at url)r� r5 zthe datasource url�?)r� �nargsru )rS rU rV rT )Z91_kernel_cmdline_urlZ 90_dpkg_maasz/etc/cloud/cloud.cfg.d/z.cfgzUsed config in %s.
rK r r# z)Must provide a url or a config with url.
r$ c s � j | dd�jS )Nr$ )r& )r0 rp �r5 )r r r �geturl� s zmain.<locals>.geturlc s t d| � | ��� f � d S )Nz == %s ==
%s
)�print�decoder� )r� r r �printurl� s zmain.<locals>.printurlc st | � d�rh�| ��� �� D ]J}|� d�r:� d| |f � q|dkrT� d| df � q�d| |f � qn�| � d S )NrB z%s%srv z
meta-data/)rG r� �
splitlines)r5 �line)r� r� r� r r r� � s
zmain.<locals>.crawlr� zChecking seed at %s
rB rf � )rh r% r& z=== user-data ===zN/Az=== meta-data ===z=== vendor-data ===r- r� z%s/)$�argparse�pprint�sys�ArgumentParser� add_argumentrH Zadd_subparsersZ
add_parser�
parse_argsZckeyZtkeyZtsecZcsecZconfigr r �exists�access�R_OK�stderr�writer Z read_confr^ r5 �exitr r� r0 ri r( r/ Zapiverr� r� rG )r� r� r� �parserZsubcmds�namer� r| �argsZcreds�fnameZfpathr[ r� r0 Zuserdatar7 r; r )r� r� r r� r �main: s� ������ ��
�
r� ) rd r rF Z cloudinitr Zloggingr r r Z getLoggerrN r+ rH rn r
r r r r( r/ rr r1 r) r* ZDEP_FILESYSTEMZ DEP_NETWORKr r� r� r r r r �<module> sB
�
�
:'�