o f>@s*ddlZddlZddlZddlZddlZddlmZddlZddlm Z ddl m Z ddl m Z ddlmZmZmZmZddlmZmZddlmZdd lmZmZdd lmZdd lmZee Z!d d gZ"dZ#dZ$dZ%Gdddej&j'Z(ddZ)ddZ*Gdddej+Z,e,ej-ffgZ.ddZ/dS)N)urlparse)ConnectionError)HTTPConnection) PoolManager)dmisources url_helperutil) EventScope EventType)NoDHCPLeaseError)EphemeralDHCPv4EphemeralIPv6Network)DataSourceHostname)ProcessExecutionErrorzhttp://169.254.42.42zhttp://[fd00:42::42] cs*eZdZdZfddZdddZZS)SourceAddressAdapterzF Adapter for requests to choose the local address to bind to. c s ||_tt|jdi|dS)N)source_addresssuperr__init__)selfrkwargs __class__rF/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceScaleway.pyr+szSourceAddressAdapter.__init__FcCs0tjtjtjdfg}t||||j|d|_dS)N) num_poolsmaxsizeblockrsocket_options)rdefault_socket_optionssocket SOL_SOCKET SO_REUSEPORTrr poolmanager)r connectionsr r!r"rrrinit_poolmanager/s  z%SourceAddressAdapter.init_poolmanager)F)__name__ __module__ __qualname____doc__rr) __classcell__rrrrr&s rc Cs^ztj|d|d|ddd}t|jWStjy.}z |jdkr)WYd}~dSd}~ww)aQ Retrieve user data or vendor data. Scaleway user/vendor data API returns HTTP/404 if user/vendor data is not set. This function calls `url_helper.readurl` but instead of considering HTTP/404 as an error that requires a retry, it considers it as empty user/vendor data. Also, be aware the user data/vendor API requires the source port to be below 1024 to ensure the client is root (since non-root users can't bind ports below 1024). If requests raises ConnectionError (EADDRINUSE), the caller should retry to call this function on an other port. NrcSs|jdko t|jtjj S)N)code isinstancecauserequests exceptionsr)_excrrrWs z%query_data_api_once..)datatimeoutretriessession exception_cbr/)rreadurlr decode_binarycontentsUrlErrorr0) api_addressr9requests_sessionrespr6rrrquery_data_api_once<s  rDc Cstdt|dD]}z]td||t}d}z)t|j}|}|ddkr,|dd}tj |dtj d dd} | tj kr@d }Wn t yJYnw| d t||fd t|||d } td|| WStjy} ztd|| td| } WYd} ~ qd} ~ ww| )a/Get user or vendor data. Handle the retrying logic in case the source port is used. Scaleway metadata service requires the source port of the client to be a privileged port (<1024). This is done to ensure that only a privileged user on the system can access the metadata service. rrz*Trying to get %s data (bind on port %d)...z0.0.0.0r[Nprotoz0::zhttp://)r)r9rBz%s-data downloadedz%Error while trying to get %s data: %s)rangemaxLOGdebugr3Sessionrnetlocr$ getaddrinfo IPPROTO_TCPAF_INET6 ValueErrormountrrDrr@warningtimesleep) api_typerAr:r9portrB localhost url_addressaddress addr_protor8r6last_excrrrquery_data_apidsT           r_cseZdZdZejejejej hiZ fddZ de ddffdd Z d d Zd d Zed dZddZddZeddZeddZddZddZd"ddZeddZed d!ZZS)#DataSourceScalewayScalewaycstt||||tt|ddgig|_t|jdt |_ t|jdt |_ t|jdt |_tj|_t|_d|_d|_d|_d|_d|_d|jvr_|j|jd7_dSdS)N datasourcerar:r9max_waitT metadata_urls)rr`rr mergemanydictget_cfg_by_pathds_cfgintgetDEF_MD_RETRIESr:DEF_MD_TIMEOUTr9DEF_MD_MAX_WAITrcrUNSET_network_config DS_BASE_URLSrd metadata_url userdata_urlvendordata_urlephemeral_fixed_addresshas_ipv4keys)rsys_cfgdistropathsrrrrs$zDataSourceScaleway.__init__ci_pkl_versionreturnNcsFt|ddttddd}|D]}t||s t||||qdS)NT)rsrtrcrdrqrr)r _unpicklerlrohasattrsetattr)rry attr_defaultsattrrrrr{s  zDataSourceScaleway._unpicklecCsxt}tj||j|jdd\}}|r-td||d|_|d|_ |d|_ dStd|t t|t ) zO Define metadata_url based upon api-metadata URL availability. F)urlsrcr9connect_synchronouslyz%s is reachablez/conf?format=jsonz/user_data/cloud-initz/vendor_data/cloud-initNz3Unable to reach api-metadata at %s after %s seconds) rV monotonicr wait_for_urlrcr9rLrMrprqrrrhr)rr start_time avail_urlr5rrr_set_metadata_urls&     z$DataSourceScaleway._set_metadata_urlcCsZtj|j|j|jd}tt|j |_ t d|j |j|j|_ t d|j|j|j|_dS)N)r9r:z user-dataz vendor-data)rr=rpr9r:jsonloadsr r>r?metadatar_rq userdata_rawrrvendordata_raw)rrCrrr_crawl_metadatas  z"DataSourceScaleway._crawl_metadatacCs>td}|dkr dStjdrdSt}d|vrdSdS)a  There are three ways to detect if you are on Scaleway: * check DMI data: not yet implemented by Scaleway, but the check is made to be future-proof. * the initrd created the file /var/run/scaleway. * "scaleway" is in the kernel cmdline. zsystem-manufacturerraTz/var/run/scalewayscalewayN)r read_dmi_dataospathexistsr get_cmdline) vendor_namecmdlinerrr ds_detects  zDataSourceScaleway.ds_detectcCs|dvr td|gSg}|D]>}t|j}|ddkr#|dd}tj|dtjddd}|tjkr?|dkr?||g7}q|tjkrN|d krN||g7}qq|S) N)ipv4ipv6zInvalid IP version : %srrErrFrGrr) rLrMrrOr$rPrQAF_INETrR)rrHr filtered_urlsurlr\r]rrr_set_urls_on_ip_versions.      z*DataSourceScaleway._set_urls_on_ip_versionc CsP|jr_z;t|j|jj)}tjtjd|j|j fdtjtjd|j d|d|_ d|j d<Wdn1s8wYWn t ttfy^}zttt|d|_WYd}~nd}~ww|jsz9t|j|jj&tjtjd |j|j fdtjtjd|j dd |j d<WdWd S1swYWd StyYdSwd S) Nz3Set api-metadata URL depending on IPv4 availability)logfuncmsgfuncargszCrawl of metadata service)rrrz fixed-addressr net_in_useFz3Set api-metadata URL depending on IPv6 availabilityrT)rtr rwfallback_interfacer log_timerLrMrrdrrsrr rrlogexcstrr)rrerrr _get_datasr       zDataSourceScaleway._get_datac Cs|jdurtdtjtj|_|jtjkr|jS|jdduri}i}|jdD]_}|d|jkr?d|d<dd d g|d <q)d |vrX|d |dd |df7<n|dd |df|d <|ddkr|ddd}d |vr|d |g7<q)|g|d <q)|||jj <d|d|_nBdd|jj d}ddig}|jdr|dd|jddd|jddddd|jdddgdg7}||d <d!|gd"|_t d#|j|jS)$z` Configure networking according to data received from the metadata API. Nz5Found None as cached _network_config. Resetting to %s private_ip public_ipsr\Tdhcp4z169.254.42.42/32z 62.210.0.1)toviaroutes addresses/netmaskfamilyinet6gatewayz::/0)rrr)version ethernetsphysicalz%s)typenamerrstaticz::0)networkprefixr)rr\rrsubnetsr)rconfigznetwork_config : %s) rnrLrUrrmrrsrurwrrM)rnetcfgip_cfgiprouterrrrnetwork_configXsh            z!DataSourceScaleway.network_configcCdSNrrrrr launch_indexzDataSourceScaleway.launch_indexcCs |jdS)Nid)rrrrrget_instance_ids z"DataSourceScaleway.get_instance_idcCs^dd|jdD}d}t|}|jdgD]}||sq|||dddq|S)NcSsg|]}|dqS)keyr).0rrrr sz:DataSourceScaleway.get_public_ssh_keys..ssh_public_keyszAUTHORIZED_KEY=tagsr5 )rlenri startswithappendreplace)rssh_keysakeypreplentagrrrget_public_ssh_keyss z&DataSourceScaleway.get_public_ssh_keysFcCst|jddS)NhostnameF)rr)rfqdn resolve_ip metadata_onlyrrr get_hostnameszDataSourceScaleway.get_hostnamecCrrrrrrravailability_zonerz$DataSourceScaleway.availability_zonecCrrrrrrrregionrzDataSourceScaleway.region)FFF)r*r+r,dsnamer NETWORKr BOOT_NEW_INSTANCEBOOT BOOT_LEGACYdefault_update_eventsrrhr{rr staticmethodrrrpropertyrrrrrrrr.rrrrr`s6  > I   r`cCs t|tSr)rlist_from_depends datasources)dependsrrrget_datasource_lists r)0rloggingrr$rV urllib.parserr3requests.exceptionsrurllib3.connectionrurllib3.poolmanagerr cloudinitrrrr cloudinit.eventr r cloudinit.net.dhcpr cloudinit.net.ephemeralr rcloudinit.sourcesrcloudinit.subpr getLoggerr*rLrorjrlrkadapters HTTPAdapterrrDr_ DataSourcer`DEP_FILESYSTEMrrrrrrs<        (4 ,