| Server IP : 35.236.43.222 / Your IP : 216.73.216.143 Web Server : Apache System : Linux order-form-vm-001 5.10.0-37-cloud-amd64 #1 SMP Debian 5.10.247-1 (2025-12-11) x86_64 User : deploy ( 1002) PHP Version : 8.1.31 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : ON | Pkexec : OFF Directory : /usr/lib/google-cloud-sdk/lib/surface/dataflow/yaml/__pycache__/ |
Upload File : |
�
��� � �" � d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlm Z ddl
m Z dd l m
Z
dd
l mZ dd lmZ d Ze j e j e j j e j j � � G d
� de j � � � � � � Zd� ZdS )z3Implementation of gcloud dataflow yaml run command.� )�absolute_import)�division)�unicode_literals)�apis)� arg_parsers)�base)�
dataflow_util)�
properties)�yaml)�filesz4gs://dataflow-templates-{}/latest/flex/Yaml_Templatec �8 � e Zd ZdZddd�Zed� � � Zd� ZdS )�Runz#Runs a job from the specified path.zERuns a job from the specified YAML description or Cloud Storage path.z� To run a job from YAML, run:
$ {command} my-job --yaml-pipeline-file=gs://yaml-path --region=europe-west1
)� DESCRIPTION�EXAMPLESc � � | � ddd�� � | � d�� � }|� dd� � � |� d
d � � � | � d d
dt j z �� � | � ddt j � � t j d�� � | � ddd�� � dS )zrRegister flags for this command.
Args:
parser: argparse.ArgumentParser to register arguments with.
�job_name�JOB_NAMEz!Unique name to assign to the job.)�metavar�helpT��requiredz--yaml-pipeline-fileziPath of a file defining the YAML pipeline to run. (Must be a local file or a URL beginning with 'gs://'.))r z--yaml-pipelinez.Inline definition of the YAML pipeline to run.z--region� REGION_IDz*Region ID of the job's regional endpoint. z--pipeline-optionszOPTIONS=VALUE;OPTION=VALUEz$Pipeline options to pass to the job.)r �type�actionr z--jinja-variables� JSON_OBJECTz1Jinja2 variables to be used in reifying the yaml.N)� add_argument� add_mutually_exclusive_groupr �DEFAULT_REGION_MESSAGEr �ArgDict� UpdateAction)�parser�groups � lib/surface/dataflow/yaml/run.py�ArgszRun.Args4 s, � � �����
0� � 2� 2� 2�
� /� /�� /� >� >�E� ��� �
F� � � � �
���� P� � � � � �����;��2�3� � 5� 5� 5� ��� �,�
�
�
"�
"��'�
3� � � � � ���� �
@� � � � � � � c �R � t |j pi � � }|j rB|j � d� � r |j |d< n't j |j � � |d< n
|j |d< |j r
|j |d< d|v rd|vrt |d � � t j
|� � }t j t j j j � d�� � ||j t& � |� � |�� � }t j � |� � S ) z�Runs the command.
Args:
args: The arguments that were provided to this command invocation.
Returns:
A Job message.
zgs://�yaml_pipeline_file�
yaml_pipeline�jinja_variableszjinja-variablesTr )�
project_id� region_idr � gcs_location�
parameters)�dict�pipeline_optionsr' �
startswithr �ReadFileContentsr( r) �_validate_yamlr � GetRegionr �TemplateArgumentsr
�VALUES�core�project�Getr �YAML_TEMPLATE_GCS_LOCATION�format� Templates�CreateJobFromFlexTemplate)�self�argsr- r+ � argumentss r# r zRun.Runa s; � � �d�+�1�r�2�2�J� � �
7�
� � +� +�G� 4� 4�
� ,0�+B�
�'�(�(�&+�&<� � #�'
� '
�
�?�#�#� %)�$6�j� �!� �� ;�&*�&:�j�"�#��*�$�$�):�*�)L�)L��Z��0�1�1�1� �'��-�-�I��&� �$�)�1�5�5�t�5�D�D��� �/�6�6�y�A�A� � � � �I� �>� 3� 3�I� >� >�>r% N)�__name__�
__module__� __qualname__�__doc__�
detailed_help� staticmethodr$ r � r% r# r r # s] � � � � � � ,�+� ��
�
�-� �*� *� �<�*�X'?� '?� '?� '?� '?r% r c �t � t j | � � }d S # t $ r}t d� � |�d }~ww xY w)Nz#yaml_pipeline must be a valid yaml.)r �load� Exception�
ValueError)r( �_�exns r# r2 r2 � sO � �E� � �-� � �A�A�A�� � E� E� E�
�:�
;�
;��D�����E���s � �
7�2�7N)rC �
__future__r r r � googlecloudsdk.api_lib.dataflowr �googlecloudsdk.callioper r �#googlecloudsdk.command_lib.dataflowr �googlecloudsdk.corer
r �googlecloudsdk.core.utilr r9 �DefaultUniverseOnly�
ReleaseTracks� ReleaseTrack�GA�BETA�Commandr r2 rF r% r# �<module>rY sU �� :� 9� &� &� &� &� &� &� � � � � � � '� '� '� '� '� '� 0� 0� 0� 0� 0� 0� /� /� /� /� /� /� (� (� (� (� (� (� =� =� =� =� =� =� *� *� *� *� *� *� $� $� $� $� $� $� *� *� *� *� *� *� ;� �
�����D�%�(�$�*;�*@�A�A�c?� c?� c?� c?� c?�$�,� c?� c?� B�A� ��c?�LE� E� E� E� Er%