Professional Documents
Culture Documents
Go to cloud shell
2. authenticate yourself in the shell
3. activate the env. with the command --> source venv/bin/activate
4. Run the command 4th command given in the dataflow python file in the 2nd hands-
on task and to that command add the flag
--template-location='gs://your bucket name/composer/data.csv'
)
change the template below task_id to template="gs://your bucket
name/composer/data.csv"
10.run the command 3rd given by mani in the teams which goes something like gsutil
cp ./youfilename.py .....
11. go to cloud composer and the open airflow link in front of oct-batch2 below
airflow webserver and then you will find your name task there