maap-s3-laptop
This python script is used to interact with the esa maap s3.
The script is by default in the stack theia and Jupyter and can be used as a shell script. From you laptop you shoud prefix the script with the command 'python'.
Prerequisite
To use the script some env variables must be defined. Execute the command below from an eclipse che workspace to see the values you have to setup.
echo $MAAP_ENV_TYPE
echo $CLIENT_ID
echo $AUTH_ACCESS_TOKEN_URLCheck if you have request library, or install it if missing.
Info
Maap S3 script is the script used to interact with the bucket S3 to share data with others maap users or to save data when workspace is full. Please dont forget the env variable token and maap_env_type The script provide following features:
To see all options run maap-s3.py help
**upload used to push the data to S3**
param 1: sourceFile
ex: /projects/test/toto.txt
param 2: s3 destination path
ex: maap-scientific-data/shared/test/tkossoko/obs.jar
exemple: maap-s3.py upload /projects/test/maap.tiff maap-scientific-data/shared/test/tkossoko/maap.tiff
resume use to continue a failed multipart previous upload. When your file is more than 5Giga, the python script use multipart upload. During the process, if the upload fails, please run resume without parameter to continue the upload.
**download to download a data from S3**
param 1: s3 path
ex: maap-scientific-data/shared/test/demo/maap.tiff
param 2: Workspace destination path
ex: /projects/test/maap.tiff
exemple: `maap-s3.py download maap-scientific-data/shared/test/tkossoko/maap.tiff /projects/test/maap.tiff`
**list to list a folder from S3**
param 1: s3 bucket folder
ex: maap-scientific-data/shared/test/demo
exemple: `maap-s3.py list maap-scientific-data/shared/test/demo`
exemple: `maap-s3.py list bmap-catalogue-data/Campaign_data`
**delete to delete a file from S3**
param 1: s3 file path
ex: maap-scientific-data/shared/test/demo/maap.tiff
exemple: `maap-s3 delete maap-scientific-data/shared/test/demo/hello-bjorn.txt`
**refresh to reset credentials and passwords when init fails because you type wrong password or email.**
exemple: `maap-s3.py refresh`Info for the stacks
Theia The shebang of the script must be replace by #!/usr/local/bin/python or use the prefix 'python'
Jupyter The shebang of the script must be replace by #!/opt/conda/bin/python