TAGS

There are no tags associated with this article.

How to mount EO DATA as a filesystem using goofys (Linux)?

To mount EO DATA resources as file system do following steps:

For Ubuntu:

$ sudo add-apt-repository ppa:gophers/archive && sudo apt-get update && sudo apt-get install golang-1.10-go
$ echo "export PATH=$PATH:/usr/lib/go-1.10/bin" >> ~/.profile
$ source ~/.profile
$ mkdir work
$ export GOPATH=$HOME/work && go get github.com/kahing/goofys && go install github.com/kahing/goofys


For Centos:

$ sudo rpm --import https://mirror.go-repo.io/centos/RPM-GPG-KEY-GO-REPO
$ curl -s https://mirror.go-repo.io/centos/go-repo.repo | tee /etc/yum.repos.d/go-repo.repo
$ sudo yum install golang


Next, create file ~/.aws/credentials

$ mkdir ~/.aws/
$ touch ~/.aws/credentials

Put the following content into ~/.aws/credentials eg.1234 ( http://data.cloudferro.com does not require an authorization):

[s3]
aws_access_key_id=1234
aws_secret_access_key=1234

Create the directory, which will be the mount point for EODATA

eg. mkdir ~/eo

invoke the following command:

$ $GOPATH/bin/goofys --region RegionOne --profile s3 --endpoint http://data.cloudferro.com DIAS ~/eo

DIAS is the name of our bucket that contains of EO DATA resources.

Now you can access the EODATA:

$ ls eo

CAMS CLMS Elevation-Tiles Jason-3 Landsat-7 Sentinel-1 Sentinel-3 jason-3 CEMS CMEMS Envisat Landsat-5 Landsat-8 Sentinel-2 Sentinel-5P

If you want to mount EODATA on startup, you should do the following:

sudo mkdir /root/.aws
sudo cp ~/.aws/credentials /root/.aws/

and add the following line to /etc/fstab:

/home/eouser/work/bin/goofys#DIAS /home/eouser/eo fuse _netdev,allow_other,--dir-mode=0777,--file-mode=0666,--region=RegionOne,--profile=s3,--endpoint=http://data.cloudferro.com 0 0

please comment out other options in /etc/fstab:

#nfs.eodata.cloudferro.com:/eodata/repository  /eodata nfs  ro,noauto,_netdev,comment=cloudconfig  0   0

#s3fs#DIAS  /eodata fuse  noauto,_netdev,allow_other,use_path_request_style,uid=0,umask=0222,mp_umask=0222,mp_umask=0222,gid=0,url=http://data.cloudferro.com,use_cache=1,max_stat_cache_size=60000,list_object_max_keys=10000,comment=cloudconfig  0  0