Upload all files to an object store

[bandtank]

HI!

I have a good news and another bad news ...
The good new:
I have managed to put the s3 and it works perfectly: D: D

The bad new:
It only works for me in EspoCrm 4.7 I've tried to do the same configuration in 5.5, 5.4 and I can't get it to work.

Is there a change in the FileStorage? What I can do?

When has it functional I will upload the files in case I can help someone
Thank you so much!

This would be absolutely amazing if we can get it to work in 5.5+. Storing files on S3 would completely change my backup and recovery strategy for the better.

[dabasystem]

HI!

I have a good news and another bad news ...
The good new:
I have managed to put the s3 and it works perfectly: D: D

The bad new:
It only works for me in EspoCrm 4.7 I've tried to do the same configuration in 5.5, 5.4 and I can't get it to work.

Is there a change in the FileStorage? What I can do?

When has it functional I will upload the files in case I can help someone
Thank you so much!

[bandtank]

I'm very curious about this as well. Being able to upload and download files to S3 would be a huge upgrade to local file storage. It would truly make EspoCRM highly available since the front end could be clustered. This would also be a necessity for Docker containers.

[huscmk]

Hi, Did anyone completed the AWS S3 implementation by any chance ? Regards,

[yuri]

1. In data/config.php need to add parameter 'defaultFileStorage' => 'AmazonS3'


2. Create custom/Espo/Custom/Resources/metadata/app/fileStorage.json with the following content

{
    "implementationClassNameMap": {
        "AmazonS3": "\\Espo\\Custom\\Core\\FileStorage\\Storages\\AmazonS3"
    }
} 

3. Create file custom/Espo/Custom/Core/FileStorage/Storages/AmazonS3.php

<?php

namespace Espo\Custom\Core\FileStorage\Storages;

use \Espo\Entities\Attachment;

use \Espo\Core\Exceptions\Error;

class AmazonS3 extends \Espo\Core\FileStorage\Storages\Base
{
    protected $dependencyList = ['fileManager', 'config'];

    protected function getFileManager()
    {
        return $this->getInjection('fileManager');
    }

    protected function getConfig()
    {
        // in config we can store storage credentials
        return $this->getInjection('config');
    }

    public function unlink(Attachment $attachment)
    {
        // removing file, returns true or false
    }

    public function isFile(Attachment $attachment)
    {
        // checks whether file exists
    }

    public function getContents(Attachment $attachment)
    {
        // returns contents of the file
    }

    public function putContents(Attachment $attachment, $contents)
    {
        // stores contents of the file
    }

    public function getLocalFilePath(Attachment $attachment)
    {
        // returns local file path of copied temporary file to be able to download//
        // if user wants to download the file we need to have it copied on the server as a temporary file
        // maybe this can be improved in future
    }

    public function getDownloadUrl(Attachment $attachment)
    {
        // if there is a direct url to download; likely, leave this method empty
    }

    public function hasDownloadUrl(Attachment $attachment)
    {
        // whether there is a url for download; likely return false;
    }
}

Don't forget to clear cache after changes in metadata.

You can use $attachment->id for filenames on the storage

I'm very busy these days. Don't have time to try to make this implementation.

[huscmk]

That would indeed be an excellent plus-value if we could externalize media files to Amazon S3 as it would mean no more storage issues on the servers running espocrm.

As I understand, there is now a framework with a storage manager that still needs to get a wrapper for S3 (or any other object storage with an API) but it seems hard to do by the look to that code only as it needs a quite good understanding of how media management is done in espocrm.

Anyone who could help with the task ?

[bandtank]

yurikuzn,

Could you please explain how to use the file storage manager feature? I would like to upload files to S3 or Dropbox, but I don't understand if that's possible or how to get started.

[bandtank]

I see the release is live and the upload feature is listed in the Github release notes. Thanks for your hard work.

[wtconseil]

Awesome :-))))
Thanks for your hard work!

[yuri]

In 4.5.0 release there will be a framework providing an ability to implement external storage. Release is planned for today.

[bandtank]

Is there anything the community can do to help? I really want this feature and I am willing to contribute if there's a way to speed up the release. I want to start using EspoCRM, but storing files in a local upload folder is a deal breaker because the ephemeral nature of an EC2 instance is very risky.

[yuri]

In the next 4.5.0 release. Soon.

[huscmk]

Great news ! Will you tell us when it's finished ?

Thanks !

[yuri]

We have planned this.

[jmreymond]

To be sure I have understand
Currently, we have very big documents like city maps, size is 300 MB for each map. It should be nice to store a document greater than 2 MB (for example) to an external storage provider like dropbox, Google drive, onedrive, ... as thunderbird filelink : https://support.mozilla.org/t5/Basic...nts/ta-p/16289
Will this be possible ?