Gigantic uploads folder

[Russ]

Hey guys!

So the uploads folder reached more than 700K records and it's almost impossible to check data through linux command line, is there any options (or roadmap to have one) on how to get out of such situation? May be use nested folders?

I need to access folders to perform certain backups, for example my /uploads folder is EFS, but I can't browse it, at all, it halts any system.


Thanks

[victor]

Hi Russ,

Attachments can be stored on AWS S3: https://docs.espocrm.com/administrat.../#file-storage.

[Russ]

Hi Russ,

Attachments can be stored on AWS S3: https://docs.espocrm.com/administrat.../#file-storage.

wow, actually, very cool. So If I enable it today, all existing attachments may stay on current server, while new ones to appear on AWS?

[victor]

Yes. For moving existing attachments you can use: https://docs.espocrm.com/administrat...ng-attachments.

[yuri]

> it's almost impossible to check data through linux command line

It's not supposed to. You can check your attachments at Administration > Attachments. You can filter orphan attachments and delete them. Find largest ones.

[shalmaxb]

yuri I had a look into that in my app. I can display all attachments or the orphans only. But I see e.g. one attachment (an image) in the orphans list, which is still in use, not deleted. I can see that by the ID.
It would also be nice to have some more columns in the list view, like ID and deleted/not deleted (like in the MySQL database as 1 or 0).
Can I modify the list display by editing the json for the list layout? Or wouldn`t you not recommend that?

[yuri]

> which is still in use. I can see that by the ID.

Where exactly it's used?

> deleted/not deleted

Not possible. Deleted just not listed.

[shalmaxb]

I have a custom entity, where I have images. The example, I gave, was one image still in use in one record of that entity, but showed up in orphans, which I thought is for deleted images.
I only tested with this one image, maybe there might be others marked as orphans, despite still in use.

[yuri]

In a field of Image type? Did you upload that image via the UI? Or maybe by some automation?

[shalmaxb]

yes, image type, upload from GUI

[Russ]

> it's almost impossible to check data through linux command line

It's not supposed to. You can check your attachments at Administration > Attachments. You can filter orphan attachments and delete them. Find largest ones.

thanks

[shalmaxb]

yuri, here screenshots from orphans and respective detail view.

[yuri]

In what year was it uploaded? IIRC we didn't store the Related field in the attachment back in the day.

[shalmaxb]

Record created 7.3.2024, image uploaded 8.3.2024
I also looked into the database, this record never had been deleted.

[yuri]

What if you upload a new image? Would it be orphan?

[yuri]

Does the attachment has empty Parent are Related?

[shalmaxb]

all attachments do not have parent, all orphans do not have parent and related.
Not orphans have related.

In the moment I cannot upload new image, as it is a client`s installation.