Import and high memory consumption

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • MartinP
    Junior Member
    • Mar 2025
    • 1

    Import and high memory consumption

    I'm trying to import 1M contacts, but the memory needed during the import is extremely high. I can chop up the file into 100K contacts, but even these files require about 10GB memory to import. When the import is done, all memory is freed, so something during the import process occupies a lot of memory. I'm not doing duplicate detection and it doesn't matter if it runs via cron or manually. Is there a trick to avoid this extreme memory consumption? (Other than splitting the job into many small batches). Thanks!
    Last edited by MartinP; 03-14-2025, 12:19 PM.
  • harrytruman
    Senior Member
    • Jun 2023
    • 102

    #2
    I've had the same challenge. The good thing is that Espo can handle the job, it just takes time. I suggest upgrading (at least temporarily) your server and memory capacity with your hosting provider. You can also run the import overnight in the backgroud.

    Comment

    Working...