Very strange scheduled business procees and cron import behavior

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • dimyy
    Active Community Member
    • Jun 2018
    • 595

    #1

    Very strange scheduled business procees and cron import behavior

    Very strange import behavior: the report has 40,000 records, it processes about 9,000 and then stops.

    I tried a workaround - through import. Created an additional chunk entity and then during import a business process is triggered which also selects records from the corresponding chunk (500 at a time). And what's interesting - the process also stalls at around 9,000 created records. Moreover, it doesn't matter from which point you start the process - it processes about 9,000 records and that's it - just hangs in running business processes. No database locks, no errors in the log. I manually terminate the business process, do a new import from a different point - same result. It feels like there's some internal limit hardcoded somewhere - where should I dig?


  • yuri
    EspoCRM product developer
    • Mar 2014
    • 9440

    #2
    Maybe this? https://forum.espocrm.com/forum/gene...ig-mass-update
    If you find EspoCRM good, we would greatly appreciate if you could give the project a star on GitHub. We believe our work truly deserves more recognition. Thanks.

    Comment

    • dimyy
      Active Community Member
      • Jun 2018
      • 595

      #3
      It's possible, but I don't understand where to check for errors like out-of-memory if the process is running in cron. Maybe at the system level add an option to run each instance in a separate process? Or, for example, split the batches into N records?

      Comment

      • yuri
        EspoCRM product developer
        • Mar 2014
        • 9440

        #4
        Memory exhaustion errors usually not logged by the app, as the app is aleady broken to be able to log.

        If it's a memory limit issue, I believe upgrading to v9.2 will fix it.
        If you find EspoCRM good, we would greatly appreciate if you could give the project a star on GitHub. We believe our work truly deserves more recognition. Thanks.

        Comment

        Working...