Slow Import

Collapse
X
 
  • Time
  • Show
Clear All
new posts

  • yuri
    replied
    Try to figure out what exactly is slow. Is it fast if you skip duplicates. Is it fast in silent mode.

    How many records are already in the database table.

    Database tweaking is also may be reasonable if you have big tables.

    Leave a comment:


  • yuri
    replied
    Server is not weak. The text is not boldenough.

    Leave a comment:


  • Ashif Malayil
    replied
    4 Core 16 GB RAM 250 GB SSD server? is this two weak?

    Leave a comment:


  • yuri
    replied
    Adding necessary indexes may held if search for duplicates performs long. Also maybe consider upgrading server's hardware.

    Leave a comment:


  • victor
    replied
    Originally posted by Ashif Malayil
    I have done a import around 2700+ data was there on the sheet with 97 columns, the file size was 5mb. But it took around 4 hour to complete the import. The import executed in idle mod. Skip duplicates and silent mode has not checked. Is there any way to fix this issue?
    For example, an import file of 18,000 lines on a very powerful server without the Skip searching for duplicates option but wiht Silent mode option enabled takes about 10 minutes (screenshot 1).​

    So, most likely, your server is simply too weak. You can enable Skip searching for duplicates and Silent mode and try to import through the UI, or better through the CLI.​
    Attached Files
    Last edited by victor; 05-10-2024, 10:37 AM.

    Leave a comment:


  • eymen-elkum
    replied
    Enabling the skip duplicate will make it faster, silent mode also make it faster, especially if the table has large number of records

    Leave a comment:


  • Ashif Malayil
    started a topic Slow Import

    Slow Import

    I have done a import around 2700+ data was there on the sheet with 97 columns, the file size was 5mb. But it took around 4 hour to complete the import. The import executed in idle mod. Skip duplicates and silent mode has not checked. Is there any way to fix this issue?
    Last edited by Ashif Malayil; 05-10-2024, 09:59 AM.
Working...