Okay
  Public Ticket #3103068
CSV File size limitations
Closed

Comments

  • Tony Goedde started the conversation

    Is there a limitation to how many data fields are in our CSV file? We have a large inventory of 105,000 items. When I upload the file for conversion it takes an understandably long time to configure it. Then when we look at our live page we get a warning that the page is having a problem and it doesn't show up. Sometimes it shows the table as one huge 105,000 long table even though I have  the "display" settings to show only 25 pages at a time. And when I try to edit the "settings" I get an error "There was an error while trying to save the table! Not Found. These problems are causing us to have to keep pushing back our launch until we can get the table to work solid. Any help is greatly appreciated.

  •  1,689
    Miloš replied

    Hi, Tony 

    Firstly, I would like to sincerely apologize for the delayed response as we have been experiencing an unusually high number of tickets. I am sorry that it has taken longer than usual to respond to your concern and your patience is highly appreciated.

    Yes, the CSV format has limitations for the number of rows, when you go beyond a certain number of rows, the page will become extremely slow, or eve break.

    -

    This format will work only up to a certain limit (no exact limit, but 3000-5000 cells is a good example). If you have a larger file, the page load time will increase. 

    For large data sets it makes sense to import the data to MySQL, you can use “Create a table by importing data from data source” option to do this.

    -

    Then, when you import the data to create a Manual table, these are the ways how an existing table can be updated :

    1. Edit the table in Excel-like editor, where you can select a range of cells from an Excel file (you can open the CSV file in Excel, and select only the new data you want to add), copy them and paste them in the last row of the Excel-Like editor, and that will paste all selected cells in the table.

    2. Save the new data you want to add (without headers) as a separate CSV file, go to the database and find the database table. Access it, and go to "Import" tab, where you can import that new CSV file, and update the database table in this way.

    Our developers will be working to improve this in the future, but I have no ETA as to when it will be implemented in the plugin

    -

    Let me know if that might work for you? Thank yousmile.png


    Kind Regards, 

    Miloš Jovanović
    [email protected]

    Rate my support

    wpDataTables: FAQ | Facebook | Twitter | InstagramFront-end and back-end demo | Docs

    Amelia: FAQ | Facebook | Twitter | InstagramAmelia demo sites | Docs | Discord Community

    You can try wpDataTables add-ons before purchasing on these sandbox sites:

    Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables