Okay
  Public Ticket #3188073
Limitation of import?
Closed

Comments

  • Christopher started the conversation

    Hello, 

    I have a csv-file that is 18 mb big. It has approx. 210 columns and 11,000 lines. 

    So my question. Is that too big for import? I'm getting an internal server error when trying to do so....

    Is there another way? Can I convert it to some other database or something like that?


    Best regards

    PS here is the video of my screen: https://uploadify.net/e3808e9b572f87a5/simplescreenrecorder1f-2022-12-19_15.30.17a.mp4

  •  1,850
    Miloš replied

    Hi, Christopher 

    You are correct.

    Data that has more than few thousand rows can  not be imported in this way directly via the plugin - this is a limitation that is coming from WordPress itself combined with server performance.

    But there is a solution.

    What you can do is, you can import the file, in form of Excel, CSV, or spreadsheet directly in your database via your database management tool, such as PhPMyAdmin.

    Here is an example how you can do it.

    When you're importing a CSV file in your database, you need to navigate to the WordPress database, and click on "Import":

    8377693210.png

    Then click on "Choose file" and select your CSV file:

    5612183262.png

    The structure of the file needs to be set so the first row of the file contains column headers. For example, if the table you're creating is supposed to look like this:

    1218668569.png

    The structure of the CSV file should contain "COLUMN1, COLUMN2, COLUMN3" in the first row, like this:

    COLUMN1,COLUMN2,COLUMN3
    Google,Test,123
    Yahoo,Test2,456
    Facebook,Test3,789
    

    Then, when you select that file scroll down, and check the "The first line of the file contains the table column names" check-box, so the first line is used for headers of the table; and then click on GO:

    6597093190.png

    You should see a screen similar to this:

    6614546190.png

    In my case, it's "TABLE 114", and you can click on it to open that database table:

    6217716179.png

    To avoid having any issues when using this table in wpDataTable, my advice is to change its name (because it contains a space). So, go to the "Operations" tab:

    1467228342.png

    And under "Table Options" rename that table to what you want it to be. 

    8668458192.png

    Just make sure not to include dots ( . ) or spaces (don't use any special characters). You can rename the table to be "table_1" for example. After you rename it, click on GO in the right corner of "Table options" section:

    3299082668.png

    And that's it. You're now able to create an SQL query based table using this query (for example):

    SELECT * FROM table_1

    -

    Let me know if you have any questions.smile.pngThank you

    Kind Regards, 

    Miloš Jovanović
    [email protected]

    Rate my support

    Try our FREE mapping plugin! MapSVG - easy Google maps, interactive SVG maps and floor plans, choropleth maps and much more - https://wordpress.org/plugins/mapsvg-lite-interactive-vector-maps/

    wpDataTables: FAQ | Facebook | Twitter | InstagramFront-end and back-end demo | Docs

    Amelia: FAQ | Facebook | Twitter | InstagramAmelia demo sites | Docs | Discord Community

    You can try wpDataTables add-ons before purchasing on these sandbox sites:

    Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables

  • Christopher replied

    Hi,

    after a few tries, I managed to import the csv through phpmyadmin. But still I cannot import it to wpDataTables.
    I renamed the table to gadm4.

    So when I try to import it through sql in wpdatatables, I'm getting: Gerenderte Abfrage: SELECT * FROM gadm4 LIMIT 10

    Not sure, where that "LIMIT 10" is coming from....

    Also in phymyadmin I'm able to see all the column names of the csv. But the tables themselves I can't see, there is no preview of them strangely...

  • Christopher replied

    PS, I also don't have a database "current" in my Wordpress database. On the left side I have this:dot.gifdot.gif

    • dot.gif New
    • dot.gif dot.gif + desputin_test03
    • dot.gif dot.gif + information_schema

    So now the data was importet under +desputin_test03, which is the wordpress-db.

  • Christopher replied

    PPS

    is it maybe possible to split my csv file and import several times to the same wpdatatable? Is that possible?

  •  1,850
    Miloš replied

    Hi, Christopher 

    Sorry for the delay

    The "current" database name is just a name we use for testing purposes, but on your site, as you have correctly checked, it is +desputin_test03.

    -

    2. Yes. There is a way , if you split your initial CSV file to lesser "chunks" of data sets,

    then you can try to import, for example, a couple of thousand rows first ( maybe up to 5000 rows, depending on how much your WordPress server can handle)  in order to create the new Manual Table through our plugin,  and for it to get created in your WP database;

    then you can upload another CSV to add more rows,  and so on.

    Please check out this documentation that explains how you can Update manual tables from source files (CSV, Excel or Google sheet).

    Let me know if that helps.smile.png

    Kind Regards, 

    Miloš Jovanović
    [email protected]

    Rate my support

    Try our FREE mapping plugin! MapSVG - easy Google maps, interactive SVG maps and floor plans, choropleth maps and much more - https://wordpress.org/plugins/mapsvg-lite-interactive-vector-maps/

    wpDataTables: FAQ | Facebook | Twitter | InstagramFront-end and back-end demo | Docs

    Amelia: FAQ | Facebook | Twitter | InstagramAmelia demo sites | Docs | Discord Community

    You can try wpDataTables add-ons before purchasing on these sandbox sites:

    Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables

  • Christopher replied

    Hi Miloš,

    P E R F E C T, Thank you, that worked fine.

  •   Miloš replied privately
  •   Christopher replied privately
  •   Miloš replied privately