Hi Miloš I understand the option you are proferring but there is a large amount of redundancy in exporting from two excel files (as CSV) bringing into a MySQL database and then exporting again and reimporting that into a wpDataTable table! Compared to the other more sophisticated things you do, maybe this is an easy win for future development?
Attached is the file (and the error page) you asked for
to see if someone may be already suggested this feature. If you can't see it, feel free to add your suggestion there, and as more people vote, the feature will move higher on the priority list.
You can certainly follow our changeLog page if you'd like ( it is also available in the plugin dashboard), where we state any changes/new features/bug fixes during updates;
and our newsletter, so you're informed about new features, bug fixes, freebies, etc.
2.
Thank you for the file and screenshot.
I think i can see what it is.
Probably due to the sheer number of rows in the data.
-
On my computer in the localhost environment, i am able to pull it off, and my wpDataTable creates a Manual table,
but on our Demo Sandbox site, i got a Critical Error, same as on your end...
I see that you have almost 160 000 rows in this data set.
Unfortunately, data set that has more than a few thousand rows can not be imported in this way directly via the plugin - this is a limitation that is coming from WordPress itself combined with server performance.
-
You would have to either import this directly in your database management software,
and create an SQL table in our plugin from it;
or you could possibly try to split up the data somehow... (even though i realise that might be a lot of hassle),
and then to import the "chunks of data" as Excel or CSV to create a new Manual wpDataTable,
but it would have to be chunks of several thousand rows at a time,
to complete the entire data set.
-
At this time, unfortunately, these are the limitations that we are battling.
My client has a large data Table (1.25m rows)
I have manually updated it (adding rows) by transferring a CSV file and running SQL statement LOAD DATA INFILE '/var/lib/mysql-files/...
I want to now enable the client to do the same process with wpDataTables
Can you advise how, please?
(I have read how to create a table at
https://wpdatatables.com/documentation/creating-new-wpdatatables-with-table-constructor/importing-data-to-editable-mysql-table-from-excel-or-csv-with-table-constructor/
...but there seems to be no documentation about bring in new rows. And the last update was 14,000+ additional rows)
Thanks
Brian
Hi, Brian
Thanks for reaching out to us
Our developers have recently released new features that now allow us to
import a new/edited file to update existing Manual tables, in the following ways :
This was released in Version 5.0 (on 26.09.2022).
So if you don't have the latest version, please update and check out these new features.
Please check out more details in the hyperlinks, and let me know if that is what you needed. Thanks
Kind Regards,
Miloš Jovanović
[email protected]
Rate my support
Try our FREE mapping plugin! MapSVG - easy Google maps, interactive SVG maps and floor plans, choropleth maps and much more - https://wordpress.org/plugins/mapsvg-lite-interactive-vector-maps/
wpDataTables: FAQ | Facebook | Twitter | Instagram | Front-end and back-end demo | Docs
Amelia: FAQ | Facebook | Twitter | Instagram | Amelia demo sites | Docs | Discord Community
You can try wpDataTables add-ons before purchasing on these sandbox sites:
Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables
Thanks Milos
I saw the new features (& their videos) and these refer to manually created tables that are "wpDataTable tables"
I have a MySQL data table and would like to perform the same operation on that.
Brian
PS. when I tried a manual import from the xlsx source file, the import crashed with an "unknown error"
Hi, Brian
1. The updating of tables via importing files to our plugin can only be performed with Manual tables made by our plugin.
The only workaround can be, if you export the data from an SQL table ( in form of CSV, or Excel, for example),
and you can either use our Export Table Tools ( which have certain limitations);
or you can go into your database management software ( such as PHPMyAdmin) and to export a file from there.
Then you can use this file as import, to make a new Manual table in wpDataTables,
then you will be able to update this table directly in our plugin with the new features.
2.
Can you please send me a zipped version of the xlsx file, and i can inspect the file - replicate the issue on my test site?
If it has any confidential data, make sure to mark reply as Private, please.
Thank you
Kind Regards,
Miloš Jovanović
[email protected]
Rate my support
Try our FREE mapping plugin! MapSVG - easy Google maps, interactive SVG maps and floor plans, choropleth maps and much more - https://wordpress.org/plugins/mapsvg-lite-interactive-vector-maps/
wpDataTables: FAQ | Facebook | Twitter | Instagram | Front-end and back-end demo | Docs
Amelia: FAQ | Facebook | Twitter | Instagram | Amelia demo sites | Docs | Discord Community
You can try wpDataTables add-ons before purchasing on these sandbox sites:
Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables
Hi Miloš
I understand the option you are proferring but there is a large amount of redundancy in exporting from two excel files (as CSV) bringing into a MySQL database and then exporting again and reimporting that into a wpDataTable table!
Compared to the other more sophisticated things you do, maybe this is an easy win for future development?
Attached is the file (and the error page) you asked for
Hi, Brian
I can see what you mean.
Yes, that was kind of an idea in the moment, to try to think of an "alternate way" that might work for SQL tables,
but now when I think more about it, it would be too much work, and a large amount of redundancy, i agree...
So at the moment, the only viable method of updating via file import does only make sense for Manual tables...
But if you can be so kind to create a suggestion for our developers, they will consider adding such feature in the future for SQL tables, as well.
Please feel free to search on our suggestions page,
to see if someone may be already suggested this feature. If you can't see it, feel free to add your suggestion there, and as more people vote, the feature will move higher on the priority list.
You can certainly follow our changeLog page if you'd like ( it is also available in the plugin dashboard), where we state any changes/new features/bug fixes during updates;
and our newsletter, so you're informed about new features, bug fixes, freebies, etc.
2.
Thank you for the file and screenshot.
I think i can see what it is.
Probably due to the sheer number of rows in the data.
-
On my computer in the localhost environment, i am able to pull it off, and my wpDataTable creates a Manual table,
but on our Demo Sandbox site, i got a Critical Error, same as on your end...
I see that you have almost 160 000 rows in this data set.
Unfortunately, data set that has more than a few thousand rows can not be imported in this way directly via the plugin - this is a limitation that is coming from WordPress itself combined with server performance.
-
You would have to either import this directly in your database management software,
and create an SQL table in our plugin from it;
or you could possibly try to split up the data somehow... (even though i realise that might be a lot of hassle),
and then to import the "chunks of data" as Excel or CSV to create a new Manual wpDataTable,
but it would have to be chunks of several thousand rows at a time,
to complete the entire data set.
-
At this time, unfortunately, these are the limitations that we are battling.
Sorry for the inconvenience.
Kind Regards,
Miloš Jovanović
[email protected]
Rate my support
Try our FREE mapping plugin! MapSVG - easy Google maps, interactive SVG maps and floor plans, choropleth maps and much more - https://wordpress.org/plugins/mapsvg-lite-interactive-vector-maps/
wpDataTables: FAQ | Facebook | Twitter | Instagram | Front-end and back-end demo | Docs
Amelia: FAQ | Facebook | Twitter | Instagram | Amelia demo sites | Docs | Discord Community
You can try wpDataTables add-ons before purchasing on these sandbox sites:
Powerful Filters | Gravity Forms Integration for wpDataTables | Formidable Forms Integration for wpDataTables | Master-Detail Tables