Support Forum

Advanced Search
Forum Scope


Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
general-topic
Wp Forum to Simple Press importer not working completly
Avatar
Juan Francisco Gonzalez Alonso
Member
Free Members
sp_UserOfflineSmall Offline
Mar 31, 2014 - 3:05 pm

Hi all,

we are trying to migrate a wp forum with more than 100.000 threads to Simple Press and it gives many errors.

At beginning there were a lot of timeouts errors and after many tunes in apache and php configuration we managed to make the import.

Actually, in our last migration we found that many forums topics had errors, so after that any post in that topic was migrated.

This was the error:

[Fri Mar 28 19:26:12 2014] [error] [client 172.22.121.1] Error Duplicate entry '4613' for key 'PRIMARY' de la base de datos de WordPress para la consulta INSERT INTO wp_sftopics (topic_id, topic_name, topic_date, topic_status, forum_id, user_id, topic_pinned, post_id, topic_slug)
ttt VALUES (4613, 'Estafa', '2007-10-16 14:26:56', 0, 2, NULL, 0, 0, 'estafa-2'); realizada por spi_import_forums, spi_create_topic, referer: http://www.example.com/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

Tables were empty when we start the migration, can be another the problem other than a duplicate key, like a user that doesn't exist or something?

Help will be really appreciated.

Regards,

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Mar 31, 2014 - 3:25 pm

Sorry to hear about the initial time-outs. We really do need to address this in the importer but most conversions are much smaller and it would mean a complete rewrite.

To be frank if the error says duplicate key then I would believe it. I do not remember fully the data storage of wp-forum but is it at all possible that there could indeed be duplicate topic IDs in your source data? The error message seems to suggest that is the case. But you would need to look at the original table data.

andy-signature.png
YELLOW
SWORDFISH
Avatar
Juan Francisco Gonzalez Alonso
Member
Free Members
sp_UserOfflineSmall Offline
Apr 1, 2014 - 9:24 am

We already looked in the original table data and there's no duplicate topics ids. We are trying to migrate for more than a month ago.

Yesterday we tried to touch the importer code to try to skip this duplicates errors, bout today we found all this errors:

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_redirection_items.*,wp_redirection_groups.tracking,wp_redirection_groups.position AS group_pos,wp_redirection_modules.id AS module_id FROM wp_redirection_items INNER JOIN wp_redirection_groups ON wp_redirection_groups.id=wp_redirection_items.group_id AND wp_redirection_groups.status='enabled' INNER JOIN wp_redirection_modules ON wp_redirection_modules.id=wp_redirection_groups.module_id AND wp_redirection_modules.type='wp' WHERE( wp_redirection_items.regex=1 OR wp_redirection_items.url='/wp-content/plugins/sp-import/engine/spimport.php?action=forumPhase&phase=12') realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, WordPress_Module->init, Red_Item->get_for_url, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'opiniones'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'marca'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'modelo'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'segmento'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'combustible'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT wp_posts.post_name rnttttttttFROM wp_posts rnttttttttWHERE wp_posts.post_status = 'publish' rn tttttttttAND wp_posts.post_type = 'acf'rn tttttttttAND wp_posts.post_date < NOW() realizada por require_once('wp-config.php'), require_once('wp-settings.php'), do_action('init'), call_user_func_array, UWT_RemoveSlugCustomPostType::init, UWT_RemoveSlugCustomPostType->__construct, UWT_RemoveSlugCustomPostType->rewrite_rules, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT * FROM wp_users WHERE ID=1 realizada por sp_forum_api_support, sp_load_current_user, sp_get_user, spUser->__construct, spdb_table, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

Can you give me some directions in why this errors may occur?

Regards,

Avatar
Juan Francisco Gonzalez Alonso
Member
Free Members
sp_UserOfflineSmall Offline
Apr 1, 2014 - 9:26 am

And more errors:

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT special_rank FROM wp_sfspecialranks WHERE user_id=0 realizada por sp_forum_api_support, sp_load_current_user, sp_get_user, spUser->__construct, sp_get_user_special_ranks, sp_get_special_rank, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT * FROM wp_posts WHERE ID=16125 realizada por sp_forum_api_support, include_once('/plugins/simple-press/sp-startup/sp-load-forum.php'), include_once('/plugins/simple-press/sp-startup/forum/sp-forum-constants.php'), spdb_table, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT * FROM wp_sftrack WHERE trackname='172.22.254.113' realizada por sp_forum_api_support, sp_get_track_id, spdb_table, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:19 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT error_count FROM wp_sferrorlog WHERE keycheck="Notice31-press/sp-api/sp-api-auths.php" AND error_type="php" realizada por spi_import_forums, spi_create_forum, sp_filter_text_save, sp_filter_save_kses, sp_kses_array, sp_get_auth, sp_construct_php_error, spdb_table, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

[Mon Mar 31 19:59:39 2014] [error] [client 172.22.254.113] Error MySQL server has gone away de la base de datos de WordPress para la consulta SELECT error_count FROM wp_sferrorlog WHERE keycheck="151-press/sp-api/sp-api-error.php" AND error_type="database" realizada por spi_import_forums, spi_create_forum, sp_filter_text_save, sp_filter_save_kses, sp_kses_array, sp_get_auth, sp_construct_php_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, sp_construct_database_error, spdb_table, spdb_select, referer: http://example.com.ar/wp-admin/admin.php?page=sp-import/admin/spimport-setup.php&sys=wpforum

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Apr 1, 2014 - 1:00 pm

These are all the same error - 'MySQL server has gone away'.

This means that the mySQL database engine is not responding to the requests. This most usually suggests a configuration issue with the server and would be something you need to discuss with your site host support.

andy-signature.png
YELLOW
SWORDFISH
Avatar
Juan Francisco Gonzalez Alonso
Member
Free Members
sp_UserOfflineSmall Offline
Apr 4, 2014 - 11:09 am

Hi,

we have been debugging the import process and the Error MySQL server has gone away is being generated case the import script is not parsing right certain posts form WP-Forum.

As you can see in post 64867 (error_post_64867.txt attached), the import script didn't parse ok the original post (postoriginal_64867.txt attached) and generated an INSERT code that generate an error even when you try to make the INSERT via phpmyadmin

In post 65943 the INSERT query, is broken in:

alt="http://www.deautos.com/images/.....495_3c.jpg

Looking to the original post, that line belongs to the following part of the post:

Red what process correctly

Black where the error is created.

and blue is some of the content that follows.

 

<img src="http://www.deautos.com/images/.....787_2c.jpg" alt="http://www.deautos.com/images/.....787_2c.jpg" />

<img src="http://www.deautos.com/images/.....787_3c.jpg" alt="http://www.deautos.com/images/.....787_3c.jpg" />

            <a href="http://www.deautos.com/usados/.....-2006.html">http://www.deautos.com/usados/.....tml%5B/url

original post and error attached too for 65943.

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Apr 5, 2014 - 4:59 am

Apologies for the delay.

Also sorry but I do not follow any of this. What are these links? They all seem to take me to a 404 page and a photo of an old black car. You mention bad insert statements but where are they? There is also no attachment...

andy-signature.png
YELLOW
SWORDFISH
Avatar
Juan Francisco Gonzalez Alonso
Member
Free Members
sp_UserOfflineSmall Offline
Apr 6, 2014 - 8:41 pm

Hi, here are the attachments.

Download error_post_64867.pdf

Download error_post_65943.pdf

Download postoriginal_64867.pdf

Download postoriginal_65943.pdf

as I tried to explain in my post we have been debugging the import process and the Error MySQL server has gone away is being generated because the import script is not parsing right certain posts from WP-Forum.

As you can see in post 64867 (error_post_64867.txt attached), the import script didn't parse ok the original post (postoriginal_64867.txt attached) and generated an INSERT code that generate an error even when you try to make the INSERT via phpmyadmin

In post 65943  (error_post_65943.txt attached) the INSERT query, is broken in:

alt="http://www.deautos.com/images/…..495_3c.jpg

Looking to the original post (postoriginal_65943.txt attached), you will find the line where the insert is broken.

Regards,

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Apr 7, 2014 - 4:14 am

Looking at this heavily escaped text is really not an easy way to analyse these issues.

Looking at the specific example you cited I do not see what the 'error' in the query is you are referring to. Unless you are referring to the fact that the error text has been truncated.

(If you have a properly formatted query (without all the escape sequences and surrounding garbage) from the error log that you want to show us then please paste JUST the query text here using the code syntax highlighter button on the toolbar. Paste the text - select the text - use the button drop-down and select 'sql'.)

Have you actually taken the time to investigate the 'server gone away' situation which is the real error underlying your problem? http://dev.mysql.com/doc/refma.....-away.html

andy-signature.png
YELLOW
SWORDFISH
Forum Timezone: Europe/Stockholm
Most Users Ever Online: 1170
Currently Online:
Guest(s) 1
Currently Browsing this Page:
1 Guest(s)
Top Posters:
Mr Papa: 19448
Ike: 2086
Brandon: 864
kvr28: 804
jim: 650
FidoSysop: 577
Conrad_Farlow: 531
fiddlerman: 358
Stefano Prete: 325
Member Stats:
Guest Posters: 619
Members: 17361
Moderators: 0
Admins: 4
Forum Stats:
Groups: 7
Forums: 17
Topics: 10127
Posts: 79625