1. Please take a little time for this simple survey! Thank you for participating!
    Dismiss Notice
  2. Dear Pleskians, please read this carefully! New attachments and other rules Thank you!
    Dismiss Notice
  3. Dear Pleskians, I really hope that you will share your opinion in this Special topic for chatter about Plesk in the Clouds. Thank you!
    Dismiss Notice

Upgraded from 2.2.4->2.3.1 - CDNS stuck in "Unsynchronized"

Discussion in 'Plesk Expand 2.3 Troubleshooting Issues' started by loopback-martin, Aug 12, 2008.

  1. loopback-martin

    loopback-martin Guest

    0
     
    Hi,

    We've just upgraded our Expand installation from 2.2.4->2.3.1 (CentOS 3). Directly after the upgrade one of our CDNS servers are stuck in 'Error: This central DNS server is unsynchronized' - the seconday CDNS is reported as healthy.

    From the log:

    <errtext>[Operator] Error synchronizing CDNS server. Failed to sync CS server #2: CS object(s) #1, #2 instances for CS server #2 are 'unsynched'.</errtext>


    We are running our Plesk servers as DNS-masters and the two CDNS servers are slaves.

    I can't see any reason why it should be reported as out of synch. The dnscontroller.log on each CDNS reports the same numbers of zones active. If I manually synchronize a zone, it's reported as a success on _both_ CDNS servers and I can verify that it's working in the dnscontroller.log.

    The CDNS Servers are running DNSController version 3.0.1.

    Does anyone have a clue? Any help at all is much appreciated !

    Best regards,
    Martin
     
  2. loopback-martin

    loopback-martin Guest

    0
     
    From the operator.log

    ---
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Synchronizing CS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Getting dnscontroller API interface for DNS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Getting DNS server #2 API version.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Getting dnscontroller API interface for version '3.0.1.0'.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Using 'CentralizedDNS:max_operated_dns_zones' = 200.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Adding recursions on CDNS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Updating recursions on CDNS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: No non-undefined recursions.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Request for CDNS server #2 is empty.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Returning recursions added on CDNS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Returning recursions updated on CDNS server #2.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Updating CS objects instances status.
    Aug 12 2008 18:10:43 [5387395:20591] ERR: CS object #1: corresponding Expand object is undefined.
    Aug 12 2008 18:10:43 [5387395:20591] ERR: CS object #2: corresponding Expand object is undefined.
    Aug 12 2008 18:10:43 [5387393:20587] INFO: Result code: 0
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Updating CS server #2 status - 'offline' problem reason.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Unlocking object(s) #1, #2 in the 'cdns_recursion_instance' table.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Object(s) #1, #2 have been unlocked - 2 row(s) affected.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Checking for CS objects without instances.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: No CS objects without instances.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Updating synched CS objects status.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Updating CS server #2 status - 'unsynched' problem reason.
    Aug 12 2008 18:10:43 [5387395:20591] INFO: Result code: 111
    ---
     
  3. gold

    gold Regular Pleskian

    25
    57%
    Joined:
    Jan 8, 2008
    Messages:
    307
    Likes Received:
    0
    The problem is in action 'Updating DNS ACL and recursion' running from upgrade scripts. Please find this action in action log and attach to this thread or send to me by private message action`s problem report. It is help to us to resolve this problem. You can update DNS ACL and recursion manually from 'Reload Servers' page.
     
  4. loopback-martin

    loopback-martin Guest

    0
     
    Thanks for your reply! I did a reload of the DNS information for our Plesk servers, when it had updated I clicked on the CDNS Server that was "unsynchronized". Expand now showed a message that one of our plesk servers DNS recursion settings differed from the rest and I had choose which recursion setting to use. After that the CDNS Servers are shown as OK again.

    Thanks a bunch for your quick reply.
     
  5. loopback-martin

    loopback-martin Guest

    0
     
    And here is the Problem report - part 1 :

    PROBLEM REPORT FOR ACTION #5392751
    ==================

    ACTION INPUT
    -------------
    <packet version="2.3.0.10">
    <sync>
    <filter>
    <all></all>
    </filter>
    </sync>
    </packet>


    ACTION OUTPUT
    -------------
    <?xml version="1.0" encoding="UTF-8" standalone="no" ?>
    <packet action_id="5392751" version="2.3.1.8">
    <sync>
    <result>
    <status>error</status>
    <errcode>11119</errcode>
    <errtext>[Operator] Error synchronizing CDNS server. Failed to sync CS server #2: CS object(s) #1, #2 instances for CS server #2 are 'unsynched'.</errtext>
    <server_id>2</server_id>
    </result>
    </sync>
    </packet>

    ACTION LOG:
    --------------
    Aug 13 2008 08:52:48 [:20589] DEBUG: pool: Sending message to parent: 2.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] NOTICE: Command 'sync' requested
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] INFO: Parsing <sync> command.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] DEBUG: <filter><all> is specified.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] INFO: Processing <sync> command.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Filtering master-slave and deassigned CDNS servers.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CDNS server #2 is a master.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CDNS server #3 is a slave.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CDNS zones.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Synch master and deassigned CDNS servers.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CS 'zone' objects.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: None CS objects instances have been selected for synch.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS server #2 status - 'unsynched' problem reason.
    Aug 13 2008 08:52:48 [:20589] DEBUG: 'unsynched' problem reason has been deleted for CS server #2 - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS server #2 status has been updated - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Synch slave CDNS servers.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CS 'zone' objects.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: None CS objects instances have been selected for synch.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS server #3 status - 'unsynched' problem reason.
    Aug 13 2008 08:52:48 [:20589] DEBUG: 'unsynched' problem reason has been deleted for CS server #3 - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS server #3 status has been updated - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CDNS ACEs.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Synch master and deassigned CDNS servers.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CS 'ACE' objects.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: None CS objects instances have been selected for synch.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS server #2 status - 'unsynched' problem reason.
    Aug 13 2008 08:52:48 [:20589] DEBUG: 'unsynched' problem reason has been deleted for CS server #2 - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS server #2 status has been updated - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CDNS recursions.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Synch master and deassigned CDNS servers.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CS 'recursion' objects.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No redundant CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No lost CS objects and instances.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] NOTICE: 'CentralizedDNS:max_operated_dns_recursions' is not defined in Expand configuration file. Using default value = 200.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Collecting CS objects for CS server #2.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #1 instance #1 is 'adding'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #2 instance #2 is 'adding'.
    Aug 13 2008 08:52:48 [:20589] INFO: Locking object(s) #1, #2 in the 'cdns_recursion_instance' table - state 'adding', action #5392751.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Object #1 is not locked.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Object #2 is not locked.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Succeeded to lock object(s) #1, #2 for update.
    Aug 13 2008 08:52:48 [:20589] INFO: Object(s) #1, #2 have been successfully locked in state 'adding' by action #5392751 - 2 row(s) affected.
     
  6. loopback-martin

    loopback-martin Guest

    0
     
    Part 2:


    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Synchronizing CS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Getting dnscontroller API interface for DNS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Getting DNS server #2 API version.
    Aug 13 2008 08:52:48 [:20589] INFO: Getting dnscontroller API interface for version '3.0.1.0'.
    Aug 13 2008 08:52:48 [:20589] INFO: Using 'CentralizedDNS:max_operated_dns_zones' = 200.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Adding recursions on CDNS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating recursions on CDNS server #2.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Checking for undefined recursions setting on CDNS server #2.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Checking for undefined CDNS recursions.
    Aug 13 2008 08:52:48 [:20589] INFO: No non-undefined recursions.
    Aug 13 2008 08:52:48 [:20589] INFO: Request for CDNS server #2 is empty.
    Aug 13 2008 08:52:48 [:20589] INFO: Returning recursions added on CDNS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Returning recursions updated on CDNS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS objects instances status.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] ERR: CS object #1: corresponding Expand object is undefined.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #1 instance for CS server #2 has been updated to 'undefined' state - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] ERR: CS object #2: corresponding Expand object is undefined.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #2 instance for CS server #2 has been updated to 'undefined' state - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Checking for 'unsynched' CS objects instances on CS server #2.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS server #2 status - 'offline' problem reason.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: 'offline' problem reason has been deleted for CS server #2 - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS server #2 status has been updated - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Unlocking object(s) #1, #2 in the 'cdns_recursion_instance' table.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Object #1 is locked in state 'adding' by action #5392751.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Object #2 is locked in state 'adding' by action #5392751.
    Aug 13 2008 08:52:48 [:20589] INFO: Object(s) #1, #2 have been unlocked - 2 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Start transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 [:20589] INFO: Checking for CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: No CS objects without instances.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating synched CS objects status.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Updating operated CS objects status.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Getting CS objects by status.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #1 status has been updated to 'unsynched' - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS object #2 status has been updated to 'unsynched' - 0 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] INFO: Updating CS server #2 status - 'unsynched' problem reason.
    Aug 13 2008 08:52:48 [:20589] DEBUG: 'unsynched' problem reason has been added for CS server #2 - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: CS server #2 status has been updated - 1 row(s) affected.
    Aug 13 2008 08:52:48 [:20589] DEBUG: Commit transaction 'DEFAULT'.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] DEBUG: Trying to disable 'Synchronize CDNS servers' periodic task - checking CDNS servers count.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] DEBUG: CDNS servers count is not 0 - 'Synchronize CDNS servers' hasn't been disabled.
    Aug 13 2008 08:52:48 [:20589] DEBUG: All transport instances destroyed.
    Aug 13 2008 08:52:48 [:20589] DEBUG: All transport instances destroyed.
    Aug 13 2008 08:52:48 CDNSZoneOp[:20589] DEBUG: Boss operator finished with code 11119.

    ACTION ERROR:
    --------------

    TASKMAN OUTPUT:
    --------------
    <?xml version="1.0" encoding="UTF-8" standalone="no"?>
    <packet version="0.1.1.0">
    <result>
    <status>error</status>
    <errtxt>Action executed with errors</errtxt>
    </result>
    </packet>
    ==================
    End of the Report
     
  7. loopback-martin

    loopback-martin Guest

    0
     
    Action #5387101 Updating DNS ACL and recursion

    Refresh Screen Refresh Screen
    Up Level Up Level
    Action Info
    State Successful
    Initiator IP localhost
    Started Aug 12, 2008 05:25 PM
    Completed Aug 12, 2008 05:25 PM
    Periodic True
    Operator /usr/local/expand/sbin/exp_plesk_dns
    Exit Code 0
    Action Output
    <?xml version="1.0" encoding="UTF-8" standalone="no" ?>
    <packet action_id="5387101" version="2.3.1.8">
    <refresh_acl></refresh_acl>
    <refresh_recursion></refresh_recursion>
    </packet>
    Action Input
    <packet version="2.3.0.26">
    <refresh_acl>
    <filter>
    <all></all>
    </filter>
    </refresh_acl>
    <refresh_recursion>
    <filter>
    <all></all>
    </filter>
    </refresh_recursion>
    </packet>
    Advanced: Taskman Output
    <?xml version="1.0" encoding="UTF-8" standalone="no"?>
    <packet version="0.1.1.0">
    <result>
    <status>success</status>
    <errtxt>Action executed successfully</errtxt>
    </result>
    </packet>
     
  8. gold

    gold Regular Pleskian

    25
    57%
    Joined:
    Jan 8, 2008
    Messages:
    307
    Likes Received:
    0
    Thanks you for your reply however it is the other action. The action from update script has title 'Updating DNS ACL and recursion' and can be found by its title on 'Action Log' page.
     
  9. gold

    gold Regular Pleskian

    25
    57%
    Joined:
    Jan 8, 2008
    Messages:
    307
    Likes Received:
    0
    I am sorry, it is all OK.
     
  10. Kaylior

    Kaylior Guest

    0
     
    Hi,

    We are having the same issue. Since upgrading from 2.2.4 to 2.3.1

    Is there a known fix for this issue, or do we need to submit a support ticket?

    EDIT: We can run a manual sync of the master DNS server and it seems to be successful. Also, if the job that fails is run manually its also successful so we are at a loss as to why the automated task is failing with this same error.
     
  11. gold

    gold Regular Pleskian

    25
    57%
    Joined:
    Jan 8, 2008
    Messages:
    307
    Likes Received:
    0
    You need to reload DNS ACL and recursion data manually for all Plesk servers from 'Plesk Servers/ Reload Servers' page.
     
  12. Kaylior

    Kaylior Guest

    0
     
    Yep that did it! Thanks for that
     
Loading...