Cannot add inter-site nodes to cluster

Status
Not open for further replies.
M

matthisk



Hello,

i have a lab-environment with 3x w2008r2 Ent. + Exchange 2010 Std (1 physical, 1 Hyper-V, 1 on ESX 4.1) in Site 1 and 2x w2008r2 Ent. + Exchange 2010 Std (2x ESX 4.0) in Site2.

Both sites (10.0.0.0/24 and 192.168.5.0/24) are connected via a site-to-site VPN, both sites have one W2008R2 DC/GC/DNS server. All servers are in one domain.

I can successfully add all three servers in site one to a DAG and i can successfully add both servers in Site 2 to a (seperate) DAG.

However, if i create a DAG in Site 1, add a server of site 1 and want to add any server of site 2 it fails. The same happens if i create a DAG in site 2, add a server of site 2 and try to add a server of site 1.

[PS] C:\Windows\system32>Add-DatabaseAvailabilityGroupServer -Identity EXCHDAG -MailboxServer mkmx03
WARNING: The operation wasn't successful because an error was encountered. You may find more details in log file
"C:\ExchangeSetupLogs\DagTasks\dagtask_2010-08-21_09-54-25.366_add-databaseavailabiltygroupserver.log".
A server-side database availability group administrative operation failed. Error: The operation failed with message: Er
ror 0x71a (The remote procedure call was cancelled) from cli_RpccAddNodeToCluster
+ CategoryInfo : InvalidArgument: :)) [Add-DatabaseAvailabilityGroupServer], DagTaskOperationFailedExcept
ion
+ FullyQualifiedErrorId : BD456E8F,Microsoft.Exchange.Management.SystemConfigurationTasks.AddDatabaseAvailabilityG
roupServer

Thats the log:

add-databaseavailabiltygroupserver started on machine MKMX03.
[2010-08-21T09:54:25] add-dagserver started
[2010-08-21T09:54:25] commandline: $scriptCmd = {& $wrappedCmd @PSBoundParameters }
[2010-08-21T09:54:25] Option 'Identity' = 'EXCHDAG'.
[2010-08-21T09:54:25] Option 'MailboxServer' = 'mkmx03'.
[2010-08-21T09:54:25] Option 'DatabaseAvailabilityGroupIpAddresses' = ''.
[2010-08-21T09:54:25] Option 'WhatIf' = ''.
[2010-08-21T09:54:25] Process: w3wp w3wp.exe:4804.
[2010-08-21T09:54:25] User context = 'NT AUTHORITY\SYSTEM'.
[2010-08-21T09:54:25] Member of group 'Everyone'.
[2010-08-21T09:54:25] Member of group 'BUILTIN\Users'.
[2010-08-21T09:54:25] Member of group 'NT AUTHORITY\SERVICE'.
[2010-08-21T09:54:25] Member of group 'CONSOLE LOGON'.
[2010-08-21T09:54:25] Member of group 'NT AUTHORITY\Authenticated Users'.
[2010-08-21T09:54:25] Member of group 'NT AUTHORITY\This Organization'.
[2010-08-21T09:54:25] Member of group 'BUILTIN\IIS_IUSRS'.
[2010-08-21T09:54:25] Member of group 'LOCAL'.
[2010-08-21T09:54:25] Member of group 'IIS APPPOOL\MSExchangePowerShellAppPool'.
[2010-08-21T09:54:25] Member of group 'BUILTIN\Administrators'.
[2010-08-21T09:54:25] Updated Progress 'Validating the parameters.' 2%.
[2010-08-21T09:54:25] Working
[2010-08-21T09:54:25] Mailbox server: value passed in = mkmx03, mailboxServer.Name = MKMX03, mailboxServer.Fqdn = MKMX03.intranet.company.com
[2010-08-21T09:54:25] LogClussvcState: clussvc is Stopped on MKMX03.intranet.company.com. Exception (if any) = none
[2010-08-21T09:54:25] The IP addresses for the DAG are (blank means DHCP): 10.0.0.15,192.168.5.15
[2010-08-21T09:54:25] Looking up IP addresses for EXCHDAG.
[2010-08-21T09:54:25] EXCHDAG = [ 10.0.0.15 ].
[2010-08-21T09:54:25] Looking up IP addresses for mkmx03.
[2010-08-21T09:54:25] mkmx03 = [ ::1, 192.168.5.12 ].
[2010-08-21T09:54:25] Looking up IP addresses for MKMX03.intranet.company.com.
[2010-08-21T09:54:25] MKMX03.intranet.company.com = [ ::1, 192.168.5.12 ].
[2010-08-21T09:54:25] DAG EXCHDAG has 3 servers:
[2010-08-21T09:54:25] DAG EXCHDAG contains server MKMX05.
[2010-08-21T09:54:25] DAG EXCHDAG contains server MKMX04.
[2010-08-21T09:54:25] DAG EXCHDAG contains server MKMX02.
[2010-08-21T09:54:25] Updated Progress 'Checking if Mailbox server 'MKMX03' is in a database availability group.' 4%.
[2010-08-21T09:54:25] Working
[2010-08-21T09:54:25] GetRemoteCluster() for the mailbox server failed with exception = An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(MKMX03.intranet.company.com) failed with 0x6d9. Error: There are no more endpoints available from the endpoint mapper"' failed.. This is OK.
[2010-08-21T09:54:25] Ignoring previous error, as it is acceptable if the cluster does not exist yet.
[2010-08-21T09:54:25] DumpClusterTopology: Opening remote cluster EXCHDAG.
[2010-08-21T09:54:25] Dumping the cluster by connecting to: EXCHDAG.
[2010-08-21T09:54:25] The cluster's name is: EXCHDAG.
[2010-08-21T09:54:25] Groups
[2010-08-21T09:54:26] group: Available Storage [not a CMS]
[2010-08-21T09:54:26] OwnerNode: MKMX04.intranet.company.com
[2010-08-21T09:54:26] State: Offline
[2010-08-21T09:54:26] group: Cluster Group [Cluster Main Group]
[2010-08-21T09:54:26] OwnerNode: MKMX04.intranet.company.com
[2010-08-21T09:54:26] State: Online
[2010-08-21T09:54:26] Resource: Cluster IP Address [Online, type = IP Address, PossibleOwners = MKMX04,MKMX05,MKMX02 ]
[2010-08-21T09:54:26] Address = [10.0.0.15]
[2010-08-21T09:54:26] EnableDhcp = [0]
[2010-08-21T09:54:26] Network = [Cluster Network 1]
[2010-08-21T09:54:26] Resource: Cluster Name [Online, type = Network Name, PossibleOwners = MKMX04,MKMX05,MKMX02 ]
[2010-08-21T09:54:27] NetName = [EXCHDAG]
[2010-08-21T09:54:27] Nodes
[2010-08-21T09:54:27] node: MKMX04.intranet.company.com [ state = Up ]
[2010-08-21T09:54:27] node: MKMX05.intranet.company.com [ state = Up ]
[2010-08-21T09:54:27] node: MKMX02.intranet.company.com [ state = Up ]
[2010-08-21T09:54:27] Subnets
[2010-08-21T09:54:27] Name(Cluster Network 1), Mask(10.0.0.0/24), Role(ClusterNetworkRoleInternalAndClient)
[2010-08-21T09:54:27] NIC 10.0.0.14 on Node MKMX04 in State=Up
[2010-08-21T09:54:27] NIC 10.0.0.13 on Node MKMX05 in State=Up
[2010-08-21T09:54:27] NIC 10.0.0.10 on Node MKMX02 in State=Up
[2010-08-21T09:54:28] Opening the cluster on nodes [mkmx05, mkmx04, mkmx02].
[2010-08-21T09:54:28] Other mailbox servers in the DAG are already members of cluster 'EXCHDAG'
[2010-08-21T09:54:28] The server MKMX03 does not belong to a cluster, and the other servers belong to EXCHDAG.
[2010-08-21T09:54:28] Successfully resolved servers based on the AD configuration.
[2010-08-21T09:54:28] The following servers are in the StartedServers list:
[2010-08-21T09:54:28] The following servers are in the StoppedServers list:
[2010-08-21T09:54:28] Verifiying that the members of database availability group 'EXCHDAG' are also members of the cluster.
[2010-08-21T09:54:28] Verifying that the members of cluster 'EXCHDAG' are also members of the database availability group.
[2010-08-21T09:54:28] According to GetNodeClusterState(), the server MKMX03 is NotConfigured.
[2010-08-21T09:54:29] The CNO is currently Online.
[2010-08-21T09:54:29] InternalValidate() done.
[2010-08-21T09:54:29] Updated Progress 'Adding server 'MKMX03' to database availability group 'EXCHDAG'.' 6%.
[2010-08-21T09:54:29] Working
[2010-08-21T09:54:29] Updated Progress 'Adding server 'MKMX03' to the cluster.' 8%.
[2010-08-21T09:54:29] Working
[2010-08-21T10:04:29] The operation wasn't successful because an error was encountered. You may find more details in log file "C:\ExchangeSetupLogs\DagTasks\dagtask_2010-08-21_09-54-25.366_add-databaseavailabiltygroupserver.log".
[2010-08-21T10:04:29] WriteError! Exception = Microsoft.Exchange.Cluster.Replay.DagTaskOperationFailedException: A server-side database availability group administrative operation failed. Error: The operation failed with message: Error 0x71a (The remote procedure call was cancelled) from cli_RpccAddNodeToCluster ---> Microsoft.Exchange.Rpc.RpcException: Error 0x71a (The remote procedure call was cancelled) from cli_RpccAddNodeToCluster
at ThrowRpcException(Int32 rpcStatus, String message)
at Microsoft.Exchange.Rpc.RpcClientBase.ThrowRpcException(Int32 rpcStatus, String routineName)
at Microsoft.Exchange.Rpc.Cluster.ReplayRpcClient.RpccAddNodeToCluster(String newNode, String& verboseLog)
at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.<>c__DisplayClass26.<RunAddNodeToCluster>b__24()
at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.<>c__DisplayClass32.<RunRpcOperationDbName>b__30()
at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientRetryableOperation(String serverName, RpcClientOperation rpcOperation)
--- End of inner exception stack trace - at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientHandleRpcException(RpcException ex, String serverName)
at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientRetryableOperation(String serverName, RpcClientOperation rpcOperation)
at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperationDbName(String serverName, String databaseName, Int32 timeoutMs, ReplayRpcClient& rpcClient, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation)
at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperation(String serverName, Nullable`1 dbGuid, Int32 timeoutMs, ReplayRpcClient& rpcClient, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation)
at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunAddNodeToCluster(AmServerName serverName, AmServerName newNode, String& verboseLog)
at Microsoft.Exchange.Management.SystemConfigurationTasks.AddDatabaseAvailabilityGroupServer.JoinNodeToCluster()
[2010-08-21T10:04:29] Updated Progress 'Done!' 100%.
[2010-08-21T10:04:29] COMPLETED
add-databaseavailabiltygroupserver explicitly called CloseTempLogFile().

Any ideas?

Thank you!
 
B

Brian Day MCITP

It looks like RPC is being blocked between the sites. Is there a firewall of any kind between them?
 
M

matthisk



Hi Brian,

thank you! I rechecked the firewall config and deactivated the DOS Defence function and it worked. A more detailed investigation discovered that the UDP Flood defence caused the non-function of the cluster-join.

Cheers
Matthias
 
Status
Not open for further replies.
Thread starter Similar threads Forum Replies Date
Mark Foley Cannot enable add-in in outlook 2010 Using Outlook 0
iwshim outlook 2013 - I cannot see the "Manage Add-ins" Using Outlook 2
B No email accounts in outlook. Cannot add email Using Outlook 5
T Cannot successfully add gmail IMAP account to Outlook 2013. Using Outlook 1
G Distribution Group Owners Cannot Add/Delete Members Using Outlook 1
A Cannot edit or open existing contact nor add new ones. BCM (Business Contact Manager) 1
D Cannot add second pst under Outlook 2010 Using Outlook 1
A cannot add hotmail to outlook Using Outlook 3
R Cannot add attachments in Outlook 2007 Using Outlook 1
D When adding a new Outlook 2010 profile, I get the error code 0x80040605 and cannot add an email acco Using Outlook 5
T Cannot add Members to Migrated Mail-enabled Security Group via EMC Exchange Server Administration 1
S Cannot Add a Second Server Node to DAG Exchange Server Administration 7
H Cannot open contacts nor add new contacts to Outlook 7 Using Outlook 1
H I Cannot Add a Yahoo Mail account to my Outlook 2010 Using Outlook 3
M The Add-in 'ACT! 2006 Extensions' (C\Windows\system32\Act7Ext.dll) cannot be loaded and has been disabled by Outlook Using Outlook 1
J cannot add email address to 2007 office outlook. Using Outlook 2
J Outlook 2010 Mail Indexing Not Working (Windows Search Email Indexer Add-in cannot be enabled) Using Outlook 3
M Windows 7, Outlook 2010, cannot add Contact Folder as an email address book. Using Outlook 12
B The add-in ‘’avg exchange extensions’’ c:\progra~1\avg\avg9\avgxch32.dll cannot be loaded Using Outlook 2
S Cannot add signatures, stationery &amp; fonts? Using Outlook 1
N Exchange 2010 current topology cannot add 2nd AD site Exchange Server Administration 2
J The add-in 'google Desktop searach outlook addin cannot be loaded and has been disabled by outlook. uninstall the add ins__ Using Outlook 3
G Cannot open, add, connect to PST files from Outlook Pro Plus 2010 RTM Using Outlook 12
Q Cannot add new appointment Using Outlook 22
D Cannot verify or add the calendar to Outlook Using Outlook 6
M Cannot add accounts to BCM BCM (Business Contact Manager) 2
rubaboo The vew cannot be found Outlook VBA and Custom Forms 0
A Cannot copy this folder because it may contain private items Using Outlook 0
L Cannot open PST file for first session each day Using Outlook 6
David in Mississippi New (Feb 2020) install of Outlook 365 - Cannot specify PST for different accounts Using Outlook 0
Marc2019 Need help please! Cannot Setup my outlook email account on my Mac Outlook 2011 Using Outlook.com accounts in Outlook 2
noshairwan Registry cannot be found, Outlook Security Using Outlook 2
Marc2019 Cannot input Vietnamese Characters on my MSOutlook 2016 in Windows 7 Using Outlook 0
T Cannot remove needless PST Using Outlook 1
Marc2019 Cannot setup Outlook Account on Mac Os 10.6.8 Using Outlook 3
N pst files are recreating automaticaly and cannot be deleted Using Outlook 6
T "cannot find the calendar folder for this item" - calendar items stuck in outbox Using Outlook 0
A Created a new user account and the local account cannot see email Using Outlook 3
T Cannot connect to main BT email account, sub accts okay Using Outlook 0
O The page that you are trying to access cannot be loaded. Using Outlook 0
M Daily Task List Minimized Cannot Display Using Outlook 2
geofferyh Cannot get Macro to SAVE more than one message attachment??? Outlook VBA and Custom Forms 5
DariTrevino MIcrosoft Outlook PST file cannot repair Using Outlook 1
B One email cannot be sent or received (but leaves outbox!) Using Outlook 1
C Outlook 2016 cannot delete, email showing in root Exchange Server Administration 5
S Outlook.com cannot edit some contacts Using Outlook.com accounts in Outlook 5
B Search: Cannot find which Folder Contains a Message Using Outlook 3
C Outlook - cannot save subject line changes Using Outlook 2
M cannot change delivery folders with IMAP accounts Using Outlook 0
S Appointment-Cannot set Categories because ConversationID is not set Outlook VBA and Custom Forms 1
Similar threads


















































Top