Home | Site Map | Cisco How ToNet How To | Wireless |Search | Forums | Services | Donations | Careers | About Us | Contact Us|

DFS stopped replicating without errors

Active Directory, Domain, DNS, WINS, DHCP, SBS, New Releases.

DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:09 am

Dear all,

we have 2 windows 2003 server R2 64 bit version belonging to the same domain that replicate 4 replication groups to each other. The 2 servers belong to different subnets. The replication worked very efficiently until some weeks ago, when it stopped without any reason. There are no errors in the event viewers and the Diagnostic reports say that there are no errors.
What else should I check?
Any ideas?

Thank you for your kind support.

Simona
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:10 am

Hello Simona,



Thank you for your reply.



I perform a research on the logs file that you send. From the RPCdump result, the PRC end mapper and network should have no problem.



Troubleshooting steps:



1. Please check to verify that there is enough space on E: drive and C: drive, which contains the replication folder and its staging folder.



2. Then check if Disk Quota has been enabled on the volume where we have DFSR Staging Folder and Replicated folders. Quota Limit is less than Staging area size. Even though we have enough free space in that volume, Disk Quota will limit the size of the staging folder. This will cause DFSR replication error 4502.



Therefore, if disk quota is the key point, Please follow the bellow steps for disabling Quota Management.

a. Open My Computer and Right Click and select Properties of the specific volume


b. Select the Tab Quota. Clear the Check Box "Enable Quota Management".



3. As I notice that the 2 DFS member server is based on windows 2003 server R2 64 bit version. And when you try to update a file on the primary member server, the replicate of that file failed, in the mean time, you can see several event 4412 and 4502 errors. This also could be a known issue on Windows Server 2003.



Please check the following KB article to view and request hotfix, and then arrange a time to update corresponding Dfsr.exe and .dll file on both of the 2 DFS member servers.



When you try to update a file that has a newer version on a Windows Server 2003, R2-based DFSR server, the operation fails, the original file is deleted from the replication partners, and event 4412 and event 4502 are logged

http://support.microsoft.com/default.aspx/kb/958876



Please note: you may need to restart the DFS member server to make it take into effect after applying the hotfix.



Afterwards, please monitor for some while to see if the replication will be normal.



Hope this information can be helpful.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:11 am

Dear David

thank you for your reply.

While I was waiting for your feedback, I read another reply you gave to another person where you said that sometimes when the staging folder is too small the replication can stop. So I indreased the staging folder and restarted the DFS replications services on both server. On the primary server (PB-FS-01) the DFS replication service seemed to be blocked since it took a lot of time to stop. At the restart, the replication started, since I noticed al lot of events on the event viewer on the primary server (no events were logged on the other server, SD-FS-01). They were events mainly of type 4412:

"The DFS Replication service detected that a file was changed on multiple servers. A conflict resolution algorithm was used to determine the winning file. The losing file was moved to the Conflict and Deleted folder".

and some events of type 4202

"The DFS Replication service has detected that the staging space in use for the replicated folder at local path E:\Data\Critical\servizi\laboratori is above the high watermark. The service will attempt to delete the oldest staging files. Performance may be affected".

At that time I did not make any changes, since the server was working and busy in replicating all the changes that were blocked from weeks, so I went home.
Furthermore I noticed that the replica was working since I tried to copy a file on a server and it was successfully replciated to the other and viceversa.
During the night, the server did not work, and in the event viewer of the primary server, there were some warnings of type 5014:

"The DFS Replication service is stopping communication with partner SD-FS-01 for replication group cedi.unipr.it\servizi\laboratori due to an error. The service will retry the connection periodically.

Additional Information:
Error: 1726 (The remote procedure call failed.)
Connection ID: AD4074F0-5DCA-47F4-911A-53220F65DB82
"
I was sure that the replica was not ok since my home folder is update on the primary server (PB-FS-01) but on server SD-FS-01 all the changes of the last weeks are not present.

Then I found this warning (type 4502):

"The DFS Replication service encountered errors replicating one or more files because adequate free space was not available on volume E:. This volume contains the replicated folder, the staging folder, or both. Please make sure that enough free space is available on this volume for replication to proceed. The service will retry replication periodically. "

and then I realized that the replica was not working anymore.
I also found that for some replica group the staging folder was on drive C, that is the system drive, and since I would like to put the staging folder on the other drive, I changed the staging folder path to the new drive and I increased it again.
The problem is that the contect of the directory "ConflictandDeleted" was lost during that change!!!

After that change, the primary server started working after 3 hours, then we got some 5014 error (this time with a different reason: Error: 9027 A failure was reported by the remote partner) and some 4502 errors.
This beahviour continued during the weekend and this morning it started to work again since I saw events of type 4412, but my home folder has not been replcaited yet. Furthermore I tried to create some test file and they were not replicated yet.

I also followed your suggestions, the max packet size is 1472. I also run the rpcdump and portqry commands on server SD-FS-01 and I sent the output to you via mail. I could not run the same command on the primary server PB-FS-01 since when I click on the installation file I get this message:

"Windows cannot access the specified device path or file. You may not have the appropriate permission to access them"

This is quite strange since I am using the domain administrator account!

Any idea?

Thank you very much for your kind and very precious help.

Simona
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:11 am

Dear David,

thank you for your prompt answer.
In the following you can find the requested data:

1. SERVER PB-FS-01 (the one with a lot of events in the DFSR events log)

Drive C: size 67,8 GB, free space 57,9 GB
Drive E: size 838 GB, free space 686 GB

Replicated directory:

E:\Data\Critical\servizi\applicazioni (size 270 MB) -> Staging Path E:\Data\Critical\servizi\applicazioni\DfsrPrivate (size 610 byte, max size 10 GB)
E:\Data\Critical\servizi\documenti (size 1,44 GB) -> Staging Path E:\Data\Critical\servizi\documenti\DfsrPrivate (size 4 KB, max size 10 GB)
E:\Data\Critical\servizi\home (size 82,9 GB) -> Staging Path E:\Data\Critical\servizi\home\DfsrPrivate (size 127 MB, max size 100 GB)
E:\Data\Critical\servizi\laboratori (size 59,5 GB) -> Staging Path E:\Data\Critical\servizi\laboratori\DfsrPrivate (size 4 KB, max size 100 GB)

SERVER SD-FS-01 (the one without events in the log)

Drive C: size 67,8 GB, free space 58 GB
Drive E: size 838 GB, free space 687 GB

Replicated directory:

E:\Data\Critical\servizi\applicazioni (size 270 MB) -> Staging Path E:\Data\Critical\servizi\applicazioni\DfsrPrivate (size 12 KB, max size 10 GB)
E:\Data\Critical\servizi\documenti (size 1,46 GB) -> Staging Path E:\Data\Critical\servizi\documenti\DfsrPrivate (size 14,7 MB, max size 10 GB)
D:\Data\Critical\servizi\home (size 78,4 GB) -> Staging Path D:\Data\Critical\servizi\home\DfsrPrivate (size 1,03 GB, max size 100 GB)
E:\Data\Critical\servizi\laboratori (size 59,5 GB) -> Staging Path E:\Data\Critical\servizi\laboratori\DfsrPrivate (size 4 KB, max size 100 GB)

From the above records it seems that tho only folder with problems is the HOME folder and since the staging folder on server SD-FS-01 is much bigger that the one on PB-FS-01, it seems that is server SD that has problem in replicating files, and not server PB. Bu I can see warnings only on server PB.

Is it correct?


2. The "Enable quota management" is not set on both server, but we are using autoquotas on folders:

...\home\staff
...\home\students

this should not affect the staging folder since it is at a higher levels (at \home levels ...)

Do you think that we should apply the hot fix anyway?

Thank you for your kind help

Simona
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:12 am

Dear David,

a little update:

the replica is working very efficiently and very fast in 3 of the 4 replicated directory.
The only directory in which it is not working is the HOME directory:

D:\Data\Critical\servizi\home for SD-FS-01
E:\Data\Critical\servizi\home for PB-FS-01

do you think it is the quota problem? Even if the quota are not applied on the staging folder?

Thank you for your attention

Simona
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:12 am

Another update for the home folder:

- the replica of a small file from SD to PB took 30 min (on the other replicated folder is immediate), while from PB to SD has not taken place yet
- furthermore on PB I got a 4504 error

The DFS Replication service did not encounter replication failures caused by insufficient free space on volume E: in the past 30 minutes.

Event Type: Information
Event Source: DFSR
Event Category: None
Event ID: 4504
Date: 29/07/2009
Time: 15.44.14
User: N/A
Computer: PB-FS-01
Description:
The DFS Replication service did not encounter replication failures caused by insufficient free space on volume E: in the past 30 minutes.

Additional Information:
Staging Folder: E:\Data\Critical\servizi\home\DfsrPrivate\Staging\ContentSet{AA518BF7-D6C1-4114-934C-A49758000888}-{D3031A89-2B99-4AF0-8BD2-122DF98483DE}
Replicated Folder Root: E:\Data\Critical\servizi\home
Replicated Folder Name: home
Replicated Folder ID: AA518BF7-D6C1-4114-934C-A49758000888
Replication Group Name: cedi.unipr.it\servizi\home
Replication Group ID: 642911ED-0798-4EF0-A810-C80AA87CC2AB
Member ID: D3031A89-2B99-4AF0-8BD2-122DF98483DE
Volume: 980604CE-735A-11DB-8D18-0017A4F61E89

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.

and then a 4502 error:

Event Type: Warning
Event Source: DFSR
Event Category: None
Event ID: 4502
Date: 29/07/2009
Time: 16.11.16
User: N/A
Computer: PB-FS-01
Description:
The DFS Replication service encountered errors replicating one or more files because adequate free space was not available on volume E:. This volume contains the replicated folder, the staging folder, or both. Please make sure that enough free space is available on this volume for replication to proceed. The service will retry replication periodically.

Additional Information:
Staging Folder: E:\Data\Critical\servizi\home\DfsrPrivate\Staging\ContentSet{AA518BF7-D6C1-4114-934C-A49758000888}-{D3031A89-2B99-4AF0-8BD2-122DF98483DE}
Replicated Folder Root: E:\Data\Critical\servizi\home
Replicated Folder Name: home
Replicated Folder ID: AA518BF7-D6C1-4114-934C-A49758000888
Replication Group Name: cedi.unipr.it\servizi\home
Replication Group ID: 642911ED-0798-4EF0-A810-C80AA87CC2AB
Member ID: D3031A89-2B99-4AF0-8BD2-122DF98483DE
Volume: 980604CE-735A-11DB-8D18-0017A4F61E89

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:13 am

Hi Simona,



Sorry for my delay.



I perform lots of research on the information and the event logs you post, I think the cause of the replication issue from PB-FS-01 to SD-FS-01 should be due to the low staging folder Quota size. Because the low quota size of staging folder can cause the replication issue between upstream and downstream DFS replication partner.



E:\Data\Critical\servizi\home (size 82,9 GB) -> Staging Path E:\Data\Critical\servizi\home\DfsrPrivate (size 127 MB, max size 100 GB)



To resolve the issue, I would like to suggest you read through the following online document, and refer to the recommendation to adjust and increase the Quota size of staging folder for HOME folder on both of the PB-FS-01 and SD-FS-01.



Staging folders and Conflict and Deleted folders

http://technet.microsoft.com/en-us/library/cc782648(WS.10).aspx



Please restart the DFS-Replication service on both of the replication partner after you adjust the size.



Hope this can fix the issue on your side.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:15 am

Dear David,

now the DFS replica is working perfectly and is very fast.

The problem was the HARD quota. I found the users that were near to their limit (more than 80 %) and I increased the limit on both server. Furthermore there was one user that had 2 different quota limits on the servers and this is not very nice!

After one 1 hour from the change, the server finished the replica on the HOME folder and now it seems that the 2 servers are allineated.
Now there are no messages in the event log on both server so I think that everything is fine.

I think I will have to address the problem more accurately since, as soon as any user reaches the hard limit quota, the problem will appear again.

So I was thinking to apply both patches from articles 954968 and 958876. I think that the first is really necessary, I am not sure about the second, since I do not know if the event described in the article is really happened (we have thousands of users, maybe it happened but they did not report it to me). In any case the patch corrects a problem of DFS with hard quota, so I would install it.

What do you think?

By the way, I would like to thank you very much for your precious support, I really appreciated. Without you, I would not be able to resolve the problem.

Thanks again

Simona
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Thu Jul 29, 2010 11:15 am

Hi Simona,



Thanks for your update.



I am glad to hear that you have found the root cause and resolved this issue with my suggestion.



Concerning hotfix in the KB 958876, you may first check file information regarding to your OS version of that 2 DFS member servers, I think you don’t have to apply 958876 anymore if the corresponding W03a2409.dll, Ww03a2409.dll files and Dfrs.exe have already been updated.





If not, to prevent that potential issue that may be exists, I would like to suggest you install and apply it.



http://support.microsoft.com/kb/958876



Thank you again for using our TechNet forum.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Mon Jun 30, 2014 8:40 pm

TCP off-loading on the network level may be causing the error message which you have posted. So please add these following registry values to all DFSR replications partners to see if it can be helpful.

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters

Value =DisableTaskOffload
Type = DWORD
Data = 1

Value =EnableTCPChimney
Type = DWORD
Data = 0

Value =EnableTCPA
Type = DWORD
Data = 0

Value =EnableRSS
Type = DWORD
Data = 0

Or install latest NIC drive.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Mon Jun 30, 2014 8:43 pm

please make sure all the necessary DFS ports on all the DFSR replications partners are not blocked by firewall or any other device. For more detailed information about the ports, please refer to the following link:



Service overview and network port requirements for Windows



http://support.microsoft.com/kb/832017#method9
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm

Re: DFS stopped replicating without errors

Postby guest » Mon Jun 30, 2014 8:44 pm

User Action:

=========



1. Please open the ADSIedit.msc console to verify the "Authenticated Users" is set with the default READ permission on the following object:



a. The computer object of the DFS server



b. The DFSR-LocalSettings object under the DFS server computer object



2. After the permissions is set correct, please run "DFSRDIAG POLLAD" to pick up the changes.



3. Another possible reason is that FSRM is configured as some types of files are blocked from DFS replication. When the DFSR filters are not set to match FSRM screens by extension and the files exist on the server before screening, this can lead to degraded DFSR performance and the files will never replicate.



If possible, please remove file screening and reconfigure it to remove files by extension or set a comparable DFSR filter rule to prevent replication attempts.



On the LG*** server, it said that “DFS Replication cannot replicate with partner due to a communication error.” “Check for network connectivity problems, for troubleshooting RPC issues”



Analyze:

=======

This error message generally caused by the network issue, such as:



1. The network connect between the two servers is broken.



2. the necessary ports are blocked by the firewall or other devices.



3. the DNS issue.



User Action :

===========

1. Ping the LE** server from the LG** server to check the network connection.



2. Run nslookup LE** server to check if the DNS name resolution can work properly.



3.Temporarly disable the firewall to check if the issue can be fixed. And double confirm all the necessary DFS ports are not blocked by any other device.



According KCC error message, please refer to the following link, it also tell us the reason and solution:



Event ID 1311: Replication configuration does not reflect the physical network



http://technet.microsoft.com/en-us/libr ... 52(v=ws.10).aspx
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 10191
Joined: Mon Nov 27, 2006 1:10 pm


Return to Windows

Your Ad Here

Who is online

Users browsing this forum: No registered users and 11 guests