Data deduplication for Windows 8 x64

This page has a good explanation and a list of instructions at the bottom, pretty easy to follow. I can't post links yet so you need to stick http :// in front of the address below

Code:

jeffwouters.nl/index.php/2012/01/disk-deduplication-in-windows-8-explained-from-a-to-z/

or use these and replace with your drive letter

Code:

Enable-DedupVolume E:

Code:

Set-DedupVolume E: -MinimumFileAgeDays 0
Start-DedupJob E: –Type Optimization

and then this to check what it's going

Code:

Get-DedupJob

 

Yep, that resource is fine...
...and also other from the same guy

 

Any way to access the deduplication console? or it works only with powershell?

 

I seem to be having trouble implementing this feature on an upgraded Windows 8 Professional box. I also notice from my own Server 2012 install, that there's additional packages in the system cache, that may be necessary for this stuff to work right.

Code:

PS C:\WINDOWS\system32> dism /online /enable-feature /featurename:Dedup-Core /all

Deployment Image Servicing and Management tool
Version: 6.2.9200.16384

Image Version: 6.2.9200.16384

Enabling feature(s)
[==========================100.0%==========================]

Error: 50

The operation is complete but Dedup-Core feature was not enabled.

Code:

PS C:\DATA\Win8 Dedup> dism /online /add-package /packagepath:Microsoft-Windows-FileServer-Package~31bf3856ad364e35~amd6
4~~6.2.9200.16384.cab

Deployment Image Servicing and Management tool
Version: 6.2.9200.16384

Image Version: 6.2.9200.16384

Processing 1 of 1 - Adding package Microsoft-Windows-FileServer-Package~31bf3856ad364e35~amd64~~6.2.9200.16384
[================           29.0%                          ]
An error occurred - Microsoft-Windows-FileServer-Package Error: 0x80073701

Error: 14081

The referenced assembly could not be found.

The DISM log file can be found at C:\WINDOWS\Logs\DISM\dism.log

 

You need to login to view this posts content.

 

You need to login to view this posts content.

 

Just wanted to post that I was able to enable deduping in Windows Server 2012 essentials RTM. I'm also able to see the dedupe interface in Server Manager.

Thank you

 

Amazing. Test on my Win 8 Pro real comp, a data volume of 203GB after deduped size on disk only 5.72GB. I install Windows Server 2012 in VMware and use real volume as additional hard disk then I can manage with dash board GUI too. Thanks 100 again.

 

Tried this out on a Hyper-V Server 2012 installation and this worked just perfectly...

 

Just update: In fact deduped files are stored in hidden System Volume Information folder, the size on disk is reported smaller but real size is in such volume and finally the saving with compressed lossless audio, ... are almost 0 or few percent. Something wrong with lower part of this blog: htt p://blogs.technet.com/b/filecab/archive/2012/05/21/introduction-to-data-deduplication-in-windows-server-2012.aspx?Redirected=true

Quoted: 30-90%+ savings can be achieved with deduplication on most types of data. I have a 200GB drive that I keep throwing data at and now it has 1.7TB of data on it. It is easy to forget that it is a 200GB drive. Unquoted

Max 90% saving but how they can put 1,7TB into 200GB drive? It helps for general files of server, annoyed for PC.

 

Why is it annoying for pc?
I now have a s**tload of vista/7 and 8 isos. While I would normally have to invent scenario's with a huge amount of xdeltas I can now simply run the dedup command and all is done for me.

And the data is indeed stored in the chunkstore in System Volume Information, the files in the normal directories are only links.

 

How does dedup actually affect performance? Anyone has some data?
Can one undo the deduplication?

 

I don't have any benchmarkdata.
I thing the Unoptimization for the -type parameter "undedups" a volume, but of course it will only work if there is enough space for all the fully deflated files.

 

I don't see any option for undo the deduplication with Powershell in Win 8. To stop dedupe for a volume, I have to use Windows Server in VMware, mount that volume and uncheck dedupe. All deduped files can not be read by non dedupe system, only copy to normal volume from deduped PC. When delete files, I have to GarbageCollection to reclaim space. To stream my lossless audio from a deduped USB volume is nightmare.

 

I haven't tried it, but first command 100 linked to and then start-dedupjob -volume "X:" -type "unoptimization" should do the job.
It could be that you need to run 100's command after mine though.

If there's a gui solution then there also is a cmd/ps solution.

 

i really recomend it for ssd drives, there no inpact on performance cause random seek time is the same on every sector for ssd

 

Hi 100, great Information - I just installed it with success. Thanks a lot. By the way - how did you extract those packages? I looked around the winsxs Folder, but didn't get any clue how to extract packages.

 

Please do post the script

Please do! thanks in advance