Data deduplication for Windows 8 x64

Hi,

it would be great if you could provide your script (even if it is not perfect yet) or just explain how to generate the necessary files. My Windows 8 installation is set to another langage, so I cannot use your files. That is tehr eason why I would like to extract them myself from a localized Windows Server 2012 installation.

Thanks!

 

Hi, I came across this thread after months of searching for the reason my data is corrupted on one of my storage drives. Long story short I refreshed Windows 8 and after I did that most of my files over 64kb on this drive were unreadable by the disk even though all the directories were intact. Fast forwarding it seems that for some reason I had data dedup of some kind running as I have a dedup folder in my system information hidden directory with about 460GB of chunk store data in the form of .cd . ccc files. I believe all my missing data in here. I am simply looking for a way to get my data back.

I went through the cab installations for depup however I cannot enable the service via powershell (error 50). I am not sure enabling dedup on the volume in question is even the fix, is there any way to recompile these cd ccc files via a 3rd party application? I feel like I am so close to the solution but so far

Thanks

 

I would really appreciate it if you could post some sort of tutorial for how you went about ripping the components from SRV2012 like this!

I'm kinda thinkin' there's a few other components that I might like having on my win8 workstations!

Also, could you use this type of method for actually Removing components from a windows install too? In the case of VDI deployments and what not, pretty much 90% of the s**t Windows installs by default is completely useless, and I'd love to know how to just remove everything from my initial "Gold" images!~

Thanks!

btw: dedupe PWNS on win8! My OS/Application ISO's directory is like, 80gb- and right now it's size on disk is 4.45gb, haahah!!

 

What do you mean by a "repair install" I'm getting the same error with the FileServer package failing at 29% due to an SxS Assembly missing.

 

More Info: trying to apply these packages directly to my install media (By mounting the Windows 8 Enterprise install.wim file to D:\Mounted, I get the following error:
It seems to me like there are some prerequisite dlls missing either from my install media (this is a direct from msdn iso), or from the package cab for the FileServer package.

I tried browsing the logs, but I'm having trouble figuring out which assembly it's actually missing.

Code:

D:\Win8Dedup>dism /image:D:\Mounted /Add-Package /PackagePath:"Microsoft-Windows
-Dedup-Package~31bf3856ad364e35~amd64~~6.2.9200.16384.cab" /PackagePath:"Microso
ft-Windows-Dedup-Package~31bf3856ad364e35~amd64~en-US~6.2.9200.16384.cab" /Packa
gePath:"Microsoft-Windows-FileServer-Package~31bf3856ad364e35~amd64~~6.2.9200.16
384.cab" /PackagePath:"Microsoft-Windows-FileServer-Package~31bf3856ad364e35~amd
64~en-US~6.2.9200.16384.cab" /PackagePath:"Microsoft-Windows-VdsInterop-Package~
31bf3856ad364e35~amd64~~6.2.9200.16384.cab" /PackagePath:"Microsoft-Windows-VdsI
nterop-Package~31bf3856ad364e35~amd64~en-US~6.2.9200.16384.cab"

Deployment Image Servicing and Management tool
Version: 6.2.9200.16384

Image Version: 6.2.9200.16384

Processing 1 of 6 - Adding package Microsoft-Windows-Dedup-Package~31bf3856ad364
e35~amd64~~6.2.9200.16384
[==========================100.0%==========================]
Processing 2 of 6 - Adding package Microsoft-Windows-Dedup-Package~31bf3856ad364
e35~amd64~en-US~6.2.9200.16384
[==========================100.0%==========================]
Processing 3 of 6 - Adding package Microsoft-Windows-FileServer-Package~31bf3856
ad364e35~amd64~~6.2.9200.16384
[================           29.0%                          ]
Microsoft-Windows-FileServer-Package: The source files could not be found.
Use the "Source" option to specify the location of the files that are required t
o restore the feature. For more information on specifying a source location, see
 _link_.
 Error: 0x800f081f
Processing 4 of 6 - Adding package Microsoft-Windows-FileServer-Package~31bf3856
ad364e35~amd64~en-US~6.2.9200.16384
[==========================100.0%==========================]
Processing 5 of 6 - Adding package Microsoft-Windows-VdsInterop-Package~31bf3856
ad364e35~amd64~~6.2.9200.16384
[==========================100.0%==========================]
Processing 6 of 6 - Adding package Microsoft-Windows-VdsInterop-Package~31bf3856
ad364e35~amd64~en-US~6.2.9200.16384
[==========================100.0%==========================]

Error: 0x800f081e

The specified package is not applicable to this image.
The specified package is not applicable to this image.
The specified package is not applicable to this image.
The command completed with errors.
For more information, refer to the log file.

The DISM log file can be found at C:\Windows\Logs\DISM\dism.log

 

After prolonged agony (And realizing Server 2012 wouldn't work well enough for me on my laptop) I finally got this working *fingers crossed* *knock on wood*.

Here's what it took.

1. Install Windows 8 x64 Pro
2. Enable Data-Deduplication using listed steps
3. Ensure Deduplication works
4. Use UpDown 1.5 to convert Win 8 Pro to Win 8 Enterprise
5. Insert Enterprise Install media and "upgrade" (from within windows) to enterprise edition.
6. REINSTALL and reactivate Deduplication using listed steps (yes.. a second time).
7. Re-enable deduplication and verify it indeed works
8. Finally done.

Honestly I'm not sure why deduplication installs fine on Pro but not on Enterprise...

 

Many thanks 100 for the files!

My story of how I get this to work in Windows 8.1 Pro Preview build 9431 x64:

So I installed the Windows 8.1 Preview and obviously figured too late that 100's package won't work in this new build... I spent som hours trying to replicate his work with the Server 2012 R2 Preview files, and as I finally got it to work I thought I'd share.

All kudos to 100

First I just tried to do a mindless 1:1 copy of the same files that's in 100's cabs, according to this information:
"Advanced guidelines for diagnosing and fixing servicing corruption" technet.microsoft.com/en-us/library/ee619779(v=ws.10).aspx Scroll to "Options for obtaining files".

I gathered that files are stores in these locations:
* The update.cat and update.mum in each cab-file are located in %windir%\servicing\packages\ with the same name as the .cab from 100's files. These are copied to the cab and renamed to update.*
* .manifest-files are located in %windir%\winsxs\manifests\
* (not necessarily true, read below) the folders in each cab are located in %windir%\winsxs\

So I started copy these files from install.wim and ended up with an exact set of cabs and it's content that 100 posted. While some cabs worked it was not enough. For the Fileserver Package I first needed additional files, most which are included in the Dedup Package as well, so I added those. That resulted in hash mismatches, 'cause apparently some of the files in the folders (those from \winsxs\) seem to be modified during install. So I had to install the Windows Server 2012 R2 Preview and enable the deduplication feature, and then rather copy those files from various locations within %windir%.

Basically an attempt to do an exact set of files as 100's ended up with trial and error and solving what the logs complained about. The log-files are as follows:
* %windir%\logs\DISM\dism.log - not very useful, but some info
* %windir%\logs\CBS\CBS.log - detailed log with information about missing .manifest, other missing files, hash mismatches etc

I have to say I consider my cabs rather "dirty" though, probably some extra files here and there as I didn't really do it from scratch. I got it to work on my primary PC though and installed a clean virtual machine where it worked as well.
As far as I know the best way to do a clean set of files is to start with Microsoft-Windows-Dedup-Package~31bf3856ad364e35~amd64~~6.3.9431.0 .cat/.mum in an empty cab and just keep adding files and features according to logs until it installs, but I just learned about this yesterday so don't take my word for it.

Oh, and the cabs.. I just downloaded a random 3rd party cab-creator and let it do it for me, couldn't figure how to add folders with the built-in creator in Windows.

I've uploaded the files here if anyone has use for it: mediafire.com/download/mhonl2cokbceaxg/Dedup_for_Windows_8.1_Preview_9431_x64.zip
Just run Install.cmd as admin. Don't blame me if it doesn't work though

Regards

 

If I have time tomorrow I may start on an app for it. It can turn out extremely useful for frankenbuilding chinenglish pre-release iso's if we can somehow fors dism to install packages with mismatching buildnumbers or temper with the buildnumbers in the manifests.
It is dangerous if people start using without warning it's a frankenbuild, but I'll make sure files are marked so it's clear they aren't official.

 

Nice, I always wanted to have this feature on my workstation. I really missed it.

Thanks a lot!

 

Does anyone have the files for the RTM version?

 

+1

I would like the files as well. I was using dedup until I upgraded to 8.1 RTM. I had to attach my deduped drive as a pass thru disk on a server 2012 VM so I can access it. ;-)

 

so we need the windows 2012 server r2 rtm image to extract this for windows 8.1?

 

eff it, installing to a VM see if i can get us the files

results in RTM (no rurprise just wanted it noted)

Image Version: 6.3.9600.16384

Processing 1 of 6 - Adding package Microsoft-Windows-VdsInterop-Package~31bf3856
ad364e35~amd64~~6.3.9431.0
[==========================100.0%==========================]
Processing 2 of 6 - Adding package Microsoft-Windows-VdsInterop-Package~31bf3856
ad364e35~amd64~en-US~6.3.9431.0
[==========================100.0%==========================]
Processing 3 of 6 - Adding package Microsoft-Windows-FileServer-Package~31bf3856
ad364e35~amd64~~6.3.9431.0
[==========================100.0%==========================]
Processing 4 of 6 - Adding package Microsoft-Windows-FileServer-Package~31bf3856
ad364e35~amd64~en-US~6.3.9431.0
[==========================100.0%==========================]
Processing 5 of 6 - Adding package Microsoft-Windows-Dedup-Package~31bf3856ad364
e35~amd64~~6.3.9431.0
[===========================50.0% ]
An error occurred - Microsoft-Windows-Dedup-Package Error: 0x800736cc
Processing 6 of 6 - Adding package Microsoft-Windows-Dedup-Package~31bf3856ad364
e35~amd64~en-US~6.3.9431.0
[==========================100.0%==========================]

 

posting working files

 

You need to login to view this posts content.

 

Don't you rather want b9600 CABs?
I'll extract them tomorrow from Server 2012 R2...

 

Thanks! I'm a big fan of this feature in the client OS.

 

Hi Moderate,

did you get time to extract the files from Server 2012 R2. I'd like to upgrade my preview to RTM but this is not possible without the cab files.

Do you have a describtion how to create the cab files because that's a black box to me and I couldn't find any clear how-to like document.

Thanks in advance...

 

You need to login to view this posts content.