Working Deduplication files for Microsoft Windows 10

Discussion in 'Windows 10' started by dreamss, Oct 4, 2014.

  1. luzea

    luzea MDL Addicted

    Apr 25, 2019
    721
    804
    30
    Code:
    Get-DedupStatus | Format-List
    Short form:
    Code:
    Get-DedupStatus | fl
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  2. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
    Thanks...

    Code:
    Volume                             : E:
    VolumeId                           : \\?\Volume{202012aa-95dc-478c-a83b-40d100943024}\
    Capacity                           : 153.7 GB
    FreeSpace                          : 126.56 GB
    UsedSpace                          : 27.14 GB
    UnoptimizedSize                    : 31.56 GB
    SavedSpace                         : 4.42 GB
    SavingsRate                        : 14 %
    OptimizedFilesCount                : 9052
    OptimizedFilesSize                 : 25.89 GB
    OptimizedFilesSavingsRate          : 17 %
    InPolicyFilesCount                 : 9059
    InPolicyFilesSize                  : 25.89 GB
    LastOptimizationTime               : 5/23/2020 4:47:59 PM
    LastOptimizationResult             : 0x00000000
    LastOptimizationResultMessage      : The operation completed successfully.
    LastGarbageCollectionTime          : 5/23/2020 2:45:56 AM
    LastGarbageCollectionResult        : 0x00000000
    LastGarbageCollectionResultMessage : The operation completed successfully.
    LastScrubbingTime                  : 5/23/2020 3:45:09 AM
    LastScrubbingResult                : 0x00000000
    LastScrubbingResultMessage         : The operation completed successfully.
    
    Volume                             : D:
    VolumeId                           : \\?\Volume{f4df9e0b-6127-4244-a2c5-29628ad50879}\
    Capacity                           : 465.75 GB
    FreeSpace                          : 345.54 GB
    UsedSpace                          : 120.2 GB
    UnoptimizedSize                    : 165.77 GB
    SavedSpace                         : 45.57 GB
    SavingsRate                        : 27 %
    OptimizedFilesCount                : 6180
    OptimizedFilesSize                 : 163.07 GB
    OptimizedFilesSavingsRate          : 27 %
    InPolicyFilesCount                 : 6180
    InPolicyFilesSize                  : 163.07 GB
    LastOptimizationTime               : 5/23/2020 4:48:24 PM
    LastOptimizationResult             : 0x00000000
    LastOptimizationResultMessage      : The operation completed successfully.
    LastGarbageCollectionTime          : 5/23/2020 2:45:18 AM
    LastGarbageCollectionResult        : 0x00000000
    LastGarbageCollectionResultMessage : The operation completed successfully.
    LastScrubbingTime                  : 5/23/2020 3:45:12 AM
    LastScrubbingResult                : 0x00000000
    LastScrubbingResultMessage         : The operation completed successfully.
    19041_ENT.png
     
  3. luzea

    luzea MDL Addicted

    Apr 25, 2019
    721
    804
    30
    That is weird, now it shows all values:
    Code:
    Volume                             : Y:
    VolumeId                           : \\?\Volume{34cb727f-a6f2-4546-b7c3-8de382c073a4}\
    Capacity                           : 3.64 TB
    FreeSpace                          : 2.02 TB
    UsedSpace                          : 1.62 TB
    UnoptimizedSize                    : 10.35 TB
    SavedSpace                         : 8.73 TB
    SavingsRate                        : 84 %
    OptimizedFilesCount                : 3321
    OptimizedFilesSize                 : 9.99 TB
    OptimizedFilesSavingsRate          : 87 %
    InPolicyFilesCount                 : 3320
    InPolicyFilesSize                  : 9.99 TB
    LastOptimizationTime               : 18.05.2020 12:40:34
    LastOptimizationResult             : 0x00000000
    LastOptimizationResultMessage      : Der Vorgang wurde erfolgreich beendet.
    LastGarbageCollectionTime          : 30.04.2020 22:36:18
    LastGarbageCollectionResult        : 0x00000000
    LastGarbageCollectionResultMessage : Der Vorgang wurde erfolgreich beendet.
    LastScrubbingTime                  : 28.04.2020 14:24:50
    LastScrubbingResult                : 0x00000000
    LastScrubbingResultMessage         : Der Vorgang wurde erfolgreich beendet.
    
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  4. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
    Weird indeed. Seems to me that MS changed something and I'd even go so far as to assume that there might be some servers running 19041 having Data Deduplication issues as well.
     
  5. Luis Guilherme

    Luis Guilherme MDL Novice

    Jun 20, 2018
    1
    0
    0
    I've seen the two behaviours, and the difference is on the PowerShell version being run. PowerShell 7.0 does not show all values as reported, Windows PowerShell shows all values
     
  6. smaitlx

    smaitlx MDL Novice

    Dec 11, 2018
    2
    1
    0
    I'm getting error 0x80070002 when trying to install the first package.

    C:\TempPath>dism /online /add-package /packagepath:Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1.cab /packagepath:Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1-en-US.cab

    Deployment Image Servicing and Management tool
    Version: 10.0.19041.1

    Image Version: 10.0.19041.264

    An error occurred trying to open - Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1-en-US.cab Error: 0x80070002
    An error occurred trying to open - C:\TempPath\Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1-en-US.cab Error: 0x80070002
    Processing 1 of 1 - Adding package Microsoft-Windows-FileServer-ServerCore-Package~31bf3856ad364e35~amd64~~10.0.19041.1
    [==========================100.0%==========================]
    An error occurred - Microsoft-Windows-FileServer-ServerCore-Package Error: 0x80073701

    Error: 2

    An error occurred trying to open - C:\TempPath\Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1-en-US.cab Error: 0x80070002

    The DISM log file can be found at C:\WINDOWS\Logs\DISM\dism.log
     
  7. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
    #627 bfoos, Jun 3, 2020
    Last edited: Jun 3, 2020
    My bad, there is a typo in the installation instructions that I provided. Try this...

    Code:
    dism /online /add-package /packagepath:Microsoft-Windows-FileServer-ServerCore-Package-amd64-10.0.19041.1.cab /packagepath:Microsoft-Windows-FileServer-ServerCore-Package-amd64-en-US-10.0.19041.1.cab
    dism /online /add-package /packagepath:Microsoft-Windows-Dedup-Package-amd64-10.0.19041.1.cab /packagepath:Microsoft-Windows-Dedup-Package-amd64-en-US-10.0.19041.1.cab
    dism /online /enable-feature /featurename:Dedup-Core /all
    
    Sorry about that. :( Thanks for posting the error info as it made it easy to spot my mistake. I fixed it and uploaded a new archive.
     
  8. luzea

    luzea MDL Addicted

    Apr 25, 2019
    721
    804
    30
    You’re right, I was running it from PowerShell 7.0.1. The other thing I noticed is that no progress will be shown when running in PS 7.0.1. It always stays at 0%, but completes nicely.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  9. smaitlx

    smaitlx MDL Novice

    Dec 11, 2018
    2
    1
    0
    #629 smaitlx, Jun 3, 2020
    Last edited: Jun 3, 2020
    EDIT: This worked.
     
  10. iorx

    iorx MDL Novice

    Sep 15, 2013
    6
    2
    0
    Hi, I got server not found trying to access the link for dedup-10.0.19041.1.7z ; w-w-w-.-u-p-l-o-a-d-.-e-e-/files/11814407/dedup-10.0.19041.1.7z.html (cant post links yet becasue of 5 post limitation, so trying mask the upload link)
    Anyone got a mirror of this pack?
    Brgs,
     
  11. iorx

    iorx MDL Novice

    Sep 15, 2013
    6
    2
    0
    Hi, solved it with files from the MEGA-archive. Here is mine dism which installed that version:
    In my case the the base files plus en-US lang.

    Code:
    dism /online /add-package /packagepath:Microsoft-Windows-FileServer-ServerCore-Package~31bf3856ad364e35~amd64~~10.0.19041.1.cab /packagepath:Microsoft-Windows-FileServer-ServerCore-Package~31bf3856ad364e35~amd64~en-US~10.0.19041.1.cab
    dism /online /add-package /packagepath:Microsoft-Windows-Dedup-Package~31bf3856ad364e35~amd64~~10.0.19041.1.cab /packagepath:Microsoft-Windows-Dedup-Package~31bf3856ad364e35~amd64~en-US~10.0.19041.1.cab
    dism /online /enable-feature /featurename:Dedup-Core /all
    I upgraded from the 1909 version [10.0.18362.1]. Should one uninstall that version first before adding this package?
    Everything looks like it working after a reboot so maybe it's fine like I did it.

    I'm deduping a vhdx-file which I automount at startup, so this isn't a "real" partition.

    Code:
    Volume                   : E:
    VolumeId                 : \\?\Volume{0ddd9cc4-4cb8-4d13-9140-****}\
    Enabled                  : True
    UsageType                : Default
    DataAccessEnabled        : True
    Capacity                 : 255.98 GB
    FreeSpace                : 125.77 GB
    UsedSpace                : 130.21 GB
    UnoptimizedSize          : 345.25 GB
    SavedSpace               : 215.04 GB
    SavingsRate              : 62 %
    MinimumFileAgeDays       : 0
    MinimumFileSize          : 32768
    NoCompress               : False
    NearInlineMode           : False
    ExcludeFolder            :
    ExcludeFileType          :
    ExcludeFileTypeDefault   : {edb, jrs}
    NoCompressionFileType    : {asf, mov, wma, wmv...}
    ChunkRedundancyThreshold : 100
    Verify                   : False
    OptimizeInUseFiles       : True
    OptimizePartialFiles     : True
    InputOutputScale         : 0
    IdleTimeoutDefault       : 60
    AutoStart                : False
    ChunkIndexCacheVolume    :
     
  12. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
    I just checked my upload.ee link and it is still active.
     
  13. iorx

    iorx MDL Novice

    Sep 15, 2013
    6
    2
    0
    Thanks.
    Yes, can confirm its working now. At the time of my previous post I couldn't reach it, tried from several places (Sweden and US).
    Brgs,
     
  14. acevicky

    acevicky MDL Novice

    Apr 16, 2017
    1
    1
    0
    #634 acevicky, Jun 16, 2020
    Last edited: Jun 16, 2020
    I had similar error to Deathmouse and Smasher.
    I had Windows 10 1909 which was recently upgraded to 2004. after the upgrade I installed the dedup package, ran the PowerShell commands but can't access the data on Dedup volume. On checking the dedup status, I get the below status.

    In order to get to the data i even tried resetting the OS which didn't help. Then i tried reinstalling Windows 10 a fresh, installed dedup package but still i cant access the data and get the above error message when i get the dedup status.

    Code:
    LastOptimizationTime               : 16-06-2020 01:32:02
    LastOptimizationResult             : 0x80565309
    LastOptimizationResultMessage      : A required filter driver is either not installed, not loaded, or not ready for service.
    LastGarbageCollectionTime          : 16-06-2020 01:32:08
    LastGarbageCollectionResult        : 0x80565323
    LastGarbageCollectionResultMessage : The specified volume is not enabled for deduplication.
    LastScrubbingTime                  : 16-06-2020 01:32:13
    LastScrubbingResult                : 0x80565323
    LastScrubbingResultMessage         : The specified volume is not enabled for deduplication.
     
  15. josywong

    josywong MDL Novice

    Apr 18, 2014
    13
    1
    0
    can somebody reupload 19041? the link is nt working for me
     
  16. mhussain

    mhussain MDL Member

    Oct 1, 2012
    132
    22
    10
    could someone give me the link to the forum thread for the ssx tool?
     
  17. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
  18. mhussain

    mhussain MDL Member

    Oct 1, 2012
    132
    22
    10
    @bfoos
    hi,
    I have ssxv1 or that is what the name of the folder is called,
    with a bat file named start,
    how do i use the importlist file?
    I have put in the package names but it gennerates a base package list and asks for the number corrisponding to the package from sed list?
    how do i get packages from a offline image?
    e.g a image that is mounted?
    or from a mounted vhd?
    thanks for your assistence :)
    Majid
     
  19. bfoos

    bfoos MDL Guide Dog

    Jun 15, 2008
    757
    691
    30
    In the _Helper directory find SxSExport.cmd and edit it. Under ::Flags change set Flag_AskImage=0 to =1 then just below that under ::Examples REM out the set Path_Image=%SystemRoot% line. Then run start.cmd and it will ask you to input a source directory, for example the path to the %systemroot% on your mounted VHD or WIM.
     
  20. ptit_poulet

    ptit_poulet MDL Novice

    Apr 6, 2017
    1
    0
    0
    Hi,

    After upgrade to 2004, unable to access dedup volume.
    Is a new version of the package available?

    Thanks in advance.