Working Deduplication files for Microsoft Windows 10

Discussion in 'Windows 10' started by dreamss, Oct 4, 2014.

  1. fbifido

    fbifido MDL Member

    Joined:
    Jun 6, 2007
    Messages:
    199
    Likes Received:
    26
    Trophy Points:
    10
    #221 fbifido, Jul 30, 2016
    Last edited by a moderator: Apr 20, 2017
    With just this update, I have seen a boost in dedup

    old dedup stat:
    Code:
    PS C:\Temp> Get-DedupStatus
    
    FreeSpace    SavedSpace   OptimizedFiles     InPolicyFiles      Volume
    ---------    ----------   --------------     -------------      ------
    6.68 GB      504.98 GB    50815              50816              D:
    
    It's a 2TB HDD, with a lot of zip, iso, rar, 7z, pdf, mp4 files.

    new dedup stat:
    Code:
    PS C:\Temp> Enable-DedupVolume D: -UsageType Default
    
    Enabled    UsageType      SavedSpace      SavingsRate      Volume
    -------    ---------      ----------      -----------      ------
    True       Default        504.98 GB        21 %              D:
    
    PS C:\Temp> Set-Dedupvolume D: -MinimumFileAgeDays 0
    
    PS C:\Temp> Start-DedupJob -Volume D: -Type Optimization -full
    
    Type          ScheduleType   StartTime      Progress   State        Volume
    ----          ------------   ---------      --------   -----        ------
    Optimization  Manual                            0 %    Queued        D:
    
    PS C:\Temp> get-dedupjob
    
    Type          ScheduleType    StartTime    Progress   State       Volume
    ----          ------------    ---------    --------   -----       ------
    Optimization  Scheduled                      0 %      Queued        D:
    Optimization  Manual          10:00 PM       71 %     Running       D:
    
    PS C:\Temp> Get-DedupStatus
    
    FreeSpace    SavedSpace   OptimizedFiles    InPolicyFiles     Volume
    ---------    ----------   --------------    -------------     ------
    82.56 GB     494.83 GB    54009             54010              D:
    
    after-new dedup.png after-new dedup 2.png
     
  2. abbodi1406

    abbodi1406 MDL KB0000001

    Joined:
    Feb 19, 2011
    Messages:
    12,067
    Likes Received:
    55,424
    Trophy Points:
    340
    Knowing your edition would be helpful :)
    i think the pack works properly on Pro and up
     
  3. moderate

    moderate MDL Guru

    Joined:
    Aug 31, 2009
    Messages:
    2,787
    Likes Received:
    2,302
    Trophy Points:
    90
    I will not tell you. :p
    4All: It is Enterprise, but don't tell Abbodi. :)
     
  4. T-S

    T-S MDL Guru

    Joined:
    Dec 14, 2012
    Messages:
    3,988
    Likes Received:
    1,327
    Trophy Points:
    120
    494 GB saved over 504GB doesn't look that boost to me :g:
     
  5. moderate

    moderate MDL Guru

    Joined:
    Aug 31, 2009
    Messages:
    2,787
    Likes Received:
    2,302
    Trophy Points:
    90
    Problem solved.
     
  6. fbifido

    fbifido MDL Member

    Joined:
    Jun 6, 2007
    Messages:
    199
    Likes Received:
    26
    Trophy Points:
    10
    #226 fbifido, Jul 31, 2016
    Last edited by a moderator: Apr 20, 2017
    D: drive is a 2TB drive.

    don't use that as your only stats, to see if it has improved.
    d: = 86.5K files, 2.4TB with only 6GB free.
    with the new dedup from 14393
    d: = 86.5K files, 2.4TB with now 119GB free.

    I have not add or removed any files from my D: drive.
    optimize files went from 50815 to 54009, with 82GB free space.
    with those 54009 and more optimization, we move to 118GB free space.

    That's because it not finish, I have to wait for the week end to finish.
    today is Sat, July 30, 2016 9:55pm, this is how it look:

    Code:
    C:\WINDOWS\system32>powershell
    Windows PowerShell
    Copyright (C) 2016 Microsoft Corporation. All rights reserved.
    
    PS C:\WINDOWS\system32> Get-DedupStatus
    
    FreeSpace    SavedSpace   OptimizedFiles     InPolicyFiles      Volume
    ---------    ----------   --------------     -------------      ------
    118.73 GB    531.5 GB     54009              54010              D:
    
    
    PS C:\WINDOWS\system32> Get-DedupSchedule
    
    Enabled    Type               StartTime              Days               Name
    -------    ----               ---------              ----               ----
    True       Optimization                                                 BackgroundOptimization
    True       GarbageCollection  2:45 AM                Saturday           WeeklyGarbageCollection
    True       Scrubbing          3:45 AM                Saturday           WeeklyScrubbing
    
    
    PS C:\WINDOWS\system32> Get-DedupJob
    PS C:\WINDOWS\system32>
    
    thanks.
     
  7. TONSCHUH

    TONSCHUH MDL Addicted

    Joined:
    Jun 11, 2012
    Messages:
    816
    Likes Received:
    285
    Trophy Points:
    30
  8. T-S

    T-S MDL Guru

    Joined:
    Dec 14, 2012
    Messages:
    3,988
    Likes Received:
    1,327
    Trophy Points:
    120
    #228 T-S, Aug 1, 2016
    Last edited: Aug 1, 2016
    You can't deduplicate the system partition/drive
     
  9. Luckie

    Luckie MDL Junior Member

    Joined:
    Jan 14, 2008
    Messages:
    80
    Likes Received:
    15
    Trophy Points:
    0
    #229 Luckie, Aug 1, 2016
    Last edited by a moderator: Apr 20, 2017
    can you please add the de-DE packages?
     
  10. abbodi1406

    abbodi1406 MDL KB0000001

    Joined:
    Feb 19, 2011
    Messages:
    12,067
    Likes Received:
    55,424
    Trophy Points:
    340
    Server LangPacks are not released
     
  11. fbifido

    fbifido MDL Member

    Joined:
    Jun 6, 2007
    Messages:
    199
    Likes Received:
    26
    Trophy Points:
    10
    #231 fbifido, Aug 1, 2016
    Last edited: Aug 1, 2016
    Can you show the physical size of these drives ?
    and how much space is been use (Ctrl+A on the root of each drive, the right click & select properties) ?

    thanks.

    (note: Drive Properties, don't always show the real information, so you need to look at files properties)
    (you can compact-OS & compress the system drive, but not dedup it)
     
  12. SLRVision39

    SLRVision39 MDL Member

    Joined:
    Aug 5, 2009
    Messages:
    147
    Likes Received:
    13
    Trophy Points:
    10
    Thanks a lot abbodi1406. Once again, you did a great job :)
     
  13. dreamss

    dreamss MDL Junior Member

    Joined:
    Apr 7, 2009
    Messages:
    99
    Likes Received:
    50
    Trophy Points:
    10
  14. jtb1965

    jtb1965 MDL Novice

    Joined:
    Aug 5, 2016
    Messages:
    1
    Likes Received:
    0
    Trophy Points:
    0
    Now I can read my deduplicated drives which I couldn't after going to 14393. What isn't working is actually deduplicating new files.
     
  15. TONSCHUH

    TONSCHUH MDL Addicted

    Joined:
    Jun 11, 2012
    Messages:
    816
    Likes Received:
    285
    Trophy Points:
    30
  16. EFA11

    EFA11 Avatar Guru

    Joined:
    Oct 7, 2010
    Messages:
    8,729
    Likes Received:
    6,728
    Trophy Points:
    270
  17. abuabdo

    abuabdo MDL Novice

    Joined:
    Oct 29, 2012
    Messages:
    13
    Likes Received:
    1
    Trophy Points:
    0
    Hi
    Done anniversary update.
    I can't run dism from the text file included in Dedup_10.0.14393.0
    Are there any prerequisites before i can run the dism in ps as admin?
     
  18. EFA11

    EFA11 Avatar Guru

    Joined:
    Oct 7, 2010
    Messages:
    8,729
    Likes Received:
    6,728
    Trophy Points:
    270
    #238 EFA11, Aug 7, 2016
    Last edited by a moderator: Apr 20, 2017
  19. T-S

    T-S MDL Guru

    Joined:
    Dec 14, 2012
    Messages:
    3,988
    Likes Received:
    1,327
    Trophy Points:
    120
    Copy that text and paste it on an admin command prompt (then enter). Or rename the txt as cmd and launch it as administrator.
     
  20. stylemessiah

    stylemessiah MDL Novice

    Joined:
    Aug 14, 2009
    Messages:
    27
    Likes Received:
    8
    Trophy Points:
    0
    #240 stylemessiah, Aug 7, 2016
    Last edited: Aug 7, 2016
    Have to ask, why are average people messing with dedupe, and even hacking to enable it...if i need more storage space, i buy a new disk, cost per megabyte has never been lower, the drive can be used on every PC/MAC i can find, and its far safer than murdering your consumer level HDD with extra strain of deduping

    After 35+ years in IT, all my important files live on an external drive that is only connected when i need it, the very last thing id do would be leave any important files...media included on a drive thats spinning 24/7, and then add deduping to it...no thanks