Working Deduplication files for Microsoft Windows 10

Discussion in 'Windows 10' started by dreamss, Oct 4, 2014.

  1. acer-5100

    acer-5100 MDL Guru

    Dec 8, 2018
    3,782
    2,699
    120
    #781 acer-5100, Dec 21, 2021
    Last edited: Dec 22, 2021

    Feeling counts nothing. Real World experiences count a lot.

    Looks like you have no idea of what I'm talking about.

    Wasted storage O_0 ? 1 Terabyte on bare metal = 1 Terabyte on VM

    Wasted CPU ? Just no. CPU usage is practically 0 when idling, a bit more when accessing files. Obviously is High when the dedup service runs, but that's true for baremetal as well.

    Wasted RAM ? Well Hypercore 2019 takes about 600MB when idling. Less than a couple of modern web pages on nowadays web browsers.

    Looks something released by the "Bureau for complications of simple affairs"

    Aside that I can't see what one dying to have the dedup working on W11 has to do with linux and btrfs...

    The only robust Dedup solution on linux comes from ZFS, but given that's native and not sticked over an old FS like the MS one, it dedupes the files on the fly, not on schedule, and to do so it uses an huge quantity of ram, 8GB per TB of deduped storage is really the bare minimum, while in windows I can dedupe 2TB with less of 2GB (which are used only when the dedup service is running). That's what I call a waste of resources (for home usage at least)

    So (until a native package for w11 is released) you have tree choices.

    #1 Stay on win 10 and live happy

    #2 Stay on win 10 and play with a virtuaized w11

    #3 Folllow my suggestion above
     
  2. abbodi1406

    abbodi1406 MDL KB0000001

    Feb 19, 2011
    16,226
    84,922
    340
    @Evengard
    try to enroll to Insider Preview

    will Server 2022 (build 20348) dedup work?
     
  3. acer-5100

    acer-5100 MDL Guru

    Dec 8, 2018
    3,782
    2,699
    120
    It's the same if you try to port the w8 dedup on w7 or w10 dedup on w81, clearly the kernel/fltrmgr.sys changes matters.
     
  4. emike09

    emike09 MDL Novice

    Jul 19, 2017
    2
    0
    0
    #786 emike09, Jan 5, 2022
    Last edited: Jan 5, 2022
    I'm trying to get deduplication running on 21H2, are there any builds for this?
     
  5. acer-5100

    acer-5100 MDL Guru

    Dec 8, 2018
    3,782
    2,699
    120
  6. Eflanili

    Eflanili MDL Novice

    Mar 26, 2017
    35
    19
    0
  7. Eflanili

    Eflanili MDL Novice

    Mar 26, 2017
    35
    19
    0
  8. Azy

    Azy MDL Novice

    Mar 18, 2016
    8
    4
    0
    Thanks a bunch!
     
  9. Azy

    Azy MDL Novice

    Mar 18, 2016
    8
    4
    0
    Hi guys, could someone please repost the archive from post #782 shared by @abbodi1406?
    I'm having trouble installing dedup on Windows 11, not really having installed anything offline with dism until now.
    I tried installing it from Dedup-22526.1000.7z posted by @xinso and the tweaked .mum files posted by @Eflanili, but I'm stumped.
    If someone can give me some pointers on how I should do it, I am very grateful.
    Thanks again and have a nice day!
     
  10. acer-5100

    acer-5100 MDL Guru

    Dec 8, 2018
    3,782
    2,699
    120
    if you are on 22000.xxx you must follow what i wrote

    https://forums.mydigitallife.net/th...crosoft-windows-10.57189/page-40#post-1715821

    Dedup-22526.1000.7z are ok only if you are on 22526 (and maybe later) builds
     
  11. Azy

    Azy MDL Novice

    Mar 18, 2016
    8
    4
    0
    Yeah, I'm on Windows 11 build 22000.xxx. I'll try to install dedup again following your instructions. I was having trouble downloading the package shared by Abbodi, because I wasn't registered on that site. You also wrote in your post that "obviously the procedure can be automated with very little effort"... What do you mean by that?
     
  12. Azy

    Azy MDL Novice

    Mar 18, 2016
    8
    4
    0
    #796 Azy, Mar 4, 2022
    Last edited: Mar 4, 2022
    Thanks again!
     
  13. acer-5100

    acer-5100 MDL Guru

    Dec 8, 2018
    3,782
    2,699
    120

    No registration is needed not even now that Russian things tend to be problematic

    Likely there are a dozen of ways to do that, but adding a couple of lines to the batch to copy/replace a single file and start a service, shouldn't a problem even for a person using a PC since a week...
     
  14. Azy

    Azy MDL Novice

    Mar 18, 2016
    8
    4
    0
    Sadly I couldn't install that dedup package successfully. I reverted to Windows 10 21H2 for now. In the future, I think I'll have to use your Hyper-V with Windows Server HyperCore solution to be able to use dedup successfully on Windows 11.
    Thanks for your help anyway!