Disable in windows 10 to copy/move files first into the RAM from SSD?

Discussion in 'PC' started by ArticStorm, May 15, 2023.

  1. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    I dont want windows 10 to copy files first into ram when copying/moving files around to other ssd and also fast USB HDD. This drives me crazy as it is painful slow.

    I had this turned off in the previous system and it working fine for me.
    (did find anything useful searching with google.)
     
    Last edited: May 16, 2023
  2.  
  3. GammaStar

    GammaStar Platinum Record

    Joined:
    Jul 28, 2012
    Messages:
    246
    Likes Received:
    165
    Location:
    Niburu
    i just right clic the .rar & drag to folder where i want to extract to... it just extracts for rars anyhow
    (winrar) :wink:
     
  4. tzzsmk

    tzzsmk Audiosexual

    Joined:
    Sep 13, 2016
    Messages:
    3,709
    Likes Received:
    2,280
    Location:
    Heart of Europe
  5. jhagen

    jhagen Platinum Record

    Joined:
    Apr 9, 2013
    Messages:
    504
    Likes Received:
    183
    As far as I know to copy anything from A to B you need to buffer data into memory, pointers are needed.
    Sure you can reduce buffer size but you can't skip it.
    Even if you copy just a byte one by one it is stored in a memory address first.
     
    • Agree Agree x 2
    • Like Like x 1
    • List
  6. SineWave

    SineWave Audiosexual

    Joined:
    Sep 4, 2011
    Messages:
    4,434
    Likes Received:
    3,570
    Location:
    Where the sun doesn't shine.
    You want to turn off disk write caching. That's easy - go to device manager, find your disk under "disks", click on it>properties>caching>turn off write cache. It's actually recommendable setting for audio computers - safer for data and uses less cpu. If you have only NVMes and SSDs this caching is a complete waste of time. You may find this setting turned off by default depending on your OS and disk types.

    Cheers ArticStorm! :wink:
     
    • Useful Useful x 2
    • Interesting Interesting x 1
    • List
  7. tzzsmk

    tzzsmk Audiosexual

    Joined:
    Sep 13, 2016
    Messages:
    3,709
    Likes Received:
    2,280
    Location:
    Heart of Europe
    sorry to hijack thread by slightly offtopic comment, but what if NVME SSD actually leverages Host Memory Buffer (HMB) to access host system’s RAM for storing parts of the SSD’s mapping tables, as seen by for ex. WD Black SN770, is that completely independent from OS write caching?
     
  8. SineWave

    SineWave Audiosexual

    Joined:
    Sep 4, 2011
    Messages:
    4,434
    Likes Received:
    3,570
    Location:
    Where the sun doesn't shine.
    It's a great question. Knowing how Windows, and Linux for that matter, handles caching - it does what's generally best for a certain type of disk automatically, I don't think it is possible to make anything worse or unstable by turning it off, if it is possible to turn it off at all. I don't have NVMe so I don't know how OSes handle these. It might be disabled by default and parts that need to be in RAM are handled differently.

    What I said here is - I'm sure HMB caching is retained in any case. Sorry, I'm still a bit groggy from sleeping. :)

    So I wonder if it will be possible to do anything at all. We'll see what ArticStorm says.
     
    Last edited: May 15, 2023
  9. saccamano

    saccamano Audiosexual

    Joined:
    Mar 26, 2023
    Messages:
    1,279
    Likes Received:
    518
    Location:
    CBGB omfug
    I've turned off write-caching on the large HDD where I keep vsti's (and their associated samples), new footage that needs to be cataloged, and storage for offline footage. Write caching on NVMe's and SSD's is kind of a wash because they are very fast to begin with and you really don't notice the speed difference that much. HDD's especially ones larger than, say 3TB, you will notice some speed increase with it turned off.
     
  10. erminardi

    erminardi Kapellmeister

    Joined:
    Feb 10, 2012
    Messages:
    95
    Likes Received:
    57
    Teracopy.
     
  11. Olymoon

    Olymoon Moderator

    Joined:
    Jan 31, 2012
    Messages:
    5,777
    Likes Received:
    4,446
    @SineWave will turning off write caching create a problem for mechanical hard drives?
     
  12. shinjiya

    shinjiya Platinum Record

    Joined:
    Dec 25, 2018
    Messages:
    264
    Likes Received:
    161
    AFAIK Windows will disable or enable cache if it deems necessary for the disk in question.

    Edit: worth noting that disabling cache is a placebo at best. The only reason to disable it is if you're afraid of data loss (and if it's on and never happened, no reason to be afraid now)

    Cache will boost performance, but results in data loss in a crash or outage. If you also turn buffer flushing off, you might damage the filesystem. I would keep it as is, whatever is the current setting.
     
    • Agree Agree x 1
    • Interesting Interesting x 1
    • List
  13. panaman

    panaman Kapellmeister

    Joined:
    Jul 8, 2017
    Messages:
    249
    Likes Received:
    45
  14. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    this was meant in general, when i copy stuff around it usually copies/moves first into RAM and then it almost falls off.
    After copying/moving is done explorer.exe is 5GB big and it doesnt give the Memory back. Only way to free the RAM is to kill the explorer process and recall it to have the taskbar back.
     
  15. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    If this is really the case why is using Total commanders copying/moving feature so much faster?
    Both were equal on the old notebook i had. but here windows normal copying/moving is super slow and leaves garbage in the RAM after the operation is finished.
     
  16. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    Let me try, if this is faster now.

    Didnt read your answer earlier.
     
    Last edited: May 16, 2023
  17. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    Okay it work now. But it could be that compressing the Partition with windows might not be to good for moving, copying bigger stuff around.
    (I always had specific folder compressed, which have lots of space saving files in it, but never the whole drive.)
     
  18. saccamano

    saccamano Audiosexual

    Joined:
    Mar 26, 2023
    Messages:
    1,279
    Likes Received:
    518
    Location:
    CBGB omfug
    For media production of any kind at all, you want the easiest, most direct, and fastest path between data storage, RAM, and CPU/GPU that you can get. Unfortunately, they don't make NVMe's in 6-12+ TB sizes yet (if they did they most likely be out of anyone's price range). So for large cheap, fairly fast storage, the job still falls to HDD's.
     
  19. shinjiya

    shinjiya Platinum Record

    Joined:
    Dec 25, 2018
    Messages:
    264
    Likes Received:
    161
    I can't say Total Commander is faster without benchmarking it, but why it can be faster is because Total Commander doesn't use the same copy/move code from Windows Explorer. Instead of calling those native functions, it has its own. If it's faster or not in all cases, that can't be said without proper testing, but caching has not a lot to do with that. Windows will not cache unimportant files, and mostly important, it flushes its cache constantly to avoid data loss.

    The issue with slow copying and garbage being left behind might be a symptom of another problem entirely.
     
  20. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    7,835
    Likes Received:
    4,015
    Location:
    AudioSexPro
    yeah i think a big problem is that i had the drives compressed.

    Still TC copies a lot faster than windows method (and yes after copying explorer process was as big as 6GB in the RAM, could be its connected with the compression of the drive, which i have removed.)

    I had the cache always turned off and it never failed me over 10 years.
     
  21. saccamano

    saccamano Audiosexual

    Joined:
    Mar 26, 2023
    Messages:
    1,279
    Likes Received:
    518
    Location:
    CBGB omfug
    Have you retested with teracopy? Does it leave the same garbage in RAM as the os file-mangler does? Would be interesting to find out.

    I learned early on that microsoft's drive encryption and compression were junk and never ever used them in my some 20+ years using mickey-soft operating systems. The encryption service is one of the first things to be deleted on a new build.
     
Loading...
Loading...