How to achieve the BEST file/archive compression?

Discussion in 'Software' started by ToadMonster, Jan 17, 2024.

  1. GeoffreyMcJefferson

    GeoffreyMcJefferson Kapellmeister

    Joined:
    Mar 17, 2023
    Messages:
    77
    Likes Received:
    46
  2. Garamondo Furbish

    Garamondo Furbish Audiosexual

    Joined:
    Nov 13, 2023
    Messages:
    1,403
    Likes Received:
    656
    Location:
    North America
    surprised to see this discussion, haven't heard this discussed since late 1990's. as hard drives became orders of magnitude bigger, compression has become much less of an issue for storage.

    most use of compression is now in streaming and shared internet services.

    There always has to be the consideration of lossy compression versus loseless compression.

    as we know mp3 compresses sound by throwing out the shit we can't hear, problem is everybody has different levels of hearing loss, so one man's pina colada is another man's day old guiness. and mp3 compression is recursive so you can keep compressing until you have a 1 bit file also known as silence.

    as always, the "BEST" compression is the one that works for you. so it will vary from use case to use case, from content type to content type
    to the amount of storage or transmission bandwidth available for your use case.

    the best compression is a Unicorn, but we love to chase mythic beasts..
     
  3. Will Kweks

    Will Kweks Platinum Record

    Joined:
    Oct 31, 2023
    Messages:
    323
    Likes Received:
    192
    While I agree with you (in most part anyway), and let's have not have a discussion about the merits of various lossy compression, this discussion here seems to be about stuff that can't be lossily compressed, like application data, text, and so on, is it not? Lossless compression can be compared because there's zero subjectivity.

    But I'm hypercranky and pedantic right now so I'd be besides myself if I didn't point out a technical inaccuarcy here.. :yes:.

    mp3 is not "recursive", a mp3 frame is the same size always and add mp3 header(s) on top of that. The smallest sample rate is 8kHz and it's always 16bits (I suppose there might be nonstandard extensions to this, but...) so even in silence the file size would be somewhere around one kilobyte (round up to your block size). Besides, a 1-bit audio file would make no sense, either you're encoding heavily asymmetrical square waves, or square waves (but not silence).
     
  4. Garamondo Furbish

    Garamondo Furbish Audiosexual

    Joined:
    Nov 13, 2023
    Messages:
    1,403
    Likes Received:
    656
    Location:
    North America
    so an mp3 of one hand clapping will always be 1kb?
     
  5. Sinus Well

    Sinus Well Audiosexual

    Joined:
    Jul 24, 2019
    Messages:
    2,044
    Likes Received:
    1,560
    Location:
    Sanatorium
    That is true for PCM. But not for DSD. "1-Bit" conversion, "Bitstream" or "single-bit", as it is also called. It makes sense.
     
    Last edited: Jan 21, 2024
  6. Will Kweks

    Will Kweks Platinum Record

    Joined:
    Oct 31, 2023
    Messages:
    323
    Likes Received:
    192
    Fair, but I don't think 1bit encoders/decoders exist.
     
  7. Will Kweks

    Will Kweks Platinum Record

    Joined:
    Oct 31, 2023
    Messages:
    323
    Likes Received:
    192
    Very true :bow:

    Shit, are NFTs still in fashion? I'm going to look into selling some taoist mp3s. Or empty frames, but that's by the by.
     
  8. Sinus Well

    Sinus Well Audiosexual

    Joined:
    Jul 24, 2019
    Messages:
    2,044
    Likes Received:
    1,560
    Location:
    Sanatorium
    To be honest, I don't know what you mean. DSD is more of a niche format, but there are plenty of devices (and software converters) that can encode and/or decode 1-bit signals. My AV reciever, for example, can decode DSD. But I have never used this feature.

    [​IMG]
     
  9. Will Kweks

    Will Kweks Platinum Record

    Joined:
    Oct 31, 2023
    Messages:
    323
    Likes Received:
    192
    I don't know enough about oversampling, but for mp3 it doesn't make sense, as the bitrate is limited to 320kbit/sec so I don't think it would possible to encode MHz rate data (with frequency filtering). At least the spec doesn't support it. How are DSD streams compressed, if any? Perhaps some non-standard extension? I don't know to be honest with you.

    I've always thought the whole oversampling business was not because you can add more data to the stream, but to make ADC better. But we're going so far off topic and I'm going so far out of my knowledge I think imma gonna stop here :)
     
  10. Sinus Well

    Sinus Well Audiosexual

    Joined:
    Jul 24, 2019
    Messages:
    2,044
    Likes Received:
    1,560
    Location:
    Sanatorium
    I am anything but an expert when it comes to lossless data compression methods. But I think this is the best answer. I once read that compression algorithms handle certain types of data differently, so it depends very much on the content of an archive which algorithm leads to the best result.
     
  11. SineWave

    SineWave Audiosexual

    Joined:
    Sep 4, 2011
    Messages:
    4,372
    Likes Received:
    3,478
    Location:
    Where the sun doesn't shine.
    ZST (ZST or ZSTD archivers) makes the smallest archives of all the archivers known to me. But it's sooooo slow, and it can only produce solid archives, so it's kinda unusable for people who often view files directly from an archive on a NAS when couple of GBs archive gets transferred over the network every time they want to read a PDF, RTF, TXT, NFO file in it. But if you want the archive to be compressed into a smallest possible archive there is, ZST is the one to do it with. :wink: There's only one switch that controls the level of compression. -1 to -19 in zstd and -1 to -9 in zst :wink:
     
Loading...
Similar Threads - achieve BEST file Forum Date
How do I achieve a Bass Stereo Image like this Mixing and Mastering Mar 6, 2024
How is this achieved? [solved] Mixing and Mastering Feb 24, 2024
How can i achieve this synth stab in "Something About You" - Rudimental & Elderbrook? how to make "that" sound Mar 11, 2023
default sound from canopener? any way to achieve that how to make "that" sound Sep 30, 2022
How on Gods Green Earth, do I achieve a Mix like this? Mixing and Mastering Nov 19, 2021
Loading...