People store large quantities of data in their electronic devices and transfer some of this data to others, whether for professional or personal reasons. Data compression methods are thus of the utmost importance, as they can boost the efficiency of devices and communications, making users less reliant on cloud data services and external storage devices.
  • barsoap@lemm.eeEnglish
    3·
    17 hours ago

    I would guess it’s pretty hard to reconstruct data with a different LLM

    I think the idea is to have compressor and decompressor use the exact same neural network. Looks like arithmetic coding with a learned function.

    But yes model size is probably going to be an issue.

    • Harlehatschi@lemmy.mlEnglish
      2·
      15 hours ago

      Ye but that would limit the use cases to very few. Most of the time you compress data to either transfer it to a different system or to store it for some time, in both cases you wouldn’t want to be limited to the exact same LLM. Which leaves us with almost no use case.

      I mean… cool research… kinda… but pretty useless.