Civilloquy
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
pavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 年前

LLMs are surprisingly great at compressing images and audio, DeepMind researchers find

venturebeat.com

external-link
message-square
6
fedilink
85
external-link

LLMs are surprisingly great at compressing images and audio, DeepMind researchers find

venturebeat.com

pavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 年前
message-square
6
fedilink
Despite being primarily trained on text, these models achieved remarkable compression rates on image and audio data.
alert-triangle
You must log in or register to comment.
  • akrot@lemmy.world
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    2 年前

    I wonder how consistent is the decompression and how much information is lost in the process.

    • PupBiru@kbin.social
      link
      fedilink
      arrow-up
      14
      ·
      2 年前

      i’d guess they could hyper optimise for “perceived difference” rather than data loss specifically… they do a pretty good job of generating something from nothing, so i’d say with enough data they’d probably generate a pretty reasonable facsimile of “standard” stuff

      • Edgelord_Of_Tomorrow@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        3
        ·
        2 年前

        An LLM can’t know what difference a person has perceived.

        • ilinamorato@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          2 年前

          There have been a lot of studies done (and published) on what humans can and can’t perceive. I wouldn’t have much trouble believing that the LLM has access to them and can pattern match on the variables involved.

    • BetaDoggo_@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 年前

      It’s lossless: https://arxiv.org/pdf/2309.10668.pdf

  • xodoh74984@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 年前

    Gavin Belson has entered the chat

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @L4s@lemmy.world
  • @autotldr@lemmings.world
  • @PipedLinkBot@feddit.rocks
  • @wikibot@lemmy.world
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 2.96K users / day
  • 6.83K users / week
  • 12.2K users / month
  • 27.4K users / 6 months
  • 1 local subscriber
  • 76.5K subscribers
  • 15.2K Posts
  • 479K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.world
  • BE: 0.19.5
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org