• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    16 days ago

    Depends for sure. I usually try the 32B first, but give really “hard” queries to some API model.

    • horse_battery_staple@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      16 days ago

      With the distilled models I have, I’ve been able to build and troubleshoot pretty complicated apps in Golang and Python. However, these distilled models are very specialized and will not do things like write me a story about a duck made out of duct tape or properly summarize articles. There are absolutely limits to my workflow and setup. But I’m pretty happy with it.