• 1 Post
  • 3 Comments
Joined 23 days ago
cake
Cake day: September 4th, 2026

help-circle


  • dandiandy@lemmy.caOPtoSelfhosted@lemmy.world•Observability Stack?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    8 hours ago

    Cool, sounds like a fun project.

    Not sure if you have been looking into Jev or other System 1 models, but it might be a good fit since it can output a structured type-safe output. Most of the automation I’ve tried in the past with LLMs failed due to the output structure being hallucinated (ignoring my requested structure). But it sounds like System 1 models might fix that.

    I’ve been looking at an open source model called Laya a little and it might work well for your project. Sounds like you’d want structured output.

    What kind of rig do you have ollama running on?