• theherk@lemmy.world
    link
    fedilink
    English
    arrow-up
    37
    arrow-down
    1
    ·
    2 days ago

    Which makes sense, if you want some standards across contributions. Setting aside that agent assisted contribution itself is questionable, as long as it is happening, a universal agents file is probably helpful.

    • CameronDev@programming.dev
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      5
      ·
      2 days ago

      I don’t get why agents.MD needs to be committed. It feels a bit like committing IDE settings, everyone is going to have slightly different preferences, so its better to just have everyone do their own thing. If anything, I prefer to .gitignore itso it doesnt get accidentally committed.

      • Kogasa@programming.dev
        link
        fedilink
        English
        arrow-up
        3
        ·
        8 hours ago

        You’d put the things that aren’t up to personal preference in there, like an AI disclosure / contribution policy or what changes should look like to be reviewable. You usually don’t need to tell humans “don’t change things for the sake of changing them” because we don’t like to do more work than we have to, but agents do.

        You can also include a compact “table of contents,” describing what lives where in the project. It saves at most a little bit of exploration though so I don’t know if it’s really worth the maintenance

        • CameronDev@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 hours ago

          but agents do

          Depends on the model, Gemma 4 is extremely lazy in my experience, half the time it won’t finish the task properly anyway. Deepseek (not sure of the version) was crazily overactive. I personally prefer Gemma’s laziness, because it avoid making the chaotic changes that need to be rolled back, but thats a personal preference.

          And thats kinda why I don’t like it being committed. If the entire team is using one model, then sure, commit the agents.md, and everyone gets a sane default, but given this is a multi-developer project with likely many different agents and models in use, it makes more sense to me that each developer manages the agents.md themselves and optimises it for their own model/workflow.

          • Kogasa@programming.dev
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 hours ago

            You do definitely need some agent-specific guidance locally. The committed AGENTS.md should be pretty sparse. Ironically I think the clearest use case is for instructing agents that AI contributions are not allowed. Not that they won’t ignore it if prompted.

      • treadful@lemmy.zip
        link
        fedilink
        English
        arrow-up
        4
        ·
        24 hours ago

        For agents (semi-autonomous) I think it’s more similar to introductory developer docs. Which are usually committed.

        • CameronDev@programming.dev
          link
          fedilink
          English
          arrow-up
          2
          ·
          7 hours ago

          I get that analogy. However, I would heirarchaically place the agents as subordinates to the developer, which is why I would expect each developer to institute their own customised agents.md file, rather than it being dictated from the repo, which is a level removed.

      • theherk@lemmy.world
        link
        fedilink
        English
        arrow-up
        17
        ·
        2 days ago

        Like formatters and git ignore configuration, some agent instructions are personal and those should not be commited. But some are worth sharing. Having formatter config in a repo is not uncommon. And in this case the file is only a link to the readme, so the agent reads the contrib guidelines.

        • CameronDev@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          2 days ago

          I’m on board with committing formatter config, because thats deterministic and really should be shared amongst a team.

          I don’t get why the agent needs to have the contrib guidelines, it should be a human doing the actual contrib part, so its just a waste of tokens for the LLM to read it?

          • Passerby6497@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            ·
            1 day ago

            I don’t get why the agent needs to have the contrib guidelines, it should be a human doing the actual contrib part, so its just a waste of tokens for the LLM to read it?

            Why would you want to waste the tokens required to generate a subpar response that will either require the user to undo a potentially significant portion of what was generated, or you’ll end up using more tokens while the operator tries to get the AI to obey the standard (before they inevitably tell the stupid thing to follow the guide themselves later, anyway)?

            • CameronDev@programming.dev
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              2
              ·
              1 day ago

              At least for the specific example given, I want developers to do the commit part themselves, so if their LLM is doing any part of that, its already a mistake IMO.

              I had a very quick look at the AI agent guidelines, and nothing about them strikes me as overly burdensome for a human to fix up. So I’d rather just do that myself (if I were a kernel dev).

              My main objection is forcing it on developers, it should be up to each dev to configure and manage their own agent. Making it a suggestion is fine, just don’t commit it. Also, if developers are using local hosted models, then context may be quite limited, so wasting it on an Agents.MD maybe be unideal.

          • theherk@lemmy.world
            link
            fedilink
            English
            arrow-up
            6
            ·
            2 days ago

            Waste of tokens for the agent to make changes that the human then changes to comply with contrib guidelines. Potentially a smaller number used to read in some guidelines and get closer to correct in the first place.

      • MagicShel@lemmy.zip
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 day ago

        A contributor still has global config for their personal preferences. It makes sense to me, anyway. My biggest issue is it’s not deterministic. Someone else could have a version that works better or uses fewer tokens for the same thing.

        At work we commit the whole .claude folder, though we carve out some space for personal agents and skills.

  • tidderuuf@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    1
    ·
    1 day ago

    Everywhere I go I started leaving AGENTS.md files. I feel like the future needs some reliability and stability as LLMs help us improve everything we do. So if your agent replies with a bunch of shit emojis or an ASCII art of a beautiful veiny dick then you can thank this guy and is AGENTS.md files. You’re welcome.

  • 0x4f1@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    This is being proposed so that the bot doesn’t have to read the entire README file. Humans are supposed to do it but the bot replacing them does not. Makes sense to me.

    Surely this will improve code quality for the single most important piece of software in existence today.

    • brian@programming.dev
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      1 day ago

      I feel like you either didn’t read your article or didn’t read the post article

      • RumRunningDevil@lemmy.zip
        link
        fedilink
        English
        arrow-up
        3
        ·
        7 hours ago

        To quote the research paper conclusion…

        Conclusion We evaluate the impact of context files on coding agent performance for four common coding agents on SWE-BENCH and the novel CTXBENCH, built from recent GitHub issues and less popular repositories containing developer-written context files. We find that all context files consistently increase the cost and number of steps required to complete tasks. LLM-generated context files have a marginal negative effect on task success rates, while developer-written ones provide a marginal performance gain, neither statistically significant. Our trace analyses show that instructions in context files are generally followed and lead to more test- ing and broader exploration; however, they do not function as effective repository overviews. Over- all, our results suggest that context files don’t improve coding agent performance, and should only contain specific additional instructions beyond what is already available in the codebase. This high- lights a concrete gap between current agent-developer recommendations and observed outcomes, and motivates future work on principled ways to automatically generate concise, task-relevant guid- ance for coding agents.

        That sounds like “Agents.MD doesn’t work” to me.

        Am I missing something?

          • RumRunningDevil@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            ·
            3 hours ago

            What is the difference between the models writing code “well” and their performance in this context? Are we referring to readability?

            Genuine question. If we use agents to read, edit, and review code, why do we care about readability? That’s a human constraint. Unless attempting to do those three is not effective and thus requires human attention to correct issues which would justify readable code. If that’s the case; why use the agent to edit the code in the first place?