Post by Johannes Tigges
Interessantes Paper zum Einfluss von AGENTS.md et al. Dateien.
arxiv.org/pdf/…
Wichtiger Quote aber auch:
Limitations and Future Work Programming languages The current evaluation is focused on Python. Since this is a language that is widely represented in the training data, detailed knowledge about tooling, dependencies, and other repository specifics might be present in the models’ parametric knowledge, nullifying the effect of context files. Future work may investigate the effect of context files on more niche programming languages and toolchains that are less represented in the training data [8, 27].Context files beyond task resolution In this work, we evaluate the impact of context files on task resolution rate. However, other aspects of coding agent performance, such as code efficiency [14] and security [10], would be interesting directions for future work. Security, specifically, was found to be sensitive to prompt changes in prior work [37].
Hervorhebung eigene.
Im Prinzip also: Spitz, nützlich und was das Modell halt nicht selbst kann reinschreiben, nicht was Captain Obvious auch schon gewusst hätte. Whowouldathought. Klingt wie bei Menschen…😆
