• lime!@feddit.nu
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 hours ago

    i finished those studies twelve years ago. and we did in fact go through the mechanisms of training and inference that language models are using, albeit in fewer dimensions. i have no idea where you are getting your information because it’s simply not true. it’s amusingly like the idea of bootstrap physics that acollierastro did a video on yesterday; the idea that we can’t boil it down to something fundamental so we shouldn’t even try.