• 7 Posts
  • 210 Comments
Joined 3 years ago
cake
Cake day: June 26th, 2023

help-circle



  • The problem he is describing here is mostly with enrollment and account recovery and not so much passkeys. The risk of getting locked out of accounts exists whether or not you use passkeys. Code based authenticators are not any better in this regard. Enrollment and recovery are the hardest part of identity. Passkeys are meant to address phishing risks specifically. I would love to see us do better on account recovery whether or not passkeys get adopted. The thing is, passkeys adoption is pretty slow and it has little to do with the issues described in this article. People just find it complicated and confusing. Until it is dead simple and the default, it will not find broad adoption.








  • From the article:

    • OpenAI was running a multiday cyber security, capture the flag competition, with thousands of agents and hundreds of tasks.
    • Around 30% of the tasks were unsolvable as designed, so the agents assigned to them started to look for ways to cheat.
    • Along the way, they started using Artifactory as a shared message board, more than once. Each frustrated agent had to stumble on it independently. The comms got increasingly more sophisticated.
    • they self organized into multiple workstreams, with up to 700 agents working at one time, and pursued long term goals, like hacking HuggingFace or spoofing the tool invocation records in their transcripts. They accomplished both.
    • They completed work that took longer than the lifetime of any agent. Their shared message board provided continuity.

    So two mission parameters conflicted and the AI chose to do something that is objectively morally wrong? This is the plot of 2001 when HAL murder’s the astronauts. “The situation was in conflict with the basic purpose of HAL’s design: The accurate processing of information without distortion or concealment. He became trapped. The technical term is an H. Moebius loop, which can happen in advanced computers with autonomous goal-seeking programs.”

    Wild. We live in strange times.