Alan Tseng

I go into more detail here: agentlans/ai-human-alignment

In short:

• You can talk with both LLMs and human beings but they're fundamentally different
  • because humans are self-aware and have experiences
  • so you can't truly understand what an AI is thinking or what kind of entity it is
  • this makes AIs black boxes
• Since AIs don't have conscious experiences
  • they must constantly be updated with data that aligns with human needs
  • sure, good design and initial training datasets are important
  • but human needs and values are always changing
  • and there can be unintended consequences when dealing with an automatic black box (more so than a human being)

I have many complicated opinions about that. Not to get into a debate but I think:

• AIs are black boxes. It's hard to say whether a new black box is really better than your old black box.
• Even if you have received the most profound wisdom and data from the prophets - you're still training a black box.
• AIs are more aligned with their creators than their users.
• Any technology can be abused, no matter how well-intentioned their inventors were.