🧵 View Thread
🧵 Thread (16 tweets)
@JimmyRis Its easier to plant malicious behavior behind a black box that we trust and claim ignorance, vs planting a human spy.The former is also scalable. Having a piece of malware that does something based on some statistical inference would be nigh undetectable.
@JimmyRis This lack of trust and perception that an algorithm is lying/manipulating us is at the core here. Feeling like google's suggestion algorithm is trying to hide a search term. Or that algorithmic bias is intentional (or an artifact of) a corrupt system? Rational given unknowns.
@JimmyRis Imagine an AI doctor that prescribes a bunch of pills that end up killing a bunch of people. We might wanna know why the AI decided this was the best course of action. With a black box, we must necessarily assume it was subterfuge as one possibility. https://t.co/svdg8A0Llu
@JimmyRis Even in contrived cases of unexplainable human actions (as given in this quote tweet ) we are still able to / desire to interrogate why a destructive behavior occurred. https://t.co/gmJDRARI8q
@JimmyRis I find it interesting that so many people have adopted this talking point about "we don't expect this of humans" when we do! We have entire court systems and systems of law based on interrogation & seeking explanation / justice.We should absolutely hold AI to this standard.
@JimmyRis It's one thing to frame this under a framework of unknowability and the nature of axioms of knowledge, but an entirely other thing to say "guess we can't know, better just put up with potential abuses by proxy agents ran by people in positions of power & control here".
@JimmyRis I feel its far too easy to get caught up in the dazel and amazing potential of these systems, and get trapped within the PR hype cycle. There is a lot of promise in it and I to am looking forward to the future with powerful Ai.
@JimmyRis But it would be folly to stick our head in the sand here.https://t.co/cTCf1Vh8Iw
@JimmyRis Daemons. Sleeper (computer) agents. Hidden control surfaces triggered out of systems of inference."Demons are coming" is a pun.https://t.co/5uOm9tpwVu https://t.co/zcmZLhX24V
@JimmyRis But my paranoia runs deep. I wanna build my own chips.https://t.co/xi0RLy3vr7