Surprise surprise, very well-known, solved, problem with endless coverage online is solvable by models trained on the internet…

Absolutely, but that’s the easy case, computerphile had this interesting video discussing a proof of concept exploration which showed that indirectly including stuff in the training/accessible data could also lead to such behaviours. Take it with a grain of salt cause it’s obviously a bit alarmist, but very interesting nonetheless!