Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.
Oogabooga makes running one locally pretty easy. At least for me with an 8GB nvidia GPU so models like llama and such fit.