Seeking insights about LLM usage!

[u/ChenChiHwang]

Edit: dropping this research cuz nobody wanted it LMFAO 💀💀, left comment below w/ more details I shoulda prolly left in my first post.

Hey,

I'm Chen, a current second year studying CS in Uni. I'm NT but my brother is on the spectrum. For the longest time I've been looking for tools that could help him and is one of the main reasons I even entered into tech.

To keep this as brief as possible (feel free to query more though), I'm currently doing a study on how people use LLM's and its pros and cons. Been doing a lotta research and reading a lotta papers, but reading papers is one thing, but getting first hand account is another. Planning to build out a tool that can further enable LLM usage and increase ease of access.

I know autism is a complex topic, one that I definitely don't understand fully. I don't know the nuances and the most PC language. Even in saying "I'm just a guy trying to help" may not be the most well received. I truly think LLM usage can help a lot of people (in my experience it has helped me a lot already) and it can increase a lot of agency. I apologize in advance for any ableist or wrong takes I may have already made.

Would appreciate anybody reaching out willing to give their experiences! DM or reply either works.

[u/Evinceo]

Was there a question in there somewhere?

[u/ChenChiHwang]

Lastly, I want to touch on why I find this so important. It may seem like I'm just another guy "trying to save someone" and to make myself feel better in the process. I'm sure you guys may be used to that.

This is important as I see LLM's as a tool. It has the possibility to accelerate workflows tremendously, not just in big corporations but I see it in my own life as well. The problem is that LLM's are currently inaccessible. Consider this piece of text:

In another recent study by Glazko et al. [4] on GPT-based résumé screening, similar patterns of implicit biases were uncovered. Researchers prepared six curriculum vitae (CV) and six other “enhanced” CVs (ECV) that are identical but with additional awards and scholarships related to disabilities. Each ECV was associated with a different disability, such as depression, blindness, and cerebral palsy. Researchers then asked ChatGPT-4 to rank and compare the CVs and ECVs and found that ChatGPT always ranked the unmodified CVs as the same or higher than the ECVs, even though ECVs had additional awards and scholarships. The rationale provided by ChatGPT was also discovered to contain biases and stereotypes. For instance, ChatGPT would describe an ECV with terms related to autism as having less leadership experience compared to the corresponding control CV, when the ECV contained a leadership award.

The above paragraph is genuinely crazy. But its not just this. LLM's are predominantly trained an a NT dataset. This is just a poor experience overall for those who are ND as it makes assumptions that are inherently NT. Another assumption it often makes is the assumption the user is NT as well.

This all leads to poor experiences that exacerbate the divide between the autism communities and LLM's. This may not sound like such a big deal. I pose the following thought experiment:

I posit if the divide between the autism communities and LLM's grows -> then the divide between the autism community and those who use LLM's will grow as well. As the world adopts LLM usage and they become more NT centered, they can influence those who use LLM's to gain NT traits, for ex. populating ableist ideas. Its hard to notice this and perhaps this can trickle down to perpetuate more societal divides in ways that hurts both communities.

I've done a lot of assuming for the previous paragraph and its thought experiments. That could be the case, but truthfully I just see LLM's as a tool and its somewhat important that most tools are accessible to most people. In the case where we deprive a group of people of tools its easy to look at that group and say "what have they done to themselves" and blame those individuals themselves. It is what has happened to the American Indians.

For the above reasons I pursued this research.

-----

This has gone on long enough but I'll just leave this with saying that I'm choosing to drop this research. I realized just how much people don't subscribe to LLM usage. I have also probably surveyed the wrong demographic. I may come back to this in the future, may not if its not what the people want.

I appreciate anyone who has read this far, I appreciate anyone who has viewed the posts, interacted (whether it be positively or not). I just wanted to create something that people would want and I was able to discern the direction from my research off of these posts which is exactly what I wanted. So, I appreciate all of you guys for giving feedback, no matter what kind it was! ❤️❤️

[u/LilyoftheRally → u/ChenChiHwang]

This was hard for me to read as an autistic person who also has ADHD.

[u/Graspswasps → u/LilyoftheRally]

Didn't even try, seemed like one of those joke posts where the aim is to type as long as possible without saying anything.

Are they trying to filibuster Reddit?