Prompt engineering in the age of generative AI: Insights from public discourse on social media.

Résumé

BACKGROUND: Public discourse on "prompt engineering" has grown rapidly, but large-scale evidence on how people discuss it is limited. The nascent coinage describes a user journey of optimizing text-based parameters within large language models and generative AI platforms in a trial-and-error process, adding modifiers or key phrases to yield a satisfactory output. While several studies have systematically and taxonomically mapped these techniques, no big data studies have specifically delved into the public reception to the concept. The study significantly contributes to the literature by documenting emerging new trends. It is prudent to keep abreast of discursive content as these techniques enter into the public lexicon, by capturing public discourse, sentiments and dominant themes.OBJECTIVES: This paper maps prominent discussion peaks and quarter-by-quarter themes and sentiment in posts mentioning "prompt engine*" on X and Reddit (1 May 2023-30 April 2024).METHODS: We analyzed a large social media corpus (n = 298,774) of publicly-available English-language posts containing "prompt engine*" (engine/engineer/engineering/engineered). Our first research direction detected discussion spikes using peak-prominence modeling (pre-specified prominence threshold at 95th-percentile significance), then qualitatively coded the top-engagement posts on peak dates. Our second research direction computed quarterly sentiment, frequent bigrams, and emoji usage.RESULTS: Six peaks centered on: (i) skill validity, (ii) future ramifications, (iii) title longevity, (iv) artist-attribution disputes, (v) model bias/guardrails, and (vi) analogies to child-rearing. Negative sentiment increased from 14.1% (Q1) to 37.3% (Q4), while positive sentiment fell from 36.4% to 22.8%. Tutorials dominated early content; later quarters featured humor, satire and legal liability discussions.CONCLUSIONS: Public narratives around prompt engineering increasingly question legitimacy, longevity, and ethics. Clearer terminology, transparency about guardrails, and guidance on responsible use may help align expectations and practice.