https://pinboard.in/u:cshalizi/public/ recent bookmarks from cshalizi 2025-09-22T17:16:39+00:00 https://www.aeaweb.org/articles?id=10.1257/aer.20211811 cshalizi to:NB bibliometry inequality sexism academia sociology_of_science causal_inference text_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:531ac8f380a6/ 2025-07-28T14:24:58+00:00 https://www.pnas.org/doi/10.1073/pnas.2422455122 cshalizi to:NB large_language_models_(so_called) text_mining reinhart.alex https://pinboard.in/ https://pinboard.in/u:cshalizi/b:b2c83d5d03a0/ 2025-06-15T16:07:40+00:00 https://arxiv.org/abs/2505.12540 cshalizi to:NB neural_networks inference_to_latent_objects text_mining large_language_models_(so_called) https://pinboard.in/ https://pinboard.in/u:cshalizi/b:d6d9dd7f0540/ 2024-12-11T19:34:48+00:00 https://arxiv.org/abs/2403.07183 cshalizi to:NB large_language_models_(so_called) why_oh_why_cant_we_have_a_better_academic_publishing_system text_mining peer_review funny:sad https://pinboard.in/ https://pinboard.in/u:cshalizi/b:fb6815f21c08/ 2024-09-24T13:45:38+00:00 https://arxiv.org/abs/2402.00159 cshalizi large_language_models_(so_called) text_mining via:brendan_o. in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:fe56245298a1/ 2024-05-14T13:09:06+00:00 https://github.com/dasmiq/cs7180-sp2024/ cshalizi track_down_references large_language_models_(so_called) text_mining via:rbuurma https://pinboard.in/ https://pinboard.in/u:cshalizi/b:506fe263c2c8/ 2023-11-16T02:57:38+00:00 https://arxiv.org/abs/2311.03658 cshalizi text_mining large_language_models_(so_called) veitch.victor in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:97a7aef509b6/ 2023-11-16T02:53:59+00:00 https://global.oup.com/academic/product/mapping-texts-9780197756881?cc=us&lang=en&# cshalizi to:NB books:noted text_mining books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6c73fec72a77/ 2023-11-02T01:17:39+00:00 https://arxiv.org/abs/2310.17611 cshalizi to:NB text_mining natural_language_processing veitch.victor aragam.bryon https://pinboard.in/ https://pinboard.in/u:cshalizi/b:bb600f378458/ 2023-08-10T19:33:54+00:00 https://arxiv.org/abs/2202.02950 cshalizi to:NB to_read ensemble_methods text_mining networked_life social_life_of_the_mind via:henry_farrell https://pinboard.in/ https://pinboard.in/u:cshalizi/b:dcc0ae80623f/ 2022-10-24T01:59:28+00:00 https://openreview.net/forum?id=HklBjCEKvH cshalizi text_mining natural_language_processing neural_networks nearest_neighbors your_favorite_deep_neural_network_sucks large_language_models_(so_called) in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:c6e9c942b454/ 2022-07-22T13:44:55+00:00 https://www.wsj.com/articles/what-ai-still-doesnt-know-how-to-do-11657891316 cshalizi in_NB text_mining artificial_intelligence gopnik.alison have_read re:gopnikism https://pinboard.in/ https://pinboard.in/u:cshalizi/b:7662ca141031/ 2022-07-08T13:35:47+00:00 https://nautil.us/moving-beyond-mimicry-in-artificial-intelligence-21015/ cshalizi neural_networks text_mining your_favorite_deep_neural_network_sucks artificial_intelligence via:melanie_mitchell have_read large_language_models_(so_called) https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2caf16961f42/ 2022-07-03T13:50:51+00:00 https://oxford.universitypressscholarship.com/view/10.1093/oso/9780197582268.001.0001/oso-9780197582268?rskey=PzGaKz&result=254 cshalizi books:noted rhetorical_self-fashioning text_mining social_media networked_life twitter congress us_politics political_science our_decrepit_institutions re:actually-dr-internet-is-the-name-of-the-monsters-creator in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:f307ec0f3631/ 2022-06-25T17:21:21+00:00 https://www.aiweirdness.com/interview-with-a-squirrel/ cshalizifunny:geeky funny:malicious artificial_intelligence philip_k_dick_and_the_fake_humans_rules_everything_around_me text_mining natural_language_processing to_teach:data-mining via:? https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ef35cd9c4100/ 2022-06-19T16:52:48+00:00 https://arxiv.org/abs/2206.07271 cshalizi natural_born_cyborgs natural_language_processing natural_history_of_truthiness text_mining via:henry_farrell cognitive_science networked_life philip_k_dick_and_the_fake_humans_rules_everything_around_me large_language_models_(so_called) in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:8ab7ffaadfd0/ 2022-06-13T16:59:20+00:00 https://arxiv.org/abs/2206.04301 cshalizi neural_networks artificial_intelligence your_favorite_deep_neural_network_sucks text_mining large_language_models_(so_called) in_NB to_read https://pinboard.in/ https://pinboard.in/u:cshalizi/b:e20f76c0ad42/ 2022-05-27T15:21:27+00:00 https://link.springer.com/article/10.1007/s11023-022-09602-0 cshalizi text_mining neural_networks your_favorite_deep_neural_network_sucks artificial_intelligence philip_k_dick_and_the_fake_humans_rules_everything_around_me in_NB large_language_models_(so_called) https://pinboard.in/ https://pinboard.in/u:cshalizi/b:0378888d889b/ 2022-02-27T03:28:42+00:00 https://www.nytimes.com/2022/02/19/technology/qanon-messages-authors.html cshalizi qanon conspiracy_theories psychoceramics stylometrics text_mining natural_language_processing classifiers to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:cf3f4ef95f36/ 2022-02-05T21:05:55+00:00 https://press.princeton.edu/books/ebook/9780691207995/text-as-data cshalizibooks:suggest_to_library books:owned to:NB books:noted text_mining social_science_methodology data_mining social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:932d4cca5bd9/ 2022-01-31T14:32:25+00:00 https://www.pnas.org/content/119/4/e2110406119 cshalizi to:NB music psychology epidemiology_of_representations cultural_differences text_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1a630ce19b17/ 2021-10-19T03:14:20+00:00 https://delphi.allenai.org/ cshalizi utter_stupidity text_mining ethics to:blog via:? https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2a1928053b48/ 2021-09-23T22:53:55+00:00 https://arxiv.org/abs/2109.00725 cshalizi to:NB to_read causal_inference natural_language_processing text_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:4b632534e148/ 2021-08-15T14:00:47+00:00 https://journals.sagepub.com/doi/abs/10.1177/08944393211031452?journalCode=ssce cshalizi to:NB text_mining us_politics us_culture_wars social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:7a2a3ac74c2e/ 2021-07-28T04:35:11+00:00 https://mobile.twitter.com/benmschmidt/status/1419497587296571395 cshalizi bad_data_analysis text_mining twitter_threads_that_should_be_blog_posts https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ec52a8789029/ 2021-07-09T14:32:11+00:00 https://arxiv.org/abs/2107.03684 cshalizi to:NB topic_models text_mining tsybakov.alexandre clustering statistics https://pinboard.in/ https://pinboard.in/u:cshalizi/b:35ac01acf120/ 2021-06-28T03:43:32+00:00 https://arxiv.org/abs/2105.01150 cshalizi to:NB text_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a1486087ad82/ 2021-06-28T02:52:01+00:00 https://www.washingtonpost.com/outlook/2021/05/20/ai-bots-grassroots-astroturf/ cshalizitext_mining deceiving_us_has_become_an_industrial_process re:actually-dr-internet-is-the-name-of-the-monsters-creator farrell.henry kith_and_kin https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a378518e226f/ 2021-06-24T13:15:27+00:00 https://www.pnas.org/content/118/26/e2024292118 cshalizi partisanship_and_polarization social_media text_mining re:actually-dr-internet-is-the-name-of-the-monsters-creator via:rvenkat color_me_skeptical https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a466d0c991f5/ 2021-06-13T04:18:46+00:00 https://cup.columbia.edu/book/trade-and-nation/9780231184359 cshalizi to:NB books:noted history_of_ideas history_of_economics text_mining downloaded https://pinboard.in/ https://pinboard.in/u:cshalizi/b:0edae18ca819/ 2021-06-04T04:01:37+00:00 https://bigthink.com/laurie-vazquez/are-you-a-geek-or-a-nerd cshalizitext_mining geekdom nerdworld to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:17d81b4fb072/ 2021-05-06T13:24:01+00:00 https://arxiv.org/abs/2104.12553 cshalizi to:NB text_mining classifiers sociology_of_science the_american_dilemma to_teach:statistics_of_inequality_and_discrimination color_me_skeptical https://pinboard.in/ https://pinboard.in/u:cshalizi/b:c0dddef66827/ 2021-04-16T16:08:59+00:00 https://arxiv.org/abs/2012.07729 cshalizi epidemiology_of_representations coronavirus_pandemic_of_2019-- conspiracy_theories text_mining re:actually-dr-internet-is-the-name-of-the-monsters-creator in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:486cb561892a/ 2021-04-13T03:56:29+00:00 https://arxiv.org/abs/2104.05010 cshalizi to:NB linguistics text_mining networked_life re:actually-dr-internet-is-the-name-of-the-monsters-creator https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a09e9d84ffb3/ 2021-04-12T03:08:58+00:00 https://sociologicalscience.com/articles-v7-23-544/ cshalizi to:NB text_mining social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:8a822de4302b/ 2021-04-11T03:23:26+00:00 https://twitter.com/literalbanana/status/1380386461728522243 cshalizitwitter_threads_that_should_be_blog_posts social_measurement bad_science text_mining bad_data_analysis https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ae18a81bf461/ 2021-04-10T04:03:05+00:00 https://arxiv.org/abs/2003.03667 cshalizi to:NB text_mining social_media twitter https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a09e3bed177b/ 2021-04-02T19:52:47+00:00 https://cepa.stanford.edu/content/essay-content-strongly-related-household-income-and-sat-scores-evidence-60000-undergraduate-applications cshalizi to:NB education standardized_testing academia inequality to_read text_mining color_me_skeptical to_teach:statistics_of_inequality_and_discrimination https://pinboard.in/ https://pinboard.in/u:cshalizi/b:06d125a57ec1/ 2021-01-22T05:38:19+00:00 https://arxiv.org/abs/2101.06887 cshalizi to:NB text_mining neural_networks natural_language_processing your_favorite_deep_neural_network_sucks https://pinboard.in/ https://pinboard.in/u:cshalizi/b:dab541e23f6b/ 2021-01-14T19:18:06+00:00 https://slackprop.wordpress.com/2013/06/03/on-geek-versus-nerd/ cshalizinerdworld geekdom text_mining to_teach:data-mining via:? https://pinboard.in/ https://pinboard.in/u:cshalizi/b:47c970aa75c5/ 2020-12-19T16:41:23+00:00 https://projecteuclid.org/euclid.aoas/1608346893 cshalizi to:NB time_series point_processes text_mining american_hegemony https://pinboard.in/ https://pinboard.in/u:cshalizi/b:962f8470aa78/ 2020-12-19T16:38:02+00:00 https://projecteuclid.org/euclid.aoas/1608346908 cshalizi to:NB time_series text_mining point_processes epidemiology_of_representations information_cascades branching_processes https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a1ec73f52c61/ 2020-12-17T02:04:26+00:00 https://arxiv.org/abs/2012.07805 cshalizijudging the quick and the dead basilisk-dom being amenable to bargaining under the canons of timeless decision theory.]]> have_read your_favorite_deep_neural_network_sucks natural_language_processing text_mining neural_networks privacy large_language_models_(so_called) in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:c6eb365e40be/ 2020-12-16T20:16:37+00:00 https://journals.sagepub.com/doi/abs/10.1177/0049124118769114 cshalizi to:NB text_mining content_analysis social_science_methodology social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:448ffe2b449c/ 2020-12-02T15:18:53+00:00 https://arxiv.org/abs/2012.00095 cshalizi to:NB technological_change text_mining innovation social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:d6b0c9cb1bcf/ 2020-12-02T01:44:30+00:00 https://arxiv.org/abs/2011.14326 cshalizi to:NB text_mining prediction contagion networked_life to_teach:data-mining coronavirus_pandemic_of_2019-- https://pinboard.in/ https://pinboard.in/u:cshalizi/b:36621ff362e2/ 2020-12-01T01:54:23+00:00 https://www.cambridge.org/9781108420211 cshalizi to:NB books:noted natural_language_processing text_mining neural_networks books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:fed110f3c2d8/ 2020-11-27T06:15:01+00:00 https://www.bbc.com/worklife/article/20200123-how-your-twitter-feed-could-help-find-your-dream-job cshalizitwitter text_mining to_teach:data-mining bad_data_analysis to:blog trapped_in_plutos_republic re:career_advising_in_plutos_republic bad_science_journalism https://pinboard.in/ https://pinboard.in/u:cshalizi/b:b003b2327e6c/ 2020-11-27T06:14:40+00:00 http://nautil.us/blog/scientists-can-predict-your-job-by-your-social_media-personality cshalizitext_mining twitter bad_data_analysis to_teach:data-mining to:blog trapped_in_plutos_republic re:career_advising_in_plutos_republic bad_science_journalism https://pinboard.in/ https://pinboard.in/u:cshalizi/b:f1c8a863e7dd/ 2020-11-27T05:49:38+00:00 https://doi.org/10.1371/journal.pone.0233879 cshalizi conspiracy_theories narrative grammar_induction text_mining epidemiology_of_representations color_me_skeptical https://pinboard.in/ https://pinboard.in/u:cshalizi/b:124d39ccde9a/ 2020-11-08T06:43:12+00:00 https://arxiv.org/abs/1808.00382 cshalizi to:NB text_mining literary_history riddell.allen https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1f98e447d57b/ 2020-10-30T17:51:35+00:00 https://arxiv.org/abs/2010.15581 cshalizi to:NB to_read neural_networks your_favorite_deep_neural_network_sucks market_failures_in_everything text_mining causal_inference https://pinboard.in/ https://pinboard.in/u:cshalizi/b:21fbbbbcf40b/ 2020-09-21T03:53:08+00:00 https://mitpress.mit.edu/books/cultural-analytics cshalizi to:NB books:noted in_wishlist text_mining digital_humanities books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1eb26df991ef/ 2020-09-02T05:39:50+00:00 https://www.tabletmag.com/sections/news/articles/media-great-racial-awakening cshalizitext_mining us_culture_wars have_read https://pinboard.in/ https://pinboard.in/u:cshalizi/b:3d7d70d32c0f/ 2020-07-29T15:10:43+00:00 https://www.aclweb.org/anthology/D14-1162/ cshalizi natural_language_processing text_mining to_teach:data-mining in_NB have_read https://pinboard.in/ https://pinboard.in/u:cshalizi/b:f51c305cd2fd/ 2020-07-29T15:08:49+00:00 https://arxiv.org/abs/2002.12327 cshalizi neural_networks natural_language_processing text_mining to_read large_language_models_(so_called) in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:77a75c67f585/ 2020-07-16T18:57:42+00:00 https://cloud.ibm.com/docs/personality-insights?topic=personality-insights-science cshalizi Glove embedding -> prediction of Big 5 personality scores (et al.). Correlations of about 0.3 for English in their samples where they actually administered personality tests. No details about how the subjects were recruited, or even whether this is the correlation on a test set or on a training set. --- ETA: At the bottom of the document, they admit that "While the correlation between inferred and survey-based scores is both positive and significant, the results imply that inferred scores might not always correlate with survey-based results", and give three references to three non-IBM publications which (supposedly) "conducted experiments to compare how well inferred scores match scores obtained from surveys". The third of these is: "Mairesse and Walker (2006) reported 60- to 70-percent accuracy for Big Five personality prediction." I was intrigued by what 60% accuracy would mean for continuous vectors, so I followed their link; this reported both regression results and classifications where the threshold between the class was, for each personality dimension, set at the median. What's remarkable there is that _most_ of the reported results are not marked as statistically significant improvements over the baseline (always predict the mean or always predict the more common class). For self-reported speech, they do 40 hypothesis test and get 2 (!) significant improvements over baseline results at the 5% level. For corpora judged by others, the models do better; over-all I count 130 hypothesis tests and 36 results significant at the 5% level, so it's not _quite_ a case for the neutral model of inquiry, but it's Pluto's Republic all the way down.]]> personality_tests text_mining data_mining trapped_in_plutos_republic to:blog re:career_advising_in_plutos_republic https://pinboard.in/ https://pinboard.in/u:cshalizi/b:643a68d73f09/ 2020-07-16T15:49:42+00:00 https://www.pnas.org/content/116/52/26459 cshalizi to:NB have_read bad_science bad_data_analysis classifiers text_mining personality_tests logistic_regression social_media psychology why_oh_why_cant_we_have_a_better_academic_publishing_system to_teach:data-mining forty_minutes_of_my_life_im_not_getting_back trapped_in_plutos_republic to:blog twitter re:career_advising_in_plutos_republic https://pinboard.in/ https://pinboard.in/u:cshalizi/b:780cca65f6d0/ 2020-05-06T20:12:10+00:00 https://arxiv.org/abs/1905.12516 cshalizi algorithmic_fairness text_mining classifiers to_teach:data-mining to_teach:statistics_of_inequality_and_discrimination in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1ce9a1ebca05/ 2019-11-25T15:57:00+00:00 https://www.jair.org/index.php/jair/article/view/11030 cshalizi to:NB neural_networks natural_language_processing text_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:519570246914/ 2019-11-11T20:13:17+00:00 https://arxiv.org/abs/1911.02656 cshalizi word_embeddings text_mining natural_language_processing model_selection to_teach:data-mining have_read linear_algebra oopsies in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:15724565eb13/ 2019-11-11T20:10:33+00:00 https://arxiv.org/abs/1911.02639 cshalizi text_mining natural_language_processing word_embeddings information_theory to_teach:data-mining low-rank_approximation have_read in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2ea2e7a59cfb/ 2019-10-29T14:59:54+00:00 https://arxiv.org/abs/1910.12618 cshalizi to:NB text_mining natural_language_processing prediction time_series statistics https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ac01a1a4a360/ 2019-10-29T14:15:52+00:00 https://arxiv.org/abs/1910.12203 cshalizi to:NB text_mining deceiving_us_has_become_an_industrial_process networked_life re:disinformation_attacks_on_democratic_systems https://pinboard.in/ https://pinboard.in/u:cshalizi/b:c345a4d890eb/ 2019-10-29T14:15:00+00:00 https://arxiv.org/abs/1910.12073 cshalizi to:NB networked_life text_mining re:disinformation_attacks_on_democratic_systems https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1ba9c6c15ff4/ 2019-10-24T13:41:05+00:00 https://arxiv.org/abs/1910.08350 cshalizi information_theory natural_language_processing text_mining to_teach:data-mining have_read in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:5c06199bbf45/ 2019-10-17T14:13:01+00:00 https://arxiv.org/abs/1907.04670 cshalizi to:NB natural_language_processing text_mining markov_models neural_networks statistics your_favorite_deep_neural_network_sucks https://pinboard.in/ https://pinboard.in/u:cshalizi/b:e02f8d1668fc/ 2019-10-11T00:39:58+00:00 https://languagelog.ldc.upenn.edu/nll/?p=44621 cshalizi to:NB text_mining neural_networks machine_learning artificial_intelligence liberman.mark https://pinboard.in/ https://pinboard.in/u:cshalizi/b:adfa2b0c27f1/ 2019-10-02T15:53:00+00:00 https://arxiv.org/abs/1910.00163 cshalizi to:NB information_bottleneck text_mining inference_to_latent_objects statistics https://pinboard.in/ https://pinboard.in/u:cshalizi/b:55644087a65d/ 2019-10-01T17:15:12+00:00 https://arxiv.org/abs/1909.13456 cshalizi text_mining network_data_analysis joint_modeling_of_text_and_networks in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:4a3815969b5c/