https://pinboard.in/u:cshalizi/public/ recent bookmarks from cshalizi 2025-03-08T21:24:22+00:00 https://www.nber.org/papers/w32917 cshalizi to:NB color_me_skeptical credit_ratings prediction data_mining economistic_imperialism https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ee5ffe715728/ 2024-12-04T14:38:02+00:00 https://link.springer.com/article/10.1007/s00146-020-01097-6 cshalizi large_language_models_(so_called) artificial_intelligence data_mining re:shoggothim via:warrenellis no_really_via:warrenellis in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:7860d376a580/ 2024-11-28T00:35:00+00:00 https://www.countbayesie.com/blog/2023/4/21/linear-diffusion cshalizi have_read data_mining principal_components generative_diffusion_models in_NB to_teach:statistics_and_generative_ai https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6ea3912b2b43/ 2024-04-30T14:44:43+00:00 https://direct.mit.edu/books/oa-monograph/5587/Computational-FormalismArt-History-and-Machine cshalizi to:NB downloaded art_history data_mining digitial_humanities https://pinboard.in/ https://pinboard.in/u:cshalizi/b:30a0f90c67b1/ 2024-04-29T14:22:26+00:00 https://direct.mit.edu/books/oa-monograph/5674/Distant-ViewingComputational-Exploration-of cshalizi to:NB books:noted downloaded art_history digital_humanities image_processing data_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6699678ef830/ 2023-12-10T02:36:46+00:00 https://philsci-archive.pitt.edu/22690/ cshalizi to:NB philosophy_of_science data_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:bb4879318782/ 2023-06-28T15:53:18+00:00 https://www.theverge.com/features/23764584/ai-artificial-intelligence-data-notation-labor-scale-surge-remotasks-openai-chatbots cshalizi data_mining data_sets machine_learning have_read via:alison_gopnik !_at_the_via in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:5077d9479d14/ 2023-05-02T20:24:17+00:00 https://www.propublica.org/article/chicagos-race-neutral-traffic-cameras-ticket-black-and-latino-drivers-the-most cshalizi have_read chicago track_down_references data_mining algorithmic_fairness to_teach:statistics_of_inequality_and_discrimination https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1fa35ec0cf69/ 2023-02-15T20:07:10+00:00 https://arxiv.org/abs/2301.13188 cshalizi in_NB neural_networks data_mining generative_diffusion_models https://pinboard.in/ https://pinboard.in/u:cshalizi/b:50d279186918/ 2023-01-17T06:19:08+00:00 https://link.springer.com/article/10.1007/s10618-022-00907-3 cshalizi to:NB decision_trees data_mining hooker.giles https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2edc09ab8e94/ 2022-08-31T21:56:27+00:00 https://www.foreignaffairs.com/world/spirals-delusion-artificial-intelligence-decision-making cshalizihave_read in_NB data_mining algorithmic_fairness kith_and_kin farrell.henry to_teach:data-mining re:democratic_cognition seeing_like_a_finite_state_machine https://pinboard.in/ https://pinboard.in/u:cshalizi/b:bf239783c563/ 2022-07-22T14:57:34+00:00 https://www.nytimes.com/2022/06/25/technology/china-surveillance-police.html cshalizi have_read to_teach:data-mining seeing_like_a_finite_state_machine surveillance china:prc prediction data_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:b19320bc850b/ 2022-07-03T04:11:52+00:00 https://logicmag.io/play/my-stepdad's-huge-data-set/ cshalizi have_read pr0n advertising data_mining epidemiology_of_representations practices_relating_to_the_transmission_of_genetic_information to_teach:data-mining sfw https://pinboard.in/ https://pinboard.in/u:cshalizi/b:9a15a8940499/ 2022-07-03T03:34:09+00:00 https://www.cambridge.org/core/books/big-data-and-the-welfare-state/340936CE478BD6264DE77D9123357D4A#fndtn-information cshalizi to:NB books:noted prediction data_mining political_economy welfare_state downloaded https://pinboard.in/ https://pinboard.in/u:cshalizi/b:01042e85ab57/ 2022-06-28T18:24:38+00:00 https://www.nytimes.com/2022/06/25/technology/china-surveillance-police.html?action=click&module=Well&pgtype=Homepage&section=Business cshalizisurveillance data_mining prediction china:prc to_teach:data-mining police https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a70ccc43e029/ 2022-04-13T03:01:09+00:00 https://www.nature.com/articles/s41467-019-10933-3/ cshalizi to:NB privacy data_mining to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6a95196c6bc1/ 2022-03-31T23:35:44+00:00 https://arxiv.org/abs/2203.06498 cshalizidata_analysis bad_data_analysis psychology data_mining gelman.andrew to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6c960a97eea4/ 2022-03-12T13:25:01+00:00 https://www.sciencedirect.com/science/article/pii/S016792361400061X?casa_token=8mKjKuwIF58AAAAA:DjRmaJuDoBZjjHb2kA3iEoCckvybsakE7Ww6qdBRABxULXlOuE8FIvmSbgMgYO0ZwLasjyow cshalizi data_mining marketing to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:3c63a5c22abb/ 2022-02-05T21:05:55+00:00 https://press.princeton.edu/books/ebook/9780691207995/text-as-data cshalizibooks:suggest_to_library books:owned to:NB books:noted text_mining social_science_methodology data_mining social_measurement https://pinboard.in/ https://pinboard.in/u:cshalizi/b:932d4cca5bd9/ 2021-08-03T04:35:55+00:00 https://www.annualreviews.org/doi/abs/10.1146/annurev-soc-090820-020800 cshalizi to:NB data_mining networked_life to_teach:data-mining fourcade.marion https://pinboard.in/ https://pinboard.in/u:cshalizi/b:08a0ff6c918b/ 2021-07-15T17:49:26+00:00 https://nymag.com/intelligencer/2020/09/inside-palantir-technologies-peter-thiel-alex-karp.html cshalizi data_mining national_surveillance_state to_teach:data-mining have_read https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a0a558670d10/ 2021-06-11T18:03:12+00:00 https://www.nature.com/articles/s41386-021-01020-7 cshalizi to:NB neural_data_analysis statistics classifiers to_teach:data-mining re:neutral_model_of_inquiry data_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a31d8ee83a33/ 2021-06-01T17:48:31+00:00 https://arxiv.org/abs/2105.14364 cshalizi to:NB data_mining network_data_analysis re:network_differences statistics https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ec0f72bf02dc/ 2021-05-28T16:34:18+00:00 https://www.cambridge.org/9781108845359 cshalizi books:noted neural_networks data_mining statistics baldi.pierre your_favorite_deep_neural_network_sucks books:have_suggested_to_library books:in_library downloaded in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:5f32ee3469e2/ 2021-05-18T13:55:44+00:00 https://arxiv.org/abs/2105.07020 cshalizi to:NB data_mining cities schweitzer.lisa batty.michael https://pinboard.in/ https://pinboard.in/u:cshalizi/b:260376c6ecdd/ 2021-05-17T14:40:30+00:00 https://www.nber.org/papers/w28811 cshalizi to:NB economics data_mining to_teach:data-mining organizations https://pinboard.in/ https://pinboard.in/u:cshalizi/b:29d9f6d466a9/ 2021-05-17T13:01:26+00:00 https://www.sup.org/books/title/?id=32597 cshalizi in_NB books:noted marketing data_mining deceiving_us_has_become_an_industrial_process to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:be76d8874382/ 2021-04-22T15:27:48+00:00 https://arxiv.org/abs/2104.10443 cshalizi to:NB data_mining equations_of_motion_from_a_time_series https://pinboard.in/ https://pinboard.in/u:cshalizi/b:21b982acac32/ 2021-04-11T03:31:25+00:00 https://www.nber.org/papers/w23673 cshalizi to:NB data_mining macroeconomics ng.serena heard_the_talk to_read re:your_favorite_dsge_sucks https://pinboard.in/ https://pinboard.in/u:cshalizi/b:59ca1ea7aed8/ 2021-03-21T18:40:32+00:00 https://arxiv.org/abs/2103.05766 cshalizi to:NB confidence_sets prediction statistics random_forests ensemble_methods data_mining to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:fdba38e0badc/ 2021-02-28T02:35:08+00:00 https://yalebooks.yale.edu/book/9780300209570/atlas-ai cshalizi books:noted data_mining to_teach:data-mining via:henry_farrell coveted algorithmic_fairness in_NB downloaded https://pinboard.in/ https://pinboard.in/u:cshalizi/b:62f1b55fef86/ 2021-02-04T18:52:17+00:00 https://doi.org/10.5210/fm.v19i7.4901 cshalizi in_NB data_mining advertising re:actually-dr-internet-is-the-name-of-the-monsters-creator tufekci.zeynep to_teach:data-mining have_read https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1f37d36add25/ 2021-02-04T15:27:49+00:00 https://www.cambridge.org/core/journals/data-and-policy/article/from-satisficing-to-artificing-the-evolution-of-administrative-decisionmaking-in-the-age-of-the-algorithm/8962400DADAC3C740AC023A20B38E285 cshalizi data_mining ethnography algorithmic_fairness to_teach:data-mining in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:bbe1b34260a8/ 2021-01-16T05:17:01+00:00 https://doi.org/10.1093/oso/9780190684099.001.0001 cshalizi in_NB books:noted crime prediction data_mining police downloaded https://pinboard.in/ https://pinboard.in/u:cshalizi/b:e1883fd38699/ 2021-01-16T04:09:24+00:00 https://doi.org/10.1093/oso/9780198864165.001.0001 cshalizi to:NB books:noted multiple_testing high-dimensional_statistics statistics data_mining color_me_skeptical https://pinboard.in/ https://pinboard.in/u:cshalizi/b:8072b64fafe5/ 2021-01-14T19:23:00+00:00 https://nowpublishers.com/article/Details/MAL-078-3 cshalizi to:NB data_mining network_data_analysis https://pinboard.in/ https://pinboard.in/u:cshalizi/b:aaa4585b482d/ 2021-01-14T19:21:27+00:00 https://nowpublishers.com/article/Details/MAL-078-2 cshalizi to:NB data_mining graph_theory network_data_analysis fourier_analysis https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2f8de14b2961/ 2021-01-14T19:20:33+00:00 https://nowpublishers.com/article/Details/MAL-078-1 cshalizi to:NB graph_theory data_mining network_data_analysis spectral_methods https://pinboard.in/ https://pinboard.in/u:cshalizi/b:bfd5d06856f6/ 2021-01-14T16:00:40+00:00 https://arxiv.org/abs/2101.04715 cshalizi to:NB high-dimensional_statistics data_mining hero.alfred_o. https://pinboard.in/ https://pinboard.in/u:cshalizi/b:c37308da648f/ 2021-01-14T15:15:48+00:00 https://sociologicalscience.com/articles-v8-2-26/ cshalizi sociology prediction data_mining algorithmic_fairness to_teach:data-mining in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:d2f1aee86353/ 2021-01-11T16:34:05+00:00 https://arxiv.org/abs/1711.10427 cshalizi to:NB data_mining nobel.andrew to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ef1c23d8da18/ 2020-12-24T15:33:23+00:00 https://arxiv.org/abs/2012.12802 cshalizi to:NB time_series prediction data_mining decision_trees random_forests neural_networks ensemble_methods to_teach:data_over_space_and_time https://pinboard.in/ https://pinboard.in/u:cshalizi/b:30ad1b56b9ba/ 2020-12-16T15:13:22+00:00 https://arxiv.org/abs/2012.08496 cshalizi to:NB statistics spectral_methods data_mining approximation linear_algebra to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6c3188aa8c89/ 2020-12-12T22:50:06+00:00 https://www.lse.ac.uk/cpnss/research/genetically-evolving-models-in-science cshalizi track_down_references genetic_algorithms curve_fitting data_mining its_lems_world_we_just_live_in_it symbolic_regression https://pinboard.in/ https://pinboard.in/u:cshalizi/b:f91e6e5ea694/ 2020-11-30T17:32:10+00:00 https://www.cambridge.org/9781108477444 cshalizi to:NB books:noted random_projections locality-sensitive_hashing dimension_reduction clustering data_mining computational_statistics to_teach:data-mining books:in_library books:have_suggested_to_library downloaded re:codename:catherine_wheel https://pinboard.in/ https://pinboard.in/u:cshalizi/b:8fb436ef1b8f/ 2020-11-27T05:28:52+00:00 https://www.nytimes.com/2020/01/20/opinion/facial-recognition-ban-privacy.html cshalizifacial_recognition data_mining privacy algorithmic_fairness schneier.bruce https://pinboard.in/ https://pinboard.in/u:cshalizi/b:3435da20fc1c/ 2020-11-26T16:03:32+00:00 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3727562 cshalizi law data_mining privacy in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1ca2a6473ed5/ 2020-11-25T14:32:55+00:00 https://arxiv.org/abs/2011.11483 cshalizi to:NB crime prediction data_mining color_me_skeptical https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2e5c63e6f42a/ 2020-11-25T14:19:10+00:00 https://arxiv.org/abs/1909.10832 cshalizi to:NB clustering random_projections data_mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:814eb4c5041a/ 2020-11-19T22:13:26+00:00 https://www.annualreviews.org/doi/abs/10.1146/annurev-soc-121919-054621 cshalizi to:NB sociology data_mining data_analysis network_data_analysis bail.christopher https://pinboard.in/ https://pinboard.in/u:cshalizi/b:2d69b6950b0e/ 2020-11-16T16:05:49+00:00 https://ieeexplore.ieee.org/document/8861141 cshalizi to:NB to_read data_analysis data_mining model_selection statistics post-model-selection_inference to_teach:linear_models to_teach:undergrad-ADA to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:3ef24ab591ab/ 2020-11-11T15:29:11+00:00 https://pubsonline.informs.org/doi/pdf/10.1287/mksc.2019.1188 cshalizi to:NB to_read advertising data_mining to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:a05c464a09d0/ 2020-11-06T14:32:04+00:00 https://www.wired.com/story/ad-tech-could-be-the-next-internet-bubble/ cshaliziwhy_oh_why_cant_we_have_a_better_press_corps advertising networked_life internet data_mining track_down_references our_decrepit_institutions to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:90e222793ad3/ 2020-10-23T02:15:10+00:00 https://press.princeton.edu/books/ebook/9780691200002/metrics-at-work cshalizi to:NB books:noted journalism data_mining networked_life books:in_library books:have_suggested_to_library downloaded https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1eade603ff41/ 2020-09-21T03:55:27+00:00 https://mitpress.mit.edu/books/data-action cshalizi books:noted data_mining to_download in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ca32b0c5f33c/ 2020-08-17T15:20:38+00:00 https://www.jstor.org/stable/j.ctt13x0hch cshalizibooks:noted downloaded data_mining finance to_read to_teach:data-mining in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:98fede5cdf9c/ 2020-07-29T15:17:33+00:00 https://www.pnas.org/content/117/15/8398 cshalizi to:NB prediction data_mining social_science_methodology sociology to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:75b10a8bff25/ 2020-07-28T18:40:16+00:00 https://law.stanford.edu/publications/ethnic-bias-in-big-data-analytics-how-private-biases-can-migrate-into-public-policy/ cshalizi data_mining algorithmic_fairness to_teach:data-mining in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:e4e4e6824a03/ 2020-07-26T20:24:27+00:00 https://global.oup.com/academic/product/predict-and-surveil-9780190684099 cshalizi books:noted police prediction data_mining to_teach:data-mining via:? books:owned in_NB books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ef0f9f67a0de/ 2020-07-16T18:57:42+00:00 https://cloud.ibm.com/docs/personality-insights?topic=personality-insights-science cshalizi Glove embedding -> prediction of Big 5 personality scores (et al.). Correlations of about 0.3 for English in their samples where they actually administered personality tests. No details about how the subjects were recruited, or even whether this is the correlation on a test set or on a training set. --- ETA: At the bottom of the document, they admit that "While the correlation between inferred and survey-based scores is both positive and significant, the results imply that inferred scores might not always correlate with survey-based results", and give three references to three non-IBM publications which (supposedly) "conducted experiments to compare how well inferred scores match scores obtained from surveys". The third of these is: "Mairesse and Walker (2006) reported 60- to 70-percent accuracy for Big Five personality prediction." I was intrigued by what 60% accuracy would mean for continuous vectors, so I followed their link; this reported both regression results and classifications where the threshold between the class was, for each personality dimension, set at the median. What's remarkable there is that _most_ of the reported results are not marked as statistically significant improvements over the baseline (always predict the mean or always predict the more common class). For self-reported speech, they do 40 hypothesis test and get 2 (!) significant improvements over baseline results at the 5% level. For corpora judged by others, the models do better; over-all I count 130 hypothesis tests and 36 results significant at the 5% level, so it's not _quite_ a case for the neutral model of inquiry, but it's Pluto's Republic all the way down.]]> personality_tests text_mining data_mining trapped_in_plutos_republic to:blog re:career_advising_in_plutos_republic https://pinboard.in/ https://pinboard.in/u:cshalizi/b:643a68d73f09/ 2020-07-16T15:59:43+00:00 https://www.pnas.org/content/early/2020/07/13/1920484117 cshalizi to:NB personality_tests data_mining i_really_dont_want_to_read_this_but_maybe_i_should to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:6dcd8646579b/ 2020-07-15T21:19:14+00:00 https://wwnorton.com/books/9780393634846/about-the-book/description cshalizi to:NB books:noted astrology data_mining to_teach:data-mining history_of_science books:owned books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:f8bac23f61e6/ 2020-07-15T20:18:10+00:00 https://wwnorton.com/books/9781631496103 cshalizi books:noted history_of_technology data_mining lepore.jill the_present_before_it_was_widely_distributed books:owned in_NB books:suggest_to_library https://pinboard.in/ https://pinboard.in/u:cshalizi/b:fa4e3695a53f/ 2020-07-13T17:02:18+00:00 https://www-wsj-com.cdn.ampproject.org/v/s/www.wsj.com/amp/articles/ai-isnt-magical-and-wont-help-you-reopen-your-business-11590811201?usqp=mq331AQFKAGwASA%3D&amp_js_v=0.1#referrer=https%3A%2F%2Fwww.google.com&amp_tf=From%20%251%24s&ampshare=https%3A%2F%2Fwww.wsj.com%2Farticles%2Fai-isnt-magical-and-wont-help-you-reopen-your-business-11590811201 cshalizi have_read data_mining to_teach:data-mining coronavirus_pandemic_of_2019-- https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ef307c5b5efa/ 2020-06-25T16:05:42+00:00 https://www.nytimes.com/2020/06/24/technology/facial-recognition-arrest.html?action=click&module=Top%20Stories&pgtype=Homepage cshaliziclassifiers data_mining police utter_stupidity to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:b4f394d2fc25/ 2020-06-12T17:34:19+00:00 https://academic.oup.com/jla/article/doi/10.1093/jla/laz001/5476086 cshalizi algorithmic_fairness inequality data_mining to_teach:statistics_of_inequality_and_discrimination via:chouldechova discrimination in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:e4061487a1b8/ 2020-04-14T17:36:39+00:00 https://www.buzzfeednews.com/article/ryanmac/clearview-ai-fbi-ice-global-law-enforcement cshalizisurveillance data_mining to_teach:data-mining https://pinboard.in/ https://pinboard.in/u:cshalizi/b:1a6d10afc48e/ 2020-04-08T15:58:29+00:00 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2477899 cshalizito_read algorithmic_fairness prediction data_mining to_teach:data-mining to_teach:statistics_of_inequality_and_discrimination law in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:9ab505518792/ 2020-02-19T18:55:01+00:00 https://arxiv.org/abs/2002.05193 cshalizi to_read prediction data_mining kith_and_kin in_NB malik.momin_m. https://pinboard.in/ https://pinboard.in/u:cshalizi/b:07675ced4632/ 2020-02-10T16:24:42+00:00 https://hdsr.mitpress.mit.edu/pub/56lnenzj cshalizi algorithmic_fairness statistics data_mining spiegelhalter.david to_teach:data-mining to_teach:statistics_of_inequality_and_discrimination in_NB https://pinboard.in/ https://pinboard.in/u:cshalizi/b:ab9f2582428e/