Curriculum Vitae


Publications

Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018). Auditing partisan audience bias within Google Search. In Proceedings of the ACM: Human-Computer Interaction, 1(2), Article 148. DOI: 10.1145/3274417. [Best Paper: Honorable Mention] [PDF]

Robertson, R. E., Lazer, D., & Wilson, C. (2018). Auditing the personalization and composition of politically-related search engine results pages. In Proceedings of the 2018 World Wide Web Conference on World Wide Web (pp. 955-965). DOI: 10.1145/3178876.3186143

Robertson, R. E., Tran, F. W., Lewark, L. N., & Epstein, R. (2018). Estimates of non-heterosexual prevalence: The roles of anonymity and privacy in survey methodology. Archives of Sexual Behavior. 47 (4), 1069-1084. DOI: 10.1007/s10508-017-1044-z

Epstein, R., Robertson, R.E., Lazer, D., & Wilson, C. (2018). Suppressing the search engine manipulation effect (SEME). In Proceedings of the ACM: Human-Computer Interaction, 1(2), Article 42. DOI: 10.1145/3134677

Epstein, R., & Robertson, R.E. (2017, June 1). A method for detecting bias in search rankings, with evidence of systematic bias related to the 2016 presidential election. Vista, CA: American Institute for Behavioral Research and Technology, White Paper no. WP-17-02.

Epstein, R., Ho, M., Hyun, S., Le, C., Robertson, R. E., & Stout, D. (2017). A DSM-5-based online mental health referral inventory: A large-scale validation study. Journal of Technology in Human Services. 35 (3), 231-246. DOI: 10.1080/15228835.2017.1356800

Epstein, R., Mejia, J., & Robertson, R. E. (2017). The frequency profile: An informative method for graphing the behavior of individuals post-hoc or in real time. Behavior Analysis: Research and Practice, 17 (1), 55-73. DOI: 10.1037/bar0000052

Epstein, R., Robertson, R. E., Smith, R., Vasconcellos, T., & Lao, M. (2016). Which relationship skills count most? A large-scale follow-up study. Journal of Couple and Relationship Therapy, 15 (4), 341-356. DOI: 10.1080/15332691.2016.1141136

Epstein, R., & Robertson, R. E. (2015). The search engine manipulation effect and its possible impact on the outcomes of elections. Proceedings of the National Academy of Sciences, 112 (33), E4512-E4521. DOI: 10.1073/pnas.1419828112

Epstein, R., & Robertson, R. E. (2014). How to measure sexual orientation range, and why it's worth measuring. Journal of Bisexuality, 14, 392-404. DOI: 10.1080/15299716.2014.933378


Honors / Awards

2018 CSCW Best Paper: Honorable Mention
2016, 2017 Forbes Under 30 Scholar
2016 IP2Location Programming Contest Winner
2012 Graduated Cum Laude from UCSD
2011, 2012 UCSD Provost Honors


Media Articles

Robertson, R. E. (2018, November 6). Is it the Algorithms or Us?. Medium

Robertson, R. E. (2018, June 4). When will Google defend democracy?. The Conversation

Robertson, R. E. (2018, January 15). The 21st century Skinner box. Behavioral Scientist


Software

Robertson, R. E. (2016). dtables: Simplifying Descriptive Frequencies and Statistics. R package version 0.2.0. https://CRAN.R-project.org/package=dtables

Robertson, R. E., Tran, F. W., Mejia, J., & Mourani, C. (2016). IPtoCountry: Convert IP Addresses to Country Names or Full Location with Geoplotting. R package version 0.0.1. https://CRAN.R-project.org/package=IPtoCountry

Epstein, R., Boulier, T., & Robertson, R. E. (2016). FreqProf: Frequency Profiles Computing and Plotting. R package version 0.0.1. https://CRAN.R-project.org/package=FreqProf

Robertson, R. E. (2016). files: Effective File Navigation from the R Console. R package version 0.0.1. https://CRAN.R-project.org/package=files


Presentations

Robertson, R.E., Jiang, S., Jospeh, K., Friedland, L., Lazer, D., & Wilson, C. (2018, November). Auditing partisan bias within Google Search. Paper to be presented at the annual meeting of the association for Computer-Supported Cooperative Work (CSCW 2018). Jersey City, NJ.

Epstein, R., Robertson, R.E., Lazer, D., & Wilson, C. (2018, November). Suppressing the search engine manipulation effect (SEME). Paper to be presented at the annual meeting of the association for Computer-Supported Cooperative Work (CSCW 2018). Jersey City, NJ.

Robertson, R.E., Lazer, D., & Wilson, C. (2018, April). Auditing the Personalization and Composition of Politically-Related Search Engine Results Pages. Paper presented at the 2018 World Wide Web Conference (WWW 2018). Lyon, France.

Robertson, R.E., Lazer, D., & Wilson, C. (2018, March). Modeling suggestion networks for algorithm auditing. Paper presented at CompleNet 2018. Boston, MA.

Epstein, R., Mourani, C., Olson, E., & Robertson, R. E. (2017, April). Biased search rankings can shift opinions on a wide range of topics. Paper presented at the 97th annual meeting of the Western Psychological Association. Sacramento, CA.

Epstein, R., Ding., M., Mourani, C., Olson, E., Robertson, R. E., & Tran, F. (2017, April). Multiple searches increase the impact of the Search Engine Manipulation Effect (SEME). Paper presented at the 97th annual meeting of the Western Psychological Association. Sacramento, CA.

Epstein, R., Robertson, R. E., Shepard, S. J., Zhang, S. (2017, April). A Method for Detecting Bias in Search Rankings, with Evidence of Systematic Bias Related to the 2016 Presidential Election. Paper presented at the 97th annual meeting of the Western Psychological Association. Sacramento, CA.

Epstein, R., & Robertson, R.E. (2017, March) The Search Engine Manipulation Effect (SEME): Understanding its power to change opinions and votes. Paper presented at the 2nd biennial meeting of the International Convention of Psychological Science. Vienna, Austria.

Epstein, R., & Robertson, R. E. (2016, April). A replication of the Search Engine Manipulation Effect (SEME), plus methods for suppressing the effect. Paper presented at the 96th annual meeting of the Western Psychological Association. Long Beach, CA.

Epstein, R., & Robertson, R. E. (2016, April). Why is the search engine manipulation effect (SEME) so large? Testing an operant conditioning hypothesis. Paper presented at the 96th annual meeting of the Western Psychological Association. Long Beach, CA.

Epstein, R., Vu, K., & Robertson, R. E. (2016, April). Which skills are best at boosting motivation? A large-scale Internet-based study. Paper presented at the 96th annual meeting of the Western Psychological Association. Long Beach, CA.

Epstein, R., Nanayakkara, P., & Robertson, R. E. (2016, April). Which parenting skills count most? A large-scale Internet study. Paper presented at the 96th annual meeting of the Western Psychological Association. Long Beach, CA.

Epstein, R., Robertson, R. E., & Hyun, S. (2016, April). Calling oneself straight can be stressful: Insights from a large multinational study of sexual orientation. Paper presented at the 96th annual meeting of the Western Psychological Association. Long Beach, CA.

Epstein, R., & Robertson, R. E. (2015, April). The Search Engine Manipulation Effect (SEME): Large-scale replications in two countries. Paper presented at the 95th annual meeting of the Western Psychological Association, Las Vegas, NV.

Epstein, R., Le, C., & Robertson, R. E. (2015, April). A DSM-5-based online mental health screening inventory: Preliminary validation study. Paper presented at the 95th annual meeting of the Western Psychological Association, Las Vegas, NV.

Epstein, R., Thompson, D. S., Crawford, A. S., Mejia, J., & Robertson, R. E. (2015, April). The frequency profile: An informative method for graphing the behavior of individuals post hoc or in real time. Paper presented at the 95th annual meeting of the Western Psychological Association, Las Vegas, NV.

Epstein, R., Hwang, T., & Robertson, R. E. (2015, April). Extended Childhood Disorder (ECD): Additional support for a new diagnostic category. Paper presented at the 95th annual meeting of the Western Psychological Association, Las Vegas, NV.

Epstein, R., & Robertson, R. E. (2014, April). Helping people preserve their privacy online: The surprising power of a click requirement. Paper presented at the 94th annual meeting of the Western Psychological Association, Portland, OR.

Robertson, R. E. & Epstein, R. (2014, April). Are we underestimating non-heterosexual prevalence? The critical role of survey methodology. Paper presented at the 94th annual meeting of the Western Psychological Association, Portland, OR.

Epstein, R., & Robertson, R. E. (2014, April). How adultness varies across the life span: A large-scale Internet study. Paper presented at the 94th annual meeting of the Western Psychological Association, Portland, OR.

Epstein, R., & Robertson, R. E. (2013, November). A quantitative analysis of the mismatch between sexual orientation labels and various measures of sexual expression. Paper presented at the 56th annual meeting of the Society for the Scientific Study of Sexuality, San Diego, CA.

Epstein, R., & Robertson, R. E. (2013, November). How to measure sexual orientation range and why it's worth measuring. Paper presented at the 56th annual meeting of the Society for the Scientific Study of Sexuality, San Diego, CA.

Epstein, R., & Robertson, R. E. (2013, November). How to measure sexual orientation prevalence without underestimating the prevalence of non-heterosexuals. Poster presented at the 56th annual meeting of the Society for the Scientific Study of Sexuality, San Diego, CA.

Epstein, R., & Robertson, R. E. (2013, May). Democracy at risk: Search rankings can shift voter preferences substantially. Poster presented at the 25th annual meeting of the Association for Psychological Science, Washington, D.C.

Epstein, R., & Robertson, R. E. (2013, April). The inadequacy of sexual orientation labels: Lessons from a large-scale study. Paper presented at the 93rd annual meeting of the Western Psychological Association, Reno, NV.