I am a computer science Ph.D. candidate in the DataLab group at the University of California, Irvine, advised by Dr. Padhraic Smyth. I am broadly interested in the development of user-centered tools for more interpretable and accountable machine learning; my research centers on understanding and improving human-machine interaction. I’m a member of the Steckler Center for Responsible, Ethical, and Accessible Technology, the Irvine Initiative in AI, Law, and Society, and the HPI Research Center in Machine Learning and Data Science at UCI.
I have previously interned with eBay and Apple, working broadly on tools and processes for ML model evaluation, and at Project Jupyter, where I was involved in the development and design of JupyterLab. I received my Bachelor’s degree in statistics from California Polytechnic State University, San Luis Obispo in 2020 and my Master’s degree in computer science from UCI in 2022.
Selected Publications
Variable-Based Calibration for Machine Learning Classifiers
Markelle Kelly and Padhraic Smyth
37th AAAI Conference on Artificial Intelligence (AAAI), 2023
[pdf] [code]
Capturing Humans' Mental Models of AI: An Item Response Theory Approach
Markelle Kelly, Aakriti Kumar, Padhraic Smyth, and Mark Steyvers
ACM Conference on Fairness, Accountability, and Transparency (FAccT), 2023
[pdf] [code]
Perceptions of Linguistic Uncertainty by Language Models and Humans
Catarina Belem*, Markelle Kelly*, Sameer Singh, and Padhraic Smyth
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
[pdf] [code]
Benchmark Data Repositories for Better Benchmarking
Rachel Longjohn*, Markelle Kelly*, Sameer Singh, and Padhraic Smyth
Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track, 2024
[pdf] [code]
News
12/19/2024 I'm co-organizing an ICLR 2025 Workshop: "The Future of Machine Learning Data Practices and Repositories"
10/15/2022 UCI ICS Spotlight: "Markelle Kelly Highlights the Human Side of Computer Science"
03/29/2022 UCI Statistics News: "Culture of Collaboration Leads to Cutting-Edge Work in AI"