CoFRIDA: Self-Supervised Fine-Tuning for Human-Robot Co-Painting
ICRA 2024 Best Paper on Human-Robot Interaction
ICRA Expo 2024 Finalist for Best Demonstration
Robot Synesthesia: A Sound and Emotion Guided AI Painter
IROS 2024 Nominated for Best Entertainment and Amusement Paper
AAAI workshop on Creative AI Across Modalities 2023
FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environment
ICRA 2023 Finalist for Outstanding Deployed Systems Paper
StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translation
The 2022 International Joint Conference on Artificial Intelligence
The 2021 NeurIPS Workshop on Machine Learning for Creativity and Design
Oral
Towards Real-Time Text2Video via CLIP-Guided, Pixel-Level Optimization
NeurIPS Workshop on Creativity and Design 2022
Content Masked Loss: Human-Like Brush Stroke Planning in a Reinforcement Learning Painting Agent.
AAAI'21
Computer-Supported Human Mentoring for Personalized and Equitable Math Learning
2021 Conf. on Artificial Intelligence in Education (AIED21)
Paper
Introducing the Personalized Learning² application; designed to make mentoring more effecient in order to give minoritized students more learning opportunities.
Is the Doer Effect Robust Across Multiple Data Sets?
11th Conf. on Educational Data Mining
Paper
Establishing the causal effect between active resources in an educational environment and learning.
Workshops Organized & Teaching
CVPR'21 Workshop on Bridging the Gap between Subjective and Computational Measurements of Machine Creativity
Organizer
The 2021 Conference on Computer Vision and Pattern Recognition
Website
We are organizing a conference to highlight the differences between the way that humans and machines evalaute creativity, and begin a conversation on how to bridge this gap.
SIGGRAPH'21 Workshop on Measurable Creative AI
Organizer
RSS'21 Robotics x Arts Exhibition: Opportunities and Issues in Robotics Applied in the Arts
Invited Artist
AniPainter
Causal Discovery with Tetrad in LearnSphere’s Tigris
Organizer
12th Conf. on Educational Data Mining
Paper
Visualizing Spotify Usage Data
Static Site GitHubPeter Schaldenbrand and Paulina Davison
Interactive visualizations of a user's Spotify data using Altair, Vega, and Streamlit.
wav2midi: An Unsupervised Music Format Translation Model
PaperPeter Schaldenbrand and Husni Almoubayyed
Convert arbitrary waveform audio music into MIDI format. Trained without paired wav-midi examples.
Non-Differentiable, Parametric Model Optimization via Causal Discovery
Paper[In Progress] Optimize the parameters of a model using causal discovery algorithms. Allows for non-differentiable activation functions in the model.
Real Time Learning Analytics for Intelligent Tutoring Systems
PosterKenneth Holstein, Zac Yu, Octav Popescu, Jonathan Sewall, Peter Schaldenbrand, Bruce M. McLaren, and Vincent Aleven
A Deep Dive into Water Contamination
Citadel - The Data Open 2018
Paper
Peter Schaldenbrand, Husni Almoubayyed, Zecong Hu, and Xinyi Ju
I am a PhD candidate at Carnegie Mellon University's Robotics Institute advised by Professor Jean Oh.
My research goal is to lower the barriers that people face in performing real-world acts of creativity such as painting or sculpting by creating new tools for artists using AI and Robotics.
I am particularly interested in the challenges of generating content in the real world, e.g., creating images with a few painted brush strokes versus generating pixels on a computer screen.
My work has won several awards including three categorical best paper nominations at ICRA and IROS, showing that Arts are a valuable domain for foundational Robotics research.
My research has also been featured in The New York Times, documentaries, and local news coverage, demonstrating the public's interest in artistic robotics.
News
- [October 2024] Robot Synesthesia was nominated for Best Entertainment and Amusment Paper at IROS 2024
- [September 2024] I successfully proposed my thesis! Thank you to my committee: Prof. Jean Oh (Advisor), Prof. Jim McCann, Prof. Manuela Veloso, and Prof. Ken Goldberg
- [September 2024] Our video on the history of robot painting was presented at ICRA@40
- [September 2024] Our collaborative drawing work was featured on local news, WPXI
- [May 2024] CoFRIDA won Best Paper on Human-Robot Interaction at ICRA 2024
- [April 2024] CoFRIDA was a finalist for Best Demo at the ICRA Expo 2024
- [August 2023] FRIDA was featured on the Australian Broadasting Company's documenter: AI vs Human: The Creativity Experiment
- [May 2023] FRIDA was a finalist for Best Paper on Deployed Systems at ICRA 2023
- [March 2023] Our work was featured in the New York Times
Research Programmer / Analyst
Carnegie Mellon University
Human-Computer Interaction Institute
2017 — July 2021
Personalized Learning²
Full-stack, lead developer on the Personalized Learning² project; addressing the opportunity gap for marginalized students. Created an interface for teachers and mentors at public schools in the Pittsburgh region to view data from their students’ usage of multiple Math tutoring software and access resources to intervene on students’ motivational and cognitive obstacles. Gave input on the designing of the tool and managed multiple design interns throughout its development process.
Learnsphere Tigris
Contributed improvements in full stack development to LearnSphere’s Tigris: An online workflow tool for analyzing, visualizing, and mining educational data
Presented and taught at workshops and CMU courses. Created videos to teach the software tools I contributed to.
Carnegie Mellon University
Robotics Institute
Doctor of Philosophy
GPA: 4.0
August 2021 —
The University of Pittsburgh
Bachelor of Science: Computer Science
GPA: 3.9
2013 — 2017
Central Catholic High School
Pittsburgh, PA
2009 — 2013
Volunteer
Muscular Dystrophy Association
Councelor and unit leader at MDA's summer camp for children with muscular diseases
2012 — 2020
Action
Volleyball
High school and college experience
Assisted coach at Central Catholic High School
Assisted coach at Central Catholic High School
Biking
You'll catch me outside on my bike as soon as the warm weather hits. I use it to find the best rock skipping spots in Western PA.
Music
Guitar, Saxophone, Bagpipes, Synthesizer in what small free time I find
