Pedro Colón-Hernández

Massachusetts Institute of Technology - Media Lab pe25171@media.mit.edu

I am a final year Ph.D. student that works on making technology more understandable and usable for everyone through conversational agents. I have experience in hardware and software systems, but my current specialty is on conversational AI and NLP. In my free time I do landscape photography.


Experience

Graduate Research Assistant

Massachusetts Institute of Technology

Working on the development of intelligent assistants that can browse for information, compile it into a usable source, and make inferences from it. The assistant will be able to guide users along tasks, and handle any problems that they encounter along the way.

June 2018 - Present

Graduate Prototyping Intern

Apple - Siri Experience Prototyping

Worked on prototyping of dictation experiences and Siri capabilities.

June 2022 - September 2022

MIT Summer Research Program - Pod Leader

MIT Office of Graduate Education

Supervised 10 undergraduate students for the summer, coordinated weekly activities with them, checked in on them regularly to see how their experience at the Institute had been, and helped review their written works (statements of objectives, posters, etc.)

June 2021 - August 2021

Graduate Diversity Ambassador

MIT Office of Graduate Education

Have participated and helped with diversity recruiting initiatives at the Institute. My page

June 2020 - Present

Graduate Prototyping Intern

Apple - Siri Experience Prototyping

Design and development of conversational experiences for Siri.

June 2020 - September 2020

Sagrado-MIT Neuroscience Pre-college Program

MIT

Helped review students applications to the program, and in October of 2020 mentored 1 student on his journey to college.

2019-Present

Graduate Prototyping Intern

Apple - Siri Experience Prototyping

Developed prototyping tools to facilitate conversational experience design.

  • Web tool development
  • Conversational design pattern development

June 2019 - September 2019

AI Latin American SumMIT - Coordinator

MIT

Helped coordinate the first ever AI Latin American SumMIT at MIT to discuss AI, its potential effect in Latin America, and developments in the region related to AI. We no longer host the page, but UNESCO has an overview

June 2019 - September 2019

Master's Thesis

Massachusetts Institute of Technology

Worked on developing an object detection wearable that uses a sensor fusion (Radar, spectrometers, broadband camera) to identify objects and relay, through conversations with an intelligent agent, relevant information.

September 2017 - May 2018

Summer Graduate Research Intern

Massachusetts Institute of Technology's Lincoln Laboratory

Worked on fuzzing commercial avionics through various means (grammar, mixing and matching, manually constructed input). Did some C++ and Python tool development, and made a system to automate the fuzzing of avionics.

June 2017 - August 2017

Graduate Research Assistant

Massachusetts Institute of Technology

Worked on fuzzing commercial avionics through various means (grammar, mixing and matching, manually constructed input). Did some C++ and Python tool development, and made a system to automate the fuzzing of avionics.

June 2017 - August 2017

MIT Media Lab SOS Program

MIT Media Lab

Helped students review their application materials and offered feedback and places to improve in it.

2017-Present

Projects (Under Development)

Dynamic Assistants

MIT Media Lab (Cambridge, MA)
September 2018 - Present

Synonymy and Antonymy in Hinting

I am currently leading a team with 2 undergraduate students (Nanxi Liu (Wellesly), Chelsea Joe (Dartmouth)) on incoporating synonyms and antonyms in controllable commonsense inference.
MIT Media Lab (Cambridge, MA)
Fall 2022 - Present

Empathic Similarity

Advising a current M.S. student (Jocelyn Shen) on development of a dataset and transformer-based models for empathic similarity scoring for stories.
MIT Media Lab (Cambridge, MA)
Fall 2022 - Present

Commonsense Dialogic Question Generation

MIT Media Lab (Cambridge, MA)
Spring 2022 - Present
Fall 2021

Structured Knowledge Injection

MIT Media Lab (Cambridge, MA)
Fall 2020
Fall 2020

Hover

MIT Media Lab (Cambridge, MA)
September 2018 - Present

Where's Pedro?

MIT Media Lab (Cambridge, MA)
September 2018 - Present

Holobits

MIT Media Lab (Cambridge, MA)
Fall 2018

Data Manipulator

MIT Media Lab (Cambridge, MA)
Fall 2018

Xeon Phi Card Management Tools

Intel Ronler Acres (Hillsboro, Oregon)
Summer 2013

Education

Massachusetts Institute of Technology

Doctor of Philosophy
Dissertation: A conversational agent for dynamic procedures (TBD)
Media Arts and Sciences

GPA: 5.00/5.00

September 2018 - May 2023

Massachusetts Institute of Technology

Master of Science
Media Arts and Sciences

GPA: 5.00/5.00

September 2016 - May 2018

University of Puerto Rico at Mayaguez

Bachelor of Science - Magna Cum Laude
Computer Engineering

GPA: 3.90/4.00

August 2011 - May 2016

Skills

Programming Languages & Tools
A non-comprehensive list of languages and tools that I have worked with. Most of my most recent experience has been with Python and JavaScript.

Interests

Apart from being an engineer, I enjoy photography, long walks, and reading. In the winter, I am a polar bear. During the summer, I enjoy going to the beach.

When forced indoors, I follow a number of sci-fi and fantasy genre movies and television shows, I am an aspiring chef, and I spend a large amount of my free time exploring the latest technology advancements.


Awards & Certifications

  • Graduate Education for Minorities (GEM) Fellowship Recipient - 2016
  • National Science Foundation (NSF) Graduate Research Fellowship Recipient - 2016
  • Certified Computer Engineer in Training (EIT) in Puerto Rico - 2016
  • Passed the Computer Engineering Professional Engineer exam in Puerto Rico - 2016
  • Approved the Computer Engineer Professional Engineering (PE) Exam - 2016