Generated by All in One SEO v4.9.10, this is an llms.txt file, used by LLMs to index the site. # Humans To Robots Laboratory Empowering every person with a collaborative robot ## Sitemaps - [XML Sitemap](https://h2r.cs.brown.edu/sitemap.xml): Contains all public & indexable URLs for this website. ## Posts - [Elephants Don't Write Sonnets](https://h2r.cs.brown.edu/elephants-dont-write-sonnets/) - What does it really mean for a machine to be intelligent? In 1950, Alan Turing proposed his famous Imitation Game as a test for machine intelligence. The test was simple: could a computer, through text alone, fool a human into believing it was also human? For decades, this remained a distant goal. Today, large language - [How to Write a Review](https://h2r.cs.brown.edu/how-to-write-a-review/) - When writing a review, it is important to provide positive, constructive, actionable feedback to the authors. When rejecting a paper, imagine that you are writing to next year's best paper winners. What advice or feedback can you give to the authors to help them turn their paper to award-winning work? Most robotics conferences work by - [A Survey of Robotic Language Grounding: Tradeoffs between Symbols and Embeddings](https://h2r.cs.brown.edu/a-survey-of-robotic-language-grounding-tradeoffs-between-symbols-and-embeddings/) - With large language models, robots can understand language more flexibly and more capably than ever before. This survey reviews and situates recent literature into a spectrum with two poles: 1) mapping between language and some manually defined formal representation of meaning, and 2) mapping between language and high-dimensional vector spaces that translate directly to low-level - [Teaching Kids to Program Without Screens](https://h2r.cs.brown.edu/teaching-kids-to-program-without-screens/) - Play this game with your kids to introduce them to programming without screens. They can play even if they are too young to read! - [Most Robots Can't Pick up Most Objects Most of the Time](https://h2r.cs.brown.edu/most-robots-cant-pick-up-most-objects-most-of-the-time/) - Most robots can't pick up most objects most of the time. This is for a variety of reasons. The robot is turned off. The object is out of reach. The object won't fit in the gripper. The robot doesn't know where the object is, because it doesn't have a sensor at all, or because the - [Computer Science Activities for the Pandemic Parent](https://h2r.cs.brown.edu/computer-science-activities-for-the-pandemic-parent/) - I am a computer science professor and also a mom and an aunt. I have taken the opportunity of the COVID pandemic to take a deep dive into computer science with my son and his cousins, ages 7-11. I wanted to share some of the things we've tried and what worked and didn't work. Scratch - [Learning to Follow Directions With Less Supervision](https://h2r.cs.brown.edu/learning-to-follow-directions-with-less-supervision/) - A person should be able to give a complex natural language command to a robot drone or self-driving car in a cityscale environment and have it be understood, such as ""walk along third street until the intersection with main street, then walk until you reach the charles river." Existing approaches represent commands like these as - [Learning Collaborative Pushing and Grasping Policies](https://h2r.cs.brown.edu/calling-your-shot-learning-collaborative-pushing-and-grasping-policies/) - Imagine a robot trying to clean up a messy dinner table. Two main manipulation skills are required: grasping that enables the robot to pick up objects, and planar pushing that allows the robot to isolate objects in the dense clutter to find a good grasp pose. It is necessary to identify grasps within the full - [Object Search in 3D](https://h2r.cs.brown.edu/object-search-in-3d/) - Robots operating in human spaces must find objects such as glasses, books, or cleaning supplies that could be on the floor, shelves, or tables. This search space is naturally 3D. When multiple objects must be searched for, such as a cup and a mobile phone, an intuitive strategy is to first hypothesize likely search regions - [Understanding Spatial Language to Find Objects Faster](https://h2r.cs.brown.edu/understanding-spatial-language-to-find-objects-faster/) - Humans use spatial language to describe object locations and their relations. Consider the following scenario. A tourist is looking for an ice cream truck in an amusement park. She asks a passer-by and gets the reply "the ice cream truck is behind the ticket booth." The tourist looks at the amusement park map and locates - [Checklist for Paper Submissions](https://h2r.cs.brown.edu/checklist-for-paper-submissions/) - We all want our papers to be awesome. Here is the checklist I use before paper submission. Make sure there are no latex errors. Especially if you are using Overleaf, it will make a pdf even if your latex has errors, but it may not render the way you expect. If you are building on - [Understanding Adjectives](https://h2r.cs.brown.edu/understanding-adjectives/) - As robots grow increasingly capable of understanding and interacting with objects, it is important for non-expert users to be able to communicate with robots. One of the most sought after communication modalities is natural language, allowing users to verbally issue directives. We focus our work on natural language object retrieval---the task of finding and recovering - [How to Fix a Broken Robot](https://h2r.cs.brown.edu/how-to-fix-a-broken-robot/) - This post describes steps for fixing a robot that is broken. Since robots are computers, many of the steps also apply to fixing a broken phone, tablet or PC, although the details differ. Hardware The first step is to determine if the hardware itself is working. The hardware subsystems that most commonly fail are 1) - [Scanning the Internet for ROS](https://h2r.cs.brown.edu/scanning-the-internet-for-ros/) - Security is particularly important in robotics. A robot can sense the physical world using sensors, or directly change it with its actuators. Thus, it can leak sensitive information about its environment, or even cause physical harm if accessed by an unauthorized party. Existing work has assessed the state of industrial robot security and found a - [Learning Abstractions to Follow Commands](https://h2r.cs.brown.edu/learning-abstractions-to-follow-commands/) - Natural language allows us to create abstractions to be as specific about a task as needed, without providing trivial details. For example, when we give directions we mention salient places that contain information like traffic signals, or street corners or house colors, but we do not specify what gait a person must take, or how - [Writing a Research Statement for Graduate School and Fellowships](https://h2r.cs.brown.edu/writing-a-research-statement-for-graduate-school-and-fellowships/) - Writing a research statement happens many times throughout a research career. Often for the first time it happens when applying to Ph.D. programs or applying to fellowships. Later, you will be writing postdoc and faculty applications. These documents are challenging to write because they seek to capture your entire research career in one document that - [Writing a Technical Paper](https://h2r.cs.brown.edu/writing-a-technical-paper/) - This post describes my outline/structure for a technical paper. I have found a fairly specific structure works best for abstracts and introductions. For the other sections, I describe a process for writing them. Abstracts and Introductions The first sentence should be a general statement of the problem's importance. The second sentence should summarize the shortcomings - [POMDPS and Mixed Reality for Resolving References to Objects](https://h2r.cs.brown.edu/pomdps-and-mixed-reality-for-resolving-references-to-objects/) - Communicating human knowledge and intent to robots is essential for successful human-robot interaction (HRI). Failures in communication, and thus collaboration, occur when there is mismatch between two agents' mental states. Question-asking allows a robot to acquire information that targets its uncertainty, facilitating recovery from failure states. However, all question-asking modalities (natural language, eye-gaze, gestures, visual - [Action Oriented Semantic Maps](https://h2r.cs.brown.edu/action-oriented-semantic-maps/) - A long-term goal of robotics is designing robots intelligent enough to enter a person's home and perform daily chores for them. This requires the robot to learn specific behaviors and semantic information that can only be acquired after entering the home and interacting with the humans living there. For example, there may be a trinket - [Natural Language, Mixed Reality, and Drones](https://h2r.cs.brown.edu/natural-language-augmented-reality-and-drones/) - As drones become increasingly autonomous, it is imperative that designers create intuitive and flexible ways for untrained users to interact with these systems. A natural language interface is immediately accessible to non-technical users and does not require the user to use a touchscreen or radio control (RC). Current natural language interfaces require a predefinedmodel of - [Finding Objects with Verbs Instead of Nouns](https://h2r.cs.brown.edu/780-2/) - A key bottleneck in widespread deployment of robots in human-centric environments is the ability for non-expert users to communicate with robots. Natural language is one of the most popular communication modalities due to the familiarity and comfort it affords a majority of users. However, training a robot to understand open-ended natural language commands is challenging - [Robots that Use Language](https://h2r.cs.brown.edu/robots-that-use-language/) - With my wonderful collaborators Cynthia Matuszek, Hadas Kress-Gazit and Nakul Gopalan, we published a review paper about language and robots. This article surveys the use of natural language in robotics from a robotics point of view. To use human language, robots must map words to aspects of the physical world, mediated by the robot’s sensors - [Remote Teaching on a Time Budget](https://h2r.cs.brown.edu/remote-teaching-on-a-time-budget/) - Many of us are preparing to virtualize our classes in response to the COVID-19 outbreak that is spreading in the United States. I wanted to share my experiences teaching my Introduction to Robotics class with video lectures last semester. My motivation for doing online lectures last fall had nothing to do with the COVID-19 outbreak. - [Following Commands in Cities](https://h2r.cs.brown.edu/following-commands-in-cities/) - When a person visits a strange city, they can follow directions by finding landmarks in a map. For example, the can follow instructions like "Go to the Wegmans supermarket" by finding the supermarket in their map of the city. Autonomous systems on robots need the ability to understand natural language instructions referring to landmarks as - [How to Read a Paper](https://h2r.cs.brown.edu/how-to-read-a-paper/) - The only way to really understand a paper is to implement that paper. Obviously we don't have time or resources to do that for most of the papers we read. So most of the papers we read, we won't really understand. But that's okay! When reading a technical paper, it is important to first pay - [Robot Writing and Drawing](https://h2r.cs.brown.edu/robot-writing-and-drawing/) - Writing is a form of human linguistic expression, and Atsu Kotani has investigate this by creating a system to enable a robot to write. Atsu's work introduces an approach which enables manipulator robots to write handwrit ten characters or line drawings. Given an image of just-drawn handwritten characters, the robot infers a plan to replicate - [Advanced Autonomy on a Low-Cost Drone](https://h2r.cs.brown.edu/advanced-autonomy-on-a-low-cost-drone/) - We created a hardware and software framework for an autonomous aerial robot, in which all software for autonomy can run onboard the drone, implemented in Python. We present an Unscented Kalman Filter (UKF) for accurate state estimation. Next, we present an implementation of Monte Carlo (MC) Localization and FastSLAM for Simultaneous Localization and Mapping (SLAM). - [Tenure!](https://h2r.cs.brown.edu/tenure/) - I am proud to announce that I have been promoted to Associate Professor with Tenure. This milestone would not have been possible without the help and support from my wonderful students and collaborators, as well as my friends and family. This acknowledgement is an accolade to them as much as it is to me. Looking - [Abstract Product MDPs](https://h2r.cs.brown.edu/abstract-product-mdps/) - Natural language instructions issued to robots convey intent with multiple layers of spatial abstraction. These layers include high-level goals (“fly to the end of the street”), low-level specifications (“go ten meters south then ten meters east”), or a hybrid (“fly to the lamppost on Hex Street”). In addition, language can express constraints on reaching a - [Object Oriented POMDPs](https://h2r.cs.brown.edu/object-oriented-pomdps/) - The human mind does not see a visual scene as pixels; rather it is able to pick out objects of interest and selectively reason about them. Although object-based reasoning represents a core feature of human reasoning, only recently has it been possible to study in robotics due to advances in computer vision for segmentation and - [Raspberry Pi Python Drone](https://h2r.cs.brown.edu/raspberry-pi-python-drone-utra/) - Kevin Stacey and his team released a great article about progress in our drone project. I especially like the video! Thank you for a fantastic summer that included improved PID control, a working 3D Unscented Kalman Filter, and on-board, off-line SLAM, all on our little Raspberry Pi drone! We also received the fantastic news that - [Understanding Language about Sequences of Actions](https://h2r.cs.brown.edu/understanding-language-about-time/) - Many times, natural language commands issued to robots not only specify a particular target configuration or goal state but also outline constraints on how the robot goes about its execution. That is, the path taken to achieving some goal state is given equal importance to the goal state itself. One example of this could be - [Ode to AIBO](https://h2r.cs.brown.edu/ode-to-aibo/) - We are lucky enough to have a pack of AIBOs in our lab, leftover from Robocup days of old. My student John Oberlin resurrected them, and we use them as one of our outreach platform. Another student, Eric Rosen, just had a tutorial session teaching students how to use them for outreach. My AIBO, Ella, - [RSS Early Career Spotlight](https://h2r.cs.brown.edu/rss-early-career-spotlight/) - Stefanie gave an Early Career Spotlight talk at RSS 2018! She was introduced by her postdoctoral adviser, Nick Roy, and her talk covered many of the lab's recent accomplishments. - [Look What Santa Brought Us!](https://h2r.cs.brown.edu/look-what-santa-brought-us/) - We are excited to start playing with Kinova's MOVO Robot! It's a mobile telescoping base with two JACO arms. Here are some photos from the unboxing. Thanks to our PCTA friends for their unboxing help! - [Happy Thanksgiving!](https://h2r.cs.brown.edu/happy-thanksgiving/) - We would like to share this Thanksgiving Pie baked by Rebecca Pankow! - [Picking a Fork from Water](https://h2r.cs.brown.edu/picking-a-fork-from-water/) - This video demonstrates Baxter picking a metal fork from a sink filled with running water. The light field technology uses image averaging to mitigate the reflection of the light in the surface of the water - but the right kind of image averaging that exploits the robot's ability to move its camera to "refocus" the - [Screwing a Nut onto a Bolt with Vision](https://h2r.cs.brown.edu/picking-up-a-nut-and-bolt/) - Using light field methods, we can use Baxter's monocular camera to localize the metal 0.24' nut and corresponding bolt. The localization is precise enough to allow the robot to use the estimated poses to then perform an open-loop pick, place, and screw to put the nut on the bolt. The precise pose estimation enables complex - [Gingerbread Houses](https://h2r.cs.brown.edu/gingerbread-houses/) - We made two gingerbread houses and one gingerbread rocket ship at our holiday party! - [Check us out on NPR!](https://h2r.cs.brown.edu/check-us-out-on-npr/) - We were interviewed on All Things Considered! We talked about grasping, why it's hard, and what we plan to do about it. Also check out a video of baxter in action here - [Baxter Bowling!](https://h2r.cs.brown.edu/baxter-bowling/) - This summer, we had some great high school students work on projects involving our robots. Anisha Agarwal was one of those students. She built a bowling routine for Baxter. Here is here project! With the ability to pick and place objects comes a surprising amount of power. Picking up objects and placing them down is the - [NASA Early Career Faculty Award](https://h2r.cs.brown.edu/nasa-early-career-faculty-award/) - Stefanie won a NASA Early Career Faculty Award for Human-Robot Collaboration on Complex tasks! More information here. - [Amazon Echo + ROS + Baxter](https://h2r.cs.brown.edu/amazon-echo-ros-baxter/) - Hey! So here's a cool video of us using an Amazon Echo to control one of our Baxters. The Echo definitely outperforms our previous speech-to-text methods, and we like using it. If you're interested in finding out about how we did it, check the code here, or shoot me an email at david_whitney@brown.edu. - [Grippers On The Robot!](https://h2r.cs.brown.edu/grippers-on-the-robot/) - In more student work, our own Eric Rosen created a song and dance for our robots to better communicate with children. Check it out below! Understanding the basic capabilities of robots will be important for everyone when they are integrated into our every day lives. Without this knowledge, human-robot interactions will be poor not only - [Picking Petals From a Flower](https://h2r.cs.brown.edu/picking-petals-from-a-flower/) - Rebecca Pankow and John Oberlin programmed Baxter to pick petals off of a daisy during my graduate seminar last semester, Topics in Grounded Language for Robotics. The robot localizes the petal on the daisy using synthetic photography based on light fields, then plucks each petal off of the daisy. It looks for the largest open - [Keynote Talk at the Conference on Robot Learning!](https://h2r.cs.brown.edu/keynote-talk-at-the-conference-on-robot-learning/) - I gave a keynote talk yesterday at the Conference on Robot Learning. It is so exciting to see so much great work being presented at CORL! https://youtu.be/_9Ny2ghjwuY?t=17160 - [Happy Halloween!](https://h2r.cs.brown.edu/happy-halloween/) - [Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays](https://h2r.cs.brown.edu/communicating-robot-arm-motion-intent-through-mixed-reality-head-mounted-displays/) - When humans are collaborating together, they are constantly communicating their intents through body language and speech in order to arrive at a common understanding. Similarly, we would like to enable robots to be able to communicate their intents so that robots and humans can quickly converge to solving the same problem and avoid miscommunication issues. - [Comparing Robot Grasping Teleoperation across Desktop and Virtual Reality with ROS Reality](https://h2r.cs.brown.edu/comparing-robot-grasping-teleoperation-across-desktop-and-virtual-reality-with-ros-reality-show-abstract/) - There are many tasks that are too dangerous for humans to perform that would be better suited for a robot, such as defusing a bomb or repairing a nuclear reactor. Ideally, these robots would be autonomous, but currently, robots are not able to perform all tasks on their own yet. For robots to help with - [Robotic Overlords?](https://h2r.cs.brown.edu/robotic-overlords/) - Our group was featured in this New Yorker article, showcasing Rebecca Pankow and John Oberlin's work programming Baxter to pick petals from a daisy, as well as some of my thoughts on inequality and automation. I was thrilled with Sheelah's work on this very important issue, focusing on the effects of automation and our changing - [Reducing Errors in Object-Fetching Interactions through Social Feedback](https://h2r.cs.brown.edu/social-feedback-icra-2017/) - Humans communicating with other humans use a feedback loop that enables errors to be detected and fixed, increasing overall interaction success. We aim to enable robots to participate in this feedback loop so that they elicit additional information from the person when they are confused and use that information to resolve ambiguity and infer the person’s needs. This - [Initial Data from the Million Object Challenge](https://h2r.cs.brown.edu/initial-data-from-the-million-object-challenge/) - We are releasing a teaser data set of N objects for the Million Object Challenge. This data consists of objects mapped using Baxters at our site. We include objects from the YCB data set, as well as other objects arranged into several object categories. Download the data here: http://cs.brown.edu/~stefie10/mocTeaserData2016-02-22.tar.gz. The archive contains a stand-alone python - [We Won Rethink Robotics' Video Challenge!](https://h2r.cs.brown.edu/we-won-rethink-robotics-video-challenge/) - Our video took first place in Rethink Robotics' Video Competition! Check out the press release! Our video is available for viewing here: - [Wired Features Stefanie Tellex as Scientific Game-Changer](https://h2r.cs.brown.edu/wired-features-stefanie-tellex-as-scientific-game-changer/) - Wired interviewed Stefanie, and featured her in an article of women who changed science in 2015. Check it out! - [New Slashdot Article!](https://h2r.cs.brown.edu/new-slashdot-article/) - Slashdot wrote a little article about us! Neato! The title may be a bit inaccurate, but it does talk about a cool collaboration we have with Cornell, particularly our fellow roboticist Ashutosh Saxena. Check it out here! - [NERC 2015](https://h2r.cs.brown.edu/nerc-2015/) - We are excited to announce the 4th edition of NERC. It will be held on Saturday, November 7th at WPI. More details are at http://nerc.mit.edu. We have an exciting lineup of speakers including Leslie Kaelbling, Drew Bennett, and Sangbae Kim. It's hard to believe that NERC is four years old. It's not what I expected - [Announcing BurlapCraft](https://h2r.cs.brown.edu/announcing-burlapcraft/) - We are announcing the release of BurlapCraft 1.1. BurlapCraft is a mod for Minecraft that allows an autonomous agent to be controlled by BURLAP, the Brown-UMBC Reinforcement Learning and Planning Library. Performing experimental research on robotic platforms involves numerous practical complications, while studying collaborative interactions and efficiently collecting data from humans benefit from real time response. To - [Twin Operation](https://h2r.cs.brown.edu/twin-robots/) - On Friday we visited Rethink Robotics to install our software stack on their robots. They have agreed to help out with our scanning project. We calibrated three of the four arms; the fourth wrist camera had some kind of problem (perhaps hardware?) that led to an image that was too noisy to be useful. We - [Ducks in a Row](https://h2r.cs.brown.edu/ducks-in-a-row/) - Since we have quite a few Standard ICRA duckies, we thought it was important to get all of our ducks in a row: https://youtu.be/AXEM4jb690M - [Standard ICRA Duckies](https://h2r.cs.brown.edu/standard-icra-duckies/) - https://youtu.be/YWG2EdK3UyA?t=29 We were fortunate enough to receive several Standard ICRA Duckies at RSS. We used Baxter to pick them up and squeak them! - [Placing Mugs On Pedestals With Tell Me Dave](https://h2r.cs.brown.edu/placing-mugs-on-pedestals-with-robobrain/) - Robots engage in high level planning when executing real world tasks. We queried Tell Me Dave for a high level plan describing how to distribute three mugs among three tables. Since Baxter is not mobile, we simulated three tables by constructing three pedestals which rest inside of Baxter's work space. Here is a video showing - [Children and Robots](https://h2r.cs.brown.edu/children-and-robots/) - We like bringing kids and robots together, and we recently shot this video of Stefanie's son Jay interacting with Baxter: https://www.youtube.com/watch?v=M7jDpFGevE0 It's Jay's new favorite robot video! - [Setting the Table with YCB Objects](https://h2r.cs.brown.edu/setting-the-table-with-ycb-objects/) - We received a set of the YCB objects last week and decided to complete the Protocol and Benchmark for Table Setting. We attained a score of 10/24! See the video: https://youtu.be/Rk2IqhwOPSI Our approach was to use Baxter to autonomously collect visual models for the objects, annotate grasps, and then program the robot to move the objects - [Picking Snap Circuit Parts](https://h2r.cs.brown.edu/picking-snap-circuit-parts/) - Picking a snap circuit part. This model took about 15 minutes to acquire rgb and IR data using our Baxter. (The slow part is the IR scan.) We also had to annotate the default grasp point. It's automatically picking using the cameras to localize the object and then goes in to grasp. http://youtu.be/KI6fhJiiaIw We also - [MIT's Baxter running our pick and place stack!](https://h2r.cs.brown.edu/mits-baxter-running-our-pick-and-place-stack/) - We worked with Bianca Homberg and Mehmet Dogar from Daniela Rus's group to install our pick and place stack on their Baxter! We were all surprised at the differences between our robots, even though they are the "same" robot: the camera location, calibration parameters, gripper masks all needed to change. But once we had recalibrated - [Contrast Agents for Viewing Transparent Objects in IR](https://h2r.cs.brown.edu/contrast-agents-for-viewing-transparent-objects-in-ir/) - If an object is not visible in IR, sensors such as the Kinect or an IR range finder cannot see it. To address this problem we have developed a technique for applying a temporary contrast agent to image the object in IR. We scan the object with the contrast agent to obtain a high-quality depth - [Open-loop pick-and-place using Baxter and the Kinect 2](https://h2r.cs.brown.edu/open-loop-pick-and-place-using-baxter-and-the-kinect-2/) - We have integrated Baxter with the Kinect 2 using iai_kinect2. So far it seems to have higher latency than the Kinect 1, but higher resolution (so a larger workspace) and less calibration error. Overall picking is more accurate! The video shows four successful picks in a row. https://www.youtube.com/watch?v=xGJs5o_GuAA - [Voice-Commandable Robotic Helicopter](https://h2r.cs.brown.edu/voice-commandable-robotic-helicopter/) - We created an automous helicopter that accepts natural language commands. The helicopter infers appropriate actions and navigates to a requested location. https://www.youtube.com/watch?v=7nUq28utuGM - [Best Paper at RSS 2015!](https://h2r.cs.brown.edu/hello-world/) - Our paper on inverse semantics has won Best Paper at RSS 2015! - [Multimodal Bayes Filter](https://h2r.cs.brown.edu/multimodal-bayes-filter-video/) - We made a video of Baxter interpreting multimodal referring expressions using our multimodal Bayes filter. Our system interprets referring expressions in real time, outputting a distribution over objects at 14Hz. https://www.youtube.com/watch?v=ZFTUcHKc1YM ## Pages - [People](https://h2r.cs.brown.edu/people/) - [Substack](https://h2r.cs.brown.edu/substack-2/) - [Substack](https://h2r.cs.brown.edu/substack/) - Stefanie started a blog! David Watkins and Stefanie Tellex collaborated to write a book chapter for George Konidaris’ book Designing an Intelligence called Elphants Don't Write Sonnets. We believe that robotics is the grand challenge of AI, and we want to engage a broader audience in discussions about technology, safety, and what it takes to - [Joining the Lab](https://h2r.cs.brown.edu/joining-the-lab/) - First of all, we have a list of ongoing projects and research interests of people in our lab (you'll need a Brown account to access it), see if anything/anyone there interests you! Also, feel free to join in on our weekly meetings! Mail us for the Zoom links. Robotics Group Meeting (general & talk): Friday - [Publications](https://h2r.cs.brown.edu/publications/) - [bibtex file=h2r_publications.bib format=plain sort=year] - [Press](https://h2r.cs.brown.edu/press/) - The Serious Security Problem Looming Over Robotics, August 24, 2018. Retrieved at: https://www.wired.com/story/security-robotics/ Hordes of Research Robots Could be Hijacked for Fun and Sabotage, July 24, 2018. Retrieved at: https://www.technologyreview.com/s/611704/hordes-of-research-robots-could-be-hijacked-for-fun-and-sabotage/ Seeing the Mind of a Robot in Augmented Reality, June 4, 2018. Retrieved at: https://www.technologyreview.com/s/611296/seeing-the-mind-of-a-robot-in-augmented-reality/ This Robot Knows When It's Confused and Asks for Help, April 25, 2017. - [Videos](https://h2r.cs.brown.edu/videos/) - [Million Object Challenge](https://h2r.cs.brown.edu/million-object-challenge/) - Most robots can't pick up most objects most of the time. We aim to change that by using a Baxter robot to collect a corpus of manipulation experiences for one million real-world objects. The field of object detection and recognition is driven by annotated corpora (e.g., ImageNet) which researchers use to train and test models. These corpora consist of photos - [About](https://h2r.cs.brown.edu/about/) - We are at the cusp of a revolution in robotic technology that will fundamentally change how we live and work. Hospital robots will check on patients and report their status to nurses, saving time and improving patient outcomes. Childcare robots will help parents with chores such as assisting at diaper changing or feeding, so that ## Categories - [Uncategorized](https://h2r.cs.brown.edu/category/uncategorized/) - [Publication](https://h2r.cs.brown.edu/category/publication/) - [Demo](https://h2r.cs.brown.edu/category/demo/) - [Musings](https://h2r.cs.brown.edu/category/musings/) - [News](https://h2r.cs.brown.edu/category/news/) - [Writing](https://h2r.cs.brown.edu/category/writing/)