Sertac Karaman on the Future of Autonomous Robots: Flying, Driving, Simulation, and Societal Impact

The conversation with Sertac Karaman, a leading roboticist and co-founder of Optimus Ride, delves into the complexities of autonomous flying versus autonomous driving. Karaman argues that while consumer drones are initially easier, achieving large-scale deployment for transportation and logistics makes autonomous flying significantly harder than driving. The core challenge for both lies in integrating autonomous vehicles into human-present environments at high densities, where human interaction and societal acceptance become paramount. He emphasizes that current robotic deployments are largely confined to isolated or non-human-interactive settings, making the transition to shared spaces a monumental task. A crucial distinction is made between the "agile airspace" (too high for a stone, too low for large aircraft) as an underutilized opportunity for flying vehicles, and the ground-based environment for cars. Karaman highlights the role of simulation, not just for training but for development, noting advancements in camera simulation (exteroceptive sensors) but stressing the immense difficulty in accurately simulating complex human behavior. He also differentiates between Waymo's cautious, research-driven approach to building a fundamental "AI engine" and Tesla's more aggressive, product-focused strategy, which leverages consumer demand for automation features and the visionary appeal of Elon Musk. The discussion underscores the need for an "informed public" to make choices regarding the risks and benefits of autonomous technology. For developers, it implies moving beyond just localization and perception to effectively predict human behavior and incorporate game-theoretic considerations into robot decision-making. Robots must not only be intelligent but also understand and respond to human interaction, which can range from civil to "abusive" when the robot is perceived as a mere "thing." This necessitates a shift in design philosophy to account for social dynamics. The deployment of autonomous vehicles at scale forces explicit societal trade-offs between efficiency (e.g., reduced delays, increased capacity) and sustainability (e.g., livability, energy consumption). Aggressive robot behavior might boost efficiency but reduce livability, while a "nicer" approach might have the opposite effect. These ethical and urban planning considerations, alongside business model evolution and regulatory frameworks, are becoming central to autonomous vehicle development, moving beyond purely technological challenges to encompass profound societal questions about how we want to live and interact with intelligent machines.

"I think that autonomous flying just kind of doing it for consumer drones and so on the kinds of applications that we're looking at right now is probably easier... but I think if we look ahead I would think that you know the real benefits of autonomous flying unleashing them in like transportation logistics and so on I think it's a lot harder than autonomous driving."

"I think that the real challenge of our time is to take these vehicles and put them into places where humans are present."

"I would bet that that kind of density will first happen with autonomous cars because I think you know we can ban the environment a little bit... when they're in the air it's a little bit more complicated."

"Imagine the airspace that's high enough so that you cannot throw a stone but it is low enough that you're not interacting with the with the very large aircraft that are you know flying several thousand feet above and that airspace is underutilized or it's actually kind of not utilized at all."

"Machine learning will be key to these guys to delivering safe vehicles in the future especially not maybe the safe part but I think the intelligent part."

"The next challenge I think in simulation will be to simulate human behavior that's also extremely hard."

"When it's a human there's all kinds of ways of interacting with a human... but the thing is that like for example you and I might interact through YouTube comments and you know the conversation may go a totally different angle and so I think people kind of abusing these autonomous vehicles is a real issue in some sense."

"We can design systems in a way that they're very efficient or we can design them that they're very sustainable but ultimately the sustainability efficiency trade-offs like they're gonna be right in there we're gonna have to make some choices."

"I think the key is for people to be informed and so that they can ideally they can make a choice."

"Waymo... they realize that we're building like a new engine it's kind of like call it the AI engine or whatever that is and you know an autonomous vehicles is a very interesting embodiment of that engine."

"Tesla is doing something interesting... people pay for it and it's it's your home it's basic you know demand supply market and people like it they're happy to pay another 5k 10k for that novelty or whatever that is."