机器人书写它从未见过的语言
Robot writes in languages it has never seen before (2019)

原始链接: https://www.wired.com/story/robot-writing/

布朗大学的研究人员开发出一种机器人系统,在仅通过日语字符训练后,便能复刻复杂的笔迹与绘图。该系统利用一套两部分算法——一个是负责管理单个笔画的“局部”模型,另一个是决定这些笔画顺序的“全局”模型。通过这种方式,机器人学习的是书写的本质机理,而非仅仅模仿像素图案。 这种方法使得机器人能够成功转录其从未接触过的语言,包括印地语、希腊语和英语,涵盖印刷体与连笔书写。该系统的通用性已达到相当先进的水平,它不仅能精准复刻六岁儿童那种颤抖且不稳定的笔迹,甚至还能临摹《蒙娜丽莎》。通过学习人类运动和笔顺的“算法”,该机器人证明了曾经作为人类独特技能的创意手工书写,正日益成为机器智能触手可及的能力。

Hacker News 最新 | 往期 | 评论 | 提问 | 展示 | 招聘 | 提交 登录 机器人以从未见过的语言进行书写 (wired.com) 3 点,由 euanming 发布于 1 小时前 | 隐藏 | 往期 | 收藏 | 1 条评论 帮助 yorwba 21 分钟前 [–] (2019) 论文页面: https://www.atsunobukotani.com/robotdrawing 回复 指导原则 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:
相关文章

原文

Among the many things we humans like to lord over the rest of the animal kingdom is our complex language. Sure, other creatures talk to one another, but we’ve got all these wildly complicated written languages with syntax and fun words like defenestrate. This we can also lord over robots, who, in addition to lacking emotion and the ability to not fall on their faces, can’t write novels.

At least not yet. Researchers at Brown University just got a robot to do something as linguistically improbable as it is beautiful: After training to hand-write Japanese characters, the robot then turned around and started to copy words in a slew of other languages it’d never written before, including Hindi, Greek, and English, just by looking at examples of that handwriting. Not only that, it could do English in print and cursive. Oh, and then it copied a drawing of the Mona Lisa on its own for good measure.

Like walking on two legs, handwriting is one of those seemingly simple human charms that is in fact elaborate. When you write a word, you have to know where to put down your pen, how long to draw a line and in which direction, then pick up your pen, sometimes mid-letter (like with a capital A), and know where to put it down again.

So to get a kid to write, you can’t just show them a sample and set them loose—you have to give them instructions on how to form each letter. “They give you these little algorithms for what strokes to do and what order to put them in to make the character,” says Brown University roboticist Stefanie Tellex, who developed the system with Atsunobu Kotani, also at Brown. “And that's what our algorithm is learning to do.”

Their learning system is split into two distinct models. A “local” model is in charge of what’s going on with the current stroke of the pen—so aiming in the right direction and determining how to end the stroke. And a “global” model is in charge of moving the robot’s writing utensil to the next stroke of the character.

To train the robot, the researchers fed it a corpus of Japanese characters, and provided information about how the component strokes of a character are supposed to work. “From that, it basically learns a model that looks at pixels of the image and predicts where it needs to go to start the next stroke, and then where it needs to move while it’s drawing the stroke to reproduce the image,” Tellex says.

Then they decided to try to confuse the hell out of the robot by writing hello on a whiteboard in Hindi and Tamil and Yiddish—all of which use unique scripts. Incredibly, the robot could eyeball each with machine vision and write its own copies of the words, even though it only ever trained to write Japanese. Also, they showed it English cursive in addition to print, and it handled both fine.

Then a gaggle of kindergarteners visited Tellex’s lab. Surely, the robot couldn’t recognize and replicate their … suboptimal handwriting? Yeah, it copycatted them with ease. “Just to watch it reproduce the somewhat wobbly writing of these little 6-year-olds, it was just incredible, having never seen that before and never trained on that,” Tellex says.

联系我们 contact @ memedata.com