Grammarly’s “Expert Reviews” feature offers users “inspired” writing advice from subject matter experts, including recently departed professors. wired Reported on Wednesday. When I tried this feature myself, I found a few experts who were surprised for a different reason — one of them was my boss.
The AI-generated feedback included comments that appeared to The VergeThe editor-in-chief, Nilay Patel, as well as editor-at-large David Pierce and senior editors Sean Hollister and Tom Warren, none of whom gave Grammarly permission to include them in “expert reviews”.
The feature, which launched in August, claims to help you “sharpen your message through the lens of an industry-relevant perspective.” When users select the “Expert Reviews” button in the Grammarly sidebar, it analyzes their writing and brings up “inspired” AI-generated suggestions from relevant experts. Those “industry-relevant perspectives” include people like Stephen King, Neil deGrasse Tyson, and Carl Sagan, among many others.
The Verge Several other technology journalists were also found named in the feature, including former the verge Editors Casey Newton and Joanna Stern, East the verge Writer Monica Chin, wiredLauren Good, bloombergMark Gurman and Jason Schreiber, new York Times’ kashmir hill, atlanticCaitlin Tiffany, pc gamerWes Fenlon, gizmodoRaymond Wong, digital foundry Founder Richard Leadbetter, tom’s guide Editor-in-Chief Mark Spoonauer, former Rock Paper Shotgun Editor-in-Chief Katherine Castle, and former ign News Director Kat Bailey. There are inaccuracies in the descriptions of some experts, such as old job titles, which could have been updated accurately if Superhuman had asked those people for permission to reference their work.
in a statement to The VergeAlex Gay, vice president of product and corporate marketing at Grammarly parent company Superhuman, commented: “The Expert Review Agent does not claim endorsement or direct involvement from those experts; it provides suggestions inspired by the experts’ works and points users toward influential voices whose scholarship they can explore in more depth.”
Asked whether Superhuman had considered notifying the people named in its AI feature or requesting their permission, Gay said, “Experts appear to be experts in expert reviews because their published work is publicly available and widely cited.”
However, the experts’ task to “explore more deeply” proved difficult. The feature crashes frequently and its “sources” are linked to spammed copies of legitimate websites, or other archived copies that are not the actual source pages.
“Experts are present in peer review because their published work is publicly available and widely cited.”
Some sources also went to completely unrelated links that were not written by the person whose work they were supposedly an example of, potentially indicating that the suggestions Grammarly’s AI makes with a person’s name may be based on a different person’s work. This only becomes apparent when users click “See more” to expand the suggestions, then click the “Sources” button at the end of the suggestion.
Additionally, the way suggestions are presented can be confusing. In Google Docs, suggestions look very similar to comments from real users, appearing to mimic the AI experience of getting edits from whatever expert it is. A suggestion “inspired” by Grammarly’s AI the verge Senior editor Sean Hollister was about to add a parenthesis with a reference that was already included elsewhere. The only problem is that I find it’s actually edited by the real Shawn Hollister, who prefers to avoid repetition or unnecessary explanations, using straightforward words and organization.
If I had taken that advice and run with it, the real Shawn probably would have removed the parentheses as suggested by Grammarly. An AI might be able to take in large amounts of someone’s writing and learn to copy it, sure, but the same strategy can’t teach an AI how to edit that person based solely on the writing they’ve published, even if you give the bot a check mark logo and call it an “expert.”
<a href