With that caveat, Gilardi said for the types of tasks studied, ChatGPT looks like it can replace crowdsourced workers, which is apt because certainly models like it are trained on crowdsourced human-annotated data. And there may be scenarios in which human annotators can be more productive with the help of a model like ChatGPT, he suggested. Gilardi said it's important to gather more data using different tasks, types of data, and languages, and added that MTurkers perform other jobs like survey research, image annotation, audio and video transcription, usability testing. "Our paper demonstrates ChatGPT’s potential for data annotation tasks, but more research is needed to fully understand ChatGPT’s capacities in this area." "It is too early to say how ChatGPT might replace crowd-workers," said Gilardi in a statement emailed to The Register. In all, the research results appear to be game over for human workers keen on securing this sort of work.īut Gilardi warned against reading the findings too broadly. OpenAI rolls out ChatGPT plugins, granting iffy language model access to your apps.Here's how that worked for software security scanner Socket So you want to integrate OpenAI's bot.FTC urged to freeze OpenAI's 'biased, deceptive' GPT-4.In the battle between Microsoft and Google, LLM is the weapon too deadly to use.Fabrizio Gilardi, a professor of policy analysis in the political science department of the University of Zurich and one of the paper's co-authors, told The Register in an email that ChatGPT's results were less than 50 percent accurate in some tasks, but that was still better than MTurkers. More accurate in this instance is not very accurate.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |