How Facebook uses public videos to train, deploy machine-learning models and harvest those eyeballs
(2021/03/13)
- Reference: 1615628472
- News link: https://www.theregister.co.uk/2021/03/13/in_brief_ai/
- Source link:
In brief Facebook this week revealed an internal project to create machine-learning models that can understand visual, audio, and written content from videos publicly uploaded to its social network.
One of the models, known as Generalized Data Transformations (GDT), is now used on Instagram. Users viewing short video recordings, or Reels, can quickly find other Reels they might like to watch, thanks to an AI-powered recommender system that picks similar clips that might be interesting.
[1]
For example, if someone on Instagram tends to watch videos of tractors, the GDT recommender system will highlight other videos of tractors. The model notices similar features; both videos will contain images of a vehicle with big wheels or the sound of an engine whirring away.
Facebook hopes that the project, Learning from Videos, will help the company build more useful AI tools, like searching for specific photos taken during a birthday party.
[2]
“Recalling memories in this way requires teaching systems how to match the phrase “happy birthday” to cakes, candles, people singing various birthday songs, and more,” it [3]explained this week.
Earlier this week Facebook [4]announced a similar plan for facial recognition, using Instagram data. Don't blame Zuckerberg, you signed up for it.
Activists tell machine-learning community to turn down jobs from Google
Googlers appalled by the [5]ousting of the two leaders of the web giant's Ethical AI unit have urged the members of the machine-learning community to turn down job offers at the super-corp, and for academic conferences to decline funding from the company.
Timnit Gebru and Margaret Mitchell were expelled from Google after they pushed back on management, who had asked them to remove their names from a paper scrutinizing the social and environmental impact of large language models, like the ones used by Google.
“Therefore, we call on members of the AI community, especially those who make their careers researching the social and ethical consequences of tech, to take the following actions in solidarity with the Ethical AI team,” the group, Google Walkout for Real Change, wrote on Medium.
It urged researchers to not cooperate with Google’s recruitment teams, and to not allow the biz to sponsor academic conferences or for organizers to accept any type of funding. You can read the post in full [6]here .
New AI toolkit to help scientists unpack the genomes of rare types of cells
Researchers at Nvidia and Harvard University have built software to help sequence the DNA of cells and help geneticists study the causes of some diseases.
The toolkit, named AtacWorks, was described in a paper published in Nature Communications, this week. Essentially, it takes messy computational data describing the overall epigenetic profiles from cell sequencing experiments and cleans it up to predict its genome.
“AtacWorks both denoises sequencing data and identifies areas with accessible DNA, and can run inference on a whole genome in just half an hour with NVIDIA Tensor Core GPUs,” [7]according to an Nvidia blog post.
The software is most useful for rare cell types, where scientists haven’t been able to sequence as many of them as they’d like in their experiments. “With AtacWorks, we’re able to conduct single-cell experiments that would typically require 10 times as many cells,” said Jason Buenrostro, co-author of the paper and an assistant professor at Harvard University.
[8]
AtacWorks is available to use [9]here . ®
Get our [10]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[3] https://ai.facebook.com/blog/learning-from-videos-to-understand-the-world
[4] https://www.theregister.com/2021/03/06/facebook_ai_instagram/
[5] https://www.theregister.com/2021/02/22/in_brief_ai/
[6] https://googlewalkout.medium.com/the-future-must-be-ethical-makeaiethical-9eb3edd7cf3c
[7] https://blogs.nvidia.com/blog/2021/03/08/atacworks-genomics-ai-research/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[9] https://ngc.nvidia.com/catalog/resources/nvidia:atacworks
[10] https://whitepapers.theregister.com/
One of the models, known as Generalized Data Transformations (GDT), is now used on Instagram. Users viewing short video recordings, or Reels, can quickly find other Reels they might like to watch, thanks to an AI-powered recommender system that picks similar clips that might be interesting.
[1]
For example, if someone on Instagram tends to watch videos of tractors, the GDT recommender system will highlight other videos of tractors. The model notices similar features; both videos will contain images of a vehicle with big wheels or the sound of an engine whirring away.
Facebook hopes that the project, Learning from Videos, will help the company build more useful AI tools, like searching for specific photos taken during a birthday party.
[2]
“Recalling memories in this way requires teaching systems how to match the phrase “happy birthday” to cakes, candles, people singing various birthday songs, and more,” it [3]explained this week.
Earlier this week Facebook [4]announced a similar plan for facial recognition, using Instagram data. Don't blame Zuckerberg, you signed up for it.
Activists tell machine-learning community to turn down jobs from Google
Googlers appalled by the [5]ousting of the two leaders of the web giant's Ethical AI unit have urged the members of the machine-learning community to turn down job offers at the super-corp, and for academic conferences to decline funding from the company.
Timnit Gebru and Margaret Mitchell were expelled from Google after they pushed back on management, who had asked them to remove their names from a paper scrutinizing the social and environmental impact of large language models, like the ones used by Google.
“Therefore, we call on members of the AI community, especially those who make their careers researching the social and ethical consequences of tech, to take the following actions in solidarity with the Ethical AI team,” the group, Google Walkout for Real Change, wrote on Medium.
It urged researchers to not cooperate with Google’s recruitment teams, and to not allow the biz to sponsor academic conferences or for organizers to accept any type of funding. You can read the post in full [6]here .
New AI toolkit to help scientists unpack the genomes of rare types of cells
Researchers at Nvidia and Harvard University have built software to help sequence the DNA of cells and help geneticists study the causes of some diseases.
The toolkit, named AtacWorks, was described in a paper published in Nature Communications, this week. Essentially, it takes messy computational data describing the overall epigenetic profiles from cell sequencing experiments and cleans it up to predict its genome.
“AtacWorks both denoises sequencing data and identifies areas with accessible DNA, and can run inference on a whole genome in just half an hour with NVIDIA Tensor Core GPUs,” [7]according to an Nvidia blog post.
The software is most useful for rare cell types, where scientists haven’t been able to sequence as many of them as they’d like in their experiments. “With AtacWorks, we’re able to conduct single-cell experiments that would typically require 10 times as many cells,” said Jason Buenrostro, co-author of the paper and an assistant professor at Harvard University.
[8]
AtacWorks is available to use [9]here . ®
Get our [10]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[3] https://ai.facebook.com/blog/learning-from-videos-to-understand-the-world
[4] https://www.theregister.com/2021/03/06/facebook_ai_instagram/
[5] https://www.theregister.com/2021/02/22/in_brief_ai/
[6] https://googlewalkout.medium.com/the-future-must-be-ethical-makeaiethical-9eb3edd7cf3c
[7] https://blogs.nvidia.com/blog/2021/03/08/atacworks-genomics-ai-research/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YEybSBLBMnJo67VjgDW6ZQAAAAI&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[9] https://ngc.nvidia.com/catalog/resources/nvidia:atacworks
[10] https://whitepapers.theregister.com/
"videos of tractors"
DJV
Wooo! Tractor porn - can't get enough of it!
It's a world wide web, not your local pub.
'Public' means public. Use the privacy options if you don't want something to be public, your tweets to go viral, or your photos recycled as memes. Or someone to train their terminators on your stuff.
I'm amazed that people broadcast their views and post their photos on social media and forums and then complain that folk hurl abuse at them. The internet is not your lounge or your local pub. It's a big world out there. A percentage of people will disagree with absolutely anything you say, and a percentage of them will be rude, aggressive, racist, misogynist and quite nasty. A small percentage of a very large number is a lot of people and a lot of negative comments/hate. I've had endless amounts of abuse over the years. At first it gets to you, but after a while you get used to it. It's a learning process. We are acclimatising to the internet. All new tech requires that. Print, radio, TV and now the net. The solution is not to pick those who have a bad experience out of the crowd, magnify it, and then exploit it, as governments do, as an excuse for censorship. 'Public' means public. Understand that. It's not a tech problem but a human nature problem.
Google are making a rod for their own backs with the arrogant, petty attitude of some senior staff. Having enough lawyers to squash and silence staff or competitors may be the American way of business, but it gives governments their point of leverage. Big tech does not appear to understand that governments have been taking down the competition for centuries and are rather good at it. These are people who can turn them off, regulate them out of existence, use them as a revenue stream via fines and taxes, or recycle them as an outsourced provider of a surveillance state infrastructure. Big tech's arrogant and unethical behaviour is a free gift to the people they should really fear.