Facebook reveal a research project called Ego4D, in partnership with 13 universities, that uses 1st-person video to improve AI perception.
As part of its push into AR, Facebook is working on AI that will analyze peoples' lives using first-person video, recording what they see, do, and hear in order to help them with everyday tasks. Facebook's researchers outlined skills it wants these systems to develop, including "episodic memory" (answering questions like "where did I leave my keys?") and "audio-visual diarization" (remembering who said what when). Link