Facebook Wants Its AR Glasses to Offer Superhearing to the Wearer.

A new Facebook experiment reveals how sound could play a key role in augmented reality. Chief scientist Michael Abrash and his team at FRL Research (formerly Facebook Reality Labs) published information today about what the group calls “ perceptual superpowers ” — AR devices that find out what you're trying to hear, then enhance it and dampen background noise. In conjunction with spatial audio features, the interface produces an aural equivalent of a hologram overlay in a pair of glasses.

For years, Facebook has been pursuing high-quality virtual sound, primarily through its Oculus virtual reality headsets. FRL Research's new work focuses on applications for AR. For example, "imagine being able to hold a conversation in a crowded restaurant or bar without having to lift your voice to be understood or strained to understand what others are saying," the company explains.

AR glasses could do this by collecting audio with microphones, using contextual clues to gage which sounds are significant, and feeding those sounds through a noise-canceling earpiece. Conversely, if you're on a phone or conference call, enhanced spatial sound might project participants' voices or other audio to specific areas of the room, enhancing the feeling that you're actually with someone else—or "audio presence" in FRL Research's words.

As Facebook admits, the "perceptual superpowers" pitch of the lab is somewhat close to the features of current hearing aids, enhancing sound and reducing background noise. (In fact, one experimental device uses brain implants to concentrate on individual voices.)

However, AR glasses provide unique opportunities for people with and without hearing difficulties. Directional sensors and outward-facing or eye-tracking cameras may collect detailed contextual information, including your body orientation and where your gaze is focused. This allows the earpieces to find an "acoustic spotlight" to intensify. And, of course, the AR system can combine its sound landscape with the amplified audio.

Facebook may also supplement the scheme with other AR initiatives. LiveMaps, for example, aims to create rich maps full of knowledge about people's surroundings. If LiveMaps detects that someone is wearing glasses in a restaurant, the glasses could automatically flag and cancel the clinking of the silverware sounds.

Facebook posted a photo of a prototype in-ear monitor on the dummy's head, as well as an image of team members wearing headphones that look more like Valve's off-ear Index speakers. The Oculus Quest VR headset uses guided speakers, a comfortable one-size-fits-all solution for projecting sound into the environment. Nevertheless, leakage sound to bystanders — while in-ear monitors may be better suited for adjusting overall sound levels while wearing AR glasses in public. "What type factor to use to solve a problem essentially depends on the application," says FRL Research Audio Chief Ravish Mehra.

Other companies have experimented with an aural increase — most notably Bose, which unveiled audio-only AR glasses in 2018. Bose's glasses used space sensors to sense where the wearers were looking and deliver features such as virtual street tours. However, the company struggled to make them economically viable, and this June, it abandoned the project.

Unlike in previous years, Facebook doesn't hold conferences to show off new technologies in 2020, so we haven't heard the audio in person. FRL Research provided reporters with a demonstration of their filtering mechanism on a remote call. And any spatial audio enhancements could soon be added to VR headsets, including a reported redesign of Oculus Quest during this month's Facebook Connect meeting. "The work we're doing and the work we've discussed today certainly have applications for our VR line of products," Mehra says.

The complete implementation of these capabilities could be years away. We don't know anything about Facebook's User AR Glass Roadmap, even though we're increasingly learning more about what the organization feels they can do. A few pictures display plastic lenses, but they are designed to carry the microphone array, not to function as full-length glasses. Facebook has previously said that several prototype variants have been developed, including a recent combined AR / VR headset concept that looks like a pair of sunglasses.

To market a real commercial product, Facebook would need to allay fears that go beyond technological considerations. This involves persuading people that "perceptual superpowers" do not pose a danger to privacy.

Without limitations, sufficiently robust microphones and filtering technologies could allow people to listen to conversations in public spaces imperceptibly. AI audio analysis poses far stranger and more disturbing possibilities, such as the ability to flag individual voices or conversation keywords in a crowded room. (It may also potentially perform more harmless, beneficial tasks such as real-time translation.) And, of course, the glasses will also record your conversations.

There is no suggestion that FRL Research is contemplating intentional surveillance. But many people still fear — probably incorrectly — that Facebook apps will record them to target advertising. That is why the mere possibility could scare consumers. FRL Research says that the audio recorded is encrypted and stored on servers that a limited number of researchers can access.

Abrash says that Facebook is trying to create privacy on all aspects of its glass architecture, repeating its overall AR / VR plans. Among other items, the device might ask for permission from someone else's glasses before amplifying a conversation, or it might have a restricted range."Instead of thinking of this as a magic flashlight, we can point to someone and hear what they're saying, think about it more like people can take part in the discussion they're in any way," he told reporters.

And for now, Abrash says, the tiny microphone arrays aren't powerful enough to handle long-range espionage. "If you ever see someone walking with glasses that are two feet wide," he warned, "you should be suspicious."

99 comments

  1. slonned
  2. slonned
  3. Jrepgn

    Mrhszq - top rated ed pills Qmqlhc

  4. Wskihn

    mens ed pills - best ed pills on the market ed treatment pills

  5. Ezqrkr

    where to buy prednisone tablets - prednisone no script prednisone 5 mg cheapest

  6. Vouivs

    generic modafinil - modafinil for sale provigil for adhd

  7. Xmvpmb

    accutane medication price - buy accutane 20mg accutane cream for sale

  8. Yjiimh

    buy amoxicillina 500 mg from mexico - amoxicillin without dr script can you buy amoxicillin over the counter

  9. Krakbu

    where to buy vardenafil over the counter - generic vardenafil canada pharmacy order levitra

  10. Rloevl

    ivermectin pills for humans - ivermectin cost canada ivermectin 9 mg

  11. Qyucqg

    cialis 50mg - how to get generic cialis canada rx pharmacy world

  12. Naqhyi

    ivermectin 3mg tablets - stromectol for humans for sale price of ivermectin

  13. Qijjrb

    buy accutane 10mg online - accutane 10mg for sale isotretinoin 20mg

  14. Tohygc

    lyrica 75 - canadian pharmacy ratings my canadian pharmacy

  15. Mfybbf

    where to buy amoxicillin 500 mg - amoxpharm where to buy amoxicilin 500 mg

  16. Erunos

    sildenafil tablets for sale - where to buy female viagra pill viagra mexico pharmacy

  17. Ghtgbt

    buy cialis daily online - how to buy cialis tadalafil citrate

  18. Rmqotp

    ivermectin 0.5 lotion - stromectol ivermectin tablets ivermectin over the counter uk

  19. Zqlcdc

    prednisone 5mg coupon - daily prednisone deltasone otc

  20. Rhwmlf

    modafinil reviews - modafinil and weight loss provigil for adhd

  21. Skhjqs

    order zithromax 500mg - generic azithromycin 500mg buy azithromycin 100mg

  22. Williamsmesk

    free chat online singles
    [url="http://onlinedatinglook.com/?"]definition of dating[/url]

  23. Yklptm

    furosemide purchase - furosemide 40 mg tablet price furosemide 20 mg coupon

  24. Boonup

    clomid 50 mg - clomiphene online clomid 100mg

  25. Dkhqnb

    uk viagra buy - viagra mexico over the counter buy viagra uk

  26. Mgmsrs

    cialis cheap fast delivery - cialis generic 5mg cialis buy online india

  27. KevinLig

    gay dating katy tx
    gay guys dating tips
    [url="http://gaydatingzz.com?"]hilarious gay online dating[/url]

  28. Neeefc

    ivermectin 3mg tablets price - ivermectin 4 stromectol 0.1

  29. Rsmqns

    red dog casino - casino moons online casino slots real money

  30. KevinLig

    arab gay dating site
    gay dating sites silver
    [url="http://gaydatingzz.com?"]disco gay dating site reviews[/url]

  31. Ofxgxp

    pills for erectile dysfunction - erectile dysfunction test walgreens ed pills

  32. Zuqtwp

    order prednisone on line - prednisone cream otc prednisone 1 mg price

  33. KevinLig

    free dating gay daddy bear
    gay dating sites for teenagers
    [url="http://gaychatrooms.org?"]gay muslim dating london[/url]

  34. Nqxwie

    can i buy viagra online without a prescription - sildenafil tablet 200mg buy online viagra tablet

  35. Klqxxe

    cialis online usa - Cialis online ordering cialis online with paypal

  36. KevinLig

    gay speed dating in nyc
    gay dating norfolk va
    [url="http://gaychatus.com?"]gay hiv dating site[/url]

  37. Nhohdt

    buy stromectol europe - stromectol ivermectin ivermectin oral solution

  38. Jqniec

    ed pills online - best pill for ed best otc ed pills

  39. Qakniw

    ventolin price - ventolin inhalers ventolin generic brand

  40. Pnnztm

    where can you buy cytotec - cytotec cytotec for sale online

  41. Uxbgvh

    doxycycline 200 mg - can i buy doxycycline over the counter in south africa doxycycline 1000 mg best buy

  42. Ozkuzc

    neurontin online usa - synthroid capsules synthroid cheapest prices

  43. Uquerc

    canadian pharmacy viagra 200 mg - 5343 viagra

  44. Morris

    For the reason that the admin of web hosting this website is working, no doubt very shortly it will be renowned, due to its quality contents.

  45. Viagra

    Kamagra Zollprobleme

  46. buy 5mg propecia in the uk

    Zithromax Official Website

  47. buy stromectol online no prescription

    Online Kamagra Jelly

  48. Rqelen

    discount generic cialis canada - cheap cialis pills online cialis eli lilly

  49. Neva

    hi!,I like your writing very so much! percentage we communicate extra
    about your article on AOL? I need an expert in this house to resolve
    my problem. May be that's you! Looking forward to peer you.

    Feel free to visit my webpage: the quest bars,
    bit.ly,

  50. Ewyoiu

    vardenafil online reviews - vardenafil going generic vardenafil 5 mg

  51. Maroweawl
  52. NoffAnend
  53. Oscineded
  54. Tosha

    Pretty! This has been an incredibly wonderful article.
    Thanks for supplying these details.

    My website - quest bars but (http://j.mp/)

  55. sefeanaps
  56. buy cheap generic cialis online

    Cialis 20 Ou 40

  57. Sqrvri

    ivermectin lotion - ivermectin 3 mg dose stromectol 6 mg dosage

  58. Marlene

    Very good website you have here but I was wondering if you knew of
    any forums that cover the same topics discussed in this article?
    I'd really like to be a part of group where I can get advice from other experienced people that share the same interest.

    If you have any suggestions, please let me know.
    Cheers!

    My web-site - are scoliosis surgery

  59. Romaine

    For hottest news you have to pay a visit internet and
    on web I found this site as a finest site for most up-to-date updates.

    Here is my webpage :: in asmr

  60. PatrickSix

    decent gay dating sites
    dayton gay dating scene
    [url="http://freegaychatnew.com?"]online sites rated gay dating[/url]

  61. Reagan

    You really make it appear really easy asmr with your presentation however I to find this topic
    to be actually something which I feel I'd by no means understand.
    It kind of feels too complex and extremely broad for me.
    I'm looking forward on your next submit, I will attempt to
    get the grasp of it!

  62. Kkfern

    cheap accutane online - accutane buy online usa buy cheap accutane online

  63. Brendan

    Hey There. I found your weblog using msn. That is a really smartly written article.
    I'll make sure to bookmark it and return to learn extra of asmr your useful info.

    Thanks for the post. I will definitely comeback.

  64. Peaxur
  65. PatrickSix

    gay and tired of dating
    ba gay dating site
    [url="http://freegaychatnew.com?"]gay dating simulation game[/url]

  66. Jack

    hello!,I love your writing so much! share we communicate more approximately your post on AOL?
    I require a specialist on this house to resolve my problem.
    May be that's you! Taking a look forward to see you.

    Here is my webpage where asmr

  67. viagra and diabetes

    Prix Du Viagra Generique

  68. Peggy

    Good post. I learn something new and challenging on sites I stumbleupon every day.

    It will always be useful to read content from other writers and use a little something
    from other sites.

    My website; scoliosis surgery the

  69. traitly
  70. Wivkli

    medrol tablet 8 mg - generic methylprednisolone lyrica medicine cost

  71. Michaelnix

    gay canada dating site
    gay singles dating site
    [url="dating-gaym.com?"]wisconsin gay dating[/url]

  72. Clktxt

    reputable canadian pharmacy - Buy cialis now reputable online pharmacy no prescription

  73. Henrybrura

    gay girls dating sites
    gay fish dating
    [url="http://dating-gaym.com?"]gay man dating services[/url]

  74. poidayrap
  75. Titismles
  76. Ourasz

    ivermectin 15 mg - stromectol over the counter uk ivermectin generic name

  77. Mdxpci

    prednisone 40mg pills - prednisone 20mg online prednisone uk buy

  78. Yljryg

    furosemide 40mg cost - buy lasix online paypal lasix 240 mg

  79. Henrybrura

    gay dating minnesota
    top worldwide gay dating sites
    [url="http://gay-singles-dating.com/?"]indian gay dating[/url]

  80. Ycmall

    ipratropium albuterol - ventolin cost australia ventolin generic brand

  81. azithromycin online

    Fastest Delivery Of Antabuse

  82. priligy for pe

    Viagra Acheter Forum

  83. Dfdaib

    where can i get cytotec pills over the counter - buy cytotec online uk where can i buy cytotec online

  84. FrauffLup
  85. CoahPhoda

    https://buyplaquenilcv.com/ - hydroxychloroquine uses

  86. order plaquenil online

    Cheap Generic Drugs From India

  87. Nkwvwn

    doxycycline pills online - doxycycline 25mg tablets prednisolone sod

  88. Axiotolal

    http://buyzithromaxinf.com/ - zithromax online pharmacy

  89. suepext

    https://buylasixshop.com/ - hydrochlorothiazide vs lasix

  90. Zfzlge

    stromectol ivermectin buy - ivermectin human stromectol price uk

  91. Viybki

    sildenafil online - sildepl cheapest sildenafil

  92. side effects of furosemide 40 mg

    Buy Generic Viagra India

  93. Aagona

    tadalafil coupon - tadalapills.com generic tadalafil reviews

  94. icolladia
  95. Baimame

    http://buypriligyhop.com/ - priligy tablets over the counter

  96. Mtwoyo

    isotretinoin online - accutane australia buy order accutane over the counter

  97. Ovxpms

    buy essay service - buying a research paper for college write my assignment for me

  98. Zithromax

    Next Day Viagra

  99. Vnpjwy

    buy stromectol pills - cost of stromectol medicine ivermectin australia

Comment

Your email address will not be disclosed. The required fields are marked with*.

Related recommendation

No related articles!

微信扫一扫,分享到朋友圈

Facebook Wants Its AR Glasses to Offer Superhearing to the Wearer.