Instagram is listening to you

Some weeks ago, I saw an ad (sponsored post) on Instagram that shocked me. it was about a product I never googled, shared, liked, or talked about on any social network even in direct messages. I had a bad intuition: the only time this product came up was in a random chat with a couple of friends in a cafe. And the only way for Instagram to know about this was to listen to my real life conversations with the microphone.
Last week, I did an experiment to confirm this and the result is just as scary as you can imagine.

I speak Spanish, French and English. I usually combine these 3 languages: my roommate is from Argentina, my family is mostly Spanish, my co-workers and friends speak French, and I use English for the rest. It’s necessary to understand the context because I want to show how much technology is involved in this experiment.

I was in Spain with my family and we went hiking: from 7am to 3pm, 2300m altitude, very partial 3G, and my phone was in my backpack (iPhone 7 plus, in low battery mode).
At some point I was talking with my cousin (in Spanish) about a product I would like to buy: a micro projector connected in Bluetooth to share videos on a wall from my phone. i know that I never googled it, shared some ideas concerning it, or wrote it on any digital platform. It was a complete random discussion. I remember saying stuff like:

“It could be superb to share some videos of our hike to the ones who didn’t come on a wall”.
And my cousin replied saying that such products exist and we should try one.
That was a 5 minutes talk. Then we talked about other topics. It was a 6h hike and many conversations happened. However the one concerning the micro-projector was the only one referring to a specific product.
I actually forgot about this discussion and went back home. The day after in the morning, I checked my Instagram and guess what, I saw a perfect micro projector ad on my feed. I mean, exactly the one I wanted:
Remember the context: 2300m with partial 3G in the mountains, low battery mode, and many discussions with 5 people, some in French and other ones in Spanish.
Please Instagram, explain to me how you’re doing this. I’m a developer, I know how iOS and networks work, and I’m still very curious about the technology you’re using.

My iOS “Privacy” Settings were like this:
My first obvious conclusion is that Instagram is taping you when the app is in the background. The audio stream is translated to text on the phone (offline), and some patterns are extracted (offline). The final payload is probably smaller than the audio stream and can be sent by 3G. I was switching between French and Spanish all day long. Meaning they have lots of internal libraries to detect languages and do this audio processing. Perhaps that’s why the Instagram app is 77 mo?

During the hike I remember trying to call someone on WhatsApp and the audio quality was so bad that I had to change to text. I mention this because at this point the Instagram app couldn’t send a “raw” audio stream to a server.
Or: the audio is stored locally in chunks and then synchronized within the background to a server once the network is better (3h after the hike).
In any of the two conclusions: the microphone is used to record your surroundings. Today I’m 1000th positive about this.

Guys, what’s going on here? I’m not a child and i know that most of the biggest corporations these days are doing crazy stuff with our data. However we are talking about nearly real time analysis of our private conversations without any warnings about this. At least, I haven’t seen any legal stuff mentioning that Instagram was allowed to use my microphone in the background to listen to me. If you know more concerning this (like this article), let me know.
For the moment, simply turn off the microphone access in your settings and turn it on only when necessary.

admin • 28.05.2020

Previous Post

Next Post