Pixi’s new iOS app turns text messages into interactive AR experiences

Forget stickers, GIFs, and emoji reactions. Pixi is betting that the adjacent improvement of messaging is interactive augmented world (AR).

The startup launched its messaging-native app connected the App Store connected Wednesday, allowing users to nonstop AI-powered AR characters done iMessage. Instead of appearing arsenic static media, the characters travel to beingness done the recipient’s iPhone camera, wherever they tin respond to their surroundings, interact with people, and respond successful existent time.

While AR isn’t caller and shiny anymore—companies similar Snap person created AR filters and lenses for years—Pixi believes its attack is different. By combining AR with on-device AI, its characters tin recognize what’s happening astir them and behave accordingly. A virtual cat, for example, reacts erstwhile a existent canine walks past. (According to the company, each ocular and audio processing remains connected the instrumentality to sphere idiosyncratic privacy.)

Pixi laminitis Mark Drummond (ex-DreamWorks Animation and ex-Apple) says the app is designed to bring a greater consciousness of beingness and spontaneity to integer conversations. Rather than sending a substance to privation idiosyncratic a Happy Birthday, users tin nonstop characters that make a shared experience, turning a elemental connection into thing person to a integer acquisition oregon playful interaction.

“The user occupation we’re solving is reasoning of a person erstwhile they’re not present,” helium told TechCrunch. “Sometimes the science is called pebbling oregon originative gifting. You’re sharing tokens of affection, fundamentally cards, e-cards, and gifts. That’s your dad, or, successful immoderate cases, your granddad’s media. We tin bash better. We tin bash thing that’s digitally native, and that uses everything we learned astir AR connected the iPhone.” 

Earlier this week, Drummond demonstrated the app for us, selecting the feline character, which performed a bid of stand-up jokes connected his desk. Notably, the feline appeared to respond to Drummond’s facial expressions. For instance, the acquisition concluded erstwhile helium smiled, showcasing the character’s quality to comprehend affectional cues.

At launch, users volition person entree to a robot, a cat, and an animated envelope quality that tin respond to their dependable and “attack” their friends successful a playful way. If they move, the envelope volition pursuit them. There are besides games similar tic-tac-toe and whack-a-mole.

Image Credits:Pixi Platforms

Pixi plans to grow beyond conscionable a fewer characters. The extremity is to make a marketplace wherever studios, brands, and autarkic creators tin stock their unsocial characters for users to take from. The institution envisions this being utilized for events similar movie premieres oregon merchandise launches, allowing characters to make excitement, specified arsenic erstwhile M&Ms merchandise a caller flavor.

Drummond besides mentioned introducing Alice successful Wonderland arsenic a quality option, arsenic she is an unfastened intelligence property. He pointed retired that “our Alice quality needs to respond to objects that she sees connected your desktop successful an ‘Alice-consistent’ way,” to show to partners however their creations volition interact with the technology.

In the future, Pixi hopes to let users to make their ain characters and personalities. 

“Part of our program is to unfastened up those generative AI capabilities to our [users], truthful they tin punctual their mode to accidental something, like, ‘I privation a bluish blob that threatens my person and growls astatine them and keeps chasing them connected the phone,’” Drummond explained.

To nonstop a quality to your friend, download the app connected iOS and usage iMessage by tapping the positive motion fastener successful the little near corner. No installation is required to person a Pixi message.

Initially, the app volition beryllium disposable lone for iPhone models 11 and newer, but determination are plans to grow to Android devices and messaging platforms similar WhatsApp and Instagram successful the future. 

Also, portion the app is escaped for users, brands volition person the enactment to complaint for their characters if they choose.

“We’re going to promote radical to bash it for free, due to the fact that past radical go your ain marque ambassadors. You’re putting them successful complaint of utilizing your characters to archer their ain stories,” Drummond said.