Build an interactive AR app in Vuforia: brain model and functionalities

Anrn
3 min readJan 25, 2019

This is a school project I made for my psychology course: a marker-based AR app which helps people learn about the functions of each part of the brain in an interactive way. By scanning the image, a 3d model of the brain shows up on the screen and people will know the name and function of each brain section.

Process:

  1. the basic step: mark-based AR

I followed a couple of tutorials to figure out the best tool, and I successfully created a mark-based AR project in Vuforia by following this awesome tutorial:

2. Model

Make a low-poly brain in C4D

I downloaded a high-poly brain model from the internet, and then by adding polygon reduction, I am able to reduce the polygon and create this low poly model. I would recommend you to deal with rendering and material stuff in unity, as the rendering usually looks so different once you import your model into it.

Material and Texture

I used the free plugin Minimalist Free from unity assets store, which could help you to create a stunning neon-style rendering in a few clicks.

Interface: create the material in Minimalist Free

3. Make it interactive

I created the script here which allows the ui text show up when the sphere is clicked.

using System.Collections;
using System.Collections.Generic;
using UnityEngine.UI;
using UnityEngine;

public class click : MonoBehaviour {
bool isTrue=false;
public Text winText;
public Text funcText;
public string regionText;
public string functionText;

void OnMouseDown(){
isTrue=true;
if(isTrue){
winText.text = regionText;
funcText.text = functionText;
}
}

}

4. Move to mobile device: Tap

I found an awesome plugin that transfer the mouse-click function to “touch” and also adding gestures like scale, rotate, translate, from unity assets store:

Simply adding these script to the object you are good to go!

5. Build!

Add the scene in biuld&run, make sure you check Vuforia support in the player setting, and one more thing: ios now requires a camera usage description now, writing anything you want at “Camera Usage Description”, then build the file!

6. Xcode

In Xcode, you are able to change the icon of this app, time to be creative:)

Marker I was using.

Final Outcome

Screenshot

--

--