Fellowship Projects Summer/Fall 2023 & Summer 2024 - AR HoloLens Visualization

I worked full time over the summers of 2023 and 2024, and part time in the fall of 2023 with the Nuclear Engineering & Radiological Sciences department at the University of Michigan, specifically in the Detection for Nuclear Nonproliferation Group (DNNG) inside of the Nuclear Engineer and Radiological Sciences (NERS) department. My goals were to create and deploy both a 2D AR visualization app and 3D AR voxelization app to the Microsoft HoloLens 2 that supports visualization tools given radiation input data from a provided Handheld Dual-Particle Imager (H2DPI) and a pipelined imaging algorithm.

3D AR HoloLens 2 Visualization Application:

Visualizes the output of a 3D imaging algorithm found from radiation data acquired by the H2DPI. The visualization is obtained through voxelization of a region of space and the generation of a procedural mesh outlining the desired visualization. If a radiation source is present within the processed area, we visualize each voxel coordinate in order of energy intensity that each coordinate produced.

My Contributions:

I was the lead developer in creating the procedural mesh algorithm used to visualize the presence of a radiation source in this makeshift voxel space. I parsed and visualized the input coordinate data files to produce desired output. I also created a dynamic system that allows for voxelization of any input size that automatically adjusts with no extra user input needed. I worked together with three other developers in providing functionality to the application on the HoloLens through Unity and Microsoft's Mixed Reality Toolkit (MRTK).

2D AR HoloLens 2 Visualization Application v2.0:

Visualizes radiation data from the H2DPI in AR. Accurately visualizes the direction of the source and utilizes the built-in Spatial Awareness system on the HoloLens 2 to create a heatmap on objects in the direction of the source. Can be utilized by an individual with no prior radiation detection or computer science knowledge. Use cases may include the national security and the prevention of the smuggling of nuclear products and detecting radiation sources in a facility.

My Contributions:

I was the lead developer on the implementation of the HoloLens application through Unity. This application had been previously tackled by a prior research group, so my tasks of the summer included upgrading that application to the newly supported Unity LTS, catching and fixing prior bugs, upgrading the communication pipeline, and importing new features. I created two-way communication over TCP/IP such that the HoloLens application can send messages back to an acquisition computer containing measurement data, along with that computer sending messages to the HoloLens. Use cases for two-way communication include creating a dynamic and session-unique user-inputted parameters for calculating radiation data, creating an energy gate visualization window to increase visualization precision, and toggling on/off new visualization algorithms for back-projection imaging and heatmap visuals.

Carrots in Space - Revengeful Rabbits Studio

Carrots in Space is a 2D co-op puzzle game! Finding yourself and a partner in deep space, you must prevail...Against the hungry rabbits! Feed these rabbits their carrots and avoid obstacles on your way to saving the galaxy. It's all up to you two, so you must not back down on your way to salvation.

Credits: credits.txt

The Legend of Zelda - Remaster

This is a remastered version of the first dungeon of the original The Legend of Zelda. Filled with realistically created movement, enemies, items, and design, you are bound to have a blast playing! Along with what is expected, this version contains a special custom level that manipulates a never seen before game mechanic in the Zelda series: A laser! Press '4' on the keyboard to access the custom level...

My Contributions:

I worked on every enemy's AI, authentic level design and progression, and helped design the new and unique custom level. I worked on room enemy spawns and freezes, locked doors, and completed room rewards such as spawning a key or freeing link from being trapped in a room

Memory Adventure: A platforming game

Control a ball to reach the goal in this exciting platformer! Watch out for disappearing platforms and unknown terrain to claim victory! Beware: some magical platforms kill you when visible but allow you to stand on them when invisible due to their whacky technology. Can you reach the end and claim victory, or will the platforms prevail!?

My Contributions:

This was a solo project,
with credits given to credits.txt