Note: Most of these are made for fun.
On the Metastability of Bipodal States in Transformer Attention Dynamics
We study metastability in the transformer attention dynamics, where tokens evolve as interacting particles on the sphere.
AI-Powered Project Tracking for Hitachi Energy
An automated BI pipeline built as my NCSU senior capstone project that ingests project tracking data, uses Azure AI to generate persona-tailored insights, and delivers HTML reports and email digests on a daily schedule.
Some Structures in Transformer Architectures
Representing decoder-only transformers using Kronecker products to reveal interpretable linear algebraic structure and the introducing the phenomenon of superposition in high-dimensional vector spaces.
The Art of Attention
Cool plots created from a dynamical system inspired by self-attention mechanisms.
Stargazr
A modern stargazing assistant that provides personalized recommendations for the best nights to stargaze, combining astronomy, weather, and light pollution data.
Differential Privacy in Federated Learning
Integration of Differential Privacy into a Federated Learning framework using the MIMIC-IV dataset to enhance patient privacy while maintaining model performance.
Visualize your Spotify Taste
A web application that integrates with the Spotify API to analyze and visualize your music taste, featuring track analysis and abstract mosaic generation.
Investigation of the Genetics of Coronaviruses and the Similarities Between Them
Applying PCA and diffusion mapping to coronavirus genetic sequences to uncover clustering structure and relationships among coronavirus families.