ShinkaJinzai
Technology
Full Stack & AI Development
Purpose
SIH Team project
Tech Stack
Next.js , Three.js , GCP , Node.js
ShinkaJinzai
ShinkaJinzai is a web platform that helps its users visualize the movements of deformable objects/phenomena like humidity, temperature, landfills, clouds, etc. We built this site as our SIH project, utilizing several cutting-edge technologies like
Python for robust and scalable backend and utilize the medipipe FILM (Frame Interpollation for Large Motion) .
We have also used python to gather data from the WMS services to
Along with other technologies like GCP , GIT , Tailwind CSS , Framer Motion , Three.js , etc
If you have any questions feel free to ask me or my Chatbot
ShinkaJinzai
We securely collect real-time environmental data from various WMS (Web Map Service) sources, including information on weather patterns, geographic phenomena, and environmental conditions. This data is then processed by our Python backend, which ensures that it is handled efficiently and securely.
Once the backend has received and verified the data, it feeds it into the Mediapipe FILM (Frame Interpolation for Large Motion) model to generate realistic and smooth animations. This process allows us to create visually accurate simulations of changing phenomena, enhancing user experience through dynamic visualizations.
Finally, we use additional tools like GCP for cloud infrastructure, Three.js for 3D rendering, and Tailwind CSS for responsive styling to ensure a seamless and high-performing platform.
Working of FILM Model
The FILM model takes two images as input and outputs a middle image. At inference time, we recursively invoke the model to output in-between images. FILM has three components:
(1) A feature extractor that summarizes each input image with deep multi-scale (pyramid) features;
(2) a bi-directional motion estimator that computes pixel-wise motion (i.e., flows) at each pyramid level; and
(3) a fusion module that outputs the final interpolated image. We train FILM on regular video frame triplets, with the middle frame serving as the ground-truth for supervision.
Example Output
Working Mechanism
