Journal of Intelligent Computing System (JICS)
← Back to Journal Site
Home›Archive›Volume 1, Issue 3›Bridging Text and Motion: Generative AI Models for Video Syn…
← Back to Published Articles
Volume 1, Issue 3 · 14 September 2026
43 views

Bridging Text and Motion: Generative AI Models for Video Synthesis

Authors: Mohammad Shahnawaz Shaikh

Corresponding Author: Mohammad Shahnawaz Shaikh

Publication Details

Issue
Volume 1
Issue 3
Section
Research Article
Pages
80-92
43
Total Views
0
Citations
Cite This Article
Mohammad Shahnawaz Shaikh (2026). Bridging Text and Motion: Generative AI Models for Video Synthesis. Journal of Intelligent Computing System (JICS), Volume 1, Issue 3, 80-92. doi.org/10.67420/109319.1.3.5
Manuscript ID: JICS-2026-019 Article Type: Research Article Submitted: 20 August 2026

Abstract

The diffusion-based generative models have led to tremendous progress in text-to-video generation. This paper introduces a text-to-video synthesis framework that is trained using a combined noise-prediction, temporal-consistency, and text-alignment objective, and consists of a transformer-based text encoder, a CLIP/CVAE latent-alignment module, a conditional 3D U-Net diffusion model, and an explicit temporal-dynamics module, followed by a super-resolution refinement stage. The three complementary experiments are a quantitative comparison with quantitative baselines (GAN video generation-based, diffusion-based) across three metrics (text-alignment, distributional, structural-fidelity), using standard statistical testing (paired t-tests, Benjamini-Hochberg FDR correction, Cohen's d effect sizes), a human-rated comparative case study with the frontier commercial video generation engines (Runway Gen-4.5, Pika 2.0), and a component ablation study, which isolates the contribution of the temporal-dynamics module, the latent-alignment module, and the super-resolution module. Results indicate statistically significant improvement over conventional GAN and diffusion baselines, and a result competitive with commercial systems even with a significant disparity in the number of resources. Each architectural component's contribution to these benefits is discussed and directions are proposed to close the remaining visual fidelity gap with the larger scale commercial models.

Keywords

BERT CLIP Cross-Attention CVAE Diffusion Models GAN GPT NLP Temporal Consistency Text-to-Video

Classification

Generative AI, Video Synthesis Research Article
View PDF Download PDF ← Back to Articles