Background

From Sobel and Canny's digital image processing algorithms to detect edges in images, to deep learning algorithms like R-CNN and YOLO for object detection in images, from GANs to Diffusion Models, and from 2D to 3D, deep learning models demonstrate the potential for infinite content generation.

From ChatGPT to ERNIE Bot, from MidJourney to DALL·E, AI-generated content applications have rapidly expanded. AI-generated content (AIGC) is becoming integral to our lives, poised to be a key driver in media, culture, and creative industries.

In the fall of 2023, the Student Innovation Center of Shanghai Jiao Tong University (SJTU), in collaboration with the Institute of Artificial Intelligence of SJTU, Huawei Technologies Co., Ltd., Lenovo Group, and Lilith Games, established the "Shanghai Jiao Tong University AIGC Class" to cultivate the next generation of AIGC talents, addressing the urgent need for highly specialized professionals in the AIGC field.

Faculty

The Shanghai Jiao Tong University AIGC Class boasts a diverse and outstanding faculty, supporting comprehensive student development in the AIGC domain. The faculty includes distinguished teachers from the SJTU Student Innovation Center and the Institute of Artificial Intelligence, as well as top engineers from the industry.

The Student Innovation Center's Innovation Practice Department has 15 full-time teachers, 15 internal mentors, and 30 external experts, providing a comprehensive "course-competition-creation" education service to SJTU students.

The Institute of Artificial Intelligence has over a hundred faculty members. The Visual Intelligence Research Center focuses on integrating human-machine interactions, aiming at the scientific forefront of artificial intelligence and computer vision, developing new-generation visual intelligence theories and technologies characterized by comprehensive perception, behavioral cognition, virtual-real integration, and security. It aims to enhance visual perception and cognitive abilities in digital media, smart cities, smart healthcare, and other fields, realizing the vision of AI-powered new perspectives.

Advanced Equipment

Optical Motion Capture System:

The motion capture equipment is equipped with the advanced Optitrack optical motion capture system, including 20 high-precision Optitrack PrimeX22 cameras, multiple motion capture suits, and supporting software. Motion capture actors can wear motion capture suits and move freely within the venue, capturing complete motion sequences for animation, games, and more. Additionally, several tripods and RGB cameras are set up in the venue for visual motion capture research.

4D Facial Expression Motion Capture System:

The static facial PBR material scanner includes 46 3D modeling cameras and 5 PBR high-speed cameras, capturing 46 modeling images and 15x5 PBR photos under different lighting conditions in 3 seconds, used to reconstruct high-precision models and 8K resolution PBR texture maps.

Fluid Visual Intuitive Learning Platform:

The fluid visual intuitive learning platform focuses on researching AI fluid simulation technology across multi-scene, multi-physics, and multi-scale coupling. Through high-frame-rate, high-resolution camera arrays, it achieves multi-view, high-quality, and highly synchronized dynamic fluid data collection.

We also have:

• GPU arrays: Huawei Atlas 800, NVIDIA A100, NVIDIA RTX3090
• Dedicated work areas and workstations
• Various AR/VR headsets

Training Program

Each group consists of 4 people, with a personalized training program for different projects, totaling 1.5 years.

Engineering Skill Development (0.5 years)

• PBL project-based learning courses:
  • Computer vision and graphics
  • Introduction to machine learning and deep learning
  • Use of mainstream 3D engines
• Workshops:
  • Equipment usage
  • Data processing and analysis

Research Skill Development (1 year)

• Engineering Innovation:
  • Contributing to open-source projects: paving the way for future AIGC
  • Participating in top competitions: "Challenge Cup" and "Internet+" competitions
• Academic Innovation:
  • In-depth reading of papers
  • Proposing insights
  • Brainstorming
  • Producing papers: publishing articles in academic conferences or journals
• Mentorship:
  • Each group will be assigned a research or project mentor for guidance

Completion

• Every year, outstanding students will be selected and awarded generous scholarships.
• Successful completion will earn a certificate jointly issued by the Student Innovation Center and the Institute of Artificial Intelligence.
• Outstanding students will complete their graduation projects at the Institute of Artificial Intelligence and have the opportunity to pursue further studies at the Institute of Artificial Intelligence or intern at our our sponsors.

Application Requirements

• Sophomore (second-year) undergraduate students of Shanghai Jiao Tong University
• About 20 students recruited each year
• Must be in the top 20% of the class in the first year
• AIGC Class does not charge tuition, and there are no acedemic credit

Application Method

The application for the SJTU AIGC Class of 2023 closed on November 20, 2023.

Our application for 2024 will start in September 2024.

Contact Us

Email: aigc[AT]sjtu.edu.cn

Address: Room B300, Building B, Student Innovation Center, Shanghai Jiao Tong University