Computer Graphics Roadmap

Skills Matrix

Track your progress across key areas of computer graphics:

Industry Standards & Best Practices

1.1 Mathematics for Graphics

• Linear Algebra: Vectors, matrices, linear transformations
• Analytic Geometry: Points, lines, planes
• Parametric representations
• Implicit vs explicit forms
• Barycentric coordinates
• Trigonometry: Sine, cosine, tangent, angles and rotations
• Spherical coordinates

1.2 Color Theory

• Color models: RGB, CMYK, HSV, HSL
• Color spaces: sRGB, Adobe RGB, CIE XYZ
• Gamma correction
• Color perception and vision
• HDR (High Dynamic Range)
• Color management

1.3 Digital Image Fundamentals

• Raster vs vector graphics
• Pixels and resolution
• Bit depth and channels
• Image formats: PNG, JPEG, TIFF, EXR
• Alpha compositing
• Framebuffers

2.1 2D Primitives

• Points and pixels
• Lines: DDA, Bresenham's algorithm
• Circles: Midpoint circle algorithm
• Ellipses and arcs
• Bézier curves and splines
• Polygons and polylines

2.2 2D Transformations

• Translation, Rotation, Scaling, Shearing
• Matrix representation
• Composite transformations
• Transformation hierarchies

2.3 Clipping and Windowing

• Cohen-Sutherland line clipping
• Liang-Barsky algorithm
• Sutherland-Hodgman polygon clipping
• Viewport transformations
• Scissor testing

2.4 Anti-aliasing

• Aliasing problems
• Supersampling and area sampling
• Filtering techniques
• MSAA, FXAA, SMAA, TAA

3.1 3D Coordinate Systems

• World space, object space, camera space
• Screen space and NDC (Normalized Device Coordinates)
• Right-hand vs left-hand systems
• Coordinate transformations

3.2 3D Transformations

• Translation in 3D
• Rotation: Euler angles, axis-angle, quaternions
• Scaling in 3D
• Transformation matrices (4x4)
• Model, view, projection matrices
• Normal transformations

3.3 Projection

• Parallel Projection: Orthographic, Oblique
• Perspective Projection
• Perspective division
• Field of view (FOV)
• Perspective matrix
• Near and far clipping planes

3.4 Camera Systems

• Camera positioning
• Look-at transformation
• Camera movement (FPS, orbital)
• Viewing frustum
• Culling techniques

4.1 Polygon Meshes

• Vertices, edges, faces
• Triangle meshes vs quad meshes
• Mesh data structures
• Indexed vs non-indexed geometry
• Triangle strips and fans

4.2 Parametric Surfaces

• Bézier surfaces
• B-spline surfaces
• NURBS (Non-Uniform Rational B-Splines)
• Subdivision surfaces
• Tensor product surfaces

4.3 Implicit Surfaces

• Signed distance functions (SDFs)
• Metaballs and blobby objects
• Marching cubes algorithm
• Isosurfaces and level sets

4.4 Procedural Modeling

• Noise functions: Perlin, Simplex, Worley
• Fractals and L-systems
• Procedural terrain generation
• Procedural textures
• Instancing

4.5 Mesh Processing

• Mesh simplification and decimation
• Mesh smoothing (Laplacian, Taubin)
• Mesh subdivision (Catmull-Clark, Loop)
• Remeshing and mesh repair
• Normal computation

5.1 Lighting Models

• Local Illumination
• Ambient lighting
• Diffuse reflection (Lambertian)
• Specular reflection (Phong, Blinn-Phong)
• Light Types: Point, Directional, Spot, Area, Environment

5.2 Shading Techniques

• Flat shading, Gouraud shading, Phong shading
• Normal mapping
• Bump mapping
• Parallax mapping
• Displacement mapping

5.3 Material Models

• Lambertian (diffuse)
• Phong and Blinn-Phong
• Cook-Torrance
• Oren-Nayar (rough diffuse)
• Ward anisotropic
• Physically Based Rendering (PBR)

5.4 Physically Based Rendering (PBR)

• Microfacet theory
• BRDF (Bidirectional Reflectance Distribution Function)
• Metallic-roughness workflow
• Specular-glossiness workflow
• Energy conservation
• Fresnel effect
• Image-based lighting (IBL)

6.1 Texture Mapping Fundamentals

• UV coordinates
• Texture wrapping modes
• Texture filtering: nearest, bilinear, trilinear
• Mipmapping
• Anisotropic filtering
• Texture atlases

6.2 Advanced Texture Techniques

• Multi-texturing
• Detail textures
• Decals and splatting
• Procedural textures
• Texture compression (DXT, BC7, ASTC)
• Virtual texturing

6.3 Specialized Mapping

• Normal mapping, Displacement mapping
• Parallax occlusion mapping
• Relief mapping
• Environment mapping (cube maps, sphere maps)
• Reflection and refraction mapping

6.4 UV Unwrapping

• Planar, Cylindrical, Spherical projection
• Box mapping
• Automatic UV unwrapping
• UV layout optimization

7.1 Graphics Pipeline Overview

• Application stage
• Geometry stage
• Rasterization stage
• Pixel/fragment stage
• Output merger stage

7.2 Vertex Processing

• Vertex shaders
• Vertex transformations
• Vertex attributes
• Vertex buffer objects (VBO)
• Instancing

7.3 Primitive Assembly & Rasterization

• Triangle assembly
• Clipping
• Face culling (backface, frontface)
• Rasterization process
• Fragment generation
• Interpolation of attributes

7.4 Fragment Processing

• Fragment/pixel shaders
• Texture sampling
• Lighting calculations
• Discard operations
• Fragment shader outputs

7.5 Output Merger

• Depth testing
• Stencil testing
• Alpha blending
• Color writes
• Framebuffer operations
• Multi-render targets (MRT)

7.6 Modern Pipeline Features

• Tessellation shaders
• Geometry shaders
• Compute shaders
• Mesh shaders
• Task shaders

8.1 Rendering Optimization

• Level of Detail (LOD)
• Occlusion culling
• Frustum culling
• Distance culling
• Batching and instancing
• Draw call reduction

8.2 Shadow Techniques

• Shadow mapping
• Cascaded shadow maps (CSM)
• Percentage-Closer Filtering (PCF)
• Variance shadow maps (VSM)
• Shadow volumes
• Soft shadows

8.3 Post-Processing Effects

• Bloom and glow
• Depth of field
• Motion blur
• Color grading
• Tone mapping
• Vignetting, Film grain, Chromatic aberration

8.4 Screen-Space Techniques

• Screen-space ambient occlusion (SSAO)
• Screen-space reflections (SSR)
• Screen-space global illumination (SSGI)
• Screen-space shadows

8.5 Deferred Rendering

• G-buffer layout
• Deferred vs forward rendering
• Light accumulation pass
• Deferred shading optimizations
• Hybrid approaches

8.6 Forward+ Rendering

• Tiled rendering
• Clustered rendering
• Light culling
• Compute shader integration

9.1 Global Illumination

• Ray tracing fundamentals
• Path tracing
• Bidirectional path tracing
• Metropolis light transport
• Photon mapping
• Radiosity
• Irradiance caching

9.2 Ray Tracing

• Ray-object intersection
• Acceleration structures: BVH, k-d trees, octrees
• Recursive ray tracing
• Distributed ray tracing
• Reflection and refraction rays
• Shadow rays

9.3 Real-Time Ray Tracing

• DXR (DirectX Raytracing)
• Vulkan ray tracing
• Hardware ray tracing (RTX)
• Hybrid rendering (raster + RT)
• Denoising techniques
• Temporal accumulation

9.4 Subsurface Scattering

• BSSRDF models
• Texture-space diffusion
• Screen-space SSS
• Pre-integrated skin shading
• Translucency

9.5 Volumetric Rendering

• Volume ray marching
• Participating media
• Volumetric lighting (god rays)
• Fog and atmospheric scattering
• Volumetric clouds
• Smoke and fire simulation

10.1 Keyframe Animation

• Interpolation: linear, cubic, Bézier
• Easing functions
• Animation curves
• Keyframe editing

10.2 Skeletal Animation

• Bones and joints
• Skinning (vertex blending)
• Linear blend skinning (LBS)
• Dual quaternion skinning
• Inverse kinematics (IK)
• Forward kinematics (FK)

10.3 Morphing & Blending

• Vertex morphing
• Blend shapes/morph targets
• Facial animation
• Shape interpolation

10.4 Procedural Animation

• Particle systems
• Flocking and crowds
• Procedural character animation
• Physics-based animation

10.5 Physics Simulation

• Rigid body dynamics
• Collision detection: broad phase, narrow phase
• Soft body physics
• Cloth simulation
• Fluid simulation: SPH, grid-based
• Hair and fur simulation

10.6 Motion Capture

• Mocap data processing
• Retargeting
• Cleanup and refinement
• Marker-based vs markerless

11.1 Game Engine Architecture

• Scene graphs
• Entity-Component-System (ECS)
• Resource management
• Asset pipeline
• Level streaming

11.2 Performance Optimization

• Profiling and bottleneck analysis
• GPU profiling tools
• CPU-GPU synchronization
• Memory management
• Cache optimization

11.3 Terrain Rendering

• Heightmap terrain
• Procedural terrain generation
• LOD for terrain
• Terrain texturing and splatting
• Vegetation rendering

11.4 Water Rendering

• Planar reflections
• Water simulation (FFT, Gerstner waves)
• Underwater effects
• Foam and spray
• Caustics

11.5 Sky & Atmosphere

• Skybox and skydome
• Atmospheric scattering (Rayleigh, Mie)
• Dynamic time of day
• Weather systems
• Clouds rendering

11.6 Character Rendering

• Skin shading
• Eye rendering
• Hair rendering (Marschner model)
• Clothing and accessories

12.1 OpenGL

• OpenGL pipeline
• Vertex and fragment shaders
• Buffers: VBO, VAO, EBO
• Textures and samplers
• Framebuffer objects (FBO)
• GLSL shader language

12.2 Vulkan

• Vulkan architecture
• Command buffers and queues
• Pipelines and render passes
• Synchronization: fences, semaphores
• Memory management
• Descriptor sets
• SPIR-V shaders

12.3 DirectX

• Direct3D 11 vs Direct3D 12
• HLSL shader language
• Constant buffers
• Root signatures
• Resource barriers
• DirectX Raytracing (DXR)

12.4 Metal (Apple)

• Metal architecture
• Metal Shading Language (MSL)
• Command encoders
• Metal Performance Shaders

12.5 WebGL & WebGPU

• WebGL 1.0 and 2.0
• WebGPU modern API
• Browser rendering
• Three.js, Babylon.js integration

12.6 Shader Programming

• Vertex shaders
• Fragment/pixel shaders
• Geometry shaders
• Tessellation shaders
• Compute shaders
• Shader optimization
• Cross-compilation (SPIRV-Cross)

13.1 Neural Rendering Fundamentals

• Neural networks for graphics
• Implicit representations
• Neural scene representations
• Coordinate-based networks
• Multi-layer perceptrons (MLPs) for graphics

13.2 Neural Radiance Fields (NeRF)

• NeRF architecture and principles
• Volume rendering with NeRF
• Positional encoding
• Instant-NGP (NVIDIA)
• NeRF variants: Mip-NeRF, NeRF++, NeRF-W
• Dynamic NeRFs
• Semantic NeRFs
• Fast NeRF training

13.3 Gaussian Splatting

• 3D Gaussian primitives
• Differentiable rasterization
• Real-time rendering with Gaussians
• Gaussian splatting vs NeRF
• Dynamic Gaussian splatting
• 4D Gaussian splatting

13.4 Neural Shaders & Materials

• Neural texture synthesis
• Material capture with AI
• Neural BRDF representation
• Procedural material generation
• Style transfer for materials

13.5 AI Super-Resolution & Upscaling

• DLSS (Deep Learning Super Sampling)
• DLSS 3 with frame generation
• DLSS 4 (2025)
• FSR (FidelityFX Super Resolution)
• XeSS (Intel)
• Neural upscaling techniques
• Temporal anti-aliasing with AI

13.6 AI Denoising

• Real-time ray tracing denoising
• Neural denoising networks
• Temporal denoising
• Spatial-temporal denoising
• OptiX Denoiser

13.7 Generative 3D Models

• Text-to-3D generation
• Point-E, Shap-E (OpenAI)
• DreamFusion
• Magic3D
• Generative 3D synthesis
• NeRF-based generation

13.8 Neural Animation

• Motion synthesis with AI
• Character animation with ML
• Facial animation synthesis
• Physics prediction with neural networks

14.1 RTX Neural Shaders

• NVIDIA RTX neural shader framework
• Trainable shaders
• Real-time neural rendering
• Material learning

14.2 World Foundation Models

• NVIDIA Cosmos
• Large-scale 3D world generation
• Scene understanding with AI
• Simulation and synthetic data

14.3 Neural Graphics Primitives

• Instant-NGP acceleration
• Hash encoding
• Multi-resolution hash tables
• Real-time NeRF inference

14.4 Digital Humans

• NVIDIA ACE technology
• Facial animation with AI
• Natural language to animation
• Realistic character synthesis
• Metahuman creation (Unreal Engine)

14.5 Real-Time Global Illumination

• Lumen (Unreal Engine 5)
• Software ray tracing
• Hardware-accelerated GI
• Hybrid GI solutions
• Irradiance fields

14.6 Nanite Virtualized Geometry

• Virtual geometry system
• Automatic LOD
• Mesh cluster rendering
• Streaming and compression

14.7 Cloud Gaming & Streaming

• Remote rendering
• Latency optimization
• Compression techniques
• GeForce NOW, Stadia architecture

15.1 Non-Photorealistic Rendering (NPR)

• Cel shading / toon shading
• Sketch-based rendering
• Painterly rendering
• Line drawing algorithms
• Hatching and stippling

15.2 Medical Visualization

• Volume rendering
• Direct volume rendering
• Maximum intensity projection (MIP)
• Transfer functions
• Multi-modal visualization
• Surgical planning visualization

15.3 Scientific Visualization

• Data visualization
• Flow visualization
• Vector field rendering
• Isosurface extraction
• Glyph-based visualization

15.4 CAD and Technical Graphics

• Wireframe rendering
• Hidden line removal
• Technical illustrations
• Exploded views
• Assembly visualization

15.5 Virtual Reality (VR)

• Stereoscopic rendering
• Lens distortion correction
• Foveated rendering
• VR optimization techniques
• Motion to photon latency
• Inside-out tracking
• 6DOF (Six Degrees of Freedom)
• Reprojection and timewarp
• VR comfort and motion sickness mitigation

15.6 Augmented Reality (AR)

• Marker-based AR
• Markerless AR
• SLAM (Simultaneous Localization and Mapping)
• Occlusion handling
• Lighting estimation for AR
• AR rendering pipeline
• Spatial anchors
• Plane detection
• Feature tracking

15.7 Mixed Reality (MR)

• Passthrough AR vs optical see-through
• Spatial mapping and meshing
• Hand tracking and gesture recognition
• Eye tracking and gaze interaction
• Scene understanding
• Physics integration with real world
• Virtual object placement
• Occlusion culling with real objects

15.8 Extended Reality (XR) Unified Concepts

• Cross-platform XR development
• Reality-virtuality continuum
• Spatial computing
• Holographic rendering
• Multi-user XR experiences
• Shared spatial anchors

16.1 VR Hardware & Architecture

Display Technologies

• LCD vs OLED vs Micro-OLED
• Field of view (FOV) optimization
• Resolution and pixel density (PPD)
• Refresh rates: 90Hz, 120Hz, 144Hz+
• Persistence and motion blur
• Pancake lenses vs Fresnel lenses
• Varifocal displays

Tracking Systems

• Outside-in tracking (external sensors)
• Inside-out tracking (onboard cameras)
• SLAM-based tracking (visual-inertial)
• Lighthouse tracking (Valve Index)
• Optical tracking
• IMU (Inertial Measurement Units)
• Sensor fusion algorithms
• Tracking accuracy and latency

Input Methods

• 6DOF controllers
• Hand tracking (camera-based)
• Gesture recognition
• Voice commands
• Eye tracking
• Brain-computer interfaces (BCI)
• Haptic feedback
• Full-body tracking

16.2 VR Rendering Techniques

Stereoscopic Rendering

• Left and right eye views
• Interocular distance (IOD)
• Convergence and accommodation
• Stereo rectification
• Depth perception cues

Performance Optimization

• Single-pass stereo rendering
• Multi-view rendering
• Instanced rendering for stereo
• Fixed foveated rendering
• Dynamic foveated rendering (with eye tracking)
• LOD for VR
• Occlusion culling optimizations
• Draw call batching

VR-Specific Effects

• Lens distortion correction (barrel distortion)
• Chromatic aberration correction
• Vignetting compensation
• Timewarp and spacewarp
• Asynchronous reprojection (ASW)
• Motion smoothing
• Frame interpolation

16.3 AR Hardware & Systems

Display Types

• Optical see-through (OST)
• Video see-through (VST) / Passthrough
• Retinal projection
• Waveguide optics
• Birdbath optics
• Freeform prisms
• Holographic waveguides

AR Devices (2025)

• Apple Vision Pro (mixed reality)
• Meta Quest 3/3S (passthrough MR)
• Meta Orion (AR glasses prototype)
• XREAL Air 2 Ultra
• Magic Leap 2
• Microsoft HoloLens 2
• Snap Spectacles
• Ray-Ban Meta Smart Glasses
• Varjo XR-4

16.4 SLAM & Tracking Algorithms

Visual SLAM

• Feature detection (ORB, SIFT, SURF)
• Feature matching and tracking
• Pose estimation
• Map building and optimization
• Loop closure detection
• Bundle adjustment
• Keyframe selection

SLAM Frameworks

• ORB-SLAM2, ORB-SLAM3
• LSD-SLAM
• RTAB-Map
• OpenVSLAM
• Kimera
• ElasticFusion

Visual-Inertial Odometry (VIO)

• IMU integration
• Sensor fusion (Kalman filtering)
• MSCKF (Multi-State Constraint Kalman Filter)
• VINS-Mono, VINS-Fusion
• Basalt VIO
• Tightly coupled vs loosely coupled

16.5 Hand Tracking & Gesture Recognition

Hand Detection & Tracking

• Mediapipe Hands
• Hand pose estimation
• Skeleton tracking (21 keypoints)
• Depth-based tracking
• Marker-less tracking
• Hand mesh reconstruction

Gesture Recognition

• Static gestures (poses)
• Dynamic gestures (motions)
• Template matching
• Hidden Markov Models (HMM)
• Deep learning classifiers
• Real-time processing

16.6 Eye Tracking & Foveated Rendering

Eye Tracking Technologies

• Camera-based (infrared)
• Pupil detection
• Glint detection
• Calibration procedures
• Gaze point calculation
• Saccade and fixation detection

Foveated Rendering

• Human visual system (fovea)
• Peripheral vision degradation
• Fixed foveated rendering
• Dynamic foveated rendering
• Gaze-contingent rendering
• Variable rate shading (VRS)
• Multi-resolution shading

16.7 Spatial Mapping & Scene Understanding

Environment Mapping

• Plane detection (floors, walls, tables)
• Mesh generation from depth
• Semantic segmentation
• Object detection and classification
• Room layout estimation
• Spatial anchors and persistence

Scene Understanding APIs

• ARCore (Google)
• ARKit (Apple)
• Azure Spatial Anchors
• WorldSense (Qualcomm)
• OpenXR scene understanding

16.8 Mixed Reality Interaction

Spatial UI/UX Design

• World-locked UI vs body-locked
• Diegetic interfaces
• Spatial menus
• Hand menus and palm UI
• Voice commands
• Multimodal interaction

Object Manipulation

• Direct grab manipulation
• Ray-based selection
• Proximity-based interaction
• Scaling and rotating objects
• Two-handed manipulation
• Constraint systems

Collaboration

• Shared spatial anchors
• Multi-user synchronization
• Avatar representation
• Spatial audio positioning
• Collaborative object manipulation

16.9 AR Cloud & Persistent AR

AR Cloud Concepts

• Persistent digital content
• Cross-device shared experiences
• Visual positioning system (VPS)
• 3D map of the world
• Localization against cloud maps

Platforms

• Niantic Lightship
• Immersal
• 6D.ai
• Microsoft Spatial Anchors
• Google ARCore Cloud Anchors
• Apple ARKit World Map

16.10 XR Optimization & Performance

Rendering Budget

• 11ms per frame (90 FPS)
• 8ms per frame (120 FPS)
• CPU and GPU budgets
• Thermal management
• Battery life considerations

Optimization Techniques

• Aggressive LOD
• Occlusion culling
• Frustum culling per eye
• Static batching
• GPU instance
• Texture atlasing
• Compressed textures
• Level streaming

Profiling Tools

• RenderDoc
• Unity Profiler
• Unreal Insights
• Snapdragon Profiler
• XCode Instruments
• Android GPU Inspector

16.11 WebXR

WebXR Device API

• Browser-based XR
• VR sessions
• AR sessions
• Input sources
• Reference spaces
• Hit testing

Frameworks

• A-Frame
• Three.js + WebXR
• Babylon.js
• React 360
• PlayCanvas

16.12 Spatial Audio for XR

3D Audio Rendering

• Head-Related Transfer Function (HRTF)
• Binaural audio
• Ambisonics
• Object-based audio
• Room acoustics simulation
• Audio occlusion and obstruction

Audio Engines

• Steam Audio
• Resonance Audio (Google)
• Microsoft Spatial Sound
• Oculus Audio SDK
• FMOD Spatial Audio
• Wwise

16.13 Haptics & Force Feedback

Haptic Technologies

• Vibration motors (rumble)
• Linear actuators
• Electroactive polymers
• Ultrasonic haptics
• Force feedback gloves
• Vest/suit haptics
• Wind and temperature simulation

16.14 AI in XR (2025 Cutting-Edge)

AI-Powered Features

• Real-time environment understanding
• Intelligent object placement
• Automatic occlusion
• Scene reconstruction
• Predictive tracking
• Gaze prediction for foveation
• Gesture prediction
• Natural language interaction

Neural Rendering for XR

• Neural relighting in AR
• Real-time NeRF in headsets
• AI upscaling for XR
• Style transfer for MR
• Virtual avatar generation
• Deepfake for telepresence

Complete Algorithm & Technique Reference

A comprehensive list of essential algorithms for computer graphics:

2D Algorithms (1-20)

3D Geometry & Transformation (21-40)

Rendering Algorithms (56-85)

Ray Tracing & Global Illumination (86-100)

Modern & Neural Techniques (101-125)

Essential Tools & Software

Project Ideas by Skill Level

Beginner Level (Months 1-3)

Next Steps

1. Assess Your Level: Complete self-assessment
2. Choose Your Path: Beginner/Intermediate/Advanced/Expert
3. Set Clear Goals: What do you want to build?
4. Get Tools: Install necessary software
5. Start Project 1: Begin with basics
6. Learn Daily: Consistent practice
7. Build Portfolio: Document everything
8. Network: Join communities
9. Stay Current: Follow research
10. Never Stop Learning: Graphics always evolving

Advanced Challenges

Technical Challenges

• Implement a custom graphics API abstraction
• Port renderer between APIs (OpenGL → Vulkan)
• Achieve 1000+ FPS in complex scene
• Build complete PBR pipeline from scratch
• Implement production-quality denoiser
• Create custom shader language
• Build visual shader editor

Research Challenges

• Reproduce latest SIGGRAPH paper
• Publish your own technique
• Contribute to major open-source project
• Create novel rendering algorithm
• Optimize existing technique significantly
• Win Shadertoy competition
• Present at graphics conference

Creative Challenges

• Create photorealistic still image
• Build interactive art installation
• Make short film with custom renderer
• Create graphics demo (demoscene style)
• Design new visualization technique
• Build VR experience from scratch

Career Development

Building Experience

• Internships: Game studios, VFX houses, tech companies
• Freelance: Upwork, Fiverr for smaller projects
• Open Source: Contribute to Blender, Godot, etc.
• Game Jams: Ludum Dare, Global Game Jam
• Competitions: Shadertoy, rendering competitions
• Research: Undergraduate research programs

Certifications

• Unity Certified Programmer
• Unreal Engine Certification
• NVIDIA CUDA Certification
• Autodesk Maya/3ds Max Certification

Salary Expectations (2025)