CIS565-Fall-2023 · TongHuoAo · Oct 6, 2023 · Oct 6, 2023 · Oct 8, 2023 · Oct 9, 2023
diff --git a/README.md b/README.md
@@ -3,11 +3,192 @@ CUDA Path Tracer
 
 **University of Pennsylvania, CIS 565: GPU Programming and Architecture, Project 3**
 
-* (TODO) YOUR NAME HERE
-* Tested on: (TODO) Windows 22, i7-2222 @ 2.22GHz 22GB, GTX 222 222MB (Moore 2222 Lab)
+* Tong Hu
+* Tested on: Windows 11, Ryzen 7 1700X @ 3.4GHz 16GB, RTX 2060 6GB (Personal Desktop)
 
-### (TODO: Your README)
+![](/img/preface.png)
 
-*DO NOT* leave the README to the last minute! It is a crucial part of the
-project, and we will not be able to grade you without a good README.
+# Visual Improvement
+## Different surfaces material
 
+The visualization of light on surfaces is predominantly governed by the material properties of the object. Based on different material properties, Combining with various sampling methods, we can greatly simulate the visual effects produced by the interaction of light with objects. Following two figures from wikipedia described the reflection and refraction of light.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 39%; margin-right: 10%;">
+    <img src="./img/reflection_wikipedia.png" style="width: 100%; height: auto;" />
+    <p>Reflection of light</p>
+  </div>
+
+  <div style="flex: 1; max-width: 61%;">
+    <img src="./img/refraction_wikipedia.png" style="width: 100%; height: auto;" /> 
+    <p>Refraction of light</p>
+  </div>
+</div>
+
+On an ideal diffuse surface, light scatters uniformly in all directions, irrespective of the incident angle. Such surfaces appear soft and non-glossy. Examples might include chalk, unpolished wood, or matte paint. 
+
+A perfectly specular-reflective surface acts like a mirror, reflecting light in a singular direction dictated by the law of reflection. Such surfaces exhibit sharp, clear reflections and are found in materials like polished metals or mirrors. 
+
+A refractive object, like glass or water, can transmit light due to a change in medium and cause refraction. The precise nature of this bending is governed by the material's refractive index. Additionally, such materials can also reflect light. Thus, after intersecting the ball's surface, the direction of the path will be randomly selected between reflection and refraction.
+
+Following are images rendered for a ball with ideal diffusive surface, a ball with perfectly reflective surface, and a refractive ball with IOR equals 1.5.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/basic_diffusion.png" style="width: 100%; height: auto;" />
+    <p>Diffusion</p>
+  </div>
+
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/basic_reflection.png" style="width: 100%; height: auto;" /> 
+    <p>Reflection</p>
+  </div>
+
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/basic_refraction.png" style="width: 100%; height: auto;" /> 
+    <p>Refraction</p>
+  </div>
+</div>
+
+## Anti-aliasing
+
+The anti-aliasing is implemented based on stochastic sampling. For each pixel, instead of shooting a ray through its center, the ray's direction is slightly jittered to simulate sampling multiple locations within a pixel by setting a random offset. This makes the rendered image smoother and more realistic. Following two images shows the difference between disable and enable anti-aliasing.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 40%; margin-right: 10%;">
+    <img src="./img/without_anti_aliasing_zoomin.png" style="width: 100%; height: auto;" />
+    <p>Without Anti-aliasing</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/anti_aliasing_zoomin.png" style="width: 100%; height: auto;" /> 
+    <p>With Anti-aliasing</p>
+  </div>
+</div>
+
+
+
+## Physically-based depth-of-field
+
+When simulating depth of field, the camera model can be enhanced to account for lens properties, including aperture size and focus distance. Instead of shooting rays straight out of a pixel (as in a pinhole camera model), rays are cast from points sampled across the aperture, converging them onto a focal point in the scene. Based on this simulation, the rendered images will have parts in sharp focus while other parts are blurred.
+
+Displayed below are images spanning a range of focus distances, from near to far, all captured with an aperture setting of 1. The focus distance are calculated for each ball, so that each image focuses on different balls.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/focus_7_6.png" style="width: 100%; height: auto; " />
+    <p>focus distance: 7.6</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/focus_8_7.png" style="width: 100%; height: auto;" /> 
+    <p>focus distance: 8.7</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/focus_12_6.png" style="width: 100%; height: auto;" /> 
+    <p>focus distance: 12.6</p>
+  </div>
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/focus_15.png" style="width: 100%; height: auto;" /> 
+    <p>focus distance: 15</p>
+  </div>
+</div>
+
+When the focus distance is set to 10, targeting the center ball, an increase in the aperture size causes areas not in focus to become progressively more blurred, as shown in following images.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/aperture_0_5.png" style="width: 100%; height: auto; " />
+    <p>aperture: 0.5</p>
+  </div>
+
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/focus_10.png" style="width: 100%; height: auto;" /> 
+    <p>aperture: 1</p>
+  </div>
+
+  <div style="flex: 1; max-width: 33%;">
+    <img src="./img/aperture_2.png" style="width: 100%; height: auto;" /> 
+    <p>aperture: 2</p>
+  </div>
+</div>
+
+## Motion Blur
+
+For simulating motion blur, we incorporate the elements of time and velocity into our rendering calculations. By sampling random time points within the duration of a single frame, we can capture the movement of objects, thereby creating a blurring effect in the final image, which simulates the natural perception of rapid motion in the real world. Importantly, the randomly generated time values are square-rooted, ensuring that there's a higher sampling density towards the end of the motion, intensifying the blur effect in that phase.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 40%; margin-right: 10%;">
+    <img src="./img/static.png" style="width: 100%; height: auto;" />
+    <p>Static</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/motion_blur.png" style="width: 100%; height: auto;" /> 
+    <p>Motion Blur</p>
+  </div>
+</div>
+
+## Subsurface Scattering
+
+In our renderer, subsurface scattering (SSS) is simulated to capture the complicated behavior of light as it penetrates and scatters within a material. The process involves tracing rays multiple times inside the object, accounting for light attenuation and the probability of scattering versus exiting. Each interaction is influenced by the material's specific absorption and scattering coefficients.
+
+In the comparison between the two sets of images, the presence of subsurface scattering becomes evident. With subsurface scattering, there's a harmonious blend of light and shadow, resulting in a more gradual transition between illuminated and shaded areas. Furthermore, this technique allows light to permeate the object, enhancing its depth and realism.
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 40%; margin-right: 10%;">
+    <img src="./img/withou_subsurface_scattering.png" style="width: 100%; height: auto;" />
+    <p>Without Subsurface Scattering</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/subsurface_scattering.png" style="width: 100%; height: auto;" /> 
+    <p>Subsurface Scattering</p>
+  </div>
+</div>
+
+<div style="display: flex; justify-content: center; text-align: center;">
+  <div style="flex: 1; max-width: 40%; margin-right: 10%;">
+    <img src="./img/without_sss_close_to_light.png" style="width: 100%; height: auto;" />
+    <p>Without Subsurface Scattering</p>
+  </div>
+
+  <div style="flex: 1; max-width: 40%;">
+    <img src="./img/sss_close_to_light.png" style="width: 100%; height: auto;" /> 
+    <p>Subsurface Scattering</p>
+  </div>
+</div>
+
+# Performance Improvement
+## Stream Compaction
+
+After applying stream compaction, we observe a decline in the number of remaining paths at each depth. In the open box scenario, paths decrease more rapidly as many exit the box, ending the tracing process earlier. In contrast, for the closed box scenario, only small amount of paths that intersect the light source terminates earlier, while most persist until they've bounced the maximum number of times.
+
+![](/img/stream_compaction.png)
+
+## Material Sorting
+
+Implementing material sorting is intended to enhance rendering efficiency. By grouping by material, we aim to optimize memory access. However, from following graph we can tell that when we enable the material sorting, rendering the image takes even more time. The increased time could be attributed to the overhead from sorting, especially given that the variety of material types isn't substantial enough to manifest the benefits of such sorting.
+
+![](/img/material_sorting.png)
+
+## Cache First Bounce
+
+From following graph we can tell that caching the first bounce in path tracing expedites the rendering process. However, as the max depth increases, the time-saving difference between using caching and not diminishes. This is because, even though we optimize the first bounce, the computation becomes increasingly dominated by the subsequent bounces as depth increases.
+
+![](/img/cache.png)
+
+
+# Reference
+
+Pysically based rendering: https://pbr-book.org/3ed-2018/contents
+
+Ray Tracing in One Weekend: https://github.com/RayTracing/raytracing.github.io
+
+Ray Tracing Gems I/II: https://www.realtimerendering.com/raytracinggems/
+
+Diffuse reflection (wikipedia): https://en.wikipedia.org/wiki/Diffuse_reflection
+
+Refraction (wikipedia): https://en.wikipedia.org/wiki/Refraction
diff --git a/img/anti_aliasing.png b/img/anti_aliasing.png
diff --git a/img/anti_aliasing_3_balls.png b/img/anti_aliasing_3_balls.png
diff --git a/img/anti_aliasing_zoomin.png b/img/anti_aliasing_zoomin.png
diff --git a/img/aperture_0_5.png b/img/aperture_0_5.png
diff --git a/img/aperture_2.png b/img/aperture_2.png
diff --git a/img/basic_3_balls.png b/img/basic_3_balls.png
diff --git a/img/basic_diffusion.png b/img/basic_diffusion.png
diff --git a/img/basic_reflection.png b/img/basic_reflection.png
diff --git a/img/basic_refraction.png b/img/basic_refraction.png
diff --git a/img/cache.png b/img/cache.png
diff --git a/img/focus_10.png b/img/focus_10.png
diff --git a/img/focus_12_6.png b/img/focus_12_6.png
diff --git a/img/focus_15.png b/img/focus_15.png
diff --git a/img/focus_7_6.png b/img/focus_7_6.png
diff --git a/img/focus_8_7.png b/img/focus_8_7.png
diff --git a/img/material_sorting.png b/img/material_sorting.png
diff --git a/img/motion_blur.png b/img/motion_blur.png
diff --git a/img/preface.png b/img/preface.png
diff --git a/img/reflection_wikipedia.png b/img/reflection_wikipedia.png
diff --git a/img/refraction_wikipedia.png b/img/refraction_wikipedia.png
diff --git a/img/sss_close_to_light.png b/img/sss_close_to_light.png
diff --git a/img/static.png b/img/static.png
diff --git a/img/stream_compaction.png b/img/stream_compaction.png
diff --git a/img/subsurface_scattering.png b/img/subsurface_scattering.png
diff --git a/img/withou_subsurface_scattering.png b/img/withou_subsurface_scattering.png
diff --git a/img/without_anti_aliasing.png b/img/without_anti_aliasing.png
diff --git a/img/without_anti_aliasing_zoomin.png b/img/without_anti_aliasing_zoomin.png
diff --git a/img/without_sss_close_to_light.png b/img/without_sss_close_to_light.png
diff --git a/scenes/cornell.txt b/scenes/cornell.txt
@@ -6,7 +6,9 @@ SPECRGB     0 0 0
 REFL        0
 REFR        0
 REFRIOR     0
-EMITTANCE   5
+EMITTANCE   15
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
 
 // Diffuse white
 MATERIAL 1
@@ -17,6 +19,8 @@ REFL        0
 REFR        0
 REFRIOR     0
 EMITTANCE   0
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
 
 // Diffuse red
 MATERIAL 2
@@ -27,6 +31,8 @@ REFL        0
 REFR        0
 REFRIOR     0
 EMITTANCE   0
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
 
 // Diffuse green
 MATERIAL 3
@@ -37,6 +43,8 @@ REFL        0
 REFR        0
 REFRIOR     0
 EMITTANCE   0
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
 
 // Specular white
 MATERIAL 4
@@ -47,13 +55,40 @@ REFL        1
 REFR        0
 REFRIOR     0
 EMITTANCE   0
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
+
+// glass
+MATERIAL 5
+RGB         .98 .98 .98
+SPECEX      0
+SPECRGB     .98 .98 .98
+REFL        1
+REFR        1
+REFRIOR     1.5
+EMITTANCE   0
+SIGMAA      0 0 0
+SIGMAS      0 0 0 
+
+// 
+MATERIAL 6
+RGB         .98 .98 .98
+SPECEX      0
+SPECRGB     .98 .98 .98
+REFL        0
+REFR        0
+REFRIOR     0
+EMITTANCE   0  
+SIGMAA      0.74 1.14 1.66
+SIGMAS      2.44 1.66 1.23
+                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      SDEPTH    0.5
 
 // Camera
 CAMERA
 RES         800 800
 FOVY        45
 ITERATIONS  5000
-DEPTH       8
+DEPTH       20
 FILE        cornell
 EYE         0.0 5 10.5
 LOOKAT      0 5 0
@@ -108,10 +143,48 @@ TRANS       5 5 0
 ROTAT       0 0 0
 SCALE       .01 10 10
 
-// Sphere
+
+
+// Ball 1
 OBJECT 6
 sphere
+material 1
+TRANS       -4 5 -4
+ROTAT       0 0 0
+SCALE       2.8 2.8 2.8
+
+// Ball 2
+OBJECT 7
+sphere
 material 4
-TRANS       -1 4 -1
+TRANS       -2 5 -2
 ROTAT       0 0 0
-SCALE       3 3 3
+SCALE       2.8 2.8 2.8
+//VEL         -1 1 -1
+
+// Ball 3
+OBJECT 8
+sphere
+material 6
+TRANS       0 5 0
+ROTAT       0 0 0
+SCALE       2.8 2.8 2.8
+//VEL         -1 -1 1
+
+// Ball 4
+OBJECT 9
+sphere
+material 2
+TRANS       2 5 2
+ROTAT       0 0 0
+SCALE       2.8 2.8 2.8
+//VEL         0 2 0
+
+// Ball 5
+OBJECT 10
+sphere
+material 5
+TRANS       4 5 4
+ROTAT       0 0 0
+SCALE       2.8 2.8 2.8
+