Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Image processing with PDEs

Image processing with PDEs

Avatar for Mohammed Hachama

Mohammed Hachama

November 06, 2026

More Decks by Mohammed Hachama

Other Decks in Education

Transcript

  1. Digital Image Processing Restoration I: PDEs (Week 1) NHSM -

    5th year - Fall 2025 - Prof. Mohammed Hachama [email protected] hachama.github.io/home
  2. Image processing • Image = Matrix • Pixel = indexes

    + intensities NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 2/30
  3. Image processing • Image = Matrix • Pixel = indexes

    + intensities • Choice of a frame: Origin + Axes NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 2/30
  4. Image processing • Image = Matrix • Pixel = indexes

    + intensities • Choice of a frame: Origin + Axes • Pixel Neighborhood: 2 horizontal and 2 vertical NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 2/30
  5. Image processing • Matrix or a discrete function I :

    {1, ..., N} × {1, ..., M} → {0, ..., 255} • Continuous representation: u : Ω ⊂ R2 → R NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 2/30
  6. Image processing • Optimization problems: argminJ(u) u Z J(u) =

    F (x , u, ∇u, ∇2 u)dx Ω • Evolution equations: u(t, x ) ∂u = H(t, x , u, ∇u, ∇2 u) ⇝ ū = u(∞, .) ∂t • Stationary PDE F (u, u0 ) = 0 NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 2/30
  7. Image Restoration using PDEs NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 3/30
  8. Outline • Models: PDE • Interpretation • Theoretical results •

    Numerical schemes • Simulations: evaluation and comparison NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 4/30
  9. Gaussian filter uσ = (gσ ⋆ u0 )(x ) NHSM

    - 5th year: Digital Image Processing   1 |x |2 where gσ (x ) = exp − 2 . 2πσ 2 2σ - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  10. Gaussian filter uσ = (gσ ⋆ u0 )(x ) NHSM

    - 5th year: Digital Image Processing   1 |x |2 where gσ (x ) = exp − 2 . 2πσ 2 2σ - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  11. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  12. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  13. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  14. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  15. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  16. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  17. Gaussian filter • Convolution NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  18. Gaussian filter • Gaussian filter 0 Fg = 1 0

    NHSM - 5th year: Digital Image Processing 1 2 1 - Introduction (Week 1) - 0 1 0 M. Hachama ([email protected]) 6/30
  19. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  20. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  21. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  22. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  23. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  24. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  25. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  26. Gaussian filter • Gaussian filter NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 6/30
  27. Heat equation • PDE   ∂u (x , t)

    = ∆u(x , t), ∂t  u(x , 0) = u0 (x ). t ≥ 0, x ∈ R2 • Non uniqueness without additional conditions NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  28. Heat equation • Existence and uniqueness on R2 We consider

    that images are primarily defined on [0, 1]2 and extended to C = [−1, 1]2 via mirror symmetry. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  29. Heat equation • Existence and uniqueness on R2 We consider

    that images are primarily defined on [0, 1]2 and extended to C = [−1, 1]2 via mirror symmetry. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  30. Heat equation • Existence and uniqueness on R2 We consider

    that images are primarily defined on [0, 1]2 and extended to C = [−1, 1]2 via mirror symmetry. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  31. Heat equation • Existence and uniqueness on R2 We consider

    that images are primarily defined on [0, 1]2 and extended to C = [−1, 1]2 via mirror symmetry. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  32. Heat equation • Existence and uniqueness on R2 We consider

    that images are primarily defined on [0, 1]2 and extended to C = [−1, 1]2 via mirror symmetry. • L1# (C ) = u defined on C , such that Z u(x ) dx < +∞. C NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  33. Heat equation • Existence and uniqueness on R2 Then, u(t,

    .) = g√2t ∗ u0 is the unique function in L1# (C ), satisfying ( ∂u ∂t = ∆u, ∥u − u0 ∥L1 (C ) → 0, (t, x ) ∈ (0, ∞) × R2 t → 0. and • ∀t1 > 0, ∃c > 0, ∀t ≥ t1 : sup |u(t, x )|≤ c(t1 ) ∥u0 ∥L1# (C ) x ∈R2 • Si u0 ∈ L∞ # (C ) : inf u0 (x ) ≤ u(t, x ) ≤ sup u0 (x ), ∀t > 0 x ∈R2 NHSM - 5th year: Digital Image Processing x ∈R2 - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  34. Heat equation • Existence and uniqueness • On R2 ,

    we need a prior bound on the growth rate of u for |x |→ ∞ 2 |u(x , t)|≤ Ae a|x | , (x ∈ Rn , 0 ≤ t ≤ T ) • On bounded domain Ω: u0 continuous or L2 with Dirichlet or Neumann BC. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 7/30
  35. Heat equation • Implementation: ∀t > 0, ∂u ∂t =

    ∆u ∂u u (n+1) − u (n) ≈ ∂t τ k k k k k ∆u ≈ ui+1,j + ui−1,j + ui,j+1 + ui,j−1 − 4ui,j k+1 k k k k k = (1 − 4 τ )ui,j + τ ui+1,j + τ ui−1,j + τ ui,j+1 + τ ui,j−1 ui,j 0 F = τ 0 τ 1 − 4τ τ 0 τ 0 • Numerical stability condition: τ ≤ 0.25 NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 8/30
  36. Heat equation • Heat equation: ∀t > 0, NHSM -

    5th year: Digital Image Processing ∂u ∂t = ∆u - Introduction (Week 1) - M. Hachama ([email protected]) 8/30
  37. Heat equation Denoising effect/Blur NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 8/30
  38. Perona-Malik PDE • Equation:  ∂u  = div(c(|∇u|)∇u) 

    ∂t u(x , 0) = u0 (x )   u = 0 n Ω × ]0, T [ , Ω, ∂Ω × ]0, T [ where c(s) > 0, non-increasing, c(0) = 1, and lim c(s) = 0: x →+∞ • c1 (s) = 1/(1 + s /λ ),  • c2 (s) = exp −s 2 /(2λ2 ) , 2 2 • Charbonnier diffusivity: c3 (s) = 1/( p 1 + (s/k)2 ). • Ill-posed problem: A sol. (classical, weak, . . . ) does not exist. • Good numerical results. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 10/30
  39. Perona-Malik PDE • Central differences to approximate the gradient ci,j

    = c(|∇ui,j |) s 2  2 ui,j+1 − ui,j−1 ui+1,j − ui−1,j + |∇ui,j |≃ 2 2 • Discretized divergence and time derivative: ∂u ∂t k+1 k ui,j −ui,j ∆t = ∂ ∂ ∂x (c(|∇u|)ux ) + ∂y (c(|∇u|)uy )   k k k k k k = ci+ ui+1,j − ui,j − ci− ui,j − ui−1,j 1 1 ,j 2 ,j 2   k k k k k k + ci,j+ ui,j+1 − ui,j − ci,j− ui,j − ui,j−1 1 1 2 2 • Spatial derivatives using centred scheme at Mid-points. • Evaluation c at mid-points = averages over neighboring pixels. • ∆t ≤ 0.25 to ensure stability. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 10/30
  40. Outline Image Restoration using PDEs Heat equation Perona-Malik PDE Catté-Morel-Lions’

    PDE Weickert’s PDE Morphological PDE’s Mean Curvature Motion (MCM) Deconvolution Inpainting NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 11/30
  41. PM variant: Catté-Morel-Lions’ PDE • Equation  ∂u  =

    div(c(|∇Gσ ∗ u|)∇u) Ω × ]0, +∞[ ,  ∂t u(x , 0) = u0 (x ) Ω,   u = 0 ∂Ω × ]0, +∞[ n • Existence and Uniqueness Let c: R+ −→ R+ ∗ be smooth, decreasing with c(0) = 1 , lim c(s) = 0 s→+∞ √ and s 7 −→ c( s) smooth. If u0 ∈ L2 (Ω), then there exists a unique solution u ∈ C([0, T ]; L2 (Ω)) ∩ (]0, T [ ; W 1,2 (Ω)). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 12/30
  42. PM variant: Catté-Morel-Lions’ PDE • Schauder’s fixed-point theorem u n+1

    = T (u n )  ∂u n+1  = div (g(| (∇Gσ ∗ u n ) |)∇u n+1 ) Ω × ]0, +∞[ ,  ∂t u n+1 (x , 0) = u0 (x ) Ω,   ∂un+1 = 0 ∂Ω × ]0, +∞[ ∂n (u n )n converges in C ([0, T ]; L2 (Ω)) to the unique solution. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 12/30
  43. Weickert’s PDE • Take direction of the image gradients into

    account ∂u = div(D(∇u)∇u) ∂t where D represents a matrix-valued diffusion tensor that describes the smoothing directions and the corresponding diffusivities. • D(∇u) = I: constant diffusion coefficient in all directions • D(∇u) = g(|∇uσ |)I: Perona-Malik type nonlinear diffusion • D is a function of the structure tensor " ux2 ∇u∇u T = ux uy ux uy uy2 # • Eigenvectors: v1 ∥∇u (λ1 = |∇u|) and v2 ⊥∇u (λ2 = 0). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 14/30
  44. Weickert’s PDE • Structure tensor = image feature describing the

    local orientation information J(∇u) = gσ ∗ (∇uσ ∇uσT ). Isotropic struct. Linelike struct. Corners µ1 ≈ µ2 µ1 >> µ2 ≈ 0 µ1 ≥ µ2 >> 0 NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 14/30
  45. Weickert’s PDE • Take direction of the image gradients into

    account ∂u = div(D(J(∇u))∇u) ∂t • How to choose the matrix D(J(∇u))? • Keep the eigenvectors of J(∇u). • Choose the eigenvalues of D, λ1 and λ2 , depending on the eigenvalues of J(∇u), µ1 and µ2 . NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 14/30
  46. Weickert’s PDE • Edge-enhancing anisotropic diffusion ∂u ∂t = div(D(J(∇u))∇u)

    ( 1  2  µ1 = 0 λ1 = 1 − exp −α else µ4 1 λ2 = NHSM - 5th year: Digital Image Processing 1 - Introduction (Week 1) - M. Hachama ([email protected]) 14/30
  47. Weickert’s PDE • Coherence-enhancing aniso. diffusion ∂u ∂t = div(D(J(∇u))∇u)

    λ1 = λ2 = α ( α µ1 = µ2 α + (1 − α) exp NHSM - 5th year: Digital Image Processing  −1 (µ1 −µ2 )2 - Introduction (Week 1) -  else M. Hachama ([email protected]) 14/30
  48. Weickert’s PDE • Existance and uniqueness Assume that u0 ∈

    L∞ (Ω), ρ ≥ 0, and σ, T > 0. Let a := ess inf u0 , b := ess sup u0 , and consider the problem  ∂u  = div (D(Jρ (∇uσ |)∇u) Ω × ]0, T ] ,  ∂t u(x , 0) = u0 (x ) Ω,   u = 0 ∂Ω × ]0, T ] n where D ∈ C ∞ (R2×2 , R2×2 ),d12 (J) = d21 (J) for all symmetric matrices J, and ∀w ∈ L∞ (Ω, R2 ), there exists a positive lower bound for the eigenvalues of D(Jρ (w )). Then, the problem has a unique solution which satisfies u ∈ C ([0, T ]; L2 (Ω)) ∩ L2 (0, T ; H 1 (Ω)), ∂t u ∈ L2 (0, T ; H 1 (Ω)). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 14/30
  49. Weickert’s PDEs • Edge–Enhancing Diffusion (EED): • Smooths along edges,

    prevents smoothing across edges. • Preserves sharp boundaries and contrast. • Noise reduced within homogeneous regions. • No structure elongation; locally adaptive. • Coherence–Enhancing Diffusion (CED): • Enhances elongated, coherent structures. • Diffuses strongly along dominant orientation. • Reconnects broken lines or ridges. • May blur edges not aligned with coherence. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 15/30
  50. Morphological PDE’s • Mathematical morphology (morphological filters) NHSM - 5th

    year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 17/30
  51. Morphological PDE’s • Morphology is an approach to image analysis

    based on shapes NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 17/30
  52. Morphological PDE’s • Morphology is an approach to image analysis

    based on shapes NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 17/30
  53. Morphological PDE’s • Morphology is an approach to image analysis

    based on shapes NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 17/30
  54. Morphological PDE’s • Equation: Alvarez, Guichard, Lions and Morel ∂u

    = g(curv (u), t)|∇u|. ∂t where G is a .. ? ∇u • If u ∈ C 2 , then curv (u) = div( |∇u| ). • Particular motions • Mean curvature motion (MCM) ∂u = curv (u) |∇u|. ∂t • Affine curvature motion (ACM) 1 ∂u = curv (u) 3 |∇u| ∂t NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 17/30
  55. Outline Image Restoration using PDEs Heat equation Perona-Malik PDE Catté-Morel-Lions’

    PDE Weickert’s PDE Morphological PDE’s Mean Curvature Motion (MCM) Deconvolution Inpainting NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 18/30
  56. Mean Curvature Motion (MCM) • Mean curvature motion (MCM) ∂u

    = curv (u) |∇u|. ∂t NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  57. Mean Curvature Motion (MCM) • Geometric interpretation • Heat equation:

    ∂u ∂u = ∆u ⇐⇒ = uηη + uξξ ∂t ∂t NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  58. Mean Curvature Motion (MCM) • Geometric interpretation • MCM equation:

    ∂u = |∇u|div ∂t  ∇u |∇u|  ⇐⇒ ∂u = uξξ , ∂t • Curves evolution ∂t C (p, t) = κ(p, t)⃗k t = ∂ss C (p, t) NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  59. Mean Curvature Motion (MCM) • Geometric interpretation • Mean curvature

    motion (MCM) ∂u = curv (u) |∇u|. ∂t • A shape becomes convex and thereafter evolves towards an ellipse before collapsing. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  60. Mean Curvature Motion (MCM) • Geometric interpretation • Mean curvature

    motion (MCM) ∂u = curv (u) |∇u|. ∂t NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  61. Mean Curvature Motion (MCM) • Simulations NHSM - 5th year:

    Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  62. Mean Curvature Motion (MCM) • Simulations NHSM - 5th year:

    Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  63. Mean Curvature Motion (MCM) • Simulations NHSM - 5th year:

    Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  64. Mean Curvature Motion (MCM) • Another interpretation: median filter 52

    47 51 49 20 48 50 52 53 → 20, 47, 48, 49, 50, 50, 51, 52, 53 → 47 50 51 49 50 48 50 53 50 • Iterated weighted median filters on images converge to the MCM. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  65. Mean Curvature Motion (MCM) • Another interpretation: median filter vs

    gaussien filter NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  66. Mean Curvature Motion (MCM) • Another interpretation: median filter vs

    gaussien filter NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  67. Mean Curvature Motion (MCM) • Another interpretation: median filter vs

    gaussien filter NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  68. Mean Curvature Motion (MCM) • Another interpretation: median filter vs

    gaussien filter NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 19/30
  69. Affine Morphological Scale Space (AMSS) • MCM: Curve evolution ∂t

    C (p, t) = κ(p, t)⃗k t = ∂ss C (p, t) NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 20/30
  70. Affine Morphological Scale Space (AMSS) • AMSS: Curve evolution ∂t

    C (p, t) = κ(p, t)1/3⃗k t = ∂ss C (p, t) ∂u = curv (u)1/3 |∇u|. ∂t NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 20/30
  71. Affine Morphological Scale Space (AMSS) • Among all these possible

    curvature-driven motions, formulated either in a scalar or in a geometrical way ∂u = |∇u|F (curv (u)), ∂t ∂C F (κ)N, ∂t the AMSS special case is affine invariant: if u is a solution then so is (x , t) 7→ u(Ax , t). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 20/30
  72. Affine Morphological Scale Space (AMSS) • MCM and AMSS have

    also been applied to denoising. • The special invariances of AMSS are useful for shape recognition tasks, for corner detection, and for texture discrimination. • MCM and AMSS: ”Viscosity” solutions exist! • Min-Max flow (Malladi and Sethian): use either min(κ, 0) or max (κ, 0), depending on the average grey value within a certain neighbourhood. • Good denoising properties. But, well-posedness results are not known up to now, since the theory of viscosity solutions is no longer applicable. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 20/30
  73. Deconvolution • Heat equation   ∂u (x , t)

    = ∆u(x , t), ∂t  u(x , 0) = u0 (x ). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - t ≥ 0, x ∈ R2 M. Hachama ([email protected]) 22/30
  74. Deconvolution • Reverse Heat equation   ∂u (x ,

    t) = -∆u(x , t), ∂t  u(x , T ) = u0 (x ). NHSM - 5th year: Digital Image Processing 0 ≤ t ≤ T , x ∈ R2 - Introduction (Week 1) - M. Hachama ([email protected]) 22/30
  75. Deconvolution • Reverse Heat equation NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 22/30
  76. Deconvolution • Van Cittert’s Algorithm • Model u0 = h

    ∗ u • Let ĝ = 1 − ĥ so that we can write formally ! +∞ X uˆ0 û = = ĝ k uˆ0 . 1 − ĝ k=0 If we put ûn = Pn k=0 ĝ  k uˆ0 , we get ûn+1 = uˆ0 + ĝ ûn = uˆ0 + (1 − ĥ)ûn , un+1 = u0 + un − h ∗ un NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 22/30
  77. Deconvolution • Van Cittert’s Algorithm NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 22/30
  78. Deconvolution • Heat equation   ∂u (x , t)

    = ∆u(x , t), ∂t  u(x , 0) = u0 (x ). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - t ≥ 0, x ∈ R2 M. Hachama ([email protected]) 22/30
  79. Deconvolution • Osher-Rudin ”shock filter”   ∂u (x ,

    t) = −sign(∆u(x , t)) |∇u(x , t)|, ∂t  u(x , 0) = u0 (x ). NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - t ≥ 0, x ∈ R2 M. Hachama ([email protected]) 22/30
  80. Deconvolution • Osher-Rudin ”shock filter” ut = −sign(∆u(x , t))

    |∇u(x , t)| NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 22/30
  81. Inpainting • I : Ω → R (Domain of definition

    of the image) • D ⊂ Ω : (Missing values), I|D unknown NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 24/30
  82. Inpainting Harmonic inpainting • Linear interpolation u(i, j) = 

    1 u(i − 1, j) + u(i + 1, j) + u(i, j − 1) + u(i, j + 1) 4 • Interpretation (Finite differences): ∆u(i, j) = 0 NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 25/30
  83. Inpainting Harmonic inpainting • Equation ∆u u NHSM - 5th

    year: Digital Image Processing = = 0, in D, g, on ∂D. - Introduction (Week 1) - M. Hachama ([email protected]) 25/30
  84. Inpainting Harmonic inpainting • Equation ∆u u = = 0,

    in D, g, on ∂D. • Inpainting + Denoising   in D,  −∆u = 0, −∆u = λ(g − u), in Ω\D.   u = 0, on ∂Ω. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 25/30
  85. Inpainting Harmonic inpainting • Minimization over H 1 (smooth functions)

    • cannot pick up structures such as edges. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 25/30
  86. Inpainting Total Variation Inpainting • Robust interpolation ( ) u(i,

    j) = median u(i + 1, j), u(i − 1, j), u(i, j + 1), u(i, j − 1) • Iterating a median filter n times (n → +∞) -¿ mean curvature flow (PDE)   ∇u =0 |∇u|.div |∇u| NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 26/30
  87. Inpainting Total Variation Inpainting • Steady state PDE  

     ∇u  = 0, −div    |∇u|  ∇u −div |∇u| = λ(g − u),    u = 0, in D, in Ω\D. on ∂Ω. • Evolution  ut = div NHSM - 5th year: Digital Image Processing ∇u |∇u| - Introduction (Week 1) -  M. Hachama ([email protected]) 26/30
  88. Inpainting Total Variation Inpainting • Propagate sharp edges into the

    damaged domain • Penalizes length of edges: cannot connect contours across very large distances • Can result in corners across the inpainting domain NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 26/30
  89. Inpainting Absolutely minimising Lipschitz extensions NHSM - 5th year: Digital

    Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 27/30
  90. Inpainting Absolutely minimising Lipschitz extensions • Interpolate along the gradient

    u(x0 ) = 1 (u(x0 + h∇u) + u(x0 − h∇u)) + O(h2 ) 2 • Absolutely minimizing Lipschitz extensions (AMLE): D 2 u(∇u, ∇u)(x0 ) = 0 NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 27/30
  91. Inpainting Absolutely minimising Lipschitz extensions • The level lines are

    interpolated linearly • connected by a straight line across the missing domain • The direction of the level lines is not preserved • Solution: use of higher-order derivatives • Encode additional information (not only the length of level lines) such that the curvature NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 27/30
  92. Transport inpainting • Structural image inpainting means that we fill

    in missing parts in images by using local structural information only. • L = Information and D = Direction ∇L.D = 0 , ∂I = ∇L.D , ∂t NHSM - 5th year: Digital Image Processing Steady state equation Evolution equation - Introduction (Week 1) - M. Hachama ([email protected]) 28/30
  93. Transport Along Level Lines • Transport the known image structures

    along the level lines. ⊥ ∇ |{z} ∆u . ∇ | {zu} Info. = 0 Direction • Evolution ut = ∇∆u.∇⊥ u • Adding anisotropic diffusion ut = ∇∆u.∇⊥ u + ν∇ . (g(|∇u|)∇u) NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 29/30
  94. Transport Along Level Lines NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 29/30
  95. Transport Along Level Lines NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 29/30
  96. Transport Along Level Lines NHSM - 5th year: Digital Image

    Processing - Introduction (Week 1) - M. Hachama ([email protected]) 29/30
  97. References • G. Aubert, P. Kornprobst, ”Mathematical Problems in Image

    Processing”; Applied Mathematical Sciences 147; Springer, New York; 2006. • T. Chan and J. Shen, ”Image Processing And Analysis: Variational, PDE, Wavelet, And Stochastic Methods”, Society for Industrial and Applied Mathematics, 2005. • Joachim Weickert, ”Anisotropic Diffusion in Image Processing, ECMI Series, Teubner-Verlag, Stuttgart, Germany, 1998. NHSM - 5th year: Digital Image Processing - Introduction (Week 1) - M. Hachama ([email protected]) 30/30