Generative 3D/4D vision researcher and technical builder.
I build generative models for 3D and 4D scene reconstruction, and the systems that make
them run. At Athlence Sports I work on multi-view 4D reconstruction and generative novel
view synthesis for dynamic sports scenes. Ph.D. from ETH Zurich, with research at Google
and Meta.
Background
At Athlence the work spans the whole chain: capture, calibration, scene representation
and rendering. Alongside it runs a second body of work applying vision to satellite and
aerial imagery, including population mapping and disaster response with the
ICRC.
I did the Ph.D. in the Photogrammetry and Remote Sensing Lab. My doctoral advisors were
Prof.
Konrad Schindler and
Prof.
Devis Tuia. Before the Ph.D. I took my bachelor's and master's degrees in
Geomatics Engineering at ETH Zurich, specializing in deep learning and computer vision.
I organize the ZurichAI
meetups (ZurichCV, ZurichNLP, ZurichRobotics) and am a technical mentor at Hack4Good.
Elastic3D is a controllable, end-to-end method for monocular-to-stereo video conversion. Based
on latent diffusion with a novel guided VAE decoder, it ensures sharp and epipolar-consistent
output while allowing intuitive control over the stereo effect at inference time.
Native 3D Gaussian Splatting for Apple Silicon, implemented with Metal. A fused
forward+backward rasteriser compiled at runtime, so there is no CUDA and no Xcode.
Across all eight NeRF-synthetic scenes it reaches 31.9 dB in about 6 minutes, where
the strongest competitor needs 28 minutes to reach 29.2. Hover to watch it converge.
Marigold (TPAMI) generalizes the original CVPR'24 monocular depth estimator into a
diffusion-based foundation model for dense prediction,
supporting tasks such as depth, surface normals, and intrinsic image decomposition with only a
few diffusion steps and efficient fine-tuning.
PaGeR lifts 3D foundation models built for perspective images into the panorama domain, recovering a full
360° scene from one panoramic image. It predicts scale-invariant depth, metric depth, surface normals
and sky masks in a single forward pass, zero-shot.
Marigold-DC is a zero-shot depth completion framework. We repurpose Marigold as an
off-the-shelf monocular depth estimator and guide it with sparse depth observations.
Marigold is an affine-invariant monocular depth estimation method based on Stable Diffusion,
leveraging its rich prior knowledge for better generalization and achieving state-of-the-art
performance with significant improvements,
even with synthetic training data.
Neural heat fields model a physically exact point spread function, giving analytically correct anti-aliasing
at any scale at no extra cost. Thera turns this into aliasing-free arbitrary-scale super-resolution while
staying parameter-efficient.
We propose DADA, a novel approach to depth image super-resolution by combining guided
anisotropic diffusion with a deep convolutional network, enhancing both edge detail and
contextual reasoning.
This method achieves unprecedented results in three benchmarks, especially at larger scales like
x32
ML-Bokeh extends the SHARP codebase with physically-based rendering and smart autofocus for
cinematic depth-of-field effects. It features synthetic aperture simulation, artifact-free
spiral sampling, and an automated autofocus system based on subject detection.
Focal length is often missing from internet photos and absent from vintage ones. Recovering it from a single
view is ill-posed and needs scene understanding, so I trained a model to predict it and open-sourced the
weights.
Earth observation & humanitarian response
Vision applied to satellite and aerial imagery, including work with the ICRC on population mapping and disaster response.
POPCORN is a lightweight population mapping method using free satellite images and minimal data,
surpassing existing accuracy and providing interpretable maps for mapping populations in
data-scarce regions.
POMELO is a deep learning model that creates fine-grained population maps using coarse census
counts and open geodata,
achieving high accuracy in sub-Saharan Africa and effectively estimating population numbers even
without any census data.
We investigate whether medium-resolution Copernicus Sentinel-1 and Sentinel-2 imagery can
support rapid building damage assessment after disasters.
We introduce the xBD-S12 dataset and show that, despite 10 m resolution, building damage
can be mapped reliably across many events, making Copernicus data a practical complement to
limited very-high resolution imagery.
A lightweight, distilled version of POPCORN that estimates population from Sentinel-2 imagery alone, compact
enough for fast large-scale inference. An all-in-one version fetches the imagery and runs the model in a
single command.
We propose using neural ordinary differential equations (NODEs) combined with RNNs to improve
crop classification from irregularly spaced satellite images,
showing enhanced accuracy over common methods, especially with few observations,
and better early-season forecasting due to the continuous representation of latent dynamics.
A 42-year pan-Arctic land surface temperature record, downscaled from AVHRR GAC to 1 km with a deep
anisotropic diffusion model guided by land cover, elevation and vegetation height. The twice-daily 1 km
series extends climate monitoring into the pre-MODIS era.
We propose a method for forecasting the emergence and timing of new buildings using a deep
neural network with a custom pretraining procedure, validated on the SpaceNet7 dataset.
Automates SLF's ground-based snow monitoring in the Dischma valley, pairing deep fog classification with
pixel-wise snow segmentation. It removes manual thresholds and generalises across cameras, supporting
avalanche research and satellite validation.
This work presents a method for automatically refining 3D city models generated from aerial
images by using a neural network trained with reference data and a loss function to improve
DSMs,
effectively preserving geometric structures while removing noise and artifacts.
A lot of useful advice in research never gets written down. It travels through
networks that not everyone has access to. I keep time aside for short, informal
conversations with students and early-career researchers: picking a research direction,
moving between industry and academia, or working out a sensible next step.
If that would be useful, email me a few lines about your background and what you would
like to talk through.
Contact
Happy to talk about generative 3D/4D reconstruction, neural rendering, or building
research systems that ship.
The portrait is a 3D reconstruction. It follows the pointer, and dragging it pulls
focus through a synthetic aperture: 576 pre-rendered views for the parallax, and a rack
of focus steps whose depth of field is drawn from the predicted depth map.
SHARP predicts the Gaussians from one
photograph and
metal-gauss renders them on
Apple Silicon.
Thank you for the template Jon
Barron.