open to LLM research scientist/engineer positions →
Kristian Schwethelm

Kristian Schwethelm

PhD Student · Technical University of Munich
large language models · looped transformers · trustworthy AI

I'm a PhD student at the Technical University of Munich, supervised by Prof. Daniel Rückert and Prof. Georgios Kaissis. My research spans the full LLM stack, from pretraining and reinforcement learning to efficient inference and practical applications.

My current research is on looped, depth-recurrent transformers and on benchmarking LLM agents in clinical decision workflows. I've previously published on differentially private learning and hyperbolic neural networks. Best Graduate Award (M.Sc. Applied Computer Science, 2024), NeurIPS 2026 Spotlight, NeurIPS 2025 Top Reviewer.

Preprint · 2026 Depth-adaptive Inference of Looped LMs via Continuous Depth Batching → NeurIPS · 2026 Spotlight: How Much Is One Recurrence Worth? → ML4H · 2026 MIMIC-Note-Extract paper and dataset →

Selected work

Preprint '26

Depth-adaptive Inference of Looped Language Models via Continuous Depth Batching

K. Schwethelm, D. Rückert, G. Kaissis

We introduce the first efficient end-to-end inference method for depth-adaptive looped language models, which are taking less compute for "easy" tokens and more for "hard" tokens, translating per-token compute savings into practical inference speedups through continuous depth batching.

NeurIPS '26 Spotlight ✨

How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models

K. Schwethelm, D. Rückert, G. Kaissis

We measure the capacity of parameters of looped LMs with a scaling law exponent 𝜑 and use Δ𝜑 as a diagnostic: truncated BPTT lowers it (worse loop), hyperconnections raise it (real gain), even though both improve validation loss. Model designers should make each loop worth its compute.

ML4H '26

MIMIC-Note-Extract: A Large-Scale Structured Dataset Extracted from MIMIC-IV-Note Discharge Summaries

K. Schwethelm*, J. Kuntzer*, C. Ketzer, E. Wende, M. Schlager, D. Rückert, G. Kaissis, F. Jungmann, P. Hager

We release MIMIC-Note-Extract (MNE), a structured clinical dataset extracted from 300,000+ MIMIC discharge summaries using schema-guided LLMs. We use MNE to build a clinical decision-making benchmark for LLM agents.

TMLR '25

Visual Privacy Auditing with Diffusion Models

K. Schwethelm, J. Kaiser, M. Knolle, S. Lockfisch, D. Rückert, A. Ziller

Diffusion models, used as image priors, can reconstruct training data from differentially private models, exposing a gap between DP's theoretical bounds and what actually leaks in practice.

SaTML '25

Differentially Private Active Learning: Balancing Effective Data Selection and Privacy

K. Schwethelm, J. Kaiser, J. Kuntzer, M. Yiğitsoy, D. Rückert, G. Kaissis

First framework for combining active learning with DP-SGD in standard supervised settings. We introduce step amplification to fix privacy budget waste and show which acquisition functions still work under DP, and which fall apart.

ICLR '24

Fully Hyperbolic Convolutional Neural Networks for Computer Vision

K. Schwethelm*, A. Bdeir*, N. Landwehr

HCNN: a CNN that lives entirely in hyperbolic space. We generalize the convolutional layer, batchnorm, and the classifier head to the Lorentz model, so the network leverages hyperbolic geometry at every layer instead of just the head.