Cellular dosimetry of [177Lu]Lu-DOTA-[Tyr3]octreotate radionuclide therapy: the impact of modeling assumptions on the correlation with in vitro cytotoxicity

Background: Survival and linear-quadratic model fitting parameters implemented in treatment planning for targeted radionuclide therapy depend on accurate cellular dosimetry. Therefore, we have built a refined cellular dosimetry model for [177Lu]Lu-DOTA-[Tyr3]octreotate (177Lu-DOTATATE) in vitro experiments, accounting for specific cell morphologies and sub-cellular radioactivity distributions. Methods: Time activity curves were measured and modeled for medium, membrane-bound, and internalized activity fractions over 6 days. Clonogenic survival assays were performed at various added activities (0.1–2.5 MBq/ml). 3D microscopy images (stained for cytoplasm, nucleus, and Golgi) were used as reference for developing polygonal meshes (PM) in 3DsMax to accurately render the cellular and organelle geometry. Absorbed doses to the nucleus per decay (S values) were calculated for 3 cellular morphologies: spheres (MIRDcell), truncated cone-shaped constructive solid geometry (CSG within MCNP6.1), and realistic PM models, using Geant4-10.03. The geometrical set-up of the clonogenic survival assays was modeled, including dynamic changes in proliferation, proximity variations, and cell death. The absorbed dose to the nucleus by the radioactive source cell (self-dose) and surrounding source cells (cross-dose) was calculated applying the MIRD formalism. Finally, the correlation between absorbed dose and survival fraction was fitted using a linear dose-response curve (high α/β or fast sub-lethal damage repair half-life) for different assumptions, related to cellular sha