Hi there! I'm Nikolaos Sourlos

Senior AI/Software Engineer at Nostrion with a focus on LLMs and Structured Extraction.

My core work at Nostrion involves orchestrating structured LLM extraction using Pydantic AI and building RAG systems on legal documents, served via MCP servers and Open WebUI.

Previously, at TU Delft, I focused on benchmarking and evaluating LLMs on Q&A tasks, building prompt-driven agent systems, integrating LangSmith, and providing reproducible evaluation metrics across providers such as OpenAI, Anthropic, Gemini, HuggingFace, Together, and Groq. I enjoy the challenge of turning raw research prototypes into reproducible systems that researchers can rely on. I also led initiatives to compare GPU providers for on-demand rentals, to upgrade GPU infrastructure of the university.

Previously, I pursued a PhD project on validating AI lung nodule detection software, assessing sources of bias, and collaborating with interdisciplinary teams. My background in Physics and Biomedical Engineering means I approach problems with both theoretical rigor and an applied engineering mindset.

I also run a sole proprietorship company, using Python/Flask on the backend and HTML/CSS/Tailwind on the frontend. I’m passionate about LLMs, deepfakes, stable diffusion, computer vision, and everything that automates the boring parts of everyday development work.