The posting
We are seeking a highly experienced German-speaking Senior AI Architect for a long-term public-sector project in Germany. We're looking for an architect with a deep technical foundation in modern AI systems: someone who has led the architecture of multiple GenAI solutions and understands LLMs not just conceptually, but from the inside, including fine-tuning and productive deployment.
The environment is primarily on-premises / sovereign cloud, so experience designing AI systems outside of hyperscaler-native setups is key.
This is a long-term, full-time contract position, approx. 90% remote and 10% on site in Nuremberg.
Work Conditions
- Start Date: ASAP
- Location: ~90% remote, ~10% on site in Nuremberg
- Workload: Full-time
- Long-term contract based-role
- Very good German and strong communication skills.
- Lead architect experience on at least 2–3 GenAI projects, ideally in the public sector (not required).
- In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and comparable architectures.
- Deep understanding of modern AI model architecture and hands-on implementation experience, e.g. LLM fine-tuning or building productive GenAI solutions.
- Experience with on-prem architectures or sovereign cloud environments.
- Technical background, ideally a degree in computer science, machine learning, artificial intelligence, or data science.
- Project management qualities are a strong plus.
Technical Requirements
Mandatory
- Large Language Models: architecture, selection, evaluation, deployment
- RAG and GraphRAG architectures
- AI Gateways and LLM orchestration patterns
- LLM fine-tuning and/or productive GenAI solution development
- On-prem or sovereign cloud AI infrastructure
Nice to have
- Public sector project experience (Germany / DACH)
- AWS
- Project management or technical delivery lead experience
- Academic background in ML, AI, or data science



