High Sky
Senior LLM Engineer (SWE Agent Development)
1w ago
8000 –15000 USDWorldwideSeniorRemotehuggingfacetransformersdatasetspefttrlnlprlllm+1
High Sky is a fast-moving AI startup building production-grade AI solutions. The role involves developing agents to solve software engineering tasks using large language models, training and fine-tuning, model selection and evaluation pipelines, fully remote.
About the company
- High Sky — a fast-moving AI startup building competitive, production-grade solutions in text, audio, video generation, data enrichment, and predictive analytics.
- The team runs the full cycle: from problem analysis to deploying real-world AI systems.
Responsibilities
- Develop an agent for solving SWE tasks.
- Train and fine-tune LLMs (pre-training/fine-tuning).
- Implement agent logic running inside a sandbox.
- Build validation and evaluation pipelines for models and agents.
- Collect and clean datasets for training.
- Select architectures and pre-trained models.
- Combine models/adapters to improve performance.
Requirements
- 2+ years of hands-on experience training LLMs (fine-tuning / pre-training).
- Experience with multiple LLM training methods and pre-trained models.
- Strong hands-on background with Hugging Face ecosystem (Transformers, Datasets, PEFT, TRL).
- Deep understanding of NLP, transformers, LLM training cycles, RL, and classical ML.
- 6+ years of commercial development experience.
- Experience building products from scratch.
- Degree in Computer Science, Applied Math, or related fields.
Nice to have
- Experience with SWE-bench tasks.
- Research work in Computer Science.
- Awards in Kaggle/Boosters competitions, hackathon participation.
Conditions
- Location: Remote (no country restrictions)
How to apply
- Please forward the job posting when applying.
Found in@holder_job_devs