Senior Software Engineer, ML Focus
North
About North.Cloud
The public cloud is home to $200B+ in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth toward $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments.
At North, we’re building the next-generation cloud spend management platform—giving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era.
Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, we’re assembling a world-class team to redefine how businesses manage cloud spend. If you’re looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be.
About the Role
We’re looking for a Senior Software Engineer with strong ML experience to join our core team. This is a high-impact, hands-on role where you'll build both traditional software systems and ML-powered features that drive real customer value. You’ll work directly with our CTO to shape product architecture, deploy intelligent automation across the stack, and bring features like Agent North, our customer-facing AI assistant, to life.
This role is perfect for engineers who’ve shipped production systems (ML and non-ML), enjoy operating across the stack, and thrive in the fast, scrappy pace of an early-stage startup. You’ll touch everything from infrastructure and APIs to model tuning and deployment.
What You’ll Do
- Design, build, and deploy systems—some ML-powered, some not—that help customers automate and optimize cloud usage
- Integrate and fine-tune large language models (LLMs) for use in product features like AI assistants, forecasting, and anomaly detection
- Own projects end-to-end: architecture decisions, implementation, deployment, and monitoring
- Contribute across the stack, from backend services to data pipelines and ML infrastructure
- Collaborate with product, design, and engineering to build features that customers love and actually use
- Help build and maintain secure, reliable infrastructure across GCP, AWS, and Azure
- Experiment with cutting-edge techniques in ML deployment, prompt engineering, and model monitoring
- Influence the direction of our engineering culture, tools, and team practices
What We’re Looking For
- 5+ years of hands-on software engineering experience, ideally spanning application logic, infrastructure, and data/ML systems
- Solid experience deploying production ML systems (bonus if you’ve worked with LLMs, PyTorch, Hugging Face, or LangChain)
- Strong Python skills; bonus points for familiarity with Go and SQL
- Experience deploying and scaling software on cloud platforms (AWS, GCP, Azure)
- Comfort working in Terraform and Git for infrastructure and version control
- A “build-first” mindset—you enjoy solving problems through code and aren’t afraid to learn new tools
- Clear communicator who can explain technical ideas to peers, leadership, and sometimes customers
- Proactive, thoughtful, and excited to wear multiple hats in a startup environment
Nice to Have
- Experience in a startup or fast-paced environment
- Prior experience working with cloud cost data, FinOps, or infra tooling
- Familiarity with Amazon Bedrock, Llama, or vertex databases
- Background in AI security, prompt engineering, or fine-tuning
- AWS or cloud certification
- You’ve built AI or automation tools that solved real user pain points
Work Setup
This is a hybrid role based in New York City. Our office is in the West Village, and we typically spend part of the week in-office and part remote.
Benefits
- Unlimited PTO
- Office access in West Village
- 16-week fully paid parental leave (mothers can extend to 20 weeks at 50% pay)
- Company-wide breaks: Last week of August and Dec 23–Jan 3
- Healthcare: Anthem BlueCross Gold PPO, 75% employer-covered
- 30-day sabbatical every 4 years
- Ramp card for approved expenses
Compensation
Base salary range: $200-$250k per year, depending on experience and location.
Join Us
If you’re a senior engineer who loves building intelligent systems, thrives on ownership, and wants to help shape the future of cloud finance—we’d love to meet you.