About the role
Talent is everywhere, opportunity is not. Sora Union changes that.
Sora Union is a globally distributed professional services company that specializes in Design, Software Engineering, QA. Our experienced talent comes from communities where there is displacement or risk of displacement due to conflict or climate change. We provide services to global companies and start-ups across various industries, including healthcare, financial services, technology, and education.
We are seeking a Forward Deployed Engineer to join our growing team, where you will act as an internal entrepreneur, driving AI initiatives from ideation to production both internally and for our customers.
As a FDE, you will work closely with the Engineering , Product/Brand Design, and QA teams.
You'll be responsible for
- Customer-Facing AI Solutions: Act as the primary technical partner for customers, translating operational needs into production-grade AI experiences.
- End-to-End Implementation: Own projects entirely, from data cleaning and prototyping to full deployment, monitoring, and debugging in customer environments.
- Performance Optimization: Implement model compression, quantization, and efficient serving techniques to meet strict latency and throughput requirements for customer-facing applications.
- Advanced Prompt Engineering & LLM Customization: Develop sophisticated prompt chaining, self-correction mechanisms, and context management strategies (e.g., using RAG architectures) to enhance LLM application performance and accuracy.
Ideally, you'll have
- AI/ FDE Development Experience: 3+ years of experience building and deploying production-level AI/ML models.
- MLOps Tooling: Hands-on experience with MLOps platforms and tools such as MLflow, Kubeflow, or Weights & Biases for experiment tracking and model registry.
- Technical Proficiency: Strong expertise in Python and deep learning frameworks (TensorFlow, PyTorch), along with experience in LLM orchestration frameworks (e.g., LangChain, LlamaIndex).
- Data Engineering/API Skills: Proven ability to build and maintain high-performance, low-latency RESTful APIs (e.g., using FastAPI or Flask) for serving models, and strong proficiency in SQL/NoSQL databases for data integration.
- Customer-Facing Experience: Proven ability to work directly with stakeholders to define requirements and deliver value, ideally in a consulting or specialized engineering role.
- Deployment Expertise: Experience containerizing models (Docker) and deploying to cloud environments (AWS, GCP, or Azure).
- Entrepreneurial Mindset: Ability to thrive in a fast-paced environment, taking initiative to solve ambiguous problems
Sora Union is committed to creating and fostering a diverse team. We encourage people from underrepresented backgrounds and all walks of life to apply. We are committed to providing reasonable accommodations to all applicants throughout the application process.