About the role

What will you do at Nexusflow.ai Inc.?

About Nexusflow.ai

Modern enterprise copilots & agents call for last-mile quality, enterprise-grade robustness and scalable operation costs, beyond simplified programming interfaces for generative AI. Nexusflow tackles this challenge, enabling enterprises to own their workflow copilots & agents stacked on top of powerful yet cost-effective, compact LLMs. We train large language models and build last-mile quality dev tooling for copilots & agents on your enterprise workflows.

Our team has built the open-source LLM, NexusRaven-V2 [https://huggingface.co/Nexusflow/NexusRaven-V2-13B], rivaling GPT-4 in function calling with a 100X smaller model size. Our team members are also behind the scenes of Starling [https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha], the #1 ranked compact 7B chat model based on human evaluation in Chatbot Arena [https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard].

Position: Backend Engineer

Nexusflow is currently adding Backend Engineers to our team. Our Backend Engineers package up our technology in models and last-mile quality tooling. Our Backend Engineers will be the driving force to build our products and solutions, in extensive collaboration with our ML Engineers and Front-end Engineers.

RESPONSIBILITIES

* API system development for copilot & agent quality tooling

* API system development for copilot serving and integration with a focus on enterprise-grade requirements in the following areas

* Integration with on-prem & cloud compute vendors

* Integration with software tools required in customer oriented solutions

* Distributed system and optionally GPU performance optimization

* Wear many hats and collaborate with the whole team for product development, deployment and customer success

QUALIFICATION

REQUIRED

* Experience in ML model or ML data pipeline deployment (on-prem or on cloud)

* Experience in building backend for application or platform API systems

PREFERRED

* WORKING EXPERIENCE IN FAST-PACE TEAM ENVIRONMENT

* Experience in using or contributing to modern compute frameworks for LLMs (e.g. Deepspeed, Huggingface TGI, FSDP)

* Experience in projects involving LLMs

Which skills does this role require?

API developmentDistributed systemsMachine learning deploymentData pipelinesGPU optimizationLLMCloud computeOn-premise infrastructureBackend engineeringBackend EngineerAPIGenerative AINexusRaven-V2StarlingCopilotAgentsDistributed SystemsGPU OptimizationCloud ComputeOn-premiseMachine LearningData PipelineEnterprise-gradeSoftware ToolsProduct Development

Make your next move

Build a shortlist and prepare

Identify the requirements you can demonstrate, then choose examples from your work to discuss with the hiring team.

Build a focused shortlist before you applyCompare role requirements with your experience and give each application a clear reason.
Backend engineering jobsCompare current openings and review what to look for in this role.
Practice explaining your experience in an interviewRehearse your answers before meeting the hiring team.

Review the responsibilities and requirements before adding an opening to your shortlist.