AI/ML Engineer - Full-Time (Remote US / New York, NY)LockedIn AI is hiring a production-minded AI/ML Engineer to design, build, and scale the intelligence systems powering our real-time AI copilot used by over 1M+ users worldwide.We are building the most advanced AI interview and meeting assistance platform, and this role sits at the core of our machine learning infrastructure. You will work across the full ML lifecycle-from data and model training to deployment, monitoring, and optimization in production environments.Role OverviewAs an AI/ML Engineer, you will own the end-to-end development of ML systems powering LockedIn AIs real-time assistant. This includes:Building and fine-tuning LLMs, NLP models, and speech systemsDesigning low-latency inference pipelines for real-time AI responsesDeveloping RAG (Retrieval-Augmented Generation) systemsCreating evaluation frameworks for continuous model quality improvementDeploying scalable ML services in production environmentsThis is a full-stack ML role where research meets real-world product engineering.Key Responsibilities1. Model Development & TrainingDesign and train ML models including LLMs, NLP systems, and speech-to-text modelsApply fine-tuning techniques such as LoRA, QLoRA, RLHF, and DPOBuild data pipelines for cleaning, labeling, and augmenting datasetsRun experiments, ablation studies, and performance benchmarking2. Production & Real-Time DeploymentBuild low-latency inference pipelines for streaming AI responsesDeploy models using Docker, Kubernetes, and CI/CD pipelinesManage multi-model routing across OpenAI, Anthropic, and open-source LLMsImplement fallback systems and graceful degradation strategies3. RAG & Intelligent SystemsDevelop retrieval-augmented generation systems with vector databasesBuild embeddings pipelines and semantic search systemsDesign prompt engineering frameworks and multi-turn AI workflowsCreate agentic systems using tool calling and function execution4. Evaluation & MonitoringBuild automated evaluation frameworks (LLM-as-judge, benchmarks, human eval)Monitor latency, hallucination rates, accuracy, and user feedback signalsDetect model drift and performance degradation in productionOptimize inference cost and token usage across providers5. Data Engineering & InfrastructureDevelop scalable data pipelines for training and inferenceImplement feature extraction from user interactions and logsMaintain dataset versioning and experiment tracking systemsCollaborate with engineering teams on ML infrastructure scaling6. Responsible AI & SafetyBuild safeguards against bias, harmful outputs, and prompt injectionEnsure privacy-first AI design and secure data handlingContinuously evaluate fairness, robustness, and model safetyRequired QualificationsExperience3+ years in ML engineering or AI systems developmentProven track record of deploying production ML systemsExperience working in fast-paced startup environmentsTechnical SkillsStrong Python + ML frameworks (PyTorch / TensorFlow / JAX)Deep understanding of transformers and deep learningExperience with LLM APIs (OpenAI, Anthropic, etc.)Familiarity with RAG systems and vector databasesDocker, Kubernetes, FastAPI, and CI/CD pipelinesCloud platforms (AWS / GCP / Azure)MindsetFull-stack ML ownership from idea productionStrong product thinking and user impact focusExcellent communication and collaboration skillsHigh ownership and execution speedPreferred QualificationsExperience with real-time AI or low-latency systemsKnowledge of model compression, quantization, or distillationExperience with agentic AI systems and tool-use architecturesBackground in AI safety, adversarial robustness, or securityExperience in consumer-scale AI or SaaS products (100K+ users)Compensation & Benefits $150,000 - $220,000 USD / year Meaningful early-stage equity Remote-first (US-based) with optional NYC hybrid High-impact role in a 1M+ user AI platform Fast-paced, AI-native engineering culture Ownership across the full ML stackWhy Join LockedIn AI?LockedIn AI is building a category-defining AI copilot that helps users perform better in live interviews, coding assessments, and professional communication scenarios.You will:Own the ML systems end-to-endWork with cutting-edge LLM and AI infrastructureShip real production models that impact millions of usersOperate in a fast-moving, AI-first product environmentHow to ApplyPlease submit:Resume / CVShort note explaining why you want to join LockedIn AIOptional: GitHub, portfolio, or technical writing samples(Bonus) Feedback on the product if youve used itEqual OpportunityWe are committed to building an inclusive and diverse team. Hiring decisions are based on merit, skills, and business needs.
3 - 6 yrs
2.8 Lac/Yr
LLM Engineer 
Loading...
