AI/ML Engineer — Full-Time (Remote US / New York,NY)

AI/ML Engineer - Full-Time (Remote US / New York, NY)

LockedIn AI is hiring a production-minded AI/ML Engineer to design, build, and scale the intelligence systems powering our real-time AI copilot used by over 1M+ users worldwide.

We are building the most advanced AI interview and meeting assistance platform, and this role sits at the core of our machine learning infrastructure. You will work across the full ML lifecycle-from data and model training to deployment, monitoring, and optimization in production environments.

Role Overview

As an AI/ML Engineer, you will own the end-to-end development of ML systems powering LockedIn AI’s real-time assistant. This includes:

Building and fine-tuning LLMs, NLP models, and speech systems

Designing low-latency inference pipelines for real-time AI responses

Developing RAG (Retrieval-Augmented Generation) systems

Creating evaluation frameworks for continuous model quality improvement

Deploying scalable ML services in production environments

This is a full-stack ML role where research meets real-world product engineering.

Key Responsibilities

1. Model Development & Training

Design and train ML models including LLMs, NLP systems, and speech-to-text models

Apply fine-tuning techniques such as LoRA, QLoRA, RLHF, and DPO

Build data pipelines for cleaning, labeling, and augmenting datasets

Run experiments, ablation studies, and performance benchmarking

2. Production & Real-Time Deployment

Build low-latency inference pipelines for streaming AI responses

Deploy models using Docker, Kubernetes, and CI/CD pipelines

Manage multi-model routing across OpenAI, Anthropic, and open-source LLMs

Implement fallback systems and graceful degradation strategies

3. RAG & Intelligent Systems

Develop retrieval-augmented generation systems with vector databases

Build embeddings pipelines and semantic search systems

Design prompt engineering frameworks and multi-turn AI workflows

Create agentic systems using tool calling and function execution

4. Evaluation & Monitoring

Build automated evaluation frameworks (LLM-as-judge, benchmarks, human eval)

Monitor latency, hallucination rates, accuracy, and user feedback signals

Detect model drift and performance degradation in production

Optimize inference cost and token usage across providers

5. Data Engineering & Infrastructure

Develop scalable data pipelines for training and inference

Implement feature extraction from user interactions and logs

Maintain dataset versioning and experiment tracking systems

Collaborate with engineering teams on ML infrastructure scaling

6. Responsible AI & Safety

Build safeguards against bias, harmful outputs, and prompt injection

Ensure privacy-first AI design and secure data handling

Continuously evaluate fairness, robustness, and model safety

Required Qualifications

Experience

3+ years in ML engineering or AI systems development

Proven track record of deploying production ML systems

Experience working in fast-paced startup environments

Technical Skills

Strong Python + ML frameworks (PyTorch / TensorFlow / JAX)

Deep understanding of transformers and deep learning

Experience with LLM APIs (OpenAI, Anthropic, etc.)

Familiarity with RAG systems and vector databases

Docker, Kubernetes, FastAPI, and CI/CD pipelines

Cloud platforms (AWS / GCP / Azure)

Mindset

Full-stack ML ownership from idea → production

Strong product thinking and user impact focus

Excellent communication and collaboration skills

High ownership and execution speed

Preferred Qualifications

Experience with real-time AI or low-latency systems

Knowledge of model compression, quantization, or distillation

Experience with agentic AI systems and tool-use architectures

Background in AI safety, adversarial robustness, or security

Experience in consumer-scale AI or SaaS products (100K+ users)

Compensation & Benefits

💰 $150,000 - $220,000 USD / year

📈 Meaningful early-stage equity

🌍 Remote-first (US-based) with optional NYC hybrid

🚀 High-impact role in a 1M+ user AI platform

⚡ Fast-paced, AI-native engineering culture

🧠 Ownership across the full ML stack

Why Join LockedIn AI?

LockedIn AI is building a category-defining AI copilot that helps users perform better in live interviews, coding assessments, and professional communication scenarios.

You will:

Own the ML systems end-to-end

Work with cutting-edge LLM and AI infrastructure

Ship real production models that impact millions of users

Operate in a fast-moving, AI-first product environment

How to Apply

Please submit:

Resume / CV

Short note explaining why you want to join LockedIn AI

Optional: GitHub, portfolio, or technical writing samples

(Bonus) Feedback on the product if you’ve used it

Equal Opportunity

We are committed to building an inclusive and diverse team. Hiring decisions are based on merit, skills, and business needs.

• Experience

  3 - 6 Years

• No. of Openings

  2

• Education

  Graduate (B.Tech/B.E)

• Role

  ML Engineer

• Industry Type

  IT Services & Consulting

• Gender

  Male

• Job Country

  United States

• Type of Job

  Full Time

• Work Location Type

  Work from Office