Job Summary
Prompt Engineering
Crafting effective prompts for models like GPT DALLE and Codex.
Understanding prompt tuning chaining and context management.
2. API Integration
Using APIs from OpenAI Hugging Face Cohere etc.
Handling authentication rate limits and response parsing.
3. Model Fine-Tuning & Customization
Fine-tuning open-source models (e.g. LLaMA Mistral Falcon).
Using tools like LoRA PEFT and Hugging Face Transformers.
Responsibilities
1. Prompt Engineering
Crafting effective prompts for models like GPT DALLE and Codex.
Understanding prompt tuning chaining and context management.
2. API Integration
Using APIs from OpenAI Hugging Face Cohere etc.
Handling authentication rate limits and response parsing.
3. Model Fine-Tuning & Customization
Fine-tuning open-source models (e.g. LLaMA Mistral Falcon).
Using tools like LoRA PEFT and Hugging Face Transformers.
4. Data Engineering for AI
Collecting cleaning and preparing datasets for training or inference.
Understanding tokenization and embeddings.
5. LangChain / LlamaIndex
Building AI-powered apps with memory tools and retrieval-augmented generation (RAG).
Connecting LLMs to external data sources like PDFs databases or APIs.
6. Vector Databases
Using Pinecone Weaviate FAISS or Chroma for semantic search and RAG.
Understanding embeddings and similarity search.
7. Frontend + GenAI Integration
Building GenAI-powered UIs with React Next.js or Flutter.
Integrating chatbots image generators or code assistants