About the Role
The Data Extraction Team at Forbes Advisor, a client of Uplers, is a new team focused on designing, implementing, and overseeing advanced web scraping frameworks. This team creates and refines tools and methodologies to efficiently gather precise and meaningful data from diverse digital platforms. Additionally, they are tasked with constructing robust data pipelines and implementing Extract, Transform, Load (ETL) processes to seamlessly transfer harvested data into storage systems for analysis.
As a Data Research Engineer, you will be instrumental in harnessing the power of AI/LLM to simplify operations and streamline data gathering/retrieval for the research team. This role requires a visionary leader who will set the direction for AI/LLM usage within the team and company, think outside the box, and proactively engage with new technologies.
Responsibilities
- Develop methods to leverage the potential of LLM and AI within the team.
- Proactively find new solutions to engage the team with AI/LLM and streamline processes.
- Be a visionary with AI/LLM tools, anticipating future technologies to keep the team ahead.
- Assist in acquiring and integrating data from various sources, including web crawling and API integration.
- Stay updated with emerging technologies and industry trends.
- Explore third-party technologies as alternatives to legacy approaches for efficient data pipelines.
- Contribute to cross-functional teams in understanding data requirements.
- Assume accountability for achieving development milestones.
- Prioritize tasks to ensure timely delivery in a fast-paced environment with rapidly changing priorities.
- Collaborate with and assist fellow members of the Data Research Engineering Team as required.
- Leverage online resources effectively like StackOverflow, ChatGPT, Bard, etc., while considering their capabilities and limitations.
Required Skills and Experience
- Bachelor's degree in Computer Science, Data Science, or a related field. Higher qualifications are a plus.
- Think proactively and creatively regarding the next AI/LLM technologies and how to use them to the team’s and company’s benefits.
- “Think outside the box” mentality.
- Experience prompting LLMs in a streamlined way, accounting for potential “hallucination.”
- Experience building agentic AI platforms with modular capabilities and autonomous task execution (e.g., crewai, LangChain).
- Proficient in implementing Retrieval-Augmented Generation (RAG) pipelines for dynamic knowledge integration (e.g., chromadb, pinecone).
- Experience managing a team of AI/LLM experts is a plus, including setting goals and fine-tuning complex models.
- Strong proficiency in Python programming.
- Proficiency in SQL and data querying is a plus.
- Familiarity with web crawling techniques and API integration is a plus but not a must.
- Experience in AI/ML engineering and data extraction.
- Experience with LLMs, NLP frameworks (e.g., spaCy, NLTK, Hugging Face).
- Strong understanding of machine learning frameworks (TensorFlow, PyTorch).
- Design and build AI models using LLMs.
- Integrate LLM solutions with existing systems via APIs.
- Collaborate with the team to implement and optimize AI solutions.
- Monitor and improve model performance and accuracy.
- Familiarity with Agile development methodologies is a plus.
- Strong problem-solving and analytical skills with attention to detail.
- Creative and critical thinking.
- Ability to work collaboratively in a team environment.
- Good and effective communication skills.
- Experience with version control systems, such as Git, for collaborative development.
- Ability to thrive in a fast-paced environment with rapidly changing priorities.
- Comfortable with autonomy and ability to work independently.
Perks
- Day off on the 3rd Friday of every month.
- Monthly Wellness Reimbursement Program.
- Monthly Office Commutation Reimbursement Program.
- Paid paternity and maternity leaves.