Join to apply for the Senior Data Engineer role at Bilby 3 days ago Be among the first 25 applicants
Join to apply for the Senior Data Engineer role at Bilby Location: Hong Kong or adjacent timezone (+/- 2 hours)
We are looking for a Senior Data Engineer to join Bilby, a company that applies machine learning and AI techniques to scrape, parse, and analyse official government documents to extract features for financial market analysis.
You will play a central role in designing, building, and maintaining data pipelines and downstream applications, including an API for data delivery.
Key Responsibilities Downstream application pipelines: Build and manage pipelines for efficient data delivery and integration with end-user systems.
ML model deployment: Deploy machine learning models and construct ML pipelines to extract relevant features from texts supporting market analysis.
Architecture and technology selection: Choose appropriate technologies and architectures, balancing innovation with pragmatism.
Team collaboration: Work with and mentor junior team members.
Required Attributes The successful candidate will possess:
Experience: Proven track record as a Senior Data Engineer or similar, with experience in architecting, developing, and maintaining data pipelines and backend systems.
Must be a fully-fledged engineer with attention to system scalability, maintainability, and deployment.
Technical Skills: Strong communication skills, with clear documentation.
Proficiency in data workflow platforms like AirFlow.
Familiarity with data warehouses such as Google BigQuery.
Expertise in cloud platforms, especially GCP.
Experience deploying models and building ML pipelines using frameworks like TensorFlow or PyTorch.
Solid backend skills, including API design and implementation, proficiency in Python, with knowledge of Javascript and Go being a plus.
Knowledge of CI/CD practices and testing for reliable software deployment.
Design Taste: Ability to make pragmatic technology and architecture decisions.
Industry Awareness: Openness to new technologies and awareness of current trends in data engineering and AI/ML.
Preferred Attributes Additional qualities include:
Experience developing end-user APIs and SDKs.
Financial markets data operations experience is a plus.
Leadership skills: mentoring mid-level developers and project management experience.
What's Next To apply, please complete the application form here in Dover.
#J-18808-Ljbffr