Join to apply for the Senior Data Engineer role at Bilby
3 days ago Be among the first 25 applicants
Join to apply for the Senior Data Engineer role at Bilby
Location: Hong Kong or adjacent timezone (+/- 2 hours)
We are looking for a Senior Data Engineer to join Bilby, a company that applies machine learning and AI techniques to scrape, parse, and analyse official government documents to extract features for financial market analysis. You will play a central role in designing, building, and maintaining data pipelines and downstream applications, including an API for data delivery.
Key Responsibilities
* Downstream application pipelines: Build and manage pipelines for efficient data delivery and integration with end-user systems.
* ML model deployment: Deploy machine learning models and construct ML pipelines to extract relevant features from texts supporting market analysis.
* Architecture and technology selection: Choose appropriate technologies and architectures, balancing innovation with pragmatism.
* Team collaboration: Work with and mentor junior team members.
Required Attributes
The successful candidate will possess:
* Experience: Proven track record as a Senior Data Engineer or similar, with experience in architecting, developing, and maintaining data pipelines and backend systems. Must be a fully-fledged engineer with attention to system scalability, maintainability, and deployment.
* Technical Skills:
o Strong communication skills, with clear documentation.
o Proficiency in data workflow platforms like AirFlow.
o Familiarity with data warehouses such as Google BigQuery.
o Expertise in cloud platforms, especially GCP.
o Experience deploying models and building ML pipelines using frameworks like TensorFlow or PyTorch.
o Solid backend skills, including API design and implementation, proficiency in Python, with knowledge of Javascript and Go being a plus.
o Knowledge of CI/CD practices and testing for reliable software deployment.
* Design Taste: Ability to make pragmatic technology and architecture decisions.
* Industry Awareness: Openness to new technologies and awareness of current trends in data engineering and AI/ML.
Preferred Attributes
Additional qualities include:
* Experience developing end-user APIs and SDKs.
* Financial markets data operations experience is a plus.
* Leadership skills: mentoring mid-level developers and project management experience.
What's Next
To apply, please complete the application form here in Dover.
#J-18808-Ljbffr